Ecological Momentary Assessment and Intervention in the Treatment of Psychotic Disorders: A Systematic Review
Abstract
Objective:
Ecological momentary assessment (EMA) and ecological momentary intervention (EMI) are technologies used to track fluctuations in experiences and prompt behavioral responses within the context of a person’s daily life. Most commonly delivered via smartphone, EMA and EMI have potential to provide simple, cost-effective, and user-led treatment for psychotic disorders. This systematic review aimed to synthesize current research exploring the feasibility, acceptability, and clinical outcomes of EMA and EMI in the treatment of psychotic disorders.
Methods:
A systematic search was conducted identifying studies published between 1980 and July 7, 2016, by searching PubMed, PsycINFO, PsycARTICLES, and the Cochrane Central Register of Controlled Trials with combinations of search terms related to mobile devices, EMA and EMI, and psychotic disorders.
Results:
Of 1,623 studies identified, nine met inclusion criteria for the review. These studies found satisfactory feasibility and acceptability and preliminary evidence of improved clinical outcomes. The interventions, which had a broad array of features, targeted remote monitoring of illness and symptoms, and they also targeted illness self-management by using momentary reminders or instructions for behaviors, including medication adherence, management of symptoms and psychosocial impairments, daily living skills, and goal achievement.
Conclusions:
The findings of this review provide preliminary support for the clinical utility of EMA and EMI in the treatment of psychotic disorders. Future research should explore further applications of these technologies with larger sample sizes and controlled designs.
Developments in the use of digital technologies in treating mental disorders have been flagged as key elements in the future of mental health care (1–5). Online and smartphone-based modalities of delivery offer opportunities for simple, accessible interventions, facilitating dissemination; they also offer a way to empower service users to take an active role in mental health management as a key element of their recovery (6). There has been dramatic growth in mobile phone ownership in both clinical and nonclinical populations (1,7,8), and smartphones are an especially common means of Internet access among people with severe mental illness (9). Preliminary findings of studies investigating the use of digital interventions in psychotic disorders have been promising. For example, Alvarez-Jimenez and colleagues (10) identified 12 trials of online, social media, and mobile interventions for psychosis and noted that usability and satisfactions ratings among users were highly positive, suggesting that patients are willing and motivated to engage with these types of interventions. Such findings highlight the importance of examining new therapeutic approaches that make best use of digital platforms, particularly smartphones (3).
A key clinically relevant methodology that can utilize mobile technology is ecological momentary assessment (EMA) and ecological momentary intervention (EMI) (11,12). Also known as experience sampling methodology, EMA methods involve collecting data on repeated occasions, in real time and in the context of daily life (11). When phenomena are measured as they arise and evolve over time, they can be measured more accurately, and a depiction of the dynamic relationship between state variables can be derived. EMA can capitalize on several digital technologies that offer the unique capability of automated delivery and recording of data. These include use of smartphones for prompting and recording, as well as passive capture of, ambulatory physiological data (for example, actigraphy, heart rate, and skin conductance) and context-sensitive data (13,14).
Among persons with psychotic disorders, EMA has most commonly been used as a research tool to examine mechanisms underlying symptoms (15). The reliability and validity of this method have been established in this population (16–18), and there is growing interest in using EMA methods for clinical purposes. These include assessing symptoms more accurately, identifying and monitoring signs of relapse, and monitoring treatment effects (19).
EMI is a derivative of EMA that extends the methodology of repeated within-environment prompting into the domain of clinical intervention. EMIs were first defined by Heron and Smyth (12) as interventions that provide treatment to people during their everyday lives—in real time and in natural settings. EMIs use technology similar to that of EMA, including smartphone apps and SMS text messages that can deliver statements or instructions to promote positive behaviors and coping when needed in daily life. Heron and Smyth conducted a systematic review that identified 27 EMI studies, using palmtop computers or mobile phones to deliver regular, momentary intervention for health targets, such as smoking cessation, weight loss, anxiety, and eating disorders. The identified EMIs had a variety of characteristics, highlighting broad potential for these interventions, with evidence supporting their acceptability, feasibility, and efficacy in improving illness-related outcomes.
EMA and EMI have potential applications to psychosis management, capitalizing on a number of key capabilities of mobile technologies to provide a means of accurate assessment; they can also be used to remind people of intervention strategies in the moment they are needed (5,20,21). Such assessments and reminders may be especially beneficial in psychotic disorders, because difficulties with memory and executive functioning can limit accurate recall of past events and motivational difficulties can impede generalization of intervention strategies outside the consulting room (22–25). There is also evidence that psychotic symptoms improve through regular self-monitoring (26), a potential use of EMA shown to be effective in other disorders (27,28). Remote monitoring of information may also help to identify signs of relapse that indicate the need for escalated intervention (29,30). EMI has shown promise in promoting uptake of intervention strategies in daily life, with improved outcomes in anxiety and mood disorders (31–34). In psychotic disorders, prompts could be used to promote coping with persisting positive symptoms, to compensate for negative symptoms in managing daily functioning, or to facilitate learning skills. Overall, these applications seem potentially valuable in empowering people in more effective self-management.
Reviews of the use of EMI in psychiatry (35) and of the use of mobile devices in severe mental illness (21,36–38) have highlighted the growing potential of this technology for treating psychosis. However, to our knowledge, the therapeutic application of EMA and EMI methods to psychosis has yet to be synthesized in a systematic review. Therefore, a systematic review was conducted of research investigating the feasibility, acceptability, and clinical outcomes of EMA and EMI for the support or delivery of treatment for psychotic disorders.
Methods
We followed the PRISMA protocol for conducting systematic reviews (39). The search was conducted on July 7, 2016.
Search Protocol
Relevant studies were retrieved by searching PubMed, PsycINFO, PsycARTICLES, and the Cochrane Central Register of Controlled Trials with combinations of the following search terms within keywords, title, or abstract: mobile phone; text messaging; SMS; cell phone; ecological momentary assessment; ecological momentary intervention; momentary assessment; real time; daily life; sampling method* or experience sampling; and schizo*, psychosis, or psychotic. Relevant MeSH terms (for example, mobile device and mobile application) were used for PubMed and Cochrane databases, and index terms were used for PsycINFO and PsycARTICLES. [Further details about the database search syntax are available in online supplement 1 to this article.] Identified studies were imported into the referencing database, and duplicates were systematically removed. The abstract of each study was screened by the first author for basic criteria, and full texts were then independently evaluated by two authors (IHB and MHL) against the inclusion and exclusion criteria. Reference lists of studies meeting inclusion criteria and of prior relevant reviews were manually searched for additional articles. Authors of included studies were contacted for unpublished work to reduce risk of bias.
Study Selection
Inclusion criteria were as follows: the study was published in peer-reviewed journal between 1980 and July 7, 2016; participants were diagnosed as having a psychotic disorder; and the study involved the examination of an EMI, which we defined as any technology-based device or application that can enhance care of patients with a psychotic disorder through the delivery of regular, momentary intervention in the context of daily life outside face-to-face therapy. We also included studies that utilized EMA methods (that is, the regular and momentary assessment of clinically significant processes in daily life) to assist in clinical management or assessment of patients with a psychotic disorder. Only studies that assessed the outcomes of feasibility, acceptability, and clinical measures according to the aims of the intervention were included. We included studies without control groups because of the early stage of this literature. Exclusion criteria were as follows: the sole focus of the EMI was for medication reminders, because these have been reviewed elsewhere (40,41); the study was a neuroimaging or biomedical investigation; and the study was a case study, review, thesis, or book chapter.
Data Extraction
Two authors (IHB and MHL) agreed on the data extraction protocol, including efforts to extract both significant and nonsignificant findings to reduce risk of bias. One author (IHB) then conducted the extraction. Extracted data included the following: basic study information (for example, author, year, and location), intervention aim, sample characteristics (for example, number of participants, primary diagnosis, age, and gender), study design, characteristics of the intervention (features, design, and platform), feasibility (dropout and engagement with and adherence to intervention), acceptability (feedback from participants), and clinical outcomes depending on the target of the intervention (for example, symptoms, relapse rates, and quality of life). A narrative synthesis of the findings was used in this study because of the broad nature of the studies identified, which precluded quantitative comparisons.
Study Quality Assessment
Study quality was evaluated using the Downs and Black checklist (42), a measure suitable for both controlled and uncontrolled trials.
Results
Of 1,623 studies identified, 78 underwent detailed evaluation and nine met inclusion criteria for the review. [A PRISMA flow diagram is included in the online supplement 2 .] Three of the nine articles were sourced through manual searching of reference lists (43–45). No unpublished work was declared by any of the authors.
The characteristics and findings of the nine included studies are shown in Table 1. Of these nine studies, five met the definition of EMI (44,46–49), using prompts to promote self-management and psychosocial functioning. The remaining four studies investigated one intervention that met the broad definition of EMA (43,45,50,51), targeting illness and symptom monitoring. Six studies had controlled designs (43,45,47,49–51).
| Study and origin | Participants | Design | Intervention | EMA or EMI type | Findings | ||
|---|---|---|---|---|---|---|---|
| Feasibility | Acceptability | Outcomes | |||||
| Ben-Zeev et al., 2014 (46); USA | 33 outpatients with schizophrenia or schizoaffective disorder | Single-arm, pre-post trial | FOCUS: 4-week intervention. Users prompted 3 times daily to complete assessments with response-driven feedback to promote medication adherence, mood regulation, sleep, social functioning, and coping with persistent auditory hallucinations. Also contained on-demand resources | Native smartphone application | Dropout (N=1); average interaction with app on 86% of total days; average of 5.19 times per day; 62% participant initiated and 38% prompted | Over 90% of participants were comfortable, confident, and satisfied with app; 87% would recommend to a friend; and 12.5% were neutral; 12%–18% requested more training or support or felt the intervention was complicated. | Reductions in PANSS total score (d=.60) and PANSS positive symptoms (d=.70) and general (d=.73) subscale scores; reduction in BDI-II score (d=.51). No significant reductions for PANSS negative symptoms score, BMQ, or ISI. |
| Depp et al., 2010 (47); USA | 9 male participants with schizophrenia | Single-arm, pre-post pilot trial | Project 3: STEP; 24-week intervention, with 12 fortnightly face-to-face living skills training sessions supported by weekly 20-minute phone calls to reinforce uptake of skills | Telephone based | No dropout; 1 participant did not respond to calls but did attend sessions; some reported ethical concerns related to confidentiality and phone safety. | 57% reported enjoying the intervention very much; 14% reported that the intervention helped them very much, and 57% reported that it helped them moderately. | Improved UPSA scores compared with matched sample from a previous trial without an EMI component (24 weeks of in-person sessions only); 86% reported some or a lot of skill utilization (no statistical analysis) |
| Granholm et al., 2012 (48); USA | 55 outpatients with schizophrenia or schizoaffective disorder | Single-arm, pre-post trial | MATS: 12-week intervention. Users prompted 12 times daily to complete assessment items with response-driven, empirically derived feedback designed to promote medication adherence, socialization, or coping with auditory hallucinations | SMS based | 13 noncompleters; response rates between 78% and 86% across various items; 86% of phones returned intact | Average reported helpfulness was between moderate to very helpful; reports of helpfulness increased over the course of the intervention; some reported technical issues related to usability. | Increased adherence to and positive beliefs about medication over time; increased amount and positive perception of socialization over time; decreased reports of severity and of level of perceived uncontrollability of hallucinations over time. No significant pre-post changes in PANSS, BDI-II, or ILSS |
| Komatsu et al., 2013 (43); Japan | 55 outpatients with schizophrenia; 22 in treatment group (ITAREPS) and 23 in control group (ITAREPS monitoring without treatment response protocol) | RCT | 52-week RCT of ITAREPS (45,50,51), with nurses conducting assessments over the phone and visiting the homes of patients to deliver medication protocol in response to alerts. | Telephone combined with Web-based data management system | Dropout: treatment group (N=4); control group (N=11) | None reported | 2 hospitalizations in treatment group and 8 in control group; risk of hospitalization reduced in treatment group versus control group (hazard ratio [HR]=.21); fewer rehospitalization days and shorter inpatient length of stay in treatment group versus control group; ratio of relapses to hospitalizations lower in treatment group versus control group |
| Pijnenborg et al., 2010 (49); the Netherlands | 62 inpatients and outpatients with a schizophrenia spectrum disorder and impaired goal-directed behavior; 33 in treatment group and 29 in waitlist group | Waitlist-controlled trial with quasi-randomization | 7-week intervention; users prompted to complete personalized goals for daily living and record their achievement | SMS based | Dropout during treatment (N=7): 25 nonresponders and 22 responders (cutoff of 20% goals achieved during intervention) | Overall evaluation of intervention: positive, 70%; neutral, 20%; negative, 10%; evaluation of effectiveness: effective, 41%; neutral, 33%; ineffective, 26%; willingness to continue: willing, 47%; unsure, 22%; not willing, 31% | Percentage of overall goals achieved rose from 47% during baseline to 62% during the intervention and fell to 40% at follow-up; no change during waitlist phase for comparison group. Reduction in negative symptoms for “responders.” Subanalysis by goal type indicated that appointment attendance improved but not medication adherence, inhibition of undesirable behavior, or attendance of training program. |
| Sablier et al., 2012 (44); France | 14 inpatients and outpatients with schizophrenia and their caregivers | Single-arm, pre-post trial | Mobus: 6-week intervention. Patients program personalized goals and are then prompted to complete these at appropriate times. Patients’ record completed activities and symptoms, and this information is sent to caregivers. | PDA | Dropout (N=5); patients logged 43% of the activities initially listed; symptoms recorded once per week on average | Moderate self-reported appreciation of intervention | Increased scores (improvement) on the ILSS food subscale; reduction in thinking time as measured by SOC subtest score on CANTAB. No other significant findings were reported, including on the PANSS, RSES, and PAL. |
| Španiel et al., 2008 (50); Španiel et al., 2008 (51); Czech Republic | 73 outpatients with schizophrenia, schizoaffective disorder, or APPD and 56 family members | Pre-post trial with historical control | ITAREPS: 104-week intervention, with remote monitoring of signs of relapse using EWSQ completed weekly by patients and family members; alert sent to treatment team if relapse indicated, requiring medication increase and heightened monitoring | SMS combined with Web-based data management system | Dropout rate, 10%; 34% of patient and family pairs deemed cooperative (defined as responses to more than 70% of SMS contacts) | None reported | Significant reduction in number of hospitalizations (77%) and hospitalization days (58%) during intervention, compared with same period before enrollment |
| Španiel et al., 2012 (45); Czech Republic | 158 outpatients with schizophrenia or schizoaffective disorder and their family members; 79 in treatment group (ITAREPS) and 79 in control group (ITAREPS monitoring without treatment response protocol) | RCT | 52-week RCT of ITAREPS (50,51) | SMS combined with Web-based data management system | Dropout: treatment group (N=4); control group (N=8); average response rate, 80%; nonadherers, 13% in treatment group and 28% in control group (defined as less than 70% of reports returned) | 39% of alerts responded to by treatment team according to protocol; low rate primarily related to need for clinical autonomy | No difference between treatment and control groups for hospitalizations in intent-to-treat analysis (HR=1.05). Reduced hospitalization rate for participants whose treatment team followed the protocol, compared with those for whom the protocol was not followed (4% versus 31%; HR=.11); mean of 2.1 versus 19.7 inpatient days, respectively. |
a
APPD, acute polymorphic psychotic disorder; BDI-II, Beck Depression Inventory, 2nd edition; BMQ, Brief Medication Questionnaire; CANTAB, Cambridge Neuropsychological Test Automated Battery; EWSQ, Early Warning Signs Questionnaire; HR, hazard ratio; ILSS, Independent Living Skills Scale; ISI, Insomnia Severity Index; ITAREPS, Information Technology–Aided Relapse Prevention Program in Schizophrenia; MATS, Mobile Assessment and Treatment for Schizophrenia; PAL, Paired Associate Learning; PANSS, Positive and Negative Syndrome Scale; PDA, personal digital assistant; RCT, randomized controlled trial; RSES, Rosenberg Self-Esteem Scale; SMS, short message service; SOC, Stocking of Cambridge; STEP, Skills Training and Empowerment Program; UPSA, UCSD Performance-Based Skills Assessment
Across the included studies, a total of 459 participants with a psychotic disorder were included. Participants’ mean±SD age was 36.9±8.15, and ages ranged from 27.0 to 48.7. Most studies included samples of patients diagnosed as having schizophrenia or schizoaffective disorder (44–48). Two studies included additional patients with acute polymorphic psychotic disorder (15% of the sample) (50,51), and another study included patients with nonspecific psychotic spectrum disorders (8% of the sample) (49).
Illness and Symptom Monitoring
Four studies involved remote monitoring of the prodromal warning signs of relapse among patients with a diagnosis of a psychotic disorder to prevent hospitalization by using an intervention called Information Technology–Aided Relapse Prevention Program in Schizophrenia (ITAREPS) (43,45,50,51). Patients and caregivers completed the Early Warning Signs Questionnaire (52) weekly, which was uploaded to an online system, or the results were reported to managing nurses and were monitored by the treatment team. The response to patients who were assessed to be at risk of relapse was heightened monitoring and increased medication. The inclusion of this intervention required a broad definition of EMA, given that the assessments were conducted weekly and do not assess momentary phenomena. However, these studies were included in this review to demonstrate the potential application of remote monitoring of illness by using EMA for the purpose of clinical management.
Feasibility and acceptability.
Adherence to the monitoring protocol by patients and caregivers was relatively low in the two initial ITAREPS trials (50,51). In the randomized controlled trial (RCT), patient and caregiver adherence increased; however, only 39% of alerts were responded to by the treatment team in accord with the protocol (45). The low rate was mainly attributed to conflicts between protocol-indicated medication increases and psychiatrists’ clinical judgement (65% of cases). To account for this, Komatsu and colleagues (43) engaged nurses to conduct assessments by telephone and to monitor medication responses, which increased adherence to the response protocol.
Clinical outcomes.
The initial ITAREPS trials showed reductions in hospitalization events and total hospital days for the treatment group (sustained at follow-up), compared with the control groups, particularly for participants and treatment teams that adhered to the monitoring and responding protocol (50,51). Because the subsequent RCT suffered from a low rate of adoption and adherence by the treatment team, it was difficult to assess efficacy (45). Reductions in hospitalization events and total hospital days were noted for the group in which the treatment team adhered to the protocol, compared with the nonadherent group. In the later trial by Komatsu and colleagues (43), in which better clinician adherence was achieved, greater reductions in hospitalization and severity of relapse were observed; however, no follow-up data were reported. A cost-benefit analysis conducted by Španiel and colleagues (45) showed that the cost of treatment was lower in the group of patients with protocol-adhering treatment teams.
Self-Management and Psychosocial Functioning
Intervention characteristics.
Five of the nine studies targeted self-management and psychosocial and daily functioning for patients with a psychotic disorder. The app-based FOCUS (46) and SMS-delivered Mobile Assessment and Intervention for Schizophrenia (MATS) (48) involved EMIs targeting illness self-management through the delivery of repeated prompts to users throughout the day. These prompts provided medication reminders and momentary intervention items based on therapeutic models for challenging cognitions, coping, and promotion of healthy behaviors. Both FOCUS and MATS involved initial interviews with participants regarding treatment targets and subsequent personalization of intervention components. The FOCUS app also includes resources for participants to access on demand (62% of use), as well as prompts (38% of use) (46).
The remaining three studies focused on compensating for cognitive difficulties through promoting goal achievement and daily living activities, such as attending appointments, managing medications, and inhibiting undesirable behavior. The Skills Training and Empowerment Program trial was a pilot study aimed at enhancing the efficacy of a face-to-face intervention for patients with schizophrenia while shortening the intervention’s duration through regular phone calls (47). The app-based Mobus trial (44) and the SMS-based EMI designed by Pijnenborg and colleagues (49) involved programming of personalized daily living activities and goals to remind patients to complete these in daily life. In the Mobus trial, caregivers were engaged to work with the patient to identify goals and keep track of their progress by using the system (44).
Feasibility and acceptability.
The mean dropout rate across the EMI studies was 15%, with a range from 0% (47) to 36% (44). Reasons for dropout included loss of device, severity of illness, loss of interest, and intervention nonengagement. Mean response rates to the prompting components of the EMIs across the studies was 80% (rates were not reported in Pijnenborg and colleagues [49]). Ben-Zeev and colleagues (46) found no association between response rates and cognitive functioning or symptom severity. However, they found that the percentage of days on which the app was used was lower among participants who had a greater reduction in depressive symptoms over the course of the intervention (r=−.36). In the MATS trial, the participants who stopped responding to the intervention had more severe negative symptoms, more impaired daily living skills, and lower premorbid IQ (48). Participants with more severe paranoia in the Mobus trial were unable to engage with the intervention because of suspiciousness of the monitoring nature of the device (44). No other studies reported reasons for response rates. Technical issues were reported in three of the five trials (44,46,48), and specific issues related to confidentially and risk of carrying cell phones in public settings were mentioned by participants. Overall acceptability ratings for the interventions were moderate to high. In the MATS trial, participants reported increasing helpfulness of the app over time; however, some technical issues were reported that were related to the usability of the phone response and navigation functions (48).
Clinical outcomes.
The three trials targeting cognitive impairments or daily living skills found improvements in the percentage of goals achieved over the intervention (49), improvements in daily living skills (44,47), and evidence for improved cognitive capacity (44,49). The only study that conducted a follow-up (two weeks postintervention) did not find evidence for sustained increase in goals achieved in the treatment group (49). Four of the five EMI studies also included outcome measures related to change in psychotic symptoms. The Mobus (44) and MATS (48) studies did not detect pre-post changes in symptoms; however, the latter found improvements over time in medication adherence and attitudes, increased socialization, and positive effects on hallucinations (decreased occurrence and severity and controllability). The FOCUS study found significant reductions in depression and in total and positive symptoms but not in negative symptoms (46). Although Pijnenborg and colleagues (49) did not report symptom changes as overall outcomes, they noted that the group of participants classified as “responders” to the intervention (>20% increase in goal achievement over the intervention) showed pre-post reductions in negative symptoms but not in positive symptoms.
Study Quality Analysis
Overall, the reporting of key information across all studies was good, with clear descriptions of intervention components, participant characteristics, and methods and sound justification for the statistical analysis used. The primary methodological limitation was related to internal validity and power. Only two of the studies were RCTs (both ITAREPS studies [43,45]), and neither contained matched samples. The other two ITAREPS studies used historical data of a matched period prior to the intervention as a control (50,51). Of the EMI studies, only two included a control group; in one of the studies the control group was not randomly assigned (49), and the other relied on a matched sample from a prior intervention with inadequate reporting of quantitative data (this study was a preliminary reporting of pilot data [47]). The remaining three EMI studies employed a pre-post design (44,46,48). Only one study reported power calculations to determine sample sizes (45). These methodological limitations reflect the fact that this research area is in its infancy—most of the included studies were at the feasibility or pilot stage.
Discussion
The findings of this systematic review provide preliminary support for the clinical utility of EMA and EMI in the treatment of people with a diagnosis of a psychotic disorder. A small number of studies have demonstrated the use of EMI for illness self-management through momentary reminders or instructions to promote medication adherence, management of symptoms and psychosocial impairments, daily living skills, and goal achievement. Across these studies, dropout rates were low and compliance was moderate to high; overall acceptability and usability ratings were positive. Four of the five EMI studies conducted analysis to evaluate changes in clinical outcomes, although these should be interpreted cautiously because most trials were uncontrolled. Two of these four studies found improvements in overall and positive symptoms (46) and in negative symptoms (49). The remaining two EMI studies did not find significant pre-post changes to symptoms (44,48), although Granholm and colleagues (48) found improvements in medication adherence, auditory hallucinations, and socialization over the course of the intervention. Three of the five EMI studies found improvements in cognitive impairments, goal achievement (44,49), and daily living skills (44,47). The only intervention identified that made use of EMA-based methods (43,45,50,51) found that remote monitoring of illness states minimized relapse and hospitalization. However, this intervention highlighted important acceptability issues that were related to automatic protocols for responding to clinically significant changes among patients.
The varied features of the interventions included in this review demonstrate the broad application of EMA and EMI in the treatment of psychotic disorders. EMI can be used for autonomous illness self-management by providing statements or instructions on demand or by prompts via SMS or native smartphone apps (those stored locally on the device) or through phone calls aimed at enhancing standard face-to-face treatments. The ability to provide support on demand and in daily life is an important capability because barriers to treatment among persons with psychotic disorders could be overcome by providing support in daily life (20–25). Further studies are needed to build on these findings and extend the use of EMA and EMI to other domains. For example, EMA data are a rich source of contextually sensitive information that could be analyzed to make a variety of clinically relevant predictions. This potential was demonstrated by Burns and colleagues (32), who developed an algorithm capable of predicting a variety of psychological states and contexts (for example, mood, motivational states, activity, and social context) on the basis of sensor data (for example, location, light, and recent calls) collected via ambulatory devices. Such algorithms could be used to analyze EMA data and derive individualized prompts by using EMI or for individualized case formulation and management. Applications of EMA that warrant further investigation include the therapeutic benefit of illness self-monitoring, which has been shown to be helpful in treating depressive symptoms (27,28). Providing patients with tailored feedback regarding patterns in their psychotic experiences and the variables that influence them may improve awareness and identify possible intervention targets.
Another use of EMA and EMI has been referred to as an “ecological interventionist–causal model approach” (53). This approach involves testing interventions by linking their specific effects to the putative mechanisms and the targeted outcome (for example, psychotic symptoms). This innovative approach offers a highly reliable method of investigating the causal relationship between intervention and putative psychological mechanisms, which may ultimately lead to enhanced and more sustained effectiveness.
A number of identified studies relevant to this review were excluded because they did not present clinical outcome data. Many of these feasibility and acceptability studies demonstrated additional applications of EMA and EMI, and they provided indicators of whether these technologies are useful and acceptable to patients. Examples include the use of passive EMA sensing to detect early relapse indicators (13,14), assessment in inpatient settings using EMA (54), SMS-based EMA and EMI for monitoring and intervening with clinical changes remotely via clinicians (55), EMI for setting and prompting goal achievement to enhance motivation (56), and use of the FOCUS system for monitoring signs of relapse posthospitalization (57,58) and for presenting short videos of intervention strategies (59). These studies highlight the broad range of technologies that utilize EMA and EMI methods, including smartphones, video recordings, and sensing devices.
It is notable that some of the biggest effects found in the studies reviewed here were with the ITAREPS intervention (43,45,50,51), even though this intervention was characterized by poor rates of adherence among both consumers and practitioners. The primary issue raised by the ITAREPS intervention was the treatment team’s ability to maintain its autonomy in determining the best methods of responding to signs of relapse. It is important that future research investigate clinicians’ attitudes toward new technology-based interventions and explore how interventions may best be integrated in routine practice. The use of EMA for monitoring and detecting signs of relapse clearly has clinical utility; however, future research may benefit from approaching this from a more empowering perspective by allowing users to self-monitor and direct their own needs for intervention. An example of this is the EMPOWER trial (ISRCTN99559262), which is an ongoing study examining the use of a smartphone app in self-monitoring for early warning signs of relapse. This approach emphasizes user control over responses; users are able to notify their case coordinator and nominated caregiver if they choose, and the app suggests strategies for self-management.
The future of mobile technology in mental health care is growing increasingly prominent in the literature. A number of articles have described the various ways in which these technologies can be used in treating psychotic disorders (20) and mental disorders in general (1–5,19,21). The literature highlights the various challenges faced by this new area of research, including issues related to costs, access, user attitudes and interest, and the technology. The studies reviewed here also highlighted confidentiality, the risk of loss of or damage to the devices in public settings, technological limitations, and usability as issues related to feasibility and acceptability. Evidence was also found that response to and engagement with the interventions may be related to certain illness factors, such as the severity of symptoms and cognitive impairments (44,46,49). Patients in the MATS intervention reported difficulty using the phone in some conditions, including navigating and responding to SMS (48). The authors suggested that future improvements to smartphone technology may improve usability, making them more acceptable to patients. Research comparing traditional, SMS-based assessment to more modern and sophisticated smartphone technology has found that people with serious mental illness find both acceptable and feasible; however, they prefer native smartphone apps, which may be simpler to use (60). With technological advancements evolving at a rapid rate, interventions can become more user friendly, which may enhance outcomes. To aid this advancement, future research can investigate barriers and potential solutions, particularly focusing on feedback from people with lived experience and health care providers.
This systematic review had some limitations. Because of the lack of controlled studies, a meta-analysis was not conducted, and thus the results related to clinical outcomes are preliminary estimates. The definition of EMI used was relatively broad, and EMA is not yet well defined in treatment contexts; therefore, it is possible that not all relevant studies were captured. Although the ITAREPS studies (43,45,50,51) were included on the basis of our broad definition of EMA, this intervention demonstrated the potential utility of remote monitoring of illness, allowing momentary detection of relapse risk and treatment response. Future research that provides a more standardized definition of these types of methods would reduce the ambiguity of the inclusion criteria. Furthermore, variation across EMA and EMI methods (for example, native apps versus telephones) also made comparison challenging. As this literature grows, future research may compare the various delivery methods in order to isolate active components.
Conclusions
Overall, studies to date suggest good acceptability and feasibility of EMA and EMI in the treatment of psychotic disorders, and clinical outcome data from uncontrolled trials are promising. Controlled trials are needed to assess the potentially wide-ranging application of such technologies among individuals with psychotic disorders.
Supplementary Material
References
1.
Ben-Zeev D, Davis KE, Kaiser S, et al: Mobile technologies among people with serious mental illness: opportunities for future services. Administration and Policy in Mental Health and Mental Health Services Research 40:340–343, 2013
2.
E–Mental Health in Australia: Implications of the Internet and Related Technologies for Policy: Report. Canberra, Australia, Commonwealth Department of Health and Ageing, May 2002
3.
Gravenhorst F, Muaremi A, Bardram J, et al: Mobile phones as medical devices in mental disorder treatment: an overview. Personal and Ubiquitous Computing 19:353–355, 2015
4.
Luxton D, McCann R, Bush N, et al: mHealth for mental health: integrating smartphone technology in behavioral healthcare. Professional Psychology, Research and Practice 42:505–512, 2011
5.
Proudfoot J: The future is in our hands: the role of mobile phones in the prevention and management of mental disorders. Australian and New Zealand Journal of Psychiatry 47:111–113, 2013
6.
Drake RE, Whitley R: Recovery and severe mental illness: description and analysis. Canadian Journal of Psychiatry 59:236–242, 2014
7.
The World in 2015: ICT Facts and Figures. Geneva, International Telecommunications Union, 2015. https://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2015.pdf
8.
Torous J, Friedman R, Keshavan M: Smartphone ownership and interest in mobile applications to monitor symptoms of mental health conditions. JMIR mHealth and uHealth 2:e2, 2014
9.
Thomas N, Foley F, Lindblom K, et al: Are people with severe mental illness ready for online interventions? Access and use of the Internet in Australian mental health service users. Australasian Psychiatry 25:257–261, 2017
10.
Alvarez-Jimenez M, Alcazar-Corcoles MA, González-Blanch C, et al: Online, social media and mobile technologies for psychosis treatment: a systematic review on novel user-led interventions. Schizophrenia Research 156:96–106, 2014
11.
Shiffman S, Stone AA, Hufford MR: Ecological momentary assessment. Annual Review of Clinical Psychology 4:1–32, 2008
12.
Heron KE, Smyth JM: Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. British Journal of Health Psychology 15:1–39, 2010
13.
Ben-Zeev D, Wang R, Abdullah S, et al: Mobile behavioral sensing for outpatients and inpatients with schizophrenia. Psychiatric Services 67:558–561, 2016
14.
Wang R, Aung MS, Abdullah S, et al: CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia; in Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing 886–897, 2016
15.
Oorschot M, Kwapil T, Delespaul P, et al: Momentary assessment research in psychosis. Psychological Assessment 21:498–505, 2009
16.
Brenner CJ, Ben-Zeev D: Affective forecasting in schizophrenia: comparing predictions to real-time ecological momentary assessment (EMA) ratings. Psychiatric Rehabilitation Journal 37:316–320, 2014
17.
Granholm E, Loh C, Swendsen J: Feasibility and validity of computerized ecological momentary assessment in schizophrenia. Schizophrenia Bulletin 34:507–514, 2008
18.
Palmier-Claus JE, Ainsworth J, Machin M, et al: The feasibility and validity of ambulatory self-report of psychotic symptoms using a smartphone software application. BMC Psychiatry 12:172, 2012
19.
Trull TJ, Ebner-Priemer UW: Using experience sampling methods/ecological momentary assessment (ESM/EMA) in clinical assessment and clinical research: introduction to the special section. Psychological Assessment 21:457–462, 2009
20.
Ben-Zeev D: Mobile technologies in the study, assessment, and treatment of schizophrenia. Schizophrenia Bulletin 38:384–385, 2012
21.
Ben-Zeev D, Drake RE, Corrigan PW, et al: Using contemporary technologies in the assessment and treatment of serious mental illness. American Journal of Psychiatric Rehabilitation 15:357–376, 2012
22.
Berry K, Haddock G: The implementation of the NICE guidelines for schizophrenia: barriers to the implementation of psychological interventions and recommendations for the future. Psychology and Psychotherapy 81:419–436, 2008
23.
Johansen R, Hestad K, Iversen VC, et al: Cognitive and clinical factors are associated with service engagement in early-phase schizophrenia spectrum disorders. Journal of Nervous and Mental Disease 199:176–182, 2011
24.
Lysaker PH, Vohs JL, Ballard R, et al: Metacognition, self-reflection and recovery in schizophrenia. Future Neurology 8:103–115, 2013
25.
Mojtabai R, Fochtmann L, Chang SW, et al: Unmet need for mental health care in schizophrenia: an overview of literature and new data from a first-admission study. Schizophrenia Bulletin 35:679–695, 2009
26.
So SH, Peters ER, Swendsen J, et al: Detecting improvements in acute psychotic symptoms using experience sampling methodology. Psychiatry Research 210:82–88, 2013
27.
Kramer I, Simons CJ, Hartmann JA, et al: A therapeutic application of the experience sampling method in the treatment of depression: a randomized controlled trial. World Psychiatry 13:68–77, 2014
28.
Simons CJ, Hartmann JA, Kramer I, et al: Effects of momentary self-monitoring on empowerment in a randomized controlled trial in patients with depression. European Psychiatry 30:900–906, 2015
29.
Godleski L, Cervone D, Vogel D, et al: Home telemental health implementation and outcomes using electronic messaging. Journal of Telemedicine and Telecare 18:17–19, 2012
30.
Pratt SI, Bartels SJ, Mueser KT, et al: Feasibility and effectiveness of an automated telehealth intervention to improve illness self-management in people with serious psychiatric and medical disorders. Psychiatric Rehabilitation Journal 36:297–305, 2013
31.
Newman MG, Przeworski A, Consoli AJ, et al: A randomized controlled trial of ecological momentary intervention plus brief group therapy for generalized anxiety disorder. Psychotherapy 51:198–206, 2014
32.
Burns MN, Begale M, Duffecy J, et al: Harnessing context sensing to develop a mobile intervention for depression. Journal of Medical Internet Research 13:e55, 2011
33.
Depp CA, Ceglowski J, Wang VC, et al: Augmenting psychoeducation with a mobile intervention for bipolar disorder: a randomized controlled trial. Journal of Affective Disorders 174:23–30, 2015
34.
Przeworski A, Newman MG: Palmtop computer-assisted group therapy for social phobia. Journal of Clinical Psychology 60:179–188, 2004
35.
Myin-Germeys I, Klippel A, Steinhart H, et al: Ecological momentary interventions in psychiatry. Current Opinion in Psychiatry 29:258–263, 2016
36.
Firth J, Torous J: Smartphone apps for schizophrenia: a systematic review. JMIR mHealth and uHealth 3:e102, 2015
37.
Kimhy D, Myin-Germeys I, Palmier-Claus J, et al: Mobile assessment guide for research in schizophrenia and severe mental disorders. Schizophrenia Bulletin 38:386–395, 2012
38.
Myin-Germeys I, Birchwood M, Kwapil T: From environment to therapy in psychosis: a real-world momentary assessment approach. Schizophrenia Bulletin 37:244–247, 2011
39.
Liberati A, Altman DG, Tetzlaff J, et al: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Annals of Internal Medicine 151:W65–94, 2009
40.
Kannisto KA, Koivunen MH, Välimäki MA: Use of mobile phone text message reminders in health care services: a narrative literature review. Journal of Medical Internet Research 16:e222, 2014
41.
Park LG, Howie-Esquivel J, Dracup K: A quantitative systematic review of the efficacy of mobile phone interventions to improve medication adherence. Journal of Advanced Nursing 70:1932–1953, 2014
42.
Downs SH, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. Journal of Epidemiology and Community Health 52:377–384, 1998
43.
Komatsu H, Sekine Y, Okamura N, et al: Effectiveness of Information Technology Aided Relapse Prevention Programme in Schizophrenia excluding the effect of user adherence: a randomized controlled trial. Schizophrenia Research 150:240–244, 2013
44.
Sablier J, Stip E, Jacquet P, et al: Mobus Group: Ecological assessments of activities of daily living and personal experiences with Mobus, an assistive technology for cognition: a pilot study in schizophrenia. Assistive Technology 24:67–77, 2012
45.
Španiel F, Hrdlička J, Novák T, et al: Effectiveness of the Information Technology–Aided Program of Relapse Prevention in Schizophrenia (ITAREPS): a randomized, controlled, double-blind study. Journal of Psychiatric Practice 18:269–280, 2012
46.
Ben-Zeev D, Brenner CJ, Begale M, et al: Feasibility, acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophrenia Bulletin 40:1244–1253, 2014
47.
Depp CA, Mausbach B, Granholm E, et al: Mobile interventions for severe mental illness: design and preliminary data from three approaches. Journal of Nervous and Mental Disease 198:715–721, 2010
48.
Granholm E, Ben-Zeev D, Link PC, et al: Mobile Assessment and Treatment for Schizophrenia (MATS): a pilot trial of an interactive text-messaging intervention for medication adherence, socialization, and auditory hallucinations. Schizophrenia Bulletin 38:414–425, 2012
49.
Pijnenborg GH, Withaar FK, Brouwer WH, et al: The efficacy of SMS text messages to compensate for the effects of cognitive impairments in schizophrenia. British Journal of Clinical Psychology 49:259–274, 2010
50.
Španiel F, Vohlídka P, Hrdlicka J, et al: ITAREPS: Information Technology–Aided Relapse Prevention Programme in Schizophrenia. Schizophrenia Research 98:312–317, 2008a
51.
Španiel F, Vohlídka P, Kozený J, et al: The Information Technology–Aided Relapse Prevention Programme in Schizophrenia: an extension of a mirror-design follow-up. International Journal of Clinical Practice 62:1943–1946, 2008b
52.
Španiel F, Novák T, Motlová L, et al: Information Technology–Aided Relapse Prevention Program in Schizophrenia (ITAREPS): reliability and validity of the early warning signs questionnaire. Psychiatry 11:157–159, 2007
53.
Reininghaus U, Depp CA, Myin-Germeys I: Ecological interventionist causal models in psychosis: targeting psychological mechanisms in daily life. Schizophrenia Bulletin 42:264–269, 2016
54.
Kimhy D, Delespaul P, Corcoran C, et al: Computerized experience sampling method (ESMc): assessing feasibility and validity among individuals with schizophrenia. Journal of Psychiatric Research 40:221–230, 2006
55.
Ben-Zeev D, Kaiser SM, Krzos I: Remote “hovering” with individuals with psychotic disorders and substance use: feasibility, engagement, and therapeutic alliance with a text-messaging mobile interventionist. Journal of Dual Diagnosis 10:197–203, 2014
56.
Schlosser D, Campellone T, Kim D, et al: Feasibility of PRIME: a cognitive neuroscience–informed mobile app intervention to enhance motivated behavior and improve quality of life in recent onset schizophrenia. JMIR Research Protocols 5:e77, 2016
57.
Baumel A, Correll CU, Hauser M, et al: Health technology intervention after hospitalization for schizophrenia: service utilization and user satisfaction. Psychiatric Services 67:1035–1038, 2016
58.
Ben-Zeev D, Scherer EA, Gottlieb JD, et al: mHealth for schizophrenia: patient engagement with a mobile phone intervention following hospital discharge. JMIR Mental Health 3:e34, 2016
59.
Ben-Zeev D, Brian RM, Aschbrenner KA, et al: Video-based mHealth interventions for schizophrenia: bringing the “pocket therapist” to life. Psychiatric Rehabilitation Journal (Epub ahead of print, June 13, 2016)
60.
Ainsworth J, Palmier-Claus JE, Machin M, et al: A comparison of two delivery modalities of a mobile phone–based assessment for serious mental illness: native smartphone application vs text-messaging only implementations. Journal of Medical Internet Research 15:e60, 2013
Information & Authors
Information
Published In
Cover: Still Life of Fruit, anonymous, circa 1865. Gift of Edgar William and Bernice Chrysler Garbisch, National Gallery of Art, Washington, D.C.
History
Received: 16 November 2016
Revision received: 24 March 2017
Accepted: 28 April 2017
Published online: 3 July 2017
Published in print: November 01, 2017
Keywords
Authors
Competing Interests
Dr. Thomas reports receipt of speaker honoraria from Janssen-Cilag. The other authors report no financial relationships with commercial interests.
Funding Information
Department of Education and Training, Australian Government: Research Training Program Scholarship
This research was supported by the Australian Government Research Training Program Scholarship.Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
There are no citations for this item
View Options
View options
PDF/ePub
View PDF/ePubGet Access
Login options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).