Skip to main content

Abstract

Objective:

This study tested whether a mood tracking and alert (MTA) mobile application (app) improved mental health care delivery in a high-risk obstetric population.

Methods:

Pregnant women with depressive symptomatology at <32 weeks gestation were followed for eight weeks after randomization to a control patient portal (PP) app alone or with the MTA app. The MTA app monitored activity, assessed mood, and alerted obstetric providers of signs of worsening mood.

Results:

Seventy-two women enrolled (PP, N=24; MTA, N=48). MTA users had significantly more contacts addressing mental health, and as gestational age increased, they rated ability to manage their own health significantly better than women in the control group. Women who received telephone contact from a provider triggered by an MTA app alert were significantly more likely to receive a mental health specialist referral.

Conclusions:

A mobile MTA app improved service delivery and patient engagement among patients with perinatal depression symptoms.
Mobile health (mHealth) strategies are a potential approach to improve patient engagement and service delivery in health care settings. Mobile phone application (mobile app) self-management tools have been developed for a range of chronic illnesses and have been studied in obstetric settings for physical activity, nutrition, and gestational diabetes. These apps often provide automated feedback or cues to patients (1) but do not generally enable patients to connect directly with their health care team. Thus, such apps may exist in parallel to health care treatment, as opposed to being integrated into health care treatment (2). When integrated into treatment with a health care team, apps have the potential to extend the reach of care between in-person visits, potentially improving health care delivery. Despite the widespread use of mobile apps, there have been few evaluations of the benefits of this technology for improving health care delivery (3), particularly regarding apps focused on mental health.
Common perinatal mental disorders, primarily depression and anxiety, are associated with poor pregnancy outcomes and infant health (4). Depression occurs in up to 20% of pregnant women, with markedly higher rates in low-income populations (5). Given the negative impact on the woman and her offspring, it is critical to address these disorders in the prenatal period. However, attention to mental health in obstetric settings may be inadequate because of limited resources (6), even though women may be open to discussing mental health concerns with obstetric providers (7). Mobile apps that alert the health care team when mood symptoms worsen between prenatal visits could enhance the ability of prenatal care sites to deliver effective, targeted care of perinatal mental health concerns, particularly in resource-limited settings.
This randomized controlled trial (RCT) aimed to assess the impact of a mood tracking and alert (MTA) mobile app on patient engagement and health care delivery in an obstetric setting among women from racial-ethnic minority groups with low incomes who were experiencing depressive symptoms. The main hypotheses were that eight weeks of MTA app use would improve patient engagement (particularly patients’ perceived ability to manage their own health), improve prenatal care satisfaction (particularly sense of connectedness with providers), and enhance mental health service delivery by facilitating clinical contact when mood symptoms worsened.

Methods

This study was an RCT drawing from a convenience sample. Pregnant women were recruited from March to September 2015 from an urban ambulatory prenatal clinic within an academic medical center serving a predominantly low-income and racial-ethnic minority population. Women at least 18 years old and 32 weeks gestation or less, per electronic health record (EHR), were approached by a research coordinator at a routine prenatal appointment. Enrollment was offered to English-speaking women with depressive symptoms (≥5 on the Patient Health Questionnaire–9 [PHQ-9]) who owned a smartphone with an iOS or Android operating system (8).
Participants were randomly assigned to one of three conditions: a mobile app allowing access to a patient portal (PP), the standard of care available to all patients at the health center, that enabled e-mail-like communication with providers; PP with the addition of an MTA app (Ginger.io; San Francisco, California) that alerted providers when participant mood symptoms worsened, prompting the provider to contact the participant; or the PP app and MTA app with a lottery incentive to encourage MTA app use. Additional description of the apps is available as an online supplement to this brief report. Research staff assisted participants with the app(s) download, provided information packets explaining the assigned mobile app(s), and administered a baseline interview (demographic information, prenatal care engagement, and satisfaction). After eight weeks, care engagement and satisfaction were reassessed. Service delivery data on patient-provider contacts during the eight-week period were extracted from the EHR of each participant. As an exploratory outcome, depressive and anxiety symptoms were assessed after eight weeks within the MTA group. A priori sample size calculations were based on a moderate effect size and a power of .8. This study was approved by the University of Pennsylvania Institutional Review Board, conducted according to the guidelines of the Declaration of Helsinki, and registered on ClinicalTrials.gov.
Patient engagement and care satisfaction questions addressed confidence in ability to manage one’s own health, feeling that prenatal providers understand and respond to one’s unique needs as a patient, feeling connected with providers, ability to communicate with prenatal providers, whether one was left with unanswered questions after prenatal visits, and general satisfaction with prenatal care; items were rated on a Likert scale. To assess service delivery, data on patient-provider interactions were abstracted from the EHR for all encounters dated within the participant’s eight-week study period. Information obtained included medical history, office visit frequency, telephone contact, secure messages sent and received via PP, mental health specialist referrals and visits, and encounters that mentioned mental health or the MTA app. To assess app acceptability, participants in the MTA group were asked eight Likert-scale questions about the perceived acceptability and utility of the mobile app [see online supplement]. As exploratory measures, depressive and anxiety symptoms were assessed after eight weeks in the MTA group by using the PHQ-9 and the Generalized Anxiety Disorder–7 (GAD-7) (9).
Descriptive statistics were generated and examined for normality. Student’s t and chi-square tests assessed group differences in demographic characteristics. Patient engagement, care satisfaction, and service delivery outcomes were treated as continuous variables and were analyzed with analysis of covariance (ANCOVA) by using baseline levels as covariates. Because prenatal visits are more frequent in the later stages of pregnancy, ANCOVAs were adjusted for gestational age. A p value was considered significant at p<.05; values presented were not corrected for multiple comparisons. Analyses were performed with IBM SPSS Statistics for Macintosh, version 23.

Results

The sample included 72 participants (PP control app, N=24; PP plus MTA, N=25; PP plus MTA with lottery, N=23) of 91 screened. One participant did not receive the allocated intervention because of incomplete app download, one participant withdrew, and five participants were lost to follow-up. Randomization created generally equivalent groups; the only significant difference among the three groups in demographic characteristics, health, or psychiatric history was gestational age, which was included as a covariate in ANCOVAs (Table 1). There was no difference in utilization or outcomes for the two MTA groups related to the presence of the lottery; therefore, the groups (with and without lottery) were combined for all additional analyses.
TABLE 1. Demographic characteristics, care satisfaction, and service delivery outcomes among pregnant women randomly assigned to a patient portal (PP) app or mood tracking and alert (MTA) mobile app
 PP app (N=24)MTA app (N=48) 
VariableN%N%p
Demographic characteristic     
 Age (M±SD)26.3±4.9 26.5±6.2 .93
 Gestational age at enrollment (M±SD weeks)17.0±6.0 21.3±6.7 .02
 African American22963995.92
 Hispanic211410.90
 Married14410.44
 Employed10562563.62
 Some college or more10561845.46
 Medicaid or Medicare insurance17743688.16
 Gravida (M±SD)3.3±1.9 3.6±2.5 .61
 Para (M±SD).9±1.0 1.1±1.5 .70
 PHQ-9 at enrollment (M±SD)a12.1±5.2 11.0±4.6 .37
 Psychiatric diagnosis13542561.49
 Prescribed psychiatric medication2912.26
Engagement and care satisfaction at week 8 (M±SD)     
 I am confident that I am able to manage my own healthb6.1 ±.8 6.1±1.0 .07c
 My care team understands and responds to my unique needsb6.2±1.4 6.1±1.2 .71c
 I feel connected to my care teamb5.5±1.5 5.8±1.4 .39c
 How would you rate the ability to reach your prenatal provider by phone?d4.1±1.3 3.9±1.4 .69c
 How often do you leave a prenatal appointment with unanswered questions?e5.6 ±.7 5.7 ±.7 .77c
 How satisfied are you with your prenatal care?f5.8±1.3 6.1±1.0 .71c
Service delivery     
Prenatal careg     
  N of OB office visits (M±SD)4.5±2.6 4.7±2.1 .89c
  N of OB visits in which mental health was mentioned (M±SD).83±1.5 .85±1.3 .82c
  N of OB telephone encounters mentioning mental health (M±SD).1±4.7 .98±1.3 .02c
Mental health care     
  N of prenatal mental health specialist visits (M±SD).22±.6 .30±.5 .69c
  Patient had OB visit that addressed mental health8351742.60h
  Patient referred to mental health specialist5221127.65h
  Patient attended mental health specialist visit120327.76h
  Patient had MTA app triggered contact  1741 
a
PHQ-9, Patient Health Questionnaire–9. Possible scores range from 0 to 27, with higher scores indicating greater depressive symptomatology.
b
Items were rated on a Likert scale ranging from 1, completely disagree, to 7, completely agree.
c
Represents the p value from analysis of covariance, main effect of group, with gestational age as a covariate
d
Items were rated on a Likert scale ranging from 1, very poor, to 6, excellent.
e
Items were rated on a Likert scale ranging from 1, always, to 6, never.
f
Items were rated on a Likert scale ranging from 1, completely dissatisfied, to 7, completely satisfied.
g
OB, obstetrician
h
Represents the p value for chi-square
Regarding patient engagement and care satisfaction, as gestational age increased, women in the MTA group rated their ability to manage their own health significantly higher than the control group after eight weeks (F=4.03, df=4 and 49, p=.007; pinteraction=.04). At week 8, controlling for baseline care satisfaction scores, there were no significant differences in care satisfaction between the PP and MTA groups.
In terms of service delivery, compared with the PP group, the MTA group had significantly more telephone encounters with providers that mentioned mental health (F=6.0, df=1 and 55, p=.02), but this group did not have significantly more participants with mental health referrals or significantly better referral adherence than the PP group (Table 1). Within the MTA group, 17 women (41%) received a phone call from a provider that was triggered by an alert from the app. Those women who received a provider contact triggered by the MTA app had a significantly higher rate of referral to a mental health provider compared with women who did not receive an MTA app–triggered contact (t=−2.3, df=15, p=.03). Exploratory analysis of depressive and anxiety symptoms revealed that mean daily mood score was significantly positively correlated with number of calls that a participant received in weeks 1–4 (p<.05 for both comparisons). Participants who received an MTA-triggered call had consistently higher PHQ-9 and GAD-7 scores across the eight weeks compared with those who did not receive an MTA-triggered call. These differences were significant at weeks 1–4 for the PHQ-9 and at Weeks 3–4 for the GAD-7 (p<.05 for both comparisons).
Among participants randomly assigned to the MTA app, the minimum number of days that a participant used the app was 10. The most frequent users (N=3) used the app daily. Mean use frequency was 42.49 (±13.32) days, or 75.9% of days (about 5.3 days per week). In terms of acceptability, after eight weeks, at least half of MTA users said that the app helped them to feel open and honest about their feelings or helped them to manage their mental health. Less than 50% felt that the app helped their prenatal team to understand and respond to their unique needs, or to feel more connected to their care team [see online supplement].
Among MTA users, PHQ-9 (F=7.87, df=2.5 and 47.3, p=.001), GAD-7 (F=6.32, df=2.2 and 42.1, p=.003), and self-reported daily mood scores (F=2.62, df=4.2 and 139.9, p=.03) significantly improved over eight weeks.

Discussion

The aim of this study was to assess whether an MTA mobile app used in a high-risk obstetric population would improve patient engagement and mental health care delivery, over and above a standard app that connected patients to providers through a PP. Participants had a high rate of mental health concerns, including moderate depressive symptoms and a psychiatric diagnosis in more than half. Participants were largely African American, unmarried, young, relatively early in pregnancy, and receiving Medicaid or Medicare, representing a highly vulnerable population.
After the eight-week trial, women in the third trimester in the MTA group experienced a significant improvement in their perceived ability to manage their own health, whereas those in the PP control group did not. Previous research has suggested that mHealth interventions can help patients to self-manage certain health conditions (10).
Because the MTA app alerted providers when a patient was experiencing worsening mood symptoms, triggering telephone contact from the provider, it follows that the MTA users had more phone contact with their providers regarding mental health. Furthermore, women who received an MTA app-triggered call from a provider had significantly higher mean PHQ-9 and GAD-7 scores early in the study, indicating that the app was correctly identifying women in distress. Finally, women who received an MTA app-triggered telephone contact had significantly more referrals to a mental health provider than users who did not have a triggered contact from a provider. This finding indicates that an app such as MTA is a feasible option to improve mental health service delivery via monitoring at-risk patients between visits; this app also facilitated patient-provider contact when needed rather than relying on the patient to decide to send an electronic message to her provider through a PP.
Although a comparison group was not available, measures of depressive and anxiety symptoms and self-reported daily mood improved over eight weeks among MTA app users. However, patients with depressive symptoms tend to improve over time (11), so we cannot make any causal claims that symptom improvement was due to app use.
This study’s strengths included randomization to the MTA app or a control app and an extended (eight-week) period of app use. Although greater than 90% of women in this clinic had smartphones, less than 10% of all patients seen in this clinic had activated the PP app. Limitations included restricting participation to smartphone users actively seeking prenatal care and unblind status of the research staff. We were also underpowered to adjust our assessment of statistical significance for multiple comparisons. Also, the study was focused on care delivery rather than on clinical outcomes; future studies should assess depressive and anxiety symptoms in both app and control groups to assess the role of these apps in improving these outcomes.

Conclusions

A mobile app that monitored patients between routine obstetric visits with targeted provider contact when needed was well accepted, and it improved mental health service delivery in a high-need obstetric practice. Tools such as this app may help monitor and treat women at high risk of developing psychiatric symptoms during pregnancy.

Acknowledgments

The authors thank the members of the “Stress in Pregnancy: Improving Results With Interactive Technology (SPIRIT)” group at the University of Pennsylvania for their assistance in carrying out the study; research coordinators Rebecca Henderson and Alicia Lo; Dina Appleby, M.S., and Mary Sammel, Sc.D., for guidance on statistical analysis; the staff of the University of Pennsylvania Helen O. Dickens Center for Women's Health for providing study-related clinical services; Katy Mahraj, M.S.I., and Roy Rosin, M.B.A., from the University of Pennsylvania School of Medicine Center for Healthcare Innovation for technical guidance; and Lucy Edwards and Leanne Kaye at Ginger.io for technical guidance.

Supplementary Material

File (appi.ps.201600582.ds001.pdf)

References

1.
Choi J, Lee JH, Vittinghoff E, et al: mHealth physical activity intervention: a randomized pilot study in physically inactive pregnant women. Maternal and Child Health Journal 20:1091–1101, 2016
2.
Willcox JC, Campbell KJ, McCarthy EA, et al: Testing the feasibility of a mobile technology intervention promoting healthy gestational weight gain in pregnant women (txt4two)—study protocol for a randomised controlled trial. Trials 16:209, 2015
3.
Noordam AC, Kuepper BM, Stekelenburg J, et al: Improvement of maternal health services through the use of mobile phones. Tropical Medicine and International Health 16:622–626, 2011
4.
Grote NK, Bridge JA, Gavin AR, et al: A meta-analysis of depression during pregnancy and the risk of preterm birth, low birth weight, and intrauterine growth restriction. Archives of General Psychiatry 67:1012–1024, 2010
5.
Kim DR, Sockol LE, Sammel MD, et al: Elevated risk of adverse obstetric outcomes in pregnant women with depression. Archives of Women’s Mental Health 16:475–482, 2013
6.
LaRocco-Cockburn A, Melville J, Bell M, et al: Depression screening attitudes and practices among obstetrician-gynecologists. Obstetrics and Gynecology 101:892–898, 2003
7.
Bennett IM, Palmer S, Marcus S, et al: “One end has nothing to do with the other:” patient attitudes regarding help seeking intention for depression in gynecologic and obstetric settings. Archives of Women’s Mental Health 12:301–308, 2009
8.
Kroenke K, Spitzer RL, Williams JB: The PHQ-9: validity of a brief depression severity measure. Journal of General Internal Medicine 16:606–613, 2001
9.
Zhong Q-Y, Gelaye B, Zaslavsky AM, et al: Diagnostic validity of the Generalized Anxiety Disorder–7 (GAD-7) among pregnant women. PLoS One 10:e0125096, 2015
10.
de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, et al: Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database of Systematic Reviews 12:CD007459, 2012
11.
Mora PA, Bennett IM, Elo IT, et al: Distinct trajectories of perinatal depressive symptomatology: evidence from growth mixture modeling. American Journal of Epidemiology 169:24–32, 2009

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services

Cover: Understanding, by Michael Olszewski, 1984. Dyed and pleated silk plain weave with silk embroidery. Philadelphia Museum of Art, gift of Nancy and David Bergman, 2015.

Psychiatric Services
Pages: 104 - 107
PubMed: 29032705

History

Received: 19 December 2016
Revision received: 19 April 2017
Revision received: 23 June 2017
Accepted: 4 August 2017
Published online: 16 October 2017
Published in print: January 01, 2018

Keywords

  1. prenatal care
  2. obstetrics
  3. perinatal depression
  4. mobile application
  5. smartphone application

Authors

Affiliations

Liisa Hantsoo, Ph.D. [email protected]
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Stephanie Criniti, M.S.
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Annum Khan, B.A.
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Marian Moseley, M.S.S., M.P.H.
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Naomi Kincler, M.P.H
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Laura J. Faherty, M.D., M.P.H.
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
C. Neill Epperson, M.D.
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Ian M. Bennett, M.D., Ph.D.
Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.

Notes

Send correspondence to Dr. Hantsoo (e-mail: [email protected]).
This report is based on a panel talk at the National Institutes of Health Mental Health Services Research conference, August 1–3, 2016, Bethesda, Maryland.

Competing Interests

Ms. Kincler is currently employed at Ginger.io, the company that provided the technology for this study. Dr. Epperson reports that she or her spouse hold stock investments in Abbott, Abbvie, Johnson and Johnson, Merck, and Pfizer. Dr. Epperson also consults to Sage Therapeutics and Shire Pharmaceuticals and gives continuing medical education lectures for Global Medical Education. The other authors report no financial relationships with commercial interests.

Funding Information

Penn Center for Healthcare Innovation: Innovation Accelerator Program Grant
National Institute of Mental Health10.13039/100000025: K23MH107831, P50 MH099910
Agency for Healthcare Research and Quality10.13039/100000133: K18 HS022441
The study was funded by an Innovation Accelerator Program grant from the Penn Center for Healthcare Innovation (Dr. Bennett), by the Agency for Healthcare Research and Quality (K18 HS022441 [Dr. Bennett], P50 MH099910 [Dr. Epperson], and K23MH107831 [Dr. Hantsoo]), and by the Robert Wood Johnson Foundation Clinical Scholars Program (Dr. Faherty).

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

There are no citations for this item

View Options

View options

PDF/ePub

View PDF/ePub

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share