Evaluation of Telepsychiatry-Enabled Perinatal Integrated Care
Abstract
Objective:
The purpose of this article is to describe the implementation of the first known telepsychiatry-enabled model of perinatal integrated care and to report initial results following implementation.
Methods:
Behavioral health screening data were collected from 712 patients at an urban women’s clinic, and a more in-depth set of process and outcome measures, including treatment engagement, services utilized, and delivery and postpartum patient outcomes, was collected from 135 patients referred for behavioral health services. Using nationally published metrics to provide context, the authors applied a descriptive design to evaluate and conduct analyses of program outcomes.
Results:
The telehealth-enabled integrated care model was successfully implemented within a specialty obstetrics practice. Identification and treatment of behavioral health issues exceeded nationally published rates. The model was also associated with positive indices related to birth weight and breastfeeding behavior.
Conclusions:
These initial results point to telepsychiatry as an effective tool for expanding perinatal integrated care and lay the foundation for further study and model refinement. The results also add to the growing body of evidence for the use of telepsychiatry-supported integrated care across diverse clinical settings and patient populations.
HIGHLIGHTS
•
A telepsychiatry-supported integrated care intervention was successfully implemented for a perinatal population in a women’s clinic.
•
Positive intervention outcomes have provided new support for the expansion of telepsychiatry-supported models of integrated care from primary care into specialty care settings.
•
Telepsychiatry-supported integrated care was associated with much higher rates of perinatal depression screening and treatment engagement compared with national rates reported in the literature.
Pregnancy-related, or perinatal, depression (1) is depression during pregnancy or up to 1 year postpartum. It is the most common complication of pregnancy for mothers nationwide and is a serious threat to a mother’s ability to provide responsive and nurturing parenting. It has an estimated prevalence rate of 8%–19% nationwide (2). Studies have documented even higher rates in low-income populations, with measured prevalence as high as 59% for socioeconomically disadvantaged mothers (3). Perinatal depression is a burden not only to the mother who is experiencing depressive symptoms but also to her entire family system, with potential lifelong implications for infants in a critical developmental window (4). When maladaptive neural patterns are set during critical developmental periods, they are difficult to change later in life (4, 5). High rates of unidentified and untreated maternal depression lead to negative life outcomes for mothers and children as well as potentially avoidable lifetime health and societal costs (3, 6, 7).
Early identification and treatment of perinatal depression can improve outcomes for mothers and children by promoting both parenting success and early childhood development (8). Screening and diagnosis in primary care settings is an effective way to increase identification of perinatal depression (9). Available data indicate that routine perinatal and postpartum depression screening is undertaken in only 15%–20% of women; of those diagnosed through screening, only 40%–60% will receive treatment (3).
Integrated care, the provision of behavioral health treatment in primary care and other medical outpatient settings, improves rates of detection and treatment and patient outcomes while reducing overall health care costs by leveraging team and population health care models (10–17). Integrated care is known to improve behavioral health care access, a particular challenge in rural and socioeconomically disadvantaged populations (18). Because of the elevated risk of behavioral health challenges for perinatal women, integrated obstetric and gynecological (OB-GYN) care models are particularly important and have shown improvements in depression, adherence, and overall treatment satisfaction (19, 20). Effective models include psychiatry, psychology, and social supports and have been pragmatically and effectively implemented, including with larger, socioeconomically disadvantaged populations (5, 19, 21, 22). Findings from a 2016 meta-analysis of computer and Web-based interventions for perinatal mental health suggested that they also show promise for effective treatment of perinatal depression and complicated grief (22).
Virtual health technologies, particularly telepsychiatry, in the form of live interactive video conferencing, are demonstrating their importance in addressing challenges in integrated care delivery. Integrated care with telepsychiatry improves access and availability to psychiatric providers, increases workflow efficiency, enables scaling of integrated care services, and improves patient outcomes (16). Despite the promise of telepsychiatry for perinatal care, a review of the literature revealed no reports or evaluations on perinatal telepsychiatry outside of a policy review and assessment of feasibility of implementation (18).
We sought to pilot a model of telepsychiatry-enabled integrated care for an underserved perinatal population. We hypothesized that this model would improve screening and identification of depression and other perinatal mental health issues, increase access to treatment, and improve patient engagement in treatment and perinatal outcomes. The purpose of this evaluation was to measure rates of screening for and identification of behavioral health challenges, access to and engagement in behavioral health treatment, and short-term outcomes (breastfeeding and birthweight) with known association to long-term outcomes and compare them with nationally reported rates. In this manuscript, we describe the specific telepsychiatry-enabled integrated care model and include process and outcome data from a 14-month implementation.
Methods
Partners and Clinic Sites
This project was funded by a local private foundation; it was collaboratively implemented by a Colorado-based accountable care organization and health plan (primarily serving Medicaid and Children’s Health Insurance Program recipients), its telehealth subsidiary organization, and an urban outpatient women’s clinic within a large hospital system. In 2015, before the project started, 54% of the clinic’s patients had Medicaid benefits, 23% were uninsured, and 11% had a commercial payer source. The project began with significant practice transformation and implementation work, which is a critical component of effective clinical workflow changes.
Telepsychiatry-Supported Model of Integrated Care
The telepsychiatry-enabled model of perinatal integrated care consisted of three components: universal depression screening, a virtually embedded behavioral health clinician (BHC), and virtual integration of telepsychiatry services into a collaborative care model. Before this project started, the clinic administered the Edinburgh Postnatal Depression Scale (EPDS) at a postnatal appointment for all patients and the two-question Patient Health Questionnaire (PHQ-2) at all other perinatal visits. The nine-question PHQ (PHQ-9) was used to follow up on elevated PHQ-2 results and psychological or social concerns expressed by the patient or provider. There is literature support for using both the PHQ and the EPDS to screen for depression in the perinatal population (23, 24). Patients completed the PHQ electronically on tablet computers provided by the clinic, making the results immediately electronically available.
A full-time, licensed BHC was virtually embedded into the clinic via video conferencing to oversee the screening of all perinatal patients (including training and periodically reminding providers to ask patients about behavioral health), follow up on positive screens and other referrals, support coordination of virtual psychiatric consultation, provide brief intervention and treatment as needed, and refer and coordinate ongoing behavioral health and social services. To foster team building and new clinical workflow implementation, the BHC primarily worked onsite for the first 2 months until transitioning to full-time virtual work via video conference.
The perinatal model was implemented by using an evidence-based collaborative care model in primary care. The BHC served as the coordinator across the care team. She consulted with patients and physicians, in this case OB-GYN providers, and served as a bridge to a program psychiatrist. The psychiatrist was available via telehealth for 8 hours of consultation per month. In keeping with the model, the psychiatrist did not provide direct patient care but instead consulted with the care team via the BHC to make diagnostic and medication-related recommendations for the care team to implement. The OB-GYN provider retained prescriptive responsibility and, through the consultative model, improved her or his own ability to manage the physical and behavioral health of current and future patients.
Data Collection
Data for this project were collected as part of standard quality improvement (QI) processes for this project. The University of Colorado Institutional Review Board reviewed the project and confirmed that it met QI criteria. We collected patient-level structure, process, and outcome measures as well as system-level process measures using mixed methods. The results summarized 14 months of data collected between June 2017 and September 2018. System-level data were collected qualitatively and included descriptions of protocol development and iterations as well as team members’ experiences. Patient-level structural measures included demographic and clinical variables collected from the subset of patients who were referred to the BHC. Process measures included the number and type of services rendered, and outcome measures included depression screening scores, psychiatric encounter outcomes, intermediary metrics related to patient treatment engagement known to be associated with positive perinatal outcomes, patient satisfaction, and emergency department or hospital utilization. Standard clinic data (i.e., demographic characteristics and diagnoses) were extracted from electronic health records; remaining data were tracked by the BHC (Box 1).
BOX 1. Evaluation metrics for telepsychiatry-enabled perinatal integrated care, by type of measure
Process Measures
•
Number and type of behavioral health screenings completed
•
Number of patients referred to the behavioral health clinician
•
Number of patient encounters with the behavioral health clinician
•
Number of psychosocial referrals made
•
Number of psychiatric encounters
Structural Measures
•
Patient demographic characteristics: race-ethnicity, age, education, number of children in household, number of caregivers in household, employment status, health insurance status
•
Clinical profile: behavioral health diagnoses, general health diagnoses
Outcome Measures
•
Patient access to integrated care: rates of screening, referral, and treatment
•
Patient engagement in treatment: delivery with the clinic, family planning in place at delivery, breastfeeding, patient attendance at postnatal appointments
•
Care plan improvements: changes in diagnosis or medication following consultation with psychiatric provider
•
Depression symptom change: Patient Health Questionnaire and Edinburgh Postnatal Depression Scale scores
•
Delivery outcomes: rates of full-term delivery and birth weight
•
Utilization of emergency or in-patient services for behavioral health issues
•
Patient satisfaction
Data Analysis
Descriptive analyses were completed regularly for QI, specifically, to guide clinic process modifications to increase patients served and improve service quality and efficiency. Satisfaction surveys were distributed to a convenience sample of patients in September 2017 and July 2018. Biannual reports were produced for the funder to include summarized quantitative data and qualitative themes. We conducted statistical analyses using Microsoft Excel and IBM SPSS Statistics, version 25.
Results
For the full list of project metrics, see Box 1.
Patient Characteristics
Across 14 months, the clinic served 712 unique patients, who had a total of 4,641 clinic visits. All patients (100%) completed a depression screening during at least one encounter (see online supplement ). In total, 2,608 depression screens were administered, and 135 patients (19%) were referred for behavioral health services for elevated depression screening scores or other psychosocial concern (Figure 1). Of the 135 referred patients, 85 (63%) were Hispanic-Latina, 26 (19%) were white, 18 (13%) were black, three (2%) were Asian, and three (2%) reported unknown race-ethnicity or declined to answer. Patient ages ranged from 16 to 43, with a mean age of 29.6. There was a median of one child per household (range 0–11) and, most frequently, two caregivers in the household. Of the patients, 24% (N=33) were working full time, 44% (N=59) were unemployed, and almost one-third (N=43) did not provide employment information.
FIGURE 1. Flowchart of services provided to patients in telepsychiatry-enabled perinatal integrated carea
aBHC, behavioral health clinician.
Patients came from 50 unique zip codes in the Denver metro area. Most patients (80%, N=570) were insured by Medicaid. Of the 135 patients referred for behavioral health services, 96 (71%) had a behavioral health diagnosis recorded in the electronic health record at the time of referral. The top diagnoses were depression (N=34 patients) adjustment disorder (N=31), and anxiety (N=16). Many had more than one diagnosis. Fifty-four of the 96 (56%) had one or more mood-related disorders, including anxiety, depression, dysthymia, and bipolar. Eleven (11%) had comorbid substance use disorders documented. Ninety-two (68%) of the 135 patients referred for behavioral health services had a primary general medical diagnosis, including diabetes, obesity, and asthma as well as pregnancy-related complications.
Process Measures
Of the 135 patients referred to program services, 130 (96%) engaged in behavioral health treatment. The BHC made 834 contacts, or contact attempts, to patients, including in-person (only during initial program months), virtual, phone, and voice mails (10% of contacts were no answer, no voicemail). The BHC also made 508 calls or contacts to social and community support agencies to make or follow up on psychosocial referrals. There were an average of six contacts with the BHC and four referral calls per patient. Through evidence-based practices, including assessment, brief treatment, and ongoing contact with the BHC, 117 patients were referred to (in order of frequency) therapy or counseling, support groups, psychiatry, and Colorado’s Nurse-Family Partnership. Data on patient follow-through on referrals were unavailable.
Thirty-three of the 135 patient cases (24%) required psychiatric consultation. Most psychiatric consultations (N=61, 87%) were provider-to-provider (collaborative consultations between the psychiatrist and the BHC). Most frequently, they met once per patient (range 0–7) for a total of 70 psychiatric consultation sessions. Sessions were 30 minutes, on average (range 15–90 minutes). Of the 70 consultation sessions, a majority (N=49, 70%) of sessions involved a medication-related question, and 14 (20%) included diagnostic clarification. Most consultations were regarding patients with one diagnosis before consultation (N=45, 64%). Before consultation, the most common diagnosis was depression (N=38, 54%), followed by anxiety (N=25, 36%), bipolar disorder (N=12, 17%), and posttraumatic stress disorder (N=5, 7%). Two patients had substance use disorders, two had personality disorders, and eight had unspecified diagnoses. Many patients had two or more comorbid diagnoses.
Outcomes
Patients referred to the program were more likely to present with clinically significant PHQ-9 depression symptoms at initial screening (24%, N=14 of the 58 with an initial PHQ-9) than the rest of the patients at the women’s clinic (5%, N=17 of the 339 with a PHQ-9 score) (χ2=48.72, df=1, p<0.001). Additionally, the patients referred to the program more frequently scored in the moderate to severe range of the EPDS (36%, N=32 of the 90 with initial EPDS scores), whereas only 6% (N=27 of the 445 with EPDS scores) of the nonreferred patients fell into the possible or high-risk categories of the EPDS (χ2=92.38, df=1, p<0.001). Per evaluation design, depression scores would be collected regularly from patients for the duration of their perinatal period to measure depression changes over time. However, patients varied in terms of when they initiated services at the clinic and at what point they were referred to the program, including after delivery. Because of this variation, scores did not fall cleanly into a pre-post service pattern and were not analyzed from this perspective.
At the time of report, 76 of the patients served by the integrated care program were eligible for delivery services. Of those patients, 59 (78%) had delivered at the clinic, making delivery-outcome data available. Fifty-one of 59 patients (86%) delivered full-term babies, and 56 of 59 (95%) began breastfeeding at delivery. At delivery, 58 patients had documented family-planning strategies, one patient did not, and the remaining 16 had missing family-planning information in their health records. Nine of the 59 babies were born at a low birth weight (<2,500 grams or 5 pounds 8 ounces) (25). Excluding two sets of twins, the group receiving behavioral health services through the program had a low birth weight rate of 12%. At the time of report, 42 had returned for their 6-week postnatal visit, and 33 of the 39 (85%) who were able to breastfeed were still breastfeeding.
Sixteen patients completed satisfaction surveys, providing feedback on their experiences with both the behavioral health services and telehealth technology. Most patients had good experiences and would recommend telehealth to other patients (Figure 2). There were 38 recorded emergency department visits: none for behavioral health issues and most for pregnancy-related complications. There were 55 hospitalizations (for 35 unduplicated patients) for the cohort, and only one was for behavioral health issues.
Discussion
The results demonstrated that a telepsychiatry-supported intervention for perinatal integrated care was successfully implemented in a women’s clinic serving an at-risk, socioeconomically disadvantaged population. Approximately 19% of patients screened were identified as having depression or other behavioral health needs; at least 96% of those patients engaged in at least some form of behavioral health treatment (Figure 1). Although there was no treatment-as-usual comparison group included in the evaluation design, national estimates have cited a similar rate of prevalence but a typical treatment engagement rate of only 60% (3), lending literature-backed support to interpretations of success.
Although all 135 of the patients who were referred to behavioral health had identified depression or other behavioral health needs, few were identified via a positive depression screen. Qualitatively, the behavioral health team observed that systematic screening improved the identification of behavioral health needs but not in the manner anticipated. Although the screening did not identify all patients in need, having universal screening as a standard of care increased the obstetrical providers’ comfort in asking patients about behavioral health issues, which did increase. Providers reported that the screening process helped normalize depression and behavioral health as a topic, and the ready presence of the behavioral health program increased providers’ confidence in their ability to address and manage behavioral health symptoms in the OB-GYN setting.
Although the evaluation lacked a comparative sample, published metrics provide some context for the program’s results. On the basis of the literature-reported 15%–20% prevalence rate of depression among perinatal populations, a 15% screening rate for perinatal and postpartum depression, and a 60% treatment rate for those identified, it can be calculated that out of 100 women, 15 would be screened, three would have a positive screen, and two of those three would receive treatment. This estimate represents only 13% of the actual population (N=15 in this scenario) with perinatal and postpartum depression (3). Although the literature-reported depression prevalence is consistent with the measured 19% of our sample, universal screening (for a population of 712 unique patients) allowed this model to identify 100%, not just 15%, of patients in need. Of those identified, 96% then engaged in treatment, far surpassing the most generous national estimate of 60% treatment engagement (see online supplement ).
Untreated perinatal depression is associated with higher rates of low birth weight, which, in turn, is associated with higher rates of postnatal depression for the mother and a range of developmental challenges for the infant (25, 26). Nationally, 8% of infants are born at a low birth weight (<2,500 g) (25), and the odds of low birth weight are almost three times higher among mothers with depression (estimated odds ratio=2.94)(27). In our sample, 12% (N=7) of nontwin infants were born at low birth weight, a positive trend given three-time greater odds for low birth rate for women with depression.
Other outcomes without comparative benchmarks include breastfeeding and behavioral health–related emergency room use. Breastfeeding is a particularly important metric for women at risk of depression. There is evidence demonstrating a bidirectional relationship such that depression is associated with lower rates of breastfeeding, and breastfeeding may protect against postpartum depression and support recovery from symptoms (28). Among the 39 patients in this cohort who attended their 6-week postnatal visit by project end date and who were eligible to breastfeed, rates of breastfeeding were very high (N=33, 85%). Similarly, although people with behavioral health diagnoses have higher emergency department utilization than those without (29), there was only one recorded emergency department visit for behavioral health reasons in our sample (<1%).
Limitations of this project included the absence of a controlled comparison group, no outcome measuring symptom change related to intervention, and sample attrition leading to low rates of 6-week postnatal appointment attendance and metrics. The indices of implementation success and patient treatment engagement, however, were all positive.
Conclusions
To our knowledge, this is the first evaluation of a telepsychiatry-enabled service providing perinatal integrated care. Despite evaluation limitations, the results indicated that, as hypothesized, the program was associated with improved screening and diagnosis of perinatal behavioral health issues, increased access to treatment and patient engagement, and improved patient outcomes. These preliminary observations point to telepsychiatry as a potentially effective tool for expanding models of perinatal-integrated care and lay the foundation for further study and model refinement. They also add to the growing body of evidence for the use of telepsychiatry-supported integrated care across clinical settings and patient populations.
Footnote
Dr. Shore, Ms. Waugh, Dr. Donahue, Ms. Rodriguez, Ms. Peters, Dr. Thomas, and Dr. Giese were involved in developing the program described in this article as part of their work at Colorado Access, a provider of telehealth clinical services.
Supplementary Material
File (appi.ps.201900143.ds001.tiff)
- Download
- 315.71 KB
References
1.
Pregnancy-Related Depression. Denver, Colorado Department of Public Health and Environment. www.colorado.gov/pacific/cdphe/pregnancy-related-depression. Accessed Nov 26, 2018
2.
Beeber LS, Schwartz TA, Holditch-Davis D, et al: Parenting enhancement, interpersonal psychotherapy to reduce depression in low-income mothers of infants and toddlers: a randomized trial. Nurs Res 2013; 62:82–90
3.
Ko JY, Farr SL, Dietz PM, et al: Depression and treatment among US pregnant and nonpregnant women of reproductive age, 2005–2009. J Womens Health 2012; 21:830–836
4.
Etter K: Building Foundations of Resilience: An Overview of Promising Approaches to Buffer the Effects of Toxic Stress in Young Children. Denver, Early Childhood Colorado Partnership, 2014. www.civiccanopy.org/wp-content/uploads/2013/12/Toxic-Stress-Lit-Review-FINAL.pdf. Accessed Feb 2, 2019
5.
Grote NK, Katon WJ, Russo JE, et al: Collaborative care for perinatal depression in socio-economically disadvantaged women: a randomized trial. Depress Anxiety 2015; 32:821–834
6.
Buist A, Speelman C, Hayes B, et al: Impact of education on women with perinatal depression. J Psychosom Obstet Gynaecol 2007; 28:49–54
7.
Sanmartin MX, Ali MM, Chen J, et al: Mental health treatment and unmet mental health care need among pregnant women with major depressive episode in the United States. Psychiatr Serv 2019; 70:503–506
8.
Chen YC, Fowles ER, Walker LO: Postpartum maternal health care in the United States: a critical review. J Perinat Ed 2006; 15:34–42
9.
Milgrom J, Ericksen J, Negri L, et al: Screening for postnatal depression in routine primary care: properties of the Edinburgh Postnatal Depression Scale in an Australian sample. Aust N Z J Psychiatry 2005; 39:833–839
10.
Melek SP, Norris DT, Paulus J: Economic Impact of Integrated Medical-Behavioral Healthcare: Implications for Psychiatry. Denver, Milliman, 2014. www.integration.samhsa.gov/about-us/Milliman-Report-Economic-Impact-Integrated-Implications-Psychiatry.pdf. Accessed Dec 10, 2019
11.
Gerrity M: Evolving Models of Behavioral Health Integration: Evidence Update 2010–2015. New York, Millbank Memorial Fund, 2016. www.milbank.org/publications/evolving-models-of-behavioral-health-integration-evidence-update-2010-2015/. Accessed Feb 20, 2018
12.
Berwick DM, Nolan TW, Whittington J: The Triple Aim: care, health, and cost. Health Aff 2008; 27:759–769
13.
Berge JM, Trump L, Trudeau S, et al: Integrated care clinic: creating enhanced clinical pathways for integrated behavioral health care in a family medicine residency clinic serving a low-income, minority population. Fam Syst Health 2017; 35:283–294
14.
Reiss-Brennan B, Brunisholz KD, Dredge C, et al: Association of integrated team-based care with health care quality, utilization, and cost. JAMA 2016; 316:826–834
15.
Reiss-Brennan B: Mental health integration: normalizing team care. J Prim Care Community Health 2014; 5:55–60
16.
Joseph R, Kester R, O’Brien C, et al: The evolving practice of psychiatry in the era of integrated care. Psychosomatics 2017; 58:466–473
17.
Shim R, Rust G: Primary care, behavioral health, and public health: partners in reducing mental health stigma. Am J Public Health 2013; 103:774–776
18.
Meltzer-Brody S, Tolleson-Rinehart S: Academic and community partnerships: telepsychiatry for perinatal depression in rural setting. Obstet Gynecol 2017; 129:49S–50S
19.
Kruper A, Wichman C: Integrated perinatal mental health care. Psychiatr Ann 2017; 47:368–373
20.
Grote NK, Simon GE, Russo J, et al: Incremental benefit-cost of MOMCare: collaborative care for perinatal depression among economically disadvantaged women. Psychiatr Serv 2017; 68:1164–1171
21.
Bhat A, Grote NK, Russo J, et al: Collaborative care for perinatal depression among socioeconomically disadvantaged women: adverse neonatal birth events and treatment response. Psychiatr Serv 2017; 68:17–24
22.
Ashford MT, Olander EK, Ayers S: Computer- or web-based interventions for perinatal mental health: a systematic review. J Affect Disord 2016; 197:134–146
23.
Santos IS, Tavares BF, Munhoz TN, et al: Patient Health Questionnaire-9 versus Edinburgh Postnatal Depression Scale in screening for major depressive episodes: a cross-sectional population-based study. BMC Res Notes 2016; 9:453
24.
Murray D, Cox JL: Screening for depression during pregnancy with the Edinburgh Depression Scale (EPDS). J Reprod Infant Psychol 1990; 8:99–107
25.
Low Birth Weight. Rockville, MD, Department of Health and Human Services, Health Resources and Services Administration, Maternal and Child Health Bureau, 2011. mchb.hrsa.gov/chusa11/hstat/hsi/pages/201lbw.html. Accessed Jan 10, 2019
26.
Field T, Diego M, Hernandez-Reif M: Prenatal depression effects on the fetus and newborn: a review. Infant Beh Dev 2006; 29:445–455
27.
Chang HY, Keyes KM, Lee KS, et al: Prenatal maternal depression is associated with low birth weight through shorter gestational age in term infants in Korea. Early Hum Dev 2014; 90:15–20
28.
Pope CJ, Mazmanian D: Breastfeeding and postpartum depression: an overview and methodological recommendations for future research. Depress Res Treat 2016; 2016:4765310
29.
Centers for Disease Control and Prevention: Emergency department visits by patients with mental health disorders—North Carolina, 2008–2010. MMWR Morb Mortal Wkly Rep 2013; 62:469–472
Information & Authors
Information
Published In
History
Received: 15 March 2019
Revision received: 27 September 2019
Accepted: 22 November 2019
Published online: 5 February 2020
Published in print: May 01, 2020
Authors
Funding Information
Rose Community Foundationhttp://dx.doi.org/10.13039/100001416: 20151177
This project and quality assurance evaluation were funded by Rose Community Foundation grant 20151177.Dr. Shore receives royalties from American Psychiatric Publishing and Springer Press. The other authors report no financial relationships with commercial interests.Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).