Skip to main content

Abstract

Objective:

Stepped mental health care requires a rapid method for nonspecialists to detect illness. This study aimed to develop and validate a brief instrument, the Mental Wellness Tool (mwTool), for identification and classification.

Methods:

Cross-sectional development and validation samples included adults at six health facilities in Mozambique. Mini International Neuropsychiatric Interview diagnoses were the criterion standard. Candidate items were from nine mental disorder and functioning assessments. Regression modeling and expert consultation determined best items for identifying any mental disorder and classifying positives into disorder categories (severe mental disorder, common mental disorder, substance use disorder, and suicide risk). For validation, sensitivity and specificity were calculated for any mental disorder (index and proxy respondents) and disorder categories (index).

Results:

From the development sample (911 participants, mean±SD age=32.0±11 years, 63% female), 13 items were selected—three with 0.83 sensitivity (95% confidence interval [CI]=0.79–0.86) for any mental disorder and 10 additional items classifying participants with a specificity that ranged from 0.72 (severe mental disorder) to 0.90 (suicide risk). For validation (453 participants, age 31±11 years, 65% female), sensitivity for any mental disorder was 0.94 (95% CI=0.89–0.97) with index responses and 0.73 (95% CI=0.58–0.85) with family proxy responses. Specificity for categories ranged from 0.47 (severe mental disorder) to 0.93 (suicide risk). Removing one item increased severe mental disorder specificity to 0.63 (95% CI=0.58–0.68).

Conclusions:

The mwTool performed well for identification of any mental disorder with index and proxy responses to three items and for classification into treatment categories with index responses to nine additional items.

HIGHLIGHTS

A 99-item battery of mental health measures was reduced to three items to identify individuals with a mental disorder; nine more items were used to classify mental disorder as severe, common, substance use, or suicide risk.
In a validation sample (N=450 adults), the three items had excellent (94%) sensitivity for identifying individuals with a mental disorder, and the additional nine items demonstrated acceptable to excellent specificity for classification of positives as severe mental disorder (63%), common mental disorder (72%), substance use disorder (82%), and moderate to high suicide risk (93%).
Proxy responses provided by family members to the three identification questions showed 73% sensitivity for a mental disorder of the index individual.
Mental and substance use disorders (henceforth “mental disorders”) are the largest contributor to global burden of disease (1), yet most people living with mental disorders in low- and middle-income countries (LMICs) do not have access to care because of scarce funding and human resources (2). A stepped-care approach, in which nonspecialists manage detection of mental disorders and provide treatment or referral to specialists, is an efficient method to close the treatment gap in LMICs (35).
In stepped care, only severe mental disorders require consultation with a mental health specialist, whereas nonsevere mental disorders can be managed by primary care providers and lay workers (6). Thus key to implementation and sustainability of comprehensive stepped-care management of mental disorders is a rapid, reliable method for minimally trained providers to identify presence and type of mental disorder. Many screening tools for mental disorder detection have been validated in high-income countries and LMICs (7). However, these tools, which have five to more than 20 items and sometimes have a cost per use, are designed to detect one disorder at a time (e.g., depression [8]) or symptoms common to some disorders (e.g., psychological distress [9]). Use of a combination of these screens for all mental disorders is unfeasible in low-resource health systems.
We aimed to develop and validate a brief questionnaire, the Mental Wellness Tool (mwTool), to screen for mental disorders and classify individuals into disorder categories that facilitate comprehensive stepped-care management of mental disorders. Through novel application of a variable selection technique (least absolute shrinkage and selection operator [LASSO]) (10), we sought to identify a small set of items, selected from widely validated screening measures for individual mental disorders, with high sensitivity for identification of any mental disorder and high specificity for classification of severe mental disorders, common mental disorders, substance use disorders, and suicide risk. In a separate validation sample, we assessed performance of the mwTool in identifying and classifying mental disorders. Specifically, we examined performance by using index responses as well as proxy responses, which facilitate epidemiological research and community-based care wherein interviewing all index cases is not feasible or possible.

Methods

Participants provided written informed consent as approved by the New York State Psychiatric Institute Institutional Review Board (no. 7479) and the Eduardo Mondlane University Institutional Health Bioethics Council (CIBS FM and HCM/54/2017). Study analyses and reporting follow the Standards for Reporting of Diagnostic Accuracy Studies (11).

Study Setting

Development data were collected at two primary care clinics and one hospital in Maputo City, Mozambique, from May 16 to June 8, 2018. These facilities provide primary care, emergency, and outpatient mental health services. The hospital also provides services for victims of interpersonal violence and inpatient general medical and psychiatric services. Validation data were collected from December 5 to 12, 2018, at three primary care clinics in Nampula, Mozambique. These facilities provide primary care and emergency services. People with mental disorders are referred to Nampula’s provincial psychiatric hospital.

Study Population

Adults (patients and accompaniers) in health facility waiting rooms were invited to participate. All volunteers were taken to a private area for eligibility assessments and informed consent. Potential participants were excluded if they were under age 18 or unable to sufficiently communicate in Portuguese, which was determined by asking potential participants to repeat study objectives in their own words. For the development sample, we planned to enroll ≥400 people with at least one psychiatric diagnosis and ≥400 without any psychiatric diagnosis to ensure ±5% margins of error for sensitivity and specificity estimates. For diversity of psychiatric diagnoses, we aimed to obtain ≥40 participants with balanced representation of males and females with each specific diagnosis (detailed below). For the validation sample, we aimed to obtain ≥40 gender-balanced index participants (those providing responses about their own mental health) with each specific diagnosis (described below), of whom ≥200 would provide proxy responses (regarding the mental health of another index participant with whom they were attending the health facility), allowing enough precision for ±7% margins of error for sensitivity and specificity.

Measures

For all instruments except the Psychosis Screening Questionnaire (PSQ) and Primary Care PTSD Screen (PC-PTSD), we used existing Brazilian or Portuguese translations, and local research team members made minor adjustments for the Mozambican context (e.g., local terms for substances). The PSQ and PC-PTSD were translated from English to Portuguese by the local research team, back-translated by a native English speaker fluent in Portuguese, and reviewed for translation accuracy by a measurement specialist at Columbia University (unassociated with this study). All measures were pretested while training interviewers (Mozambican mental health specialists) and underwent final review by means of cognitive interviews with 10 Mozambican adults attending primary care.

Mental disorder diagnosis and classification.

Mental disorder diagnoses were made with the Brazilian version of the Mini International Neuropsychiatric Interview (MINI) Plus (12, 13), a structured diagnostic interview that has been widely used as a reference standard across many contexts (7). Based on MINI diagnoses, we classified participants into the following four categories corresponding to different stepped-care pathways: severe mental disorder, for diagnoses of mania, psychosis, or the presence of psychotic symptoms associated with another disorder (e.g., depression); common mental disorder, for major depressive episode, panic disorder, posttraumatic stress disorder [PTSD], anxiety, or somatization; substance use disorder, for alcohol abuse or dependence or substance abuse or dependence; suicide risk if the respondent was scored as having moderate or high suicide risk (i.e., 6 points or higher, indicative of past-month active ideation, planning, and/or attempt). All diagnoses were for current disorders, except for psychosis, for which even lifetime diagnoses were considered, because patients with a history of psychosis require referral to specialists.

Mental health screening battery.

We administered nine structured instruments commonly used to screen for specific mental disorders and to assess functioning (Table 1) (8, 1421). (Details about the screening battery are provided in an online supplement to this article.)
TABLE 1. Measures in the mental health screening battery used to develop the Mental Wellness Tool
DisorderMeasureN items
Severe mental disorder: psychosis or maniaPsychosis Screening Questionnaire5a
Common mental disorder  
 DepressionPatient Health Questionnaire9
 AnxietyGeneralized Anxiety Disorder scale7
 Posttraumatic stress disorderPrimary Care PTSD Screen for DSM-55
 SomatizationSomatic Symptom Scale8
Substance use disorder  
 AlcoholAlcohol Use Disorder Identification Test10
 SubstancesAlcohol, Smoking and Substance Involvement Screening Test12b
Suicide riskColumbia–Suicide Severity Rating Scale7c
FunctioningWHO Disability Assessment Schedule 2.036
Total items 99
a
Items that lead to a positive screen and termination of the questionnaire.
b
Based on inclusion of six items regarding cannabis use and six regarding cocaine use in the past 3 months. No other substance use was reported in the sample.
c
Final question analyzed as two items, one assessing lifetime suicidal behavior and one assessing suicidal behavior in past 3 months.

Demographic and general health measures.

We collected self-reported sociodemographic information (age, gender, marital status, living situation, education, religion, monthly household income, occupation, and race-ethnicity) and health history (chronic diseases, pregnancy, and parity). For the validation sample, we recorded the relationship between index and proxy respondents.
Responses to all measures were recorded via tablet with the REDCap platform (22).

Procedures

In the development sample, research assistants administered the sociodemographic questionnaire and then the MINI and mental health screening battery in a randomized order. In the validation phase, a research assistant first administered the sociodemographic questionnaire. Then, for participants who were alone or with someone who was not eligible to participate in the study, the research assistant administered the mwTool followed by the MINI to assess the participant’s mental health (index response). For participants attending the facility with a companion who was also a participant, research assistants privately administered the items from the mwTool for identification of any mental disorder in regard to the companion’s mental health (proxy response) and then administered the complete mwTool and MINI to assess the participant’s own mental health (index response).

Statistical Analysis

We excluded from analysis participants with incomplete responses to the MINI, screening battery, or mwTool. Analyses were performed with R, version 3.6.1 (23); the glmnet package fit LASSO models (24).

mwTool development.

First, we sought to identify three to five items from the screening battery with high sensitivity for the presence of any mental disorder. Second, we sought to identify an additional six to 12 items that provided high specificity for classification into the four disorder categories, in order to minimize false positives for potentially stigmatizing disorders and undue burden on low-resource systems while maintaining adequate sensitivity. (All items considered for the mwTool are identified in the online supplement.) Ordinal responses were dichotomized for analyses; responses indicating moderate-to-high symptom strength and frequency were considered positive.
A series of LASSO logistic regressions was used to determine the best subset of battery items for presence of any mental disorder and subsequently for each disorder category. LASSO regression incorporates a penalty term based on the sum of the absolute values of all model coefficients. The effect of this term is that, at high levels of the shrinkage parameter (λ), coefficient estimates for less important variables shrink to zero and are removed from the model. This allows for variable selection at high levels of λ, which we varied to select the best three to 10 items for predicting each outcome. We confirmed that LASSO results included only items with positive coefficients (item presence associated with higher disorder risk). Area under the receiver operating characteristic curve described the accuracy of different best-item subsets. We then selected mwTool items, balancing statistical validity (i.e., empirically best combination of items based on LASSO), feasibility (i.e., fewer total items), and face validity (i.e., items reflecting diagnostic criteria for disorder categories).
Sensitivity and specificity of the mwTool for any mental disorder and for the four disorder categories were assessed in the development sample. Because treatment of severe mental disorders takes priority in stepped care when a person has both severe and common mental disorders, participants positive for both by the mwTool were classified as having a severe mental disorder and not a common mental disorder.

mwTool validation.

We calculated sensitivity and specificity of the mwTool for any mental disorder and for the four disorder categories by using index case responses. We also assessed sensitivity and specificity of mwTool questions for any mental disorder by using proxy responses. We excluded proxy responses when proxy and index respondents provided discordant information about their relationship.

Results

mwTool Development

Across the three Maputo sites, 1,033 people were screened for eligibility; seven (1%) were under age 18, and eight (1%) were not fluent in Portuguese. Twenty-nine (3%) of the 1,018 eligible persons did not provide informed consent. We excluded from analysis 78 (8%) participants who did not complete the MINI or screening battery (see online supplement). Among the 911 included participants, 570 (63%) were female, and the mean±SD age of the sample was 32.0±11.3 years. As shown in Table 2, over half (52%) had one or more disorders on the basis of MINI diagnoses: severe mental disorder, 29%; common mental disorder, 36%; substance use disorder, 14%; and suicide risk, 9%.
TABLE 2. Performance of the 13-item Mental Wellness Tool in identifying and classifying participants with mental disorders in the development sample (N=911)
DisorderN%Sensitivity95% CISpecificity95% CI
Any disordera47052.83.79–.86.49.44–.54
Severe mental disorder26029.62.55–.67.72.69–.76
 Psychosis23526.61.55–.68.71.67–.74
 Mania708.77.66–.86.66.63–.69
Common mental disorder33036.83.78–.87.79.76–.82
 Major depressive episode29833.84.80–.88.79.76–.83
 Panic disorder334.94.80–.99.78.76–.81
 Posttraumatic stress disorder495.90.78–.97.78.75–.81
 Anxiety657.91.81–.97.79.76–.82
 Somatization131.85.55–.98.79.76–.81
Substance use disorder12414.72.63–.79.82.79–.84
 Alcohol11513.73.64–.81.81.79–.84
 Substance222.64.41–.83.75.73–.78
Suicide risk869.80.70–.88.90.88–.92
 Medium293.83.64–.94.86.83–.88
 High576.79.66–.89.88.85–.90
a
Calculated on the basis of responses to the initial three items only.
In total, 13 screening battery items were selected for inclusion in the mwTool (see diagram in online supplement). (The three, five, eight, and 10 screening items that best classified any mental disorder and each of the disorder categories are detailed in the online supplement.) Twelve items were chosen from LASSO results. In consultation with expert clinicians and clinical researchers, one additional suicide item was added to capture individuals with recent attempts, a high-risk group that may lack ideation and thus would not be detected by the LASSO models’ best items (25).
A positive response to any of the first three mwTool items signals the interviewer to ask the next 10 items; a negative response to all three indicates absence of any mental disorder and signals screening completion. When the 10 additional items are asked, a positive response to any item associated with a disorder category indicates presence of that disorder category. Negative responses to all additional 10 items indicate that the person should be classified either as having a common mental disorder, if the person gave a positive response to item 2 of the patient Health Questionnaire or item 5 of the General Anxiety Disorder [GAD] scale), or as having no disorder, if the person gave a positive response only to item 1 of the GAD.
The first three mwTool items identified any mental disorder with 0.83 sensitivity and 0.49 specificity (Table 2), and performed similarly by gender, age, and HIV status (see online supplement). The 10 additional mwTool items classified severe mental disorder with 0.72 specificity, common mental disorder with 0.79 specificity, substance use disorder with 0.82 specificity, and suicide risk with 0.90 specificity (Table 2), with little variation across subpopulations (see online supplement). Sensitivity for the specific disorder categories was highest for common mental disorder (0.83) and lowest for severe mental disorder (0.62).

mwTool Validation and Final Item Selection

At Nampula sites, 482 people were screened for eligibility; two (<1%) were not fluent in Portuguese. Of the 480 participants, 243 (51%) provided proxy responses to the three initial mwTool items regarding another participant with whom they were attending the health facility. We excluded from analysis 27 (6%) participants who did not complete the MINI or all mwTool items (see online supplement). Among the 453 included participants, 296 (65%) were female, and the mean age of the sample was 31.1±10.7 years. MINI diagnoses indicated the presence of one or more disorders for 39% of participants (Table 3): severe mental disorder, 18%; common mental disorder, 30%; substance use disorder, 6%; and suicide risk, 8%.
TABLE 3. Performance of 13-item Mental Wellness Tool for index case respondents (N=453) and proxy respondents (N=243) in the validation sample
RespondentN%Sensitivity95% CISpecificity95% CI
Index      
 Any disordera17839.94.89–.97.34.28–.40
 Severe mental disorder8218.89.80–.95.47.42–.53
 Common mental disorder13430.96.91–.98.83.78–.87
 Substance use disorder296.86.68–.96.82.78–.86
 Suicide risk358.77.60–.90.93.90–.96
Proxy, any disordera      
 Family4848.73.58–.85.31.19–.45
 Nonfamily3734.62.45–.78.51.39–.63
a
Calculated on the basis of responses to the initial three items only.
Based on index responses, the first three items of the mwTool had 0.94 sensitivity for identification of any mental disorder (Table 3). The 10 classification items had a specificity of 0.47 for severe mental disorder, 0.83 for common mental disorder, 0.82 for substance use disorder, and 0.93 for suicide risk. Sensitivity for disorder categories ranged from 0.77 (suicide risk) to 0.96 (common mental disorder). Family proxy responses had higher sensitivity than did nonfamily responses (0.73 versus 0.62), although the difference was not significant (Table 3). For both family and nonfamily proxy responses that led to a positive screen on the mwTool, 83% of corresponding index responses also led to a positive screen.
Although the 13-item mwTool generally showed similar or higher sensitivity and specificity in the validation sample compared with the development sample, the specificity for severe mental disorder was considerably lower in the validation sample. Many participants whose screen was false positive for a severe mental disorder (N=58 of 195) had endorsed only the first of the additional classification items (item 7 of the GAD). Because this item assesses a symptom of anxiety, a common mental disorder, we next evaluated performance of the mwTool when this item was excluded. When this 12-item mwTool (see diagram in online supplement) was used, specificity of index responses for classification of severe mental disorder increased to an acceptable level (0.63), and specificity for common mental disorder (which the excluded item also was used to classify in the 13-item mwTool) was reduced but remained good (0.72) (Table 4). The 12-item mwTool performed similarly in subpopulations of the validation sample (see online supplement).
TABLE 4. Performance of the 12-item Mental Wellness Tool for index case respondents (N=453) and proxy respondents (N=243) in the validation sample
RespondentN%Sensitivity95% CISpecificity95% CI
Index      
 Any disordera17839.94.89–.97.34.28–.40
 Severe mental disorder8218.82.72–.89.63.58–.68
 Common mental disorder13430.93.87–.96.72.67–.77
 Substance use disorder296.86.68–.96.82.78–.86
 Suicide risk358.77.60–.90.93.90–.96
Proxy, any disordera      
 Family4848.73.58–.85.31.19–.45
 Nonfamily3734.62.45–.78.51.39–.63
a
Calculated on the basis of responses to the initial three items only.

Discussion

We employed the novel application of LASSO regression modeling, along with expert consultation, to select items from mental health screens that can identify and classify mental disorders. We designed a two-step instrument, the mwTool, in which the first three items are asked of all respondents, and only those who are identified by these items as positive for any mental disorder are asked the additional items for classification into disorder categories.
Brevity of screening instruments reduces provider burden and, in turn, promotes adoption in primary care and community settings (26). Additionally, previous research has shown that screens with fewer items are as accurate as those with more items for detection of individual disorders in both high-income countries and LMICs (2729). Other analytical techniques, such as item response theory, have been successfully used to shorten screens for common mental and substance use disorders in LMICs (3032), although no brief instrument exists that provides transdiagnostic mental health assessment. With the LASSO variable selection technique, we reduced 99 items from nine instruments for eight different mental disorders to 12 items—or just 12% of the combined screens’ length—that had acceptable-to-excellent sensitivity and specificity for all disorder categories.
Proxy respondents are common in clinical care and epidemiological research when the index individual is unable to self-report, either because the person is unavailable, incapable of providing responses, or underage. However, evaluation of proxy responses on other assessment tools has shown them to be less reliable for questions about subjective experiences, such as emotions and psychological distress, than for objective experiences (33). Our results showed that the first three items of the mwTool had good sensitivity for identification of any mental disorder when proxy responses from family members were used. Proxy responses from nonfamily did not perform as well as family proxy responses, in line with previous research showing that friends and health care proxy respondents have lower agreement and reliability, compared with family proxies (33). Future studies are needed to determine in more detail what specific characteristics of family members—such as cohabitation or relation to the index individual—promote reliability of proxy responses on the mwTool.
Throughout mwTool development and validation, severe mental disorder was the lowest-performing disorder category. In tool development, five more questions had to be included for adequate classification of severe mental disorder, and sensitivity of the mwTool for severe mental disorder was lower than for any other disorder category. This is unsurprising, because measures for severe mental disorders have routinely been found to have lower performance than for other mental disorders (34). However, in the validation sample, by removing one question we were able to increase specificity to an acceptable level. Therefore, we recommend use of the 12-item mwTool in future assessments.
This study had several limitations. Participants in both the development and the validation samples were recruited from health clinics, and our findings may not be generalizable to other settings. Additionally, because no other published data exist on the prevalence of mental disorders in Mozambican health care settings and we cannot be certain that our data are representative, we did not calculate the positive predictive value or negative predictive value of the mwTool. However, the mwTool did not perform differently by age, gender, and HIV status subgroups. Because we assessed the mwTool in one low-income country and one language, its validity in other settings should be assessed. Moreover, owing to post hoc elimination of GAD item 7 from the 13-item mwTool assessed in the validation sample, the 12-item mwTool requires further validation in an independent sample. Finally, the population in our setting had low rates of substance use, and most substance users also used alcohol; therefore, the mwTool includes questions related only to alcohol use. In other settings, it may be necessary to add items for substance use and calibrate dichotomization of the measure according to contextual substance use patterns.

Conclusions

To our knowledge, the mwTool is the first brief screen for nonspecialist assessment of common mental disorders, severe mental disorders, substance use disorders, and suicide risk. The mwTool performed well for identification of any mental disorder when index and proxy responses to three items were used and for classification of positives into treatment categories when index responses to an additional nine items were used. Although developed in LMIC primary care, the mwTool may have applicability in multiple settings, such as community-based care, emergency situations, and population-based assessments, but further research is required to assess its performance in these settings.

Acknowledgments

The authors thank the Mozambican Ministry of Health, National Directorate of Public Health, Maputo City Health Department, Nampula Province Health Department, and research assistants for facilitating data collection and all study participants for their contribution to this work.

Supplementary Material

File (appi.ps.202000504.ds001.pdf)

References

1.
Whiteford HA, Degenhardt L, Rehm J, et al: Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. Lancet 2013; 382:1575–1586
2.
Saraceno B, van Ommeren M, Batniji R, et al: Barriers to improvement of mental health services in low-income and middle-income countries. Lancet 2007; 370:1164–1174
3.
Kakuma R, Minas H, van Ginneken N, et al: Human resources for mental health care: current situation and strategies for action. Lancet 2011; 378:1654–1663
4.
Kohrt BA, Asher L, Bhardwaj A, et al: The role of communities in mental health care in low- and middle-income countries: a meta-review of components and competencies. Int J Environ Res Public Health 2018; 15:1279
5.
Patel V, Chisholm D, Parikh R, et al: Addressing the burden of mental, neurological, and substance use disorders: key messages from Disease Control Priorities, 3rd edition. Lancet 2016; 387:1672–1685
6.
mhGAP Intervention Guide, Version 2.0. Geneva, World Health Organization, 2018
7.
Ali GC, Ryan G, De Silva MJ: Validated screening tools for common mental disorders in low and middle income countries: a systematic review. PLoS One 2016; 11:e0156939
8.
Kroenke K, Spitzer RL: The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann 2002; 32:509–515
9.
Kessler RC, Andrews G, Colpe LJ, et al: Short screening scales to monitor population prevalences and trends in non-specific psychological distress. Psychol Med 2002; 32:959–976
10.
Tibshirani R: Regression shrinkage and selection via the lasso. J R Stat Soc B 1996; 58:267–288
11.
Bossuyt PM, Reitsma JB, Bruns DE, et al: STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Radiology 2015; 277:826–832
12.
Amorim P: Mini International Neuropsychiatric Interview (MINI): validation of a short structured diagnostic psychiatric interview [in Portuguese]. Br J Psychiatry 2000; 22:106–115
13.
Sheehan DV, Lecrubier Y, Sheehan KH, et al: The Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998; 59(suppl 20):22–33
14.
Babor TF, de la Fuente JR, Saunders J, et al: AUDIT: The Alcohol Use Disorders Identification Test: guidelines for use in primary health care. Geneva, World Health Organization, 2001. https://www.who.int/publications/i/item/audit-the-alcohol-use-disorders-identification-test-guidelines-for-use-in-primary-health-care
15.
Bebbington P, Nayani T: The Psychosis Screening Questionnaire. Int J Methods Psychiatr Res 1995; 5:11–19
16.
Gierk B, Kohlmann S, Kroenke K, et al: The Somatic Symptom Scale–8 (SSS-8): a brief measure of somatic symptom burden. JAMA Intern Med 2014; 174:399–407
17.
WHO ASSIST Working Group: The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST): development, reliability and feasibility. Addiction 2002; 97:1183–1194
18.
Posner K, Brown GK, Stanley B, et al: The Columbia–Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry 2011; 168:1266–1277
19.
Prins A, Bovin MJ, Smolenski DJ, et al: The Primary Care PTSD screen for DSM-5 (PC-PTSD-5): development and evaluation within a veteran primary care sample. J Gen Intern Med 2016; 31:1206–1211
20.
Spitzer RL, Kroenke K, Williams JB, et al: A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006; 166:1092–1097
21.
Üstün TB, Kostanjsek N, Chatterji S, et al: Measuring Health and Disability: Manual for WHO Disability Assessment Schedule (WHODAS 2.0). Geneva, World Health Organization, 2010
22.
Harris PA, Taylor R, Thielke R, et al: Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009; 42:377–381
23.
R: A Language and Environment for Statistical Computing. Vienna, R Foundation, 2013. https://www.gbif.org/tool/81287/r-a-language-and-environment-for-statistical-computing
24.
Friedman J, Hastie T, Tibshirani R: Regularization paths for generalized linear models via coordinate descent. J Stat Softw 2010; 33:1–22
25.
Rimkeviciene J, O’Gorman J, De Leo D: Impulsive suicide attempts: a systematic literature review of definitions, characteristics and risk factors. J Affect Disord 2015; 171:93–104
26.
Johnson M, Jackson R, Guillaume L, et al: Barriers and facilitators to implementing screening and brief intervention for alcohol misuse: a systematic review of qualitative evidence. J Public Health 2011; 33:412–421
27.
Akena D, Joska J, Obuku EA, et al: Comparing the accuracy of brief versus long depression screening instruments which have been validated in low and middle income countries: a systematic review. BMC Psychiatry 2012; 12:187
28.
Choi SK, Boyle E, Burchell AN, et al: Validation of six short and ultra-short screening instruments for depression for people living with HIV in Ontario: results from the Ontario HIV Treatment Network Cohort Study. PLoS One 2015; 10:e0142706
29.
Mitchell AJ, Coyne JC: Do ultra-short screening instruments accurately detect depression in primary care? A pooled analysis and meta-analysis of 22 studies. Br J Gen Pract 2007; 57:144–151
30.
Betancourt TS, Yang F, Bolton P, et al: Developing an African youth psychosocial assessment: an application of item response theory. Int J Methods Psychiatr Res 2014; 23:142–160
31.
Doty SB, Haroz EE, Singh NS, et al: Adaptation and testing of an assessment for mental health and alcohol use problems among conflict-affected adults in Ukraine. Confl Health 2018; 12:34
32.
Haroz EE, Kane JC, Nguyen AJ, et al: When less is more: reducing redundancy in mental health and psychosocial instruments using Item Response Theory. Glob Ment Health 2020; 7:e3
33.
Andresen EM, Vahle VJ, Lollar D: Proxy reliability: health-related quality of life (HRQoL) measures for people with disability. Qual Life Res 2001; 10:609–619
34.
Eaton WW, Hall AL, Macdonald R, et al: Case identification in psychiatric epidemiology: a review. Int Rev Psychiatry 2007; 19:497–507

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services
Psychiatric Services
Pages: 891 - 897
PubMed: 33993717

History

Received: 3 July 2020
Revision received: 13 October 2020
Accepted: 5 November 2020
Published online: 17 May 2021
Published in print: August 01, 2021

Keywords

  1. Stepped care
  2. Diagnosis/classification (DSM)
  3. task-shifting
  4. low-resource
  5. screening

Authors

Details

Kathryn L. Lovero, Ph.D. [email protected]
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Cale Basaraba, M.P.H.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Saida Khan, M.A.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Antonio Suleman, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Dirceu Mabunda, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Paulino Feliciano, B.S.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Palmira dos Santos, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Wilza Fumo, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Flavio Mandlate, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
M. Claire Greene, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Andre Fiks Salem, B.S.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Jennifer J. Mootz, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Ana Olga Mocumbi, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Cristiane S. Duarte, Ph.D., M.P.H.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Lidia Gouveia, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Maria A. Oquendo, M.D., Ph.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Melanie M. Wall, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).
Milton L. Wainberg, M.D.
Department of Psychiatry, New York State Psychiatric Institute and Columbia University Vagelos College of Physicians and Surgeons, New York City (Lovero, Basaraba, Greene, Fiks Salem, Mootz, Duarte, Wall, Wainberg); Department of Biostatistics, Columbia University Mailman School of Public Health, New York City (Basaraba, Wall); Health Directorate of Maputo City, Ministry of Health, Maputo, Mozambique (Khan, Mabunda); Universidade Eduardo Mondlane School of Medicine, Maputo, Mozambique (Khan, Mabunda, dos Santos, Fumo, Mandlate, Mocumbi, Gouveia); Health Directorate of Nampula Province, Ministry of Health, Nampula, Mozambique (Suleman, Feliciano); Nampula Psychiatric Hospital, Nampula, Mozambique (Suleman, Feliciano); Department of Mental Health, Ministry of Health, Maputo, Mozambique (dos Santos, Fumo, Mandlate, Gouveia); National Institutes of Health, Marracuene, Mozambique (Mocumbi); Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia (Oquendo).

Notes

Send correspondence to Dr. Lovero ([email protected]).

Funding Information

This study was supported by National Institute of Mental Health grants U19MH113203, T32MH096724, and K01MH120258; Fogarty International Center grant D43TW009675; and National Institute of Alcohol Abuse and Alcoholism grant R01AA025947.Dr. Oquendo reports receipt of royalties from the Research Foundation for Mental Hygiene; ownership of shares in Mantra, Inc.; and service as an advisor to Alkermes and Otsuka. She reports that her family owns stock in Bristol Myers Squibb. The other authors report no financial relationships with commercial interests.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share