Full access
Articles
Published Online: 14 February 2016

Screening for and Diagnosis of Depression Among Adolescents in a Large Health Maintenance Organization

R. Eric Lewandowski, Ph.D., Briannon O’Connor, Ph.D., Andrew Bertagnolli, Ph.D., Arne Beck, Ph.D., Aldo Tinoco, M.D., William P. Gardner, Ph.D., Christine X. Jelinek-Berents, M.D., … Show All … , Douglas A. Newton, M.D., Kris F. Wain, B.S., Jennifer M. Boggs, M.S.W., Nancy E. Brace, R.N., Patricia deSa, M.S., Sarah Hudson Scholle, Dr.P.H., Kimberly Hoagwood, Ph.D., and Sarah McCue Horwitz, Ph.D.Authors Info & Affiliations
Publication: Psychiatric Services
Volume 67, Number 6
https://doi.org/10.1176/appi.ps.201400465
Track CitationsAdd to favorites
PDF/EPUB

Abstract

Objective:

The aim of this analysis was to determine changes in patterns of depression screening and diagnosis over three years in primary and specialty mental health care in a large health maintenance organization (HMO) as part of a project to develop quality measures for adolescent depression treatment.

Methods:

Two series of aggregate data (2010–2012) were gathered from the electronic health records of the HMO for 44,342 unique adolescents (ages 12 to 21) who had visits in primary and mental health care. Chi square tests assessed the significance of changes in frequency and departmental location of Patient Health Questionnaire–9 (PHQ-9) administration, incidence of depression symptoms, and depression diagnoses.

Results:

There was a significant increase in PHQ-9 use, predominantly in primary care, consistent with internally generated organizational recommendations to increase screening with the PHQ-9. The increase in PHQ-9 use led to an increase in depression diagnoses in primary care and a shift in the location of some diagnoses from specialty mental health care to primary care. The increase in PHQ-9 use was also linked to a decrease in the proportion of positive PHQ-9 results that led to formal depression diagnoses.

Conclusions:

The rate of depression screening in primary care increased over the study period. This increase corresponded to an increase in the number of depression diagnoses made in primary care and a shift in the location in which depression diagnoses were made, from the mental health department to primary care. The frequency of positive PHQ-9 administrations not associated with depression diagnoses also increased.
Depression affects 12% to 25% of adolescents (1,2) and is associated with a range of negative academic, social, and health outcomes (3–6). Despite the high burden of depression and the availability of effective treatments, approximately 60% to 80% of affected adolescents do not receive appropriate care (7–9). Pediatric primary care is an important site for the identification of depression among adolescents, the critical first step in connecting youths to treatment (10,11). However, depression remains poorly identified in this setting (12–15). There is consensus among professional organizations and experts in pediatrics and psychiatry to recommend routine screening of adolescents for depression to improve case identification, although available evidence suggests that screening coverage is very low (16–18).
Quality measurement is an increasingly prominent approach for improving care, whereby providers and organizations are incentivized to adhere to essential health care practices (19–22). The U.S. Preventive Services Task Force (USPSTF) and other major practice guidelines have recommended depression screening in primary care (12,15). Screening for depression in primary care has featured prominently in efforts to improve depression care, including national initiatives to develop quality measures (12,15). For example, the Centers for Medicare and Medicaid Services (CMS) included depression screening and follow-up for adolescents and adults as a quality measure in its electronic health record (EHR) incentive program, which encourages “meaningful” use of EHRs. Similarly, the National Collaborative for Innovation in Quality Measurement (NCINQ), one of seven centers of excellence funded by the Agency for Healthcare Research and Quality and CMS Pediatric Quality Measures Program, developed a suite of potential quality measures organized around a care pathway for managing adolescent depression in primary care. The first step in the pathway, and the first potential quality measure, is screening for depression (22).
The objective of this study was to partner with a large health maintenance organization (HMO) to further examine the use of depression screening as a quality measure. In the study, NCINQ partnered with the HMO to study changing patterns of depression screening over time. USPSTF has also specifically highlighted the need for research linking screening to improved identification of depression cases (16). Therefore, this study also assessed the diagnosis of depression following screening, which NCINQ included as the second potential measure in the care pathway. Examination of large-scale, naturalistic data on screening and diagnosis will help to identify gaps in essential care practices related to identification of depression and provide an indication of the fit and possible value of depression quality measures in the context of current practice.

Methods

Setting and Data Sources

Data for adolescents who met inclusion criteria were abstracted from the EHR of a large HMO. The identity of the HMO has been masked by agreement with the organization. The Chesapeake Institutional Review Board determined that this study was not human subjects research because only deidentified, aggregated data were collected. Starting in 2011, the HMO began to implement the adolescent version of the Patient Health Questionnaire–9 (PHQ-9) as a screening tool in primary care (23,24). Previously, the PHQ-9 was used primarily in the mental health department for diagnostic support and monitoring of patients with a known diagnosis of depression. Computer-programmed extraction of aggregate data for this study was conducted during May 29–31, 2013.

Measures

PHQ-9-Modified.

The PHQ-9 is a nine-item self-report questionnaire that assesses depression symptoms and severity and that has been validated with adolescents (23,24). Items based on DSM-IV criteria for depression are rated on a 4-point scale ranging from 0 (not at all) to 3 (nearly every day). The PHQ-9-Modified includes minimal adjustments to the original PHQ-9 to incorporate characteristics of depression among adolescents and age-appropriate language. Specifically, it includes irritability in the item assessing depressed mood and includes weight loss in the item assessing appetite. No psychometric data are available for the PHQ-9-Modified, but because it is identical to the PHQ-9 other than the described adjustments, its developers have indicated that using PHQ-9 cutoffs is appropriate. Throughout this article, “PHQ-9” is used to indicate the PHQ-9-Modified.
Consistent with research literature and practices within the HMO, a PHQ-9 score of 11 or greater indicated a positive screen (24). We wanted to identify instances in which the PHQ-9 was used to detect depression rather than as a way to track symptoms among individuals who were being treated for depression. Therefore, we identified positive PHQ-9 scores that were preceded by a period of six months with no record of depression diagnosis or an order for antidepressant medication. A PHQ-9 result that met these criteria was termed an “incident positive PHQ-9” and was taken to represent the identification of new depression symptoms. The six-month depression-free period preceding a positive PHQ-9 began 14 days prior to the PHQ-9 chart entry date to allow for institutional lag time between PHQ-9 administration and upload into the EHR.

Depression diagnosis.

Depression diagnoses in this study included ICD-9 codes for major depressive affective disorder, depressive-type psychosis, depressive disorder not otherwise specified, and adjustment disorder with depressed mood, with mixed anxiety and depressed mood, or with mixed disturbance of emotions and conduct (25).

Study Group

For three years (2010, 2011, and 2012), adolescents were included in the study sample if they were between the ages of 12 and 21 on December 31 of the previous year and if their EHR contained documentation of at least one face-to-face visit with a provider. Adolescents may have had multiple visits and multiple PHQ-9 results in a given calendar year, but they were counted only once. Information was also collected on the department in which the PHQ-9 was administered; if an adolescent received more than one PHQ-9 in a given calendar year, the adolescent was counted in the department where the first PHQ-9 was given. Adolescents over age 18 were seen in adult primary care settings. Because work flows for pediatric and adult clinical services may differ, these results are presented separately.

Procedures

For each calendar year (2010, 2011, and 2012), the HMO created two series of patient data summaries. The first series focused on patterns of PHQ-9 use and depression diagnoses associated with PHQ-9 results. The steps were as follows: identify all unique adolescents who were administered the PHQ-9; identify those whose PHQ-9 score was above the clinical cutoff; within this group, identify all adolescents with an incident positive PHQ-9; and identify how many unique adolescents with an incident positive PHQ-9 had subsequent new diagnoses of depression.
The second series of patient data summaries provided context for the first series by comparing the number of depression diagnoses associated with PHQ-9 results against the total number of depression diagnoses made at the HMO in selected departments. The steps were to identify all unique adolescents with a diagnosis of depression in each calendar year and within this group, identify all those with a depression diagnosis associated with an incident positive PHQ-9.
Chi square tests assessed the significance of changes in patterns of PHQ-9 use, frequency of positive PHQ-9 results, incident positive PHQ-9 results, and diagnosis of depression following incident positive PHQ-9 results.

Results

Use of the PHQ-9 in Primary Care

The number of PHQ-9 administrations by department changed significantly from 2010 to 2012 (p<.001) (Table 1). Across all departments, the proportion of unique adolescents who had at least one PHQ-9 almost doubled. From 2010 to 2012, the number of unique adolescents who received a PHQ-9 increased 14-fold in pediatric primary care and almost threefold in adult primary care. The number of adolescents who received a PHQ-9 from the mental health department decreased from 2010 to 2012.
TABLE 1. Administration of the Patient Health Questionnaire–9 (PHQ-9) and depression diagnoses among unique adolescent patients with face-to-face visits in 2010–2012, by department
 2010 (N=44,342)2011 (N=44,490)2012 (N=43,341)
VariableNTotal Na%NTotal Na%NTotal Na%χ2dfp
Administered PHQ-9         1,514.742<.001b
 Pediatric primary care162—nac890—nac2,283—nac   
 Adult primary care158—nac288—nac419—nac   
 Mental health2,079—nac2,037—nac1,883—nac   
 All departments2,399—53,215—74,585—11   
Positive PHQ-9            
 Pediatric primary care911625619689022435228319122.972<.001
 Adult primary care1141587218528864280419672.892.235
 Mental health1,0572,079511,0062,037499971,883525.002.082
 All departments1,2622,3995313873,215431,7124,58537150.232<.001
Incident positive PHQ-9d            
 Pediatric primary care79918717319688370435851.202.548
 Adult primary care1001148815518584235280841.042.593
 Mental health6081,057586071,00660557997564.202.122
 All departments7871,262629351,387671,1621,7126811.342.003
Depression diagnosis            
 Pediatric primary care43795485173491343703613.692.001
 Adult primary care2210022371552458/23525.282.871
 Mental health2446084026660744226557412.012.366
 All departments30978739388935424181162366.832.032
a
For adolescents with a positive PHQ-9, the total N is the number of adolescents who were administered the PHQ-9 in the same department; for adolescents with an incident positive PHQ-9, the total N is adolescents with a positive PHQ-9 in the same department; and for adolescents with a diagnosis of depression, the total N is adolescents with an incident positive PHQ-9 in the same department.
b
Model χ2 test; does not include “all departments”.
c
It was not possible to determine the total number of unique patients in each department because many adolescents had visits in more than one department but could be counted in only one. If adolescents had a visit in primary care and mental health in the same year, they were counted in primary care.
d
A positive PHQ-9 score that was preceded by a period of six months with no record of depression diagnosis or an order for antidepressant medication.
From 2010 to 2012, there was an increase in positive PHQ-9 results in pediatric primary care. Although the absolute number of positive PHQ-9 results in that setting increased nearly fivefold, the proportion of PHQs that were positive decreased significantly (p<.001) (Table 1).
From 2010 to 2012, the number of incident positive PHQ-9s in pediatric primary care increased over four times. However, the proportion of positive PHQ-9 results in that setting that indicated possible new cases of depression changed very little (Table 1). In adult primary care, the number of incident positive PHQ-9s doubled from 2010 to 2012 but, similarly, did not change significantly as a proportion of all positive PHQ-9 results. There was also no significant change from 2010 to 2012 in the number of incident positive PHQ-9s as a proportion of all positive PHQ-9 results for the mental health department.
In pediatric primary care, the proportion of adolescents with incident positive PHQ-9s who went on to receive a depression diagnosis decreased significantly from 2010 to 2012 (p=.001) (Table 1). There was no significant change in this proportion for adult primary care or for the mental health department.

Depression Diagnosis and Case Identification

Although the proportion of unique adolescents with a depression diagnosis summed across all departments was unchanged from 2010 to 2012, there was a significant change in the number of depression diagnoses made within departments (p<.001) (Table 2). From 2010 to 2012, the number of unique adolescents with a depression diagnosis increased by almost 40% in pediatric primary care (from 304 to 422 adolescents) and by almost 25% in adult primary care (from 179 to 222), while decreasing by 13% in the mental health department (from 917 to 796).
TABLE 2. Diagnosis of depression among unique adolescent patients with face-to-face visits in 2010–2012, by department
 2010 (N=44,342)2011 (N=44,490)2012 (N=43,341)
VariableNTotal Na%NTotal Na%NTotal Na%χ2dfp
Depression diagnosis         34.352<.001b
 Pediatric primary care304—nac316—nac422—nac   
 Adult primary care179—nac172—nac222—nac   
 Mental health917—nac824—nac796—nac   
 All departments1,400 31,312 31,440 3   
Incident positive PHQ-9d            
 Pediatric primary care433041485316271344223229.852.001
 Adult primary care22179123717222592222712.492.002
 Mental health2449172626682432226796287.002.030
 All departments3091,400223881,312304191,4402924.912.001
a
Patients in the same department with a depression diagnosis.
b
Model χ2 test; does not include “all departments”.
c
It was not possible to determine the total number of unique patients in each department because many adolescents had visits in more than one department but could be counted in only one. If adolescents had a visit in primary care and mental health in the same year, they were counted in primary care.
d
A positive Patient Health Questionnaire–9 (PHQ-9)score that was preceded by a period of six months with no record of depression diagnosis or an order for antidepressant medication.
The proportion of adolescents with a depression diagnosis in pediatric primary care who had an incident positive PHQ-9 increased from 2010 to 2012 (p=.001). Similarly, in adult primary care, there was a significant increase from 2010 to 2012 in the proportion of depression diagnoses associated with an incident positive PHQ-9 (p=.002). In the mental health department, there was a significant change between 2010 and 2012 in the proportion of depression diagnoses associated with an incident positive PHQ-9 (p=.030).

Discussion

This study assessed changing patterns of adolescent depression screening and diagnosis in a large HMO to inform the development and adjustment of quality measures. These data also make a novel contribution to the scant evidence about screening and depression diagnosis in primary care in general. In line with an organizational recommendation to screen for depression among adolescents, screening at the HMO increased over three years, predominantly in primary care. The increase in screening led to a corresponding increase in depression diagnoses made in primary care and a shift in the location of many diagnoses from the mental health department to primary care. The increase in screening also led to a decrease in the proportion of positive screening results that resulted in depression diagnoses.
We speculate that the increase in screening occurred predominantly in primary care because although the HMO recommended screening of adolescents for depression organizationwide, the emphasis of the recommendation was on pediatric primary care. The recommendation was also less likely to have an impact on the mental health department, where providers were already in the practice of using the PHQ-9 for symptom identification and diagnostic support, most likely in the context of a depression complaint.
The finding that increased depression screening in primary care led to increased depression diagnosis in primary care, while intuitive, has little prior empirical support. Reflecting the lack of such evidence, the USPSTF has advocated precisely for research linking increased depression screening of adolescents with increased case identification (17). One large cross-sectional study of mental health screening of adolescents estimated national depression screening rates but did not provide data on results of the screening or on depression diagnoses made subsequent to the screening (18). This study also relied on provider self-report of screening practices rather than a review of the EHRs, as was the case in this study.
Another large study, which was based on Massachusetts Medicaid claims data, found that a state mandate and incentive to conduct behavioral health screening with children in primary care led to large increases in administered screens over a one-year period and an increase in behavioral health assessments over the same period, although it was not possible to link these changes given that they came from different data sets (26). Depression screening in the Massachusetts study employed the PHQ-9 but only among older adolescents (ages 18 to 20), a much narrower age range compared with the age range in this study (ages 12 to 21). This study is the first published report of which we are aware to present naturalistic data on a large-scale implementation of adolescent depression screening in primary care and the first to link changes in screening practices over time to changes in frequency of depression diagnoses.
We also aimed to gauge the possible fit and utility of quality measures outlined in the NCINQ depression care pathway in a real-world practice setting, given current patterns in depression case identification and management. We speculate from the findings that the first two measures in the care pathway (screening and diagnostic assessment) are well situated to facilitate important changes in care and to contribute to improved identification of depression. This study provides encouraging evidence of providers’ willingness to adopt screening on the basis of organizational recommendations. This, again, is an intuitive—yet important—finding, in light of studies demonstrating challenges in screening uptake and adoption (26,27).
Nevertheless, despite the dramatic increase in the rate of screening from 2010 to 2012, coverage remained at only 11% of the adolescent population by 2012. The Massachusetts Medicaid claims study, which reported a screening rate of 50% after providers were incentivized to adhere to state-mandated practices, suggests that greater increases in screening may be obtained with an official mandate and incentive, such as a quality measure for screening.
We also speculate that a quality measure to mandate timely follow-up after a positive screening result could further improve case identification. In this study, the increase in depression screening in primary care resulted in a decrease in the proportion of incident positive PHQ-9s that led to confirmed depression diagnoses. We suggest some hypotheses to account for this result. Given the positive predictive value of the PHQ-9 for adolescents in primary care (15.2%) (24), it is likely that many positive results from PHQ-9 screening simply were not true cases of depression, possibly representing transient mood symptoms, and primary care providers were correct in not making depression diagnoses. However, increased use of the PHQ-9 as a screening tool in primary care may also lead to more frequent identification of consistent mild symptoms that are more difficult to diagnose confidently as depression. Considering that pediatricians may not feel confident in their ability to diagnose depression (27), the lack of diagnosis following positive PHQ-9 results may reflect difficulty or reluctance to make a diagnosis when one is warranted.
It is also possible that incident positive PHQ-9 results that did not lead to confirmed depression diagnoses represented true-positive cases of depression that did not receive a follow-up assessment to confirm the diagnosis. The possibility that case identification in primary care may be impeded by reluctance or low diagnostic confidence among primary care providers or by bottlenecks or barriers to further assessment highlights the need, as USPSTF recommends, to establish systems for accessing mental health supports to ensure accurate diagnosis and appropriate follow-up before initiating screening. A quality measure mandating and incentivizing the essential practice of confirming a depression diagnosis within a specified time after a positive screen could serve to facilitate changes to provider behavior and to organizational structure or work flow to ensure that these supports are available and accessed.
The HMO that served as a partner in this study is an example of a health system that has taken steps to meet the growing need to make mental health supports accessible in primary care. Many practices and organizations will not have the ability to provide such support internally and may instead partner with other organizations to establish the necessary mental health assessment and referral support. Other important challenges with screening, such as increasing the acceptability of screening to families and training providers in administration, scoring, and postscreening clinical decision making, must be addressed to ensure optimal functioning of screening initiatives (28). Further discussion of these factors is beyond the scope of this article.
This study had several limitations. Because data were aggregated and anonymous, it was not possible to ascertain PHQ-9 results and depression diagnoses for individual adolescents after the initial clinical visit. Future efforts should track individual patients through this process and beyond to assess additional factors associated with care quality, including whether a referral was made to specialty mental health services, whether psychotherapy was provided, and whether an antidepressant was ordered.
Because this study was conducted in a single setting, it is possible that the demonstrated impact of increased depression screening may not generalize to other practice settings with different clinical work flows and different administrative or organizational structures or policies. We speculate, nevertheless, that increased screening in primary care will lead to increases in identification of depression symptoms in other primary care settings. There may be, however, differences between settings in how these newly identified symptoms translate into depression diagnoses because of differences in provider training and experience, clinical work flow and resources, and organizational structure and policies. Each organization that implements screening is likely to face unique changes in clinical work flow and challenges in ensuring appropriate follow-up for youths who screen positive for depression.

Conclusions

This study aimed to assess patterns of depression screening and diagnosis in a large HMO to gauge the appropriateness and possible value of quality measures in the context of current practice. The data indicate that screening increased over time in accordance with organizational recommendations, although coverage remained very low. Increased screening in primary care led to an increase in confirmed depression diagnoses in primary care and a commensurate decrease in diagnoses made in specialty mental health care. Many adolescents who screened positive during the study period were not diagnosed as having depression, suggesting the importance of assessment to confirm diagnosis. Quality measures mandating depression screening and timely diagnostic confirmation may improve screening coverage and identification of depression. Given that effective and timely care for depression requires prompt treatment enrollment and management, we must develop quality measures that cover complete care pathways for children and adolescents with mental health conditions.

Footnote

The content is the responsibility of the authors and does not necessarily represent the official views of AHRQ.

References

1.
Merikangas KR, He JP, Burstein M, et al: Lifetime prevalence of mental disorders in US adolescents: results from the National Comorbidity Survey Replication—Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry 49:980–989, 2010
Crossref
PubMed
Google Scholar
2.
Lewinsohn PM, Hops H, Roberts RE, et al: Adolescent psychopathology: I. prevalence and incidence of depression and other DSM-III disorders in high school students. Journal of Abnormal Psychology 102:133–144, 1993
Google Scholar
3.
Kessler RC, Berglund P, Demler O, et al: The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R). JAMA 289:3095–3105, 2003
Crossref
PubMed
Google Scholar
4.
Shaffer D, Gould MS, Fisher P, et al: Psychiatric diagnosis in child and adolescent suicide. Archives of General Psychiatry 53:339–348, 1996
Crossref
PubMed
Google Scholar
5.
Brent DA, Baugher M, Bridge J, et al: Age- and sex-related risk factors for adolescent suicide. Journal of the American Academy of Child and Adolescent Psychiatry 38:1497–1505, 1999
Crossref
PubMed
Google Scholar
6.
Mandell DS, Guevara JP, Rostain AL, et al: Medical expenditures among children with psychiatric disorders in a Medicaid population. Psychiatric Services 54:465–467, 2003
Crossref
PubMed
Google Scholar
7.
Results From the 2012 National Survey on Drug Use and Health: Mental Health Findings. NSDUH series H-47, HHS pub no SMA 13-4805. Rockville, Md, Substance Abuse and Mental Health Services Administration, 2013
Google Scholar
8.
Merikangas KR, He JP, Burstein M, et al: Service utilization for lifetime mental disorders in US adolescents: results of the National Comorbidity Survey-Adolescent Supplement (NCS-A). Journal of the American Academy of Child and Adolescent Psychiatry 50:32–45, 2011
Crossref
PubMed
Google Scholar
9.
Kataoka SH, Zhang L, Wells KB: Unmet need for mental health care among US children: variation by ethnicity and insurance status. American Journal of Psychiatry 159:1548–1555, 2002
Crossref
PubMed
Google Scholar
10.
Horwitz SM, Kelleher K, Boyce T, et al: Barriers to health care research for children and youth with psychosocial problems. JAMA 288:1508–1512, 2002
Crossref
PubMed
Google Scholar
11.
Horwitz SM, Leaf PJ, Leventhal JM, et al: Identification and management of psychosocial and developmental problems in community-based, primary care pediatric practices. Pediatrics 89:480–485, 1992
PubMed
Google Scholar
12.
Screening and Treatment for Major Depressive Disorder in Children and Adolescents: US Preventive Services Task Force Recommendation Statement. Pediatrics 123:1223–1228, 2009
Crossref
PubMed
Google Scholar
13.
Birmaher B, Brent D, Bernet W, et al: Practice parameter for the assessment and treatment of children and adolescents with depressive disorders. Journal of the American Academy of Child and Adolescent Psychiatry 46:1503–1526, 2007
Crossref
PubMed
Google Scholar
14.
Cheung AH, Zuckerbrot RA, Jensen PS, et al: Guidelines for Adolescent Depression In Primary Care (GLAD-PC): II. treatment and ongoing management. Pediatrics 120:e1313–e1326, 2007
Crossref
PubMed
Google Scholar
15.
Zuckerbrot RA, Cheung AH, Jensen PS, et al: Guidelines for Adolescent Depression in Primary Care (GLAD-PC): I. identification, assessment, and initial management. Pediatrics 120:e1299–e1312, 2007
Crossref
PubMed
Google Scholar
16.
Williams SB, O’Connor EA, Eder M, et al: Screening for child and adolescent depression in primary care settings: a systematic evidence review for the US Preventive Services Task Force. Pediatrics 123:e716–e735, 2009
Crossref
PubMed
Google Scholar
17.
Final Research Plan: Depression in Children and Adolescents: Screening. Rockville, Md, US Preventive Services Task Force, Oct 2014. Available at www.uspreventiveservicestaskforce.org/Page/Document/final-research-plan15/depression-in-children-and-adolescents-screening1
Google Scholar
18.
Zenlea IS, Milliren CE, Mednick L, et al: Depression screening in adolescents in the United States: a national study of ambulatory office-based practice. Academic Pediatrics 14:186–191, 2014
Crossref
PubMed
Google Scholar
19.
Zima BT, Mangione-Smith R: Gaps in quality measures for child mental health care: an opportunity for a collaborative agenda. Journal of the American Academy of Child and Adolescent Psychiatry 50:735–737, 2011
Crossref
PubMed
Google Scholar
20.
The State of Health Care Quality: Reform, the Quality Agenda and Resource Use. Washington, DC, National Committee for Quality Assurance, 2010
Google Scholar
21.
Wobrock T, Weinmann S, Falkai P, et al: Quality assurance in psychiatry: quality indicators and guideline implementation. European Archives of Psychiatry and Clinical Neurosciences 259(suppl 2): S219–S-226, 2009
Crossref
Google Scholar
22.
Lewandowski RE, Acri MC, Hoagwood KE, et al: Evidence for the management of adolescent depression. Pediatrics 132:e996–e1009, 2013
Crossref
PubMed
Google Scholar
23.
Allgaier AK, Pietsch K, Frühe B, et al: Screening for depression in adolescents: validity of the Patient Health Questionnaire in pediatric care. Depression and Anxiety 29:906–913, 2012
Crossref
PubMed
Google Scholar
24.
Richardson LP, McCauley E, Grossman DC, et al: Evaluation of the Patient Health Questionnaire–9 item for detecting major depression among adolescents. Pediatrics 126:1117–1123, 2010
Crossref
PubMed
Google Scholar
25.
Classifications of diseases, functioning, and disability; in International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM). Hyattsville, Md, National Center for Health Statistics, 2013. Available at www.cdc.gov/nchs/icd/icd9cm.htm
Google Scholar
26.
Kuhlthau K, Jellinek M, White G, et al: Increases in behavioral health screening in pediatric care for Massachusetts Medicaid patients. Archives of Pediatrics and Adolescent Medicine 165:660–664, 2011
Crossref
PubMed
Google Scholar
27.
Zuckerbrot RA, Jensen PS, Kemper KJ, et al: Improving recognition of adolescent depression in primary care. Archives of Pediatrics and Adolescent Medicine 160:694–704, 2006
Crossref
PubMed
Google Scholar
28.
Wissow LS, Brown J, Fothergill KE, et al: Universal mental health screening in pediatric primary care: a systematic review. Journal of the American Academy of Child and Adolescent Psychiatry 52:1134–1147, 2013
Crossref
PubMed
Google Scholar

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services

Cover: Small chest, attributed to Johannes Spitler, ca. 1800. Paint on yellow pine, poplar, and white pine with metal and wrought iron hardware. Collection American Folk Art Museum, New York City. Gift of Ralph Esmerian, 2005.8.28.

Psychiatric Services
Volume 67 • Number 6 • June 01, 2016
Pages: 636 - 641
PubMed: 26876655

History

Received: 8 October 2014
Revision received: 2 June 2015
Revision received: 12 October 2015
Accepted: 26 October 2015
Published online: 14 February 2016
Published in print: June 01, 2016

Authors

Details

R. Eric Lewandowski, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Briannon O’Connor, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Andrew Bertagnolli, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Arne Beck, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Aldo Tinoco, M.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
William P. Gardner, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Christine X. Jelinek-Berents, M.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Douglas A. Newton, M.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Kris F. Wain, B.S.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Jennifer M. Boggs, M.S.W.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Nancy E. Brace, R.N.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Patricia deSa, M.S.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Sarah Hudson Scholle, Dr.P.H.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Kimberly Hoagwood, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author
Sarah McCue Horwitz, Ph.D.
Dr. Lewandowski, Dr. O’Connor, Dr. Hoagwood, and Dr. Horwitz are with the Department of Child and Adolescent Psychiatry, New York University, New York (e-mail: [email protected]). Dr. Bertagnolli and Ms. deSa are with the Care Management Institute, Kaiser Permanente, Oakland, California. Dr. Beck, Mr. Wain, Ms. Boggs, and Ms. Brace are with the Institute for Health Research, Dr. Jelinek-Berents is with the Department of Pediatrics, and Dr. Newton is with the Care Management Institute and the Department of Child and Adolescent Psychiatry, all at Kaiser Permanente of Colorado, Denver. Dr. Tinoco and Dr. Hudson Scholle are with the National Committee for Quality Assurance, Washington, D.C. Dr. Gardner is with the Research Institute of Children’s Hospital of Eastern Ontario, Ottawa, Ontario, Canada, and with the Department of Pediatrics, Ohio State University, Columbus.
View all articles by this author

Competing Interests

The authors report no financial relationships with commercial interests.

Funding Information

Agency for Healthcare Research and Qualityhttp://dx.doi.org/10.13039/100000867: U18HS020503
This project was supported by grant U18HS020503 from the Agency for Healthcare Research and Quality (AHRQ).

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard
Tips for downloading citations

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Item saved, go to cart
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share

×

As described within the American Psychiatric Association (APA)'s Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences. Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.