Skip to main content

Abstract

Objective

This article describes the characteristics and early implementation experiences of community behavioral health agencies that received Primary and Behavioral Health Care Integration (PBHCI) grants from the Substance Abuse and Mental Health Services Administration to integrate primary care into programs for adults with serious mental illness.

Methods

Data were collected from 56 programs, across 26 states, that received PBHCI grants in 2009 (N=13) or 2010 (N=43). The authors systematically extracted quantitative and qualitative information about program characteristics from grantee proposals and semistructured telephone interviews with core program staff. Quarterly reports submitted by grantees were coded to identify barriers to implementing integrated care.

Results

Grantees shared core features required by the grant but varied widely in terms of characteristics of the organization, such as size and location, and in the way services were integrated, such as through partnerships with a primary care agency. Barriers to program implementation at start-up included difficulty recruiting and retaining qualified staff and issues related to data collection and use of electronic health records, licensing and approvals, and physical space. By the end of the first year, some problems, such as space issues, were largely resolved, but other issues, including problems with staffing and data collection, remained. New challenges, such as patient recruitment, had emerged.

Conclusions

Early implementation experiences of PBHCI grantees may inform other programs that seek to integrate primary care into behavioral health settings as part of new, large-scale government initiatives, such as specialty mental health homes.
People with serious mental illness frequently contend with general medical conditions and have significantly shorter life expectancies than the general population (1,2). Yet the geographic, organizational, financial, and cultural separation of traditional behavioral health and general medical care systems is widely assumed to limit behavioral health consumers’ access to primary medical care (38). As such, improving the integration of behavioral and general medical services has become a focus of multiple policy initiatives (5,6,911).
In a recent review, the Agency for Healthcare Research and Quality defined integration as systematic communication and coordination across behavioral health and general medical providers (12). Early models of integrated care, in which mental health providers were brought into medical settings to identify and treat mental health conditions, have been associated with improvements in symptom severity, treatment response, and disease remission (12). Less is known about the opposite approach, in which primary care services are integrated into behavioral health settings (12,13). This approach is expected to show particular promise for persons who have frequent contact with behavioral health providers but not with general medical providers (14,15).
Recent reviews have also summarized the few studies of approaches for integrating primary care into behavioral health treatment for adults with serious mental illness, and they noted improvements in consumers’ general medical and behavioral health and in quality of care (12,13). However, the studies reviewed may not reflect all variants of this approach to integration that are occurring in the field. Specifically, most of the studies were conducted in large, integrated health systems, such as the Veterans Health Administration or other large health maintenance organizations, where primary care providers and behavioral health staff were already working together to provide care. Less systematic accounts of integration of primary care in smaller behavioral health systems described implementation barriers related to inadequate space for primary care activities and difficulty integrating primary care activities into the existing organizational work flow (16). More research is needed on the benefits and challenges of integrating primary care into diverse behavioral health settings.
To address this gap, we provide a descriptive analysis of the Substance Abuse and Mental Health Services Administration (SAMHSA) Primary and Behavioral Health Care Integration (PBHCI) grants program, which supports the integration of primary care services into community behavioral health settings for adults with serious mental illness. Specifically, we describe the grantee organizations, their integrated care programs and implementation plans, and the challenges associated with this integrated approach at start-up and after one year of program implementation.

Methods

Participants

Participants were 56 publicly funded community behavioral health agencies or agency partners that provide mental health or substance abuse services and that received a PBHCI service grant in September 2009 (N=13) or September 2010 (N=43). The programs received up to $500,000 per year for four years.

PBHCI grantee characteristics

Each grantee’s model of service integration included required and optional program features. The required program features were screening, assessment, and referral for the prevention and treatment of general medical illnesses and risk factors, including hypertension, obesity, smoking, and substance abuse; a registry or tracking system to house data about consumer-level primary care needs and outcomes; care management, defined as individualized, person-centered planning and coordination to increase consumer participation and follow-up with primary care services; and illness prevention and wellness support services.
Examples of optional program features included colocation of primary care providers in behavioral health settings, supervision by a primary care physician, and embedding of nurse care managers.
Up to 25% of the grant could be used to fund infrastructure development for the program, and up to 20% could be used to support data collection, performance measurement, and assessment.

Data extraction from grant proposals

Project team members used qualitative and quantitative templates to systematically extract information from grantees’ funded proposals, including general characteristics of participating behavioral health agencies and their PBHCI programs, such as number of locations and type of primary care partner; information about current and targeted patient populations, such as volume, gender, age, and insurance status; and implementation plans. Data extraction was completed between October and December 2010.
During November and December 2010, project team members conducted hour-long, semistructured telephone interviews with core PBHCI grantee agency staff, such as program managers, to verify the accuracy of the extracted information. Sixteen grantees (37%) did not respond to repeated telephone and e-mail requests to meet.

Coding of quarterly reports

SAMHSA requires grantees to submit quarterly reports describing program implementation progress. We coded an item from these reports describing “barriers [grantees] have experienced in implementing [their] programs.” Reports submitted at baseline (after the first quarter of implementation) by 56 programs and at one-year follow-up by 55 programs were used for coding.
Categories of barriers were developed by consensus: together two raters examined a subset of responses from the baseline reports and came to agreements about thematic content. The raters then independently evaluated the remaining baseline reports. To assess interrater reliability, ten baseline reports were randomly selected to be evaluated by both raters. The raters were in agreement about the categorization of 13 of the 16 barriers identified, yielding an interrater reliability of 81%. The same approach was used with a randomly selected group of five follow-up reports to identify any new categories of barriers, and the two raters agreed on 16 of 19 categorizations (84%).

Results

Characteristics of PBHCI grantees

The 56 grantees collectively represented 65 behavioral health agencies at 86 sites or locations. Most grantees consisted of a single treatment site (N=34, 61%), and most were located in a suburban or urban setting (N=47, 84%). The characteristics of the sites before the grant varied tremendously. For example, annual patient volume ranged from 100 to 13,000 (median=1,585), and the number of consumers with serious mental illness served ranged from 14 to 9,800 (median=1,000).
A majority of grantees included only one participating behavioral health agency (N=50, 89%). Grantees with multiple agencies generally offered the same array of services at each participating agency, so results are reported at the grantee level. Prior to receiving a PBHCI grant, all behavioral health agencies offered outpatient mental health services, nearly all offered substance use disorder services (N=51, 91%), and most offered crisis or emergency (N=38, 68%) and residential services (N=31, 55%). Less than half of the behavioral health agencies offered any primary care services prior to receiving the grant (N=25, 45%).

Organizational partnerships

PBHCI grantees tended to include at least one primary care provider organization partner (N=43, 77%), of which a majority were Federally Qualified Health Centers (FQHCs) (N=31, 67%). Most partnerships between primary and behavioral health care organizations were relatively new (median=two years) when grant applications were submitted, although some partnerships were longstanding.
Organizational partnerships were operationalized through formal contracts (N=9, 21%), memoranda of understanding or agreement (N=28; 65%), letters of commitment or agreement (N=5, 12%), and unspecified arrangements (N=1).
Primary care partner organizations varied widely in annual volume of patients (median=15,000; range 2,518–150,000) and physical proximity to partner behavioral health organizations. Some primary care partners were located in the same building as behavioral health providers, whereas others were up to 23 miles away (median=1.5 miles).

Anticipated clientele

Most programs (N=48, 86%) planned to prioritize integrated care for a subset of consumers with serious mental illness. Criteria used to identify priority groups included demonstrating inadequate connections to primary care, such as an inability to name a primary care provider (N=31 programs, 55%); having high-risk clinical factors, such as obesity (N=14, 25%); and having been diagnosed with a chronic general medical condition, such as diabetes (N=14, 25%). Six (11%) programs planned to prioritize care of consumers using psychotropic medication, and four (7%) targeted consumers lacking health insurance.
Table 1 describes characteristics of consumers that PBHCI programs expected to serve. The number of consumers expected and the racial-ethnic composition and insurance status of the target populations varied widely by program.
Table 1 Characteristics of consumers expected to receive integrated general medical services at 56 PBHCI programs, in percentagesa
CharacteristicMedianRange
Serious mental illness (N)b1,000153–9,800
Sex  
 Male5135–62
 Female4938–65
Race or ethnicity  
 White574–96
 Black233–79
 Hispanic or Latino181–75
 Asian or Pacific Islander30–100
 Native American30–75
 Other61–30
Insurancec  
 Medicaid663–99
 Medicare213–95
 Uninsured224–64
a
The data reflect anticipated clientele over a four-year period among recipients of Primary and Behavioral Health Care Integration (PBHCI) grants.
b
Includes schizophrenia, bipolar disorder, and clinical depression
c
Medicaid and Medicare were not mutually exclusive categories.

Required program features

Screening and referral.

Grantees reported a wide range of capacities for providing screenings and referral to primary care. On average, grantees planned to screen 300 consumers (range 65–3,000) and expected that 250 consumers would receive primary care services (range 40–2,000) during the first year. No grantees quantified the referral services they planned to provide.

Registry or tracking system.

Grantees generally reported the ability to collect consumer-level data (N=54, 96%), often as part of clinical care. Most grantees (N=34, 61%) reported that they had or were developing electronic health records (EHRs) for behavioral health information, and 46% (N=26) reported using or planning to use EHRs for general medical data. Plans for shared general medical and behavioral health EHRs were less common (N=16, 29%).

Care management.

Grantees planned to use PBHCI funds to support a median of 5.3 full-time employees, and most expected that at least one would be a care manager (Table 2). Care managers included nurse care managers, non–nurse care managers, and mental health case managers.
Table 2 Full-time employees (FTEs) expected to be supported by Primary and Behavioral Health Care Integration (PBHCI) grantsa
 Grantees (N=53)cFTEsFTEs per 1,000 consumers servedb
Staff positionMedianRangeMedianRange
Nurse care manager391.50.60–7.001.17.10–13.07
Nurse practitioner351.00.35–1.10.80.10–6.54
Physician30.20.03–1.50.22.02–.85
Peer specialist181.00.23–7.001.07.06–10.00
Mental health case manager131.00.20–3.00.96.10–7.84
Educator or coach13.50.05–3.30.94.08–5.50
Non–nurse care manager121.00.60–3.001.00.28–3.00
Psychiatrist11.10.05–1.00.13.03–.60
Medical assistant10.50.10–2.00.69.42–1.92
Licensed practical nurse51.00.60–2.001.15.46–1.33
Psychiatric nurse practitioner41.001.00–4.502.231.00–6.54
Therapist41.00.20–2.001.60.11–5.00
Pharmacist31.001.00–2.00.97.31–3.33
Otherd531.45.10–3.501.06.02–12.20
Total535.252.35–15.375.11.35–40.59
a
Data reflect only grantees that expected to use PBHCI funds for this staff position.
b
Data reflect FTEs per 1,000 unduplicated consumers expected to participate in PBHCI services over the lifetime of the grant.
c
Information on grant-funded FTEs could not be obtained from three of the 56 programs that received PBHCI funds.
d
Primarily nonclinical roles, such as program manager, evaluator, and data entry assistant

Illness prevention and wellness support.

Grantees unanimously reported plans to provide illness prevention and wellness services in group and individual formats. Smoking cessation programs, which grantees are now required to provide but which were optional for the first cohort of grantees funded in 2009 (N=13), were proposed by most grantees (N=34, 77%). Smoking cessation approaches included counseling (N=34, 61%), nicotine replacement (N=18, 32%), other medications (N=12, 21%), and incentives (N=7, 13%).

Optional program features

Grantees planned to implement optional program features, including colocation of nurse practitioners and primary care providers (N=53, 95%), supervision by primary care providers (N=53, 95%), and embedding of nurse care managers (N=49, 88%). Nearly all grantees (N=53, 95%) planned to deliver evidence-based behavioral health interventions, such as Screening, Brief Intervention, and Referral to Treatment (17); Illness Management and Recovery Program plans (18); Wellness Recovery Action Program plans (19); and U.S. Preventive Services Task Force Recommendations (20) (Table 3).
Table 3 Expected use of evidence-based practices for behavioral health care by 56 recipients of PBHCI grantsa
Evidence-based practiceN%
Screening, Brief Intervention, Referral, and Treatment  
 Any condition3359
 Substance use disorders3155
Motivational interviewing3257
Illness Management and Recovery Program1730
Wellness Recovery Action Program1730
Cognitive-behavioral therapy1629
USPSTF guidelinesb1221
Dialectical behavior therapy713
Other4173
a
PBHCI, Primary and Behavioral Health Care Integration
b
U.S. Preventive Services Task Force (USPSTF) Recommendations for Adults

Implementation challenges and barriers

Figure 1 shows barriers to program implementation reported by grantees at baseline, one-year follow-up, and both time points.
Figure 1 Barriers to program implementation reported at baseline and one-year follow-up by 56 recipients of Primary and Behavioral Health Care Integration (PBHCI) grantsa
a Follow-up data were available for 55 grant recipients.
b EHR, electronic health records

Start-up.

At baseline, difficulty recruiting and retaining qualified staff was the most commonly identified barrier (N=18, 32%). Grantees also reported challenges related to data management (N=13, 23%), including using EHRs and clinical registries and meeting the data collection requirements of the grant.
Grantees also reported challenges related to the availability and readiness of space in which to implement the PBHCI program (N=11, 20%); difficulty getting licensing or approvals from the grantee’s own agency administration (for example, for clinics that were part of larger health care networks), the city, the state, or the federal Health Resources and Services Administration (N=11, 20%); and problems sharing consumer data across behavioral health and primary care partners for the purpose of patient care (N=8, 14%).
Both implementation challenges related to merging primary care and behavioral health protocols and barriers related to billing and administrative issues were reported by five grantees (9%). Four grantees (7%) described staffing issues other than hiring, for example, staff conflict related to the program and lack of staff buy-in or low morale. Four grantees (7%) reported no barriers.

One-year follow-up.

Problems related to space and problems getting licensing or approvals were reported by a smaller proportion of grantees after one year (N=3, 5%, and N=5, 9%, respectively) than at baseline (N=11, 20%) (Figure 1). Two (18%) of the 11 grantees that reported problems with space or with licensing or approvals at baseline reported them again one year later.
Some program barriers were reported at similar or identical rates at baseline and follow-up, including recruiting and retaining qualified staff (N=18, 32%, and N=17, 31%, respectively); other staff issues, such as conflict or low morale (N=4, 7%); and increased or unexpected costs (N=2, 4%, and N=3, 5%, respectively). Fewer than half of the 18 sites with hiring or staffing problems at baseline reported such problems again one year later (N=8, 44%). However, three of four (75%) grantees that reported other staff issues at baseline continued to report them at follow-up. None of the grantees that reported barriers related to increased costs, billing, or other administrative issues at baseline reported them one year later.
The following barriers to implementation were reported more often at follow-up than at baseline: data management, including issues related to EHRs, clinical registries, and data collection (N=17, 31%, and N=13, 23%, respectively); sharing consumer data for the purposes of care (N=11, 20%, and N=8, 14%, respectively); and merging primary care and behavioral health protocols (N=9, 16%, and N=5, 9%, respectively). Among grantees that reported these barriers at baseline, four (31%) reported data management issues, two (25%) reported difficulties sharing consumer data, and three (60%) reported challenges merging primary and behavioral health protocols at follow-up.
The most salient barrier at follow-up was difficulty recruiting consumers to participate in PBHCI (N=19, 35%). Grantees commonly reported difficulty in getting staff to refer appropriate consumers to the program, and some reported difficulty enrolling consumers who were referred. Several reported difficulties caused by potential program participants not showing up for appointments. As one grantee said, “Many clients [are] referred to the program, but then they will either avoid our case manager’s attempts to contact them, or they will not show up for their intake.” Thirteen grantees (24%) reported difficulties maintaining participation and following up with consumers who had already enrolled in PBHCI.
Nine programs (16%) reported inadequate capacity to serve interested consumers because of higher than expected program participation and scheduling difficulties.
Fewer than four grantees (<8%) reported challenges related to consumer access to specialists, transportation, and payment and insurance. Three programs (5%) reported no implementation barriers at follow-up, and one grantee reported no barriers at either time.

Discussion

SAMHSA’s PBHCI grants support an array of programs integrating primary care services into community behavioral health settings. Because of its size and breadth, the PBHCI initiative provides a unique opportunity to learn about the range of benefits and challenges of this approach to integrated care. Currently, data describing the impact of PBHCI on consumers’ behavioral and general medical health are still being collected. This article characterizes the first 56 PBHCI grantees and their programs and describes the grantees’ early experiences implementing this nontraditional approach to integrated care.
Although the PBHCI grantee programs are constrained by the grant requirements, programs differed widely in terms of size, staffing, capacity for providing behavioral and primary care services, use of EHRs, ability to share data across provider groups, targeted clientele, and demographic characteristics and insurance status of their consumers. This diversity of programs suggests that an approach that integrates primary health care into behavioral health care may appeal to a wide variety of community behavioral health centers. In addition, the PBHCI grantees’ experiences could represent an important resource for programs unlike the large, well-integrated care systems that have been described previously in the literature (12,13).
PBHCI grantees reported diverse challenges to program implementation at start-up and one year later, some of which resembled the challenges previously reported by studies of programs that integrate behavioral health into primary care settings, such as staffing issues, organizational resistance to change, and data sharing challenges (12). Below, we discuss each of these barriers and other concerns reported by PBHCI grantees.
Recruiting and retaining staff were major challenges at both baseline and follow-up, and approximately one in three grantees who reported these issues at baseline continued to report them one year later. Other staff issues, such as conflict and low morale, were less common but more persistent, given that three out of four programs that reported these issues at baseline continued to report them one year later.
Consistent with other research (16), grantees that brought primary care providers on site reported problems with physical space; however, follow-up data suggested that most grantees resolved space-related issues within the first year of the program.
PBHCI grantees also reported challenges related to EHRs, registries, and data sharing at both baseline and follow-up. Grantees had funds available to purchase EHRs or registry software but reported concerns with the quality and capacity of available packages. Until electronic systems that efficiently and securely integrate behavioral and primary health information are widely available, progress in effective utilization of integrated data to enhance clinical care is expected to be slow.
Licensing issues, such as delays in approval for FQHCs to provide and bill for behavioral health services, were frequently mentioned by grantees, and often the issues were specific to the state in which the program was located. SAMHSA’s recently funded Center for Integrative Health Solutions, a technical assistance center intended to support integrated care programs, now provides information about licensing and regulation requirements in each state as well as strategies to expedite the licensing processes.
Finally, approximately one in four grantees reported difficulty keeping consumers engaged in the program one year into the grant, which suggests a need to further develop care management services, many of which were new as a result of PBHCI. Care managers can help consumers to attend appointments and wellness programming and should be a part of integrated care programs. In addition, some grantees have had success enlisting the help of peer specialists, who may have the time, inclination, and unique skills to effectively reach out to consumers to encourage participation.
This study had several limitations. Our descriptions of staffing, service capacity, and programming more accurately reflect the grantees that participated in structured interviews than the grantees that did not. The description of program features may be a conservative reflection of actual practice because the information was obtained by a review of grantee proposals and reports and through telephone conversations and did not include features that programs had implemented but failed to mention. Conversely, we may have overestimated the availability of program features that were proposed but had not yet been put in practice.
Because of insufficient statistical power, we are unable to determine whether characteristics of PBHCI programs or grantees, such as urban versus rural location, predicted grantee reports of the presence or absence of barriers to implementation or of the resolution of barriers from start-up to one-year follow-up.
Also, the scope of the barriers to program implementation identified in this report was limited. For example, because the PBHCI grantees were awarded four years of funding, they were unlikely to report issues related to funding and program sustainability during the first year of program implementation.

Conclusions

Few studies have described the process of implementing primary care in community behavioral health settings. The experiences of SAMHSA PBHCI grantees may inform organizations considering integrating care in diverse community-based settings. Information about the process of integrating primary care into behavioral health settings has important policy and practice implications, given that several states are pursuing integrated care through statewide initiatives, such as the Health Homes and specialty Health Homes programs (14,15). Future research should continue to monitor the benefits and challenges of integrated care and investigate potential relationships among the program characteristics and the implementation challenges identified in this article. Research on program costs may also facilitate program sustainability as funding for behavioral health programs becomes increasingly scarce.

Acknowledgments and disclosures

This research was supported by the Substance Abuse and Mental Health Services Administration and by the Office of the Assistant Secretary for Planning and Evaluation, U.S. Department of Health and Human Services (contract OS 42345). The authors acknowledge the efforts of current and past project officers Hakan Aykan, Ph.D., Kirsten Beronio, Ph.D., Lisa Patton, Ph.D., and David DeVoursney, M.P.P. They also thank Susie Lovejoy, M.P.P., and Sarah Hauer, M.A., for outstanding research and other support for this project, respectively.
The authors report no competing interests.

References

1.
Colton CW, Manderscheid RW: Congruencies in increased mortality rates, years of potential life lost, and causes of death among public mental health clients in eight states. Preventing Chronic Disease 3:A42, 2006
2.
Druss BG, Zhao L, Von Esenwein S, et al.: Understanding excess mortality in persons with mental illness: 17-year follow up of a nationally representative US survey. Medical Care 49:599–604, 2011
3.
Druss BG: Improving medical care for persons with serious mental illness: challenges and solutions. Journal of Clinical Psychiatry 68:40–44, 2007
4.
Bartels SJ: Caring for the whole person: integrated health care for older adults with severe mental illness and medical comorbidity. Journal of the American Geriatrics Society 52:S249–S257, 2004
5.
Koyanagi C: Get It Together: How to Integrate Physical and Mental Health Care for People With Serious Mental Disorders. Washington, DC, Barzelon Center, 2004
6.
Institute of Medicine: Improving the Quality of Health Care for Mental and Substance-Use Conditions. Washington, DC, National Academies Press, 2006
7.
Druss BG, Reisinger W: Mental disorders and medical comorbitity; in Research Synthesis Report 21. Princeton, NJ, Robert Wood Johnson Foundation, 2011
8.
Horvitz-Lennon M, Kilbourne AM, Pincus HA: From silos to bridges: meeting the general health care needs of adults with severe mental illnesses. Health Affairs 25:659–669, 2006
9.
Achieving the Promise: Transforming Mental Health Care in America. Pub no SMA-03-3832. Rockville, Md, Department of Health and Human Services, President’s New Freedom Commission on Mental Health, 2003
10.
Unützer J, Schoenbaum M, Druss BG, et al.: Transforming mental health care at the interface with general medicine: report for the Presidents Commission. Psychiatric Services 57:37–47, 2006
11.
Amiel JM, Pincus HA: The medical home model: new opportunities for psychiatric services in the United States. Current Opinion in Psychiatry 24:562–568, 2011
12.
Butler M, Kane RL, McAlpin D, et al.: Integration of Mental Health/Substance Abuse and Primary Care. Rockville, Md, Agency for Healthcare Research and Quality, 2008
13.
Druss BG, von Esenwein SA: Improving general medical care for persons with mental and addictive disorders: systematic review. General Hospital Psychiatry 28:145–153, 2006
14.
Smith TE, Sederer LI: A new kind of homelessness for individuals with serious mental illness? The need for a “mental health home.” Psychiatric Services 60:528–533, 2009
15.
Alakeson V, Frank RG, Katz RE: Specialty care medical homes for people with severe, persistent mental disorders. Health Affairs 29:867–873, 2010
16.
Boardman JB: Health access and integration for adults with serious and persistent mental illness. Families, Systems and Health 24:3–18, 2006
17.
Babor TF, McRee BG, Kassebaum PA, et al.: Screening, Brief Intervention, and Referral to Treatment (SBIRT): toward a public health approach to the management of substance abuse. Substance Abuse 28:7–30, 2007
18.
Mueser KT, Meyer PS, Penn DL, et al.: The Illness Management and Recovery Program: rationale, development, and preliminary findings. Schizophrenia Bulletin 32(suppl 1):S32–S43, 2006
19.
Copeland M: Wellness Recovery Action Plan. Dummerston, Vt, Peach Press, 2002
20.
Recommendations for Adults. Rockville, Md, US Preventive Services Task Force, 2013. Available at www.uspreventiveservicestaskforce.org/adultrec.htm. Accessed Oct 28, 2012

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services

Cover: The Artists' Parents in the Store, by Sidney Goodman, 1973–1975. Oil on canvas, 58½ × 77 inches. Collection of the Butler Institute of American Art, Youngstown, Ohio.

Psychiatric Services
Pages: 660 - 665
PubMed: 23584674

History

Published in print: July 2013
Published online: 15 October 2014

Authors

Details

Deborah M. Scharf, Ph.D.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.
Nicole K. Eberhart, Ph.D.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.
Nicole Schmidt, M.A.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.
Christine A. Vaughan, Ph.D.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.
Trina Dutta, M.P.P., M.P.H.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.
Harold Alan Pincus, M.D.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.
M. Audrey Burnam, Ph.D.
Dr. Scharf is affiliated with the Department of Behavioral Health Sciences, RAND Corporation, 4570 Fifth Ave., Suite 600, Pittsburgh, PA 15213 (e-mail: [email protected]). Dr. Eberhart, Ms. Schmidt, Dr. Vaughan, and Dr. Burnam are with the Department of Behavioral Health Sciences, RAND Corporation, Santa Monica, California. Ms. Dutta is with the Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, Rockville, Maryland. Dr. Pincus is with the Department of Psychiatry, Columbia University, New York City.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share