Skip to main content

Abstract

Objective:

The objective of this study was to identify supply-side interventions to reduce state psychiatric hospital admission delays.

Methods:

Healthcare Enterprise Accounts Receivable Tracking System (HEARTS) data were collected for all patients admitted between July 1, 2010, and July 31, 2012, to one of North Carolina’s three state-operated psychiatric hospitals (N=3,156). Additional information on hospital use was collected at nine meetings with hospital administrators and other local stakeholders. A discrete-event simulation model was built to simulate the flow of adult nonforensic patients through the hospital. Hypothetical scenarios were used to evaluate the effects of varying levels of increased capacity on annual number of admissions and average patient wait time prior to admission.

Results:

In the base case, the model closely approximated actual state hospital utilization, with an average of 1,251±65 annual admissions and a preadmission wait time of 3.3±.1 days across 50 simulations. Results from simulated expansion scenarios highlighted substantial capacity shortfalls in the current system. For example, opening an additional 24-bed unit was projected to decrease average wait time by only 6%. Capacity would need to be increased by 165% (356 beds) to reduce average wait time below 24 hours.

Conclusions:

Without more robust community-based hospital and residential capacity, major increases in state psychiatric hospital inpatient capacity are necessary to ensure timely admission of people in crisis.
Despite more than 50 years of efforts to bolster community mental health treatment, state psychiatric hospitals continue to play a critical role in U.S. mental health services. When outpatient services are unable to help people prevent or manage crises, swift access to inpatient care in community general hospitals can be essential to ensure safety while medications are recalibrated and formal and informal supports are organized. However, general hospital psychiatric units often lack the resources to manage severe symptoms or violent or otherwise disruptive behavior. The results can be costly for health care providers, patients, families, and communities. Responding to a single patient’s violent behavior can require the resources of an entire general hospital ward or emergency room.
The severe shortage of all types of psychiatric beds across the United States (13) affects not only whether people are admitted for inpatient treatment but also how long they wait for a bed. In a 2012 national survey, 13 state mental health agency directors reported that waitlists for state hospital beds increased as a result of psychiatric bed shortages (3). Some emergency departments in general hospitals have resorted to boarding people in psychiatric crisis for days while they wait for a bed to become available (4). In these circumstances, detained individuals can receive treatment only for life-threatening conditions—not for routine psychiatric care.
In contrast to community general hospitals, state psychiatric hospitals are designed and staffed to care for people with severe mental illness, including those who may become violent. Observers now believe that state hospitals will continue to serve patients whom general hospitals and private psychiatric hospitals cannot accommodate (5). In this respect, state psychiatric hospitals are the ultimate safety net for people with mental illness.
Despite the important safety-net role of state psychiatric hospitals, to our knowledge no previous study has developed a management tool to assist these hospitals in calibrating their capacity and routines so as to increase access to inpatient beds. Simulation models are well suited to address this gap because they quickly provide “what if” results without requiring actual implementation of costly and possibly ineffective interventions. The purpose of this study was to create and test a discrete-event simulation model (6) to evaluate supply-side interventions for decreasing state hospital wait times. We characterize our approach as “supply side” because we held constant the level of community demand for state psychiatric hospital beds as we explored what the hospital itself could do to reduce wait times.

Methods

Study Setting

The hospital under study is one of three state psychiatric hospitals in North Carolina. At the time of this research, it had 398 beds and served a 25-county region with a 2012 total population of approximately 3.4 million (7). Its ratio of 11.7 beds per 100,000 population placed it below the national average of 14.1 beds per 100,000 (2). Most of the study hospital’s adult patients were male and self-pay or uninsured, had a diagnosis of severe mental illness, and were admitted under involuntary commitments (accounts receivable data on file). Community-based crisis services in the region included 494 adult psychiatric beds in 14 general hospitals or private psychiatric hospitals (19.1 beds per 100,000 population) and 66 nonhospital crisis beds in five facilities (2.6 beds per 100,000 population) (79).
These community-based services are the first tier of response for individuals in psychiatric crisis in the region, but they also serve as a major source of referrals to the state hospital. The study hospital provides a safety net when local inpatient capacity is exceeded and for patients whose illness is too acute or too difficult to manage in community-based settings. During the last six months of 2012, a mean±SD of 520±63 people waited in emergency departments across the state for admission to a state psychiatric hospital (10). These people waited an average of 3.1±.3 days, although not all patients placed on waitlists were admitted.
At the time of this research, the study hospital’s clinical service units were organized into screening and admissions, medical, child and adolescent, adult acute (short-term), adult community transition (longer-term rehabilitative), and geriatric services. The study reported here focused on patients served in the adult acute and community transition units, because this subpopulation constituted the majority of the monthly waitlist. Each of these units contained male- and female-specific subunits, as well as a high-management subunit for patients requiring more intensive services or increased supervision.

Stakeholder Engagement

We held nine mental health system stakeholder meetings between October 2008 and February 2012 to communicate the study team’s goals and elicit written and unwritten “rules” governing how people flowed through the hospital. The number of attendees ranged from four to 30. The first four meetings were held with stakeholders from the hospital and from two of the hospital’s local community service areas, including representatives from local mental health agencies, psychiatric crisis care and outpatient care providers, community general hospitals, and law enforcement, all of whom were affected by delays in state psychiatric hospital admission. The last five meetings were held with the hospital’s clinical management staff, with three of the last five meetings also including executives from local mental health agencies. These later meetings were conducted to gain specific information about hospital unit capacities and the flow of patients through the hospital, as well as to seek feedback on preliminary findings.
Hospital administrators indicated that the total number of staffed beds was fixed at 398, but overtime and temporary staffing could be used to accommodate fluctuations in patient case-mix severity. Our research team initially considered cost-neutral scenarios that involved shifting beds between treatment units to explore efficiencies. However, preliminary simulation results indicated that most units were already operating at or near full capacity and that substantially decreasing wait times through supply-side interventions would require increasing bed capacity. Increasing staffed-bed capacity was potentially feasible at the study hospital, because 15% of its licensed beds were not in use at the time of this research. Therefore, our hypothetical scenarios focused on how many additional beds would be needed to reduce wait times by targeted amounts.

Data

We built the simulation model using North Carolina’s Healthcare Enterprise Accounts Receivable Tracking System (HEARTS), state psychiatric hospital waitlist data, information shared at mental health system stakeholder meetings, and personal communications with hospital stakeholders. HEARTS is an administrative claims database and billing system maintained for all visits to the state’s psychiatric hospitals. We used admissions data for all adult acute and community transition unit admissions between July 1, 2010, and July 31, 2012, to determine rates of patient arrivals and gain insights about the rules of patient flow through the hospital. We also used state psychiatric hospital waitlist data to confirm that the baseline model results were consistent with available data.

Simulation Model

Discrete-event simulations (6,11) model the operation of a system, such as a hospital, as a sequence of separate events in time (for example, patient admissions, treatment unit transfers, and discharges). In this study, these events changed two system states: the number of patients on the waitlist (a whole number) and treatment bed capacity (full or not). The random variables that needed to be characterized to model this system stochastically were patient waitlist arrival times and treatment unit length of stay.
Our baseline discrete-event simulation model captured the flow of patients through the state psychiatric hospital during fiscal year 2012 (July 1, 2011, through June 30, 2012). We began with a simple model based on preliminary conversations with stakeholders, iteratively incorporating additional factors suggested by stakeholders to approximate the true complexity of patient flows. All scenarios started with an empty hospital, using a one-year warm-up period to allow the simulated hospital and waitlist to reach realistic census levels. The model was built using ProModel, version 8.6 (12). The main components and operationalizations are described below. [Additional technical details of the simulation modeling are included in an online supplement to this article and can be obtained from the first author.]

Patients

The model included patients ages 18–64 (the only patients eligible for care in the units being studied). These patients were randomly selected, with replacement from a pool of actual patient admissions to the hospital during fiscal year 2012, thus reflecting actual patient population diversity in age, sex, and diagnoses. Several additional attributes were assigned to patients in the model on the basis of HEARTS data, including length of stay (estimated using a Cox proportional hazards model) and eligibility for the high-management and community transition units.

Patient Arrivals and Processing

We modeled patient arrivals to reflect all patients who entered the waitlist, regardless of whether they were ultimately admitted, by increasing observed hospital admission rates by a factor of 1 divided by the mean probability of admission (.38, from waitlist data). In practice, we were told, certain patients may be prioritized for admission from the waitlist for acuity and management concerns. However, stakeholders indicated that these patients could not be identified from the utilization data available to us; thus, in our simulations, hospital admission rates were increased uniformly for all patients.
Hospital clinicians and managers noted that upon referral, if an appropriate adult acute unit bed was available, the patient was admitted to that bed. Otherwise, the patient was placed on the waitlist and retained at the referral source until a bed at the hospital became available. When a regular adult acute unit bed for a male or female became available, a patient was admitted from the male or female waitlist on a first-in, first-out basis. We used person-level waitlist data from one local service area between January 1 and June 30, 2010, to estimate the amount of time people waited before they were admitted to the state hospital, found care elsewhere, or no longer needed inpatient care.
According to clinical managers at the study hospital, admitted patients followed a number of different pathways through the hospital. Specific rules were elicited to describe how and when patients flowed between units. These rules varied by patient sex, eligibility for high-management and community transition units, and availability of beds. The rules were translated into the care pathways outlined in Figure 1.
FIGURE 1. Patient flow through the state psychiatric hospital

Treatment Units

Figure 1 depicts the two main treatment locations included in the model: the adult acute unit and the community transition unit. To account for fluctuations in staffed beds, we used HEARTS data to determine the daily average number of beds in use in each unit during the year. In the adult acute unit, we modeled 86 beds designated for men, 44 beds for women, and ten high-management beds for use by either men or women. Similarly, in the community transition unit, we modeled 44 beds for men, 22 for women, and ten high-management beds.

Base Case and Hypothetical Scenarios

We took several steps to verify that the model behaved as intended. For example, we examined the model’s behavior with only one patient arriving and varied the patient attributes to confirm that the patient’s pathway through the hospital was consistent with the pathways depicted in Figure 1 and with the associated rules. Similarly, we varied length-of-stay estimates and probabilities of high-management and community transition unit eligibility to ensure that the model reacted as expected. The first two authors independently reviewed the model’s code and conducted independent scenario analyses. Finally, technical consultants from ProModel verified our simulation model and improved its computational efficiency.
After verifying the model’s structure, we compared baseline simulated patient flow to fiscal year 2012 HEARTS data. We adjusted rules of patient flow so that the simulated outcomes better reflected actual patterns of hospital use (for example, matching the annual expected number of community transition unit discharges). Model results related to patient queuing and unit utilization were also compared with waitlist data and stakeholder input. We used four hypothetical scenarios to simulate alternative capacity expansion targets. In the first expansion scenario, we added 24 beds, distributed equally across the four regular treatment units. In each of the other three scenarios, we repeatedly added a bed to the treatment unit with the highest utilization rate (that is, the bottleneck unit) until a wait time threshold (three, two, or one days) was reached.
The study was approved by the Institutional Review Board at the University of North Carolina at Chapel Hill.

Results

Table 1 presents the study hospital’s actual admission counts (and percentage of admissions) and length-of-stay statistics by sex, age, and diagnosis. Of the 1,279 admissions in fiscal year 2012, the majority involved patients who were male (62%), were between age 30 and 54 (58%), and had a diagnosis of a schizophrenia spectrum disorder (51%) or depression–episodic mood disorder (34%). Length of stay varied from a minimum of one day to an observed maximum of 398 days (not shown), with a median of 20 days. Patients not yet discharged at the end of our data window (N=87) were excluded from length-of-stay statistics.
TABLE 1. Characteristics of patients admitted to the state psychiatric hospital during fiscal year 2012
CharacteristicN%Length of stay (days)a
MSDMedianIQRb
Full sample1,27910032.339.82010–39
Sex      
 Male7876234.543.02111–41
 Female4923828.834.01810–35
Age      
 18–293853032.745.6209–36
 30–547425830.336.01910–37
 ≥551521241.140.42814–50
Diagnosis (most severe listed)c      
 Schizophrenia spectrum disorder6575140.842.62917–49
 Depression or episodic mood disorder4363424.631.5148–26
 Anxiety, stress, or adjustment disorder68518.241.586–13
 Personality disorder39317.417.4117–20
 Conduct disturbance10121.413.21613–22
 Primary substance use disorder with no other mental disorder diagnosis45410.611.076–12
 Other mental disorder diagnosis or not in hierarchy24277.180.25015–106
a
A total of 87 patients admitted in fiscal year 2012 were not yet discharged at the end of the data window. Length-of-stay summary statistics are provided for the 1,192 patients already discharged.
b
Interquartile range
c
Diagnosis hierarchy was created in consultation with the team psychiatrist; specific ICD–9 codes used to group diagnoses are available from the first author.

Base Case Results

Base case simulation results (Table 2) indicate that the model approximated actual fiscal year 2012 utilization data. During one year, a mean±SD of approximately 1,251±65 patients were admitted to the simulated hospital. Patient lengths of stay (among patients discharged in the simulated year) ranged from one day to 655 days, with a mean of approximately 44±2 days across 50 simulations, compared with an average of 41±67 days for a comparable set of patients from 2011 or 2012 in HEARTS data. The average wait time of 3.3±.1 days for admission was considered sufficiently close to the observed averages of 3.5±.3 days for all patients waiting between July and September 2010 (13) and 3.1±.6 days for patients waiting in general hospital emergency departments during fiscal year 2012 (14). The male and female adult acute units were the most highly utilized units, at nearly 100% each, although all units had utilization rates over 90% (not shown).
TABLE 2. Simulated base case and alternative scenario results for supply-side adjustments in bed capacity at the state hospitala
ScenariobN of admissionsAverage wait time (days)
MaleFemaleTotalMaleFemaleTotal
M95% CIM95% CIM95% CIM95% CIM95% CIM95% CI
Base case761.4747.9–774.9489.2478.1–500.31,250.61,232.2–1,269.13.93.8–3.92.42.3–2.43.33.2–3.3
Scenario 1: add 24 beds, split equally across 4 regular units (male and female AAU and CTU)813.2798.5–827.9552.7542.4–562.91,365.81,346.1–1,385.63.73.7–3.82.22.1–2.23.13.1–3.1
Scenario 2: add 48 male beds (36 AAU and 12 CTU) to reduce average wait to <3 days1,011.2994.5–1028.0452.4442.8–461.91,463.61,444.3–1,482.83.23.2–3.32.52.4–2.53.03.0–3.0
Scenario 3: add 156 male beds (112 AAU and 44 CTU) and 26 female beds (24 AAU and 2 CTU) to reduce average wait to <2 days1,556.91,537.4–1,576.4610.7598.9–622.52,167.52,144.3–2,190.71.91.9–2.02.01.9–2.02.01.9–2.0
Scenario 4: add 244 male beds (187 AAU and 57 CTU) and 112 female beds (96 AAU and 16 CTU) to reduce average wait to <1 day1,825.21,802.8–1,847.61059.21,045.3–1,073.22,884.42,855.7–2,913.01.11.1–1.2.7.7–.81.0.9–1.0
a
Numbers reported are means and 95% confidence intervals across 50 simulation replications.
b
AAU, adult acute unit; CTU, community transition unit

Expansion Scenario Results

Findings from scenarios 1–4 (Table 2) quantify the expected increases in admissions and decreases in average wait times following targeted hospital capacity expansions. Adding 24 beds increased annual admissions by 9% (115.2 patients) and decreased average wait time by 6% (.2) to 3.1±.1 days. In scenario 2, adding 48 beds increased annual admissions by 17% (213.0 patients) and decreased average wait time by 9% (.3) to 3.0±.3 days. Even with the alternate inpatient psychiatric resources available in the region, reducing simulated average wait times below two days in scenario 3 and below one day in scenario 4 required respective capacity increases of 84% (182 beds, for a 73% increase in admissions) and 165% (356 beds, for a 131% increase in admissions), which greatly exceeded the 70 licensed beds that could have become operational at the study hospital if additional staffing had been made available.

Discussion

Results of supply-side simulations at our study hospital indicated that a large number of additional state hospital beds would be needed to make any substantial impact on the average wait time to admission of people in crisis. Furthermore, reducing average wait time below one day would require nearly a 165% increase in bed capacity at the study hospital. Although recent legislative proposals in North Carolina have called for the construction of a fourth state psychiatric hospital to increase systemwide capacity (15,16), authorizing legislation has yet to be enacted.
All the expansion scenarios considered in this research were based on steady-state assumptions that kept constant both the level of community demand for inpatient psychiatric treatment and the supply of alternative psychiatric beds in community general hospitals and freestanding crisis facilities in the region served by our study hospital. However, bed capacity increases could be made in these community facilities instead of, or as well as, in the state hospital. Expanding community-based intensive outpatient services, such as assertive community treatment, would also help to reduce the need for state psychiatric hospitalizations (17). In other words, a more comprehensive resource optimization model could be constructed to consider demand-side as well as supply-side interventions.
To a limited extent, North Carolina has already increased the availability of general hospital psychiatric inpatient beds for uninsured patients through its three-way contract beds initiative, which provides short-term psychiatric crisis services and detoxification in community hospitals (18). To the extent that such inpatient resources are able to serve patients who otherwise would have been cared for in a state psychiatric hospital, increases in community treatment capacity could achieve reductions in wait time similar to those described in our study hospital expansion scenarios. However, many community facilities are not currently staffed to care for the most acutely ill psychiatric patients and those who become violent. Thus, although buying community hospital beds may initially be less costly than adding state hospital beds, making community beds the sole solution would change community hospital staffing requirements, possibly increasing total costs for North Carolina.
Some other study limitations should be noted. For example, the scenarios we examined were limited to our study hospital, and we may have applied unrealistic assumptions or simulation parameters. However, we sought to ensure accurate model input by relying on utilization data to the extent possible and by involving system stakeholders throughout the model-building process. Also, the simulation model could be adapted to other state psychiatric hospitals in North Carolina and elsewhere in the United States.
Under current policy and financing arrangements, state psychiatric hospitals remain a vital component of the U.S. mental health system, offering treatment for people whose illness severity or violence exceeds the capacity of community providers. Demand for psychiatric hospital beds is increasing (19). At the same time, financially pressed states continue to reduce state hospital capacity (20), in part because of federal regulations precluding Medicaid reimbursement for nongeriatric adults in institutions for mental disease (21). This study highlights an example of the national disconnect between increasing demand for psychiatric inpatient care and decreasing supply.

Conclusions

This supply-side analysis offers a partial answer from the vantage point of a state psychiatric hospital to the growing problem of excessive wait times for psychiatric inpatient care. Coupling this approach with a demand-side analysis would offer a more comprehensive resource optimization model to calibrate trade-offs between investing in additional psychiatric beds and expanding community alternatives to hospitalization. With declining resources at all levels of government for prospective research and program evaluation, simulation models can be used to identify solutions to complex operational problems, such as optimizing a network of crisis response services for a defined geographic area.

Acknowledgments

This research was supported in part by a Gillings Innovation Laboratory Award from the Center for Research and Innovation Solutions at the Gillings School of Global Public Health, University of North Carolina at Chapel Hill. Dr. La’s efforts were partially supported by a National Research Service Award Pre-Doctoral Traineeship from the Agency for Healthcare Research and Quality sponsored by the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, grant T32-HS000032. Dr. Lich’s efforts were partially supported by award KL2RR025746 from the National Center for Research Resources. Dr. Zhu’s efforts were partially supported by National Institutes of Health grant UL1 TR001111 and a start-up grant from the University of Illinois at Urbana-Champaign. The authors gratefully acknowledge North Carolina’s Division of State Operated Healthcare Facilities for providing data for this study.

Supplementary Material

File (appi.ps.201400570.ds001.pdf)

References

1.
Torrey EF, Entsminger K, Geller J, et al: The Shortage of Public Hospital Beds for Mentally Ill Persons. Arlington, Va, Treatment Advocacy Center, 2008
2.
Torrey EF, Fuller DA, Geller J, et al: No Room at the Inn: Trends and Consequences of Closing Public Psychiatric Hospitals. Arlington, Va, Treatment Advocacy Center, 2012
3.
State Mental Health Agency Profiles System. Falls Church, Va, National Association of State Mental Health Program Directors Research Institute, Inc, 2012. Available at www.nri-inc.org/projects/profiles. Accessed Feb 20, 2013
4.
Merchant J: The state of mental health care: a fractured system is in danger of breaking down completely, leaving officials wondering–how did it get this bad? Smoky Mountain News, Jan 16, 2008. Available at www.smokymountainnews.com/archives/item/7764-the-state-of-mental-health-care-a-fractured-system-is-in-danger-of-breaking-down-completely-leaving-officials-wondering-%E2%80%94-how-did-it-get-this-bad
5.
Fisher WH, Geller JL, Pandiani JA: The changing role of the state psychiatric hospital. Health Affairs 28:676–684, 2009
6.
Harrell C, Ghosh BK, Bowden RO: Simulation Using ProModel, 3rd ed. New York, McGraw-Hill, 2011
7.
2008–2012 American Community Survey 5-year Estimates. Table S0101, Age and Sex. Washington, DC, US Census Bureau, 2012. Available at factfinder.census.gov/faces/nav/jsf/pages/searchresults.xhtml?refresh=t. Accessed April 14, 2015
8.
2012 State Medical Facilities Plan. Raleigh, Department of Health and Human Services, North Carolina Division of Health Service Regulation, 2012. Available at www.ncdhhs.gov/dhsr/ncsmfp. Accessed April 8, 2013
9.
Mental Health Facilities (GS 122C) Licensed by the State of North Carolina as of 08/2012. Raleigh, Department of Health and Human Services, North Carolina Division of Health Service Regulation, 2012. Available at www.ncdhhs.gov/dhsr/reports.htm. Accessed Aug 13, 2012
10.
Emergency Department Average Waiting Times, Quarters 1–2 FY2013. Raleigh, Department of Health and Human Services, North Carolina Division of State Operated Healthcare Facilities, 2013. Available at www.ncdhhs.gov/dsohf/facilitydata/reports.htm. Accessed Feb 12, 2013
11.
Banks J, Carson J, Nelson B, et al: Discrete-Event System Simulation, 4th ed. New York, Pearson, 2005
12.
ProModel Professional (release 8.6). Allentown, Pa, ProModel Corp, 2008
13.
Akland G, Akland A: NAMI Wake, Report II: State Psychiatric Hospital Admission Delays in North Carolina. Raleigh, NC, National Alliance on Mental Illness, 2010. Available at www.nami-wake.org/Publications.html. Accessed Jan 9, 2013
14.
Emergency Department Average Waiting Times for Referrals, State Fiscal Year 2012. Raleigh, Department of Health and Human Services, North Carolina Division of State Operated Healthcare Facilities 2012. Available at www.ncdhhs.gov/dsohf/facilitydata/reports.htm. Accessed Aug 13, 2013
15.
Bonner L: Agenda: Mental health issues finally make to-do list. News and Observer (Raleigh, NC), Jan 26, 2013. Available at www.newsobserver.com/2013/01/26/2633770/mental-health-issues-finally-make.html. Accessed April 11, 2013
16.
Bonner L, Gordon M: NC considers adding fourth psychiatric hospital near Charlotte. News and Observer (Raleigh, NC), April 2, 2013. Available at www.newsobserver.com/2013/04/02/2797315/nc-considers-adding-fourth-psychiatric.html. Accessed April 11, 2013
17.
Morrissey JP, Domino ME, Cuddeback GS: Assessing the effectiveness of recovery-oriented ACT in reducing state psychiatric hospital use. Psychiatric Services 64:303–311, 2013
18.
Quinterno J, Rash M: Serving mental health patients in crisis: a review of the state’s program to buy beds and build capacity. North Carolina Insight 23:54–113, 2012
19.
Manderscheid RW, Atay JE, Crider RA: Changing trends in state psychiatric hospital use from 2002 to 2005. Psychiatric Services 60:29–34, 2009
20.
Tracking the History of State Psychiatric Hospital Closures From 1997 to 2015. Falls Church, Va, National Association of State Mental Health Program Directors Research Institute, Inc, 2015. Available at www.nri-inc.org/#!reports-by-year/cm1j. Accessed May 19, 2015
21.
Frank RG, Goldman HH, Hogan M: Medicaid and mental health: be careful what you ask for. Health Affairs 22(1):101–113, 2003

Information & Authors

Information

Published In

Go to Psychiatric Services
Go to Psychiatric Services

Cover: Assinibone hand drum, by Werner Forman. From the Plains Indian Museum, BBHC, Cody, Wyoming. Photo credit: HIP/Art Resource, New York City.

Psychiatric Services
Pages: 523 - 528
PubMed: 26620287

History

Received: 18 December 2014
Revision received: 8 June 2015
Revision received: 23 July 2015
Accepted: 13 August 2015
Published online: 1 December 2015
Published in print: May 01, 2016

Authors

Details

Elizabeth M. La, Ph.D., M.S.E.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.
Kristen Hassmiller Lich, Ph.D., M.H.S.A.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.
Rebecca Wells, Ph.D., M.H.S.A.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.
Alan R. Ellis, Ph.D., M.S.W.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.
Marvin S. Swartz, M.D.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.
Ruoqing Zhu, Ph.D.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.
Joseph P. Morrissey, Ph.D.
When this research was conducted, Dr. La was a doctoral student in the Department of Health Policy and Management, University of North Carolina at Chapel Hill, where Dr. Lich and Dr. Morrissey are affiliated. Dr. La is now with RTI Health Solutions, Morrisville, North Carolina (e-mail: [email protected]). Dr. Morrissey is also with the Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, where Dr. Ellis is affiliated. Dr. Ellis is also with the Department of Social Work, North Carolina State University, Raleigh. Dr. Wells is with the Department of Management, Policy and Community Health, University of Texas School of Public Health, Houston. Dr. Swartz is with the Department of Psychiatry, Duke University Medical Center, Durham, North Carolina. Dr. Zhu is with the Department of Biostatistics, University of North Carolina at Chapel Hill, and with the Department of Statistics, University of Illinois at Urbana–Champaign.

Competing Interests

Dr. Ellis has received funding from Amgen and Merck. The other authors report no financial relationships with commercial interests.

Funding Information

National Institutes of Health10.13039/100000002: RR025747
Agency for Healthcare Research and Quality10.13039/100000133: T32-HS000032
National Center for Research Resources10.13039/100000097: KL2RR025746
University of North Carolina at Chapel Hill: Gillings Innovation Laboratory Award

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Psychiatric Services

PPV Articles - Psychiatric Services

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share