The emergency department (ED) is a frequent source of care for individuals with mental and substance use disorders (
1,
2). One out of every eight ED visits involves a mental or substance use disorder diagnosis (
3). For the majority of these visits, the individuals are discharged to the community (only persons who are an imminent threat to themselves or others are admitted to inpatient care), and some studies suggest that only half receive timely follow-up care after discharge (
4–
6).
Individuals who do not receive follow-up care after ED visits are more likely to return to the ED and experience worsening of their conditions (
7,
8). As a result, some service systems have taken steps to develop better linkages between EDs and community-based providers (
9,
10). Improving the delivery of follow-up care is particularly important to state Medicaid programs because they face budget pressures and increasing enrollment of individuals with mental health conditions and substance use disorders. In addition, consumers have expressed a need for support in obtaining follow-up care after psychiatric emergencies (
11).
Surprisingly few large studies have examined the receipt of follow-up care among Medicaid beneficiaries after ED visits for behavioral health conditions. Such information would be useful for policy makers, providers, and other stakeholders to understand the magnitude of the problem and to establish a benchmark by which to measure progress. Furthermore, information is needed to understand how follow-up care may be associated with beneficiary characteristics, such as geography, race-ethnicity, and diagnosis. Such information could be valuable to target quality improvement efforts.
To fill this gap in the literature, this study used Medicaid claims data from 15 states and the District of Columbia (DC) to examine the extent to which the receipt of follow-up care after discharge from the ED for visits related to mental and substance use disorders varied by state. The study also examined whether receipt of follow-up care was related to geography, race-ethnicity, age, sex, and ED diagnosis.
Methods
Data
The study used Medicaid Analytic Extract (MAX) data from calendar year 2008 (the most recent year for which data were available at the start of the analysis). MAX data are created from Medicaid eligibility and claims files that are submitted by all states and DC to the Centers for Medicare and Medicaid Services (CMS). MAX data include beneficiaries’ demographic characteristics and diagnosis and procedure codes for all Medicaid-reimbursed services. Data elements are standardized across states to create comparable measures of service use. MAX data contain fee-for-service (FFS) claims submitted for billing and some managed care encounter data for services provided by health maintenance organizations (HMOs) and behavioral health organizations (BHOs).
FFS MAX data undergo data quality reviews to assess completeness and reliability. In contrast, at the time of this study, managed care encounter data did not undergo such a review. Previous analyses of the completeness and reliability of encounter data in MAX found that information is often missing for one or more managed care plans in a state (
12) and that only two states had reasonably complete data from managed BHOs (
13). To avoid estimating artificially low ED use or follow-up rates on the basis of incomplete data, we did not include managed care encounter data.
States with high levels of enrollment in Medicaid managed care plans and states without reliable or complete FFS data were excluded. States in which at least 75% of beneficiaries were in FFS plans were included. Therefore, 23 states with high rates of HMO or BHO enrollment were excluded because FFS data were not representative of the state Medicaid population, four states were excluded because the Medicaid eligibility or FFS data were unreliable, and eight states were excluded because there were fewer than 150 ED visits for mental or substance use disorders that resulted in discharge to the community. Within the remaining states, the study population was limited to beneficiaries who were ages 18 and older, who had full Medicaid benefits, and who were enrolled in Medicaid for the entire calendar year. Beneficiaries who were dually eligible for Medicare or who had private insurance were excluded because we did not have access to all of their claims.
Information from Medicaid eligibility files was linked to information from the Area Health Resource file to designate whether a beneficiary lived in a metropolitan area (at least one urban cluster with a population of at least 50,000); micropolitan, or suburban, area (at least one urban cluster with a population of at least 10,000 but less than 50,000); or rural area (no urban cluster of at least 10,000)—as defined by the Office of Management and Budget.
Institutional review board approval was not required for this project. A data use agreement with CMS governed the security of the data and protected the confidentiality of beneficiaries.
Analyses
We used revenue and diagnosis codes to create two groups of ED discharges, one group for which the primary ED diagnosis was related to mental health and a second group for which the primary ED diagnosis was related to substance use disorder. An individual with more than one discharge could be represented multiple times, once for each ED discharge.
We then calculated seven- and 30-day follow-up rates. For ED visits that had a primary mental health diagnosis, follow-up was defined as an outpatient visit to any provider for which the primary diagnosis was related to mental health. Likewise, for ED visits that had a primary diagnosis of a substance use disorder, follow-up was defined as an outpatient visit to any provider for which the primary diagnosis was related to a substance use disorder. These definitions of follow-up care were used to ensure that the outpatient visit included some attention to the condition associated with the ED visit. After calculating whether follow-up occurred for each discharge, we aggregated the rates into state-level follow-up rates and used descriptive statistics to examine the distribution of follow-up across states.
We then conducted four separate multivariate random-effects logistic regression models. Each regression modeled the odds of follow-up (seven- or 30-day follow-up modeled separately) as a function of beneficiary age group, race-ethnicity, Medicaid eligibility group (adult/poverty, disabled, or child), primary ED diagnosis, and geographic setting (metropolitan, micropolitan, or rural). Each regression accounted for the clustering of beneficiaries within a state. To guard against drawing spurious conclusions that could result from making multiple comparisons, we implemented a Bonferroni correction to lower the acceptable p value of statistical significance from .05 to ≤.008. SAS software, version 9.3, was used to conduct the analyses.
Discussion
Despite the importance of follow-up care, on average about one-quarter of mental health ED discharges and about one-third of substance use disorder ED discharges were not associated with follow-up within 30 days. The receipt of follow-up care among Medicaid beneficiaries varied widely across states: in some states fewer than half of discharges were followed by follow-up care within seven days, whereas follow-up rates exceeded 80% in other states. In addition, the receipt of follow-up was associated with beneficiary age, race-ethnicity, geographic setting, and clinical conditions. These findings suggest that some state Medicaid programs have a considerable opportunity to improve follow-up care. To our knowledge, no other data have been published on state rates of follow-up after ED discharge among Medicaid beneficiaries that could serve as a comparison with these findings. Thus our findings may serve as a benchmark for future studies and quality improvement efforts.
Overall, we found average follow-up rates that are somewhat higher than those observed in other studies. For example, one study of managed care enrollees in a single state found that 22% of substance use disorder ED discharges were associated with follow-up care within 14 days (
5). One study of Medicaid beneficiaries treated in the ED for self-harm found a 30-day follow-up rate of 52% (
4). Our average rates may be higher because our definition of follow-up care and the populations we included were broader than those of the two earlier studies. In addition, our study included many states and a large number of beneficiaries. In contrast, Breton and colleagues (
5) used a small sample of managed care beneficiaries in a single state that was not included in our analysis. Olfson and others (
4) defined follow-up as outpatient mental health visits among adults treated in the ED for deliberate self-harm.
Receipt of follow-up care was similar within seven days for both mental health and substance use disorder ED discharges, but at 30 days, follow-up was somewhat higher for mental health discharges compared with substance use disorder discharges. In other words, between seven and 30 days, receipt of follow-up care rose by 10.1 percentage points among mental health ED discharges but by only 2.1 percentage points among substance use disorder ED discharges. This divergence between the two discharge groups may reflect that historically, many state Medicaid programs have provided limited coverage of outpatient substance abuse services (
14). However, we could not directly measure the generosity of state Medicaid benefits in this study. The source of these differences merits further investigation.
Similarly, there were differences between the beneficiary characteristics associated with receipt of follow-up care for mental health and substance use disorder ED discharges. Notably, African-American beneficiaries with ED discharges for mental health were relatively less likely than white beneficiaries to receive follow-up care; this is consistent with previous research on the delivery of general health and mental health services among Medicaid beneficiaries, which has suggested that African Americans fare worse than their white counterparts on a variety of performance metrics (
15–
17). In contrast, African Americans with ED discharges for substance use disorders were slightly more likely than whites to receive follow-up. A previous study found the same relationship (
18). Although the underlying reasons that African Americans may be more likely to receive follow-up after a substance use disorder ED discharge are unclear, others have suggested that African Americans may be more likely to be under court order to receive treatment for substance use disorders because of their overrepresentation in the criminal justice system or it may be related to other socioeconomic factors that we could not measure by using claims data (
18).
Consistent with known geographic differences in the availability of specialty behavioral health providers (
19,
20), the odds of follow-up after both types of ED discharges were slightly worse in rural areas compared with metropolitan areas, although the difference was not significant for substance use disorder ED discharges. In contrast, the odds of follow-up for substance use disorder ED discharges were slightly better in micropolitan (suburban) areas compared with metropolitan areas. Claims data alone cannot explain the source of these differences.
Despite the inclusion of a relatively large number of states and beneficiaries in this analysis, this study had several limitations. Our reliance on claims data limited our ability to measure factors that may be associated with the receipt of follow-up care. For example, another study suggested that having a place to live may influence receipt of follow-up care (
21). In addition, we could not easily account for the state-level characteristics that may influence follow-up rates, such as the availability of behavioral health providers or the generosity of Medicaid benefits. To investigate the source of state variation in follow-up rates, we conducted several post hoc analyses by using publicly available information. Specifically, we reviewed per capita psychiatrists, per capita mental health and substance abuse state spending on community-based programs, and special state initiatives on emergency psychiatric care but did not find strong correlations with state-level follow-up rates. Because this is the first large-scale study to measure follow-up care after mental health and substance use disorder ED discharges, further research should build on these findings to identify the sources of state and beneficiary variation.
Because our findings were based on FFS claims, we cannot know to extent to which the findings are generalizable to managed care populations. Some functions provided by managed care organizations, such as care coordination, may promote follow-up care. However, the measurement of follow-up care reported in this article was endorsed by the National Quality Forum (NQF) as a quality measure and may be reported by managed care plans and other entities in the future, allowing for direct comparisons with the FFS population. In addition, states participating in the Certified Community Behavioral Health Clinic demonstration program are required to report this measure, which will allow for comparisons in the future.
Finally, in adherence to standards for performance measurement (
22), the state-level follow-up rates were not “risk adjusted” for beneficiary characteristics, such as race or ethnicity. Risk adjustment at the state level for these characteristics implicitly suggests that certain subgroups of beneficiaries are not entitled to the same standard of follow-up care. Instead, it is important to observe and investigate meaningful differences in follow-up, such as those identified in our regression analyses. In addition, because the unadjusted NQF measure will be reported by managed care plans and states in the future, adjusting state-level follow-up rates by beneficiary characteristics could make them noncomparable to future reports.
Acknowledgments
The authors appreciate the guidance of D. E. B. Potter, M.S., Joel Dubenitz, Ph.D., and Kirsten Beronio, J.D., from ASPE; Lisa Patton, Ph.D., from the Substance Abuse and Mental Health Services Administration; and Melissa Azur, Ph.D., M.S., from Mathematica—and the insights of a technical advisory panel.