Skip to main content
In April 2022, the Substance Abuse and Mental Health Services Administration (SAMHSA) announced five core priorities for the upcoming year, including overdose prevention and performance measurement. Performance measurement has lagged in the behavioral health field, especially for opioid use disorder (OUD) (1), compared with other areas of medicine (2). The Health Effectiveness and Data Information Set (HEDIS) quality measures for substance use disorders (3) adopted by the Centers for Medicare and Medicaid Services (CMS) are the most widely used measure sets by payers (4); measure selection has important implications for health networks, providers, documentation, and reimbursement. While widely used, the HEDIS measures for substance use disorders grew primarily out of a consensus model from the late 1990s rather than rigorous data analysis (5, 6). Empirical studies are therefore greatly needed to guide measure development and clinical validation to improve patient outcomes at the system level and reduce overdose death.
There are two primary evidence-based interventions for reducing opioid-involved overdose deaths among patients with OUD: medication initiation and medication retention (7). While patients with OUD are receiving medication for OUD (MOUD), most commonly buprenorphine (8, 9), their risk of death declines by 66%–80% (10, 11). MOUD is the gold standard for OUD treatment and are widely promoted by federal health agencies. These two stages, medication initiation and retention, also undergird the OUD Cascade of Care (12).
However, rather than focusing specifically on evidence-based treatment with MOUD, many existing quality measures are intended to apply more generally to any substance use disorder, including those for which medication-based treatment is not available (1). For example, the widely used HEDIS measure of Engagement of Alcohol and Other Drug Abuse or Dependence Treatment, endorsed by the National Quality Forum (NQF #0004) (13), applies to a broad spectrum of substance use disorders and utilizes professional encounters as the measure of success, requiring two outpatient visits or other professional services within 34 days of an initial visit. There is a need to assess how well this general measure specifically applies to individuals with OUD initiating MOUD. For example, are two professional visits within 34 days from an initiation visit for MOUD a necessary condition to achieve minimally adequate MOUD retention?
A generally accepted measure of minimally adequate MOUD retention is incorporated in a measure of pharmacotherapy retention recently endorsed by the NQF (NQF #3175) (14), which specifies that patients initiating a medication, such as buprenorphine, should be continuously retained for a minimum of 6 months. Ideally, clinicians and payers could identify at treatment outset which patients are at risk for dropout before reaching this minimum duration of care.
To investigate the predictive value of early treatment response on 6-month treatment retention, we applied the HEDIS engagement quality measure (NQF #0004) to patients in a multisite, multistate buprenorphine maintenance treatment program. We hypothesized that patients who successfully met the engagement measure would be significantly more likely to be retained through 6 months (NQF #3175). We additionally evaluated whether successful treatment engagement was associated with even longer durations of care (i.e., 12 months and 24 months) and hypothesized that the association would persist but be attenuated.

Methods

We analyzed data from a multisite buprenorphine clinic network (15), primarily managed by advanced practice professionals and supervising physicians across eight states from January 1, 2011 through April 15, 2019, with patient diversity broadly representative of buprenorphine patients nationwide, predominantly male and non-Hispanic White (16, l7). The partner site implemented systemwide protocol-based best practices in addiction treatment, escalating the level of care (i.e., frequency of visits) as needed to help patients achieve clinical stability with care coordination between case managers, physicians, and advanced practice clinicians. Patients were stratified into risk categories based on treatment response (i.e., opioid-free urine drug screen) to determine the number of visits per month, with visits typically conducted weekly or twice weekly in the first month of care. We collected longitudinal clinical data from the unified electronic health record (EHR).
We included individuals initiating a new buprenorphine care episode between January 1, 2011 and March 31, 2017 at provider sites and followed all care episodes for up to 24 months. We limited care episodes to patients completing their intake visit who had not received care at any partner site in the preceding 90-day period in order to identify new care episodes for OUD. The exposure was a dichotomous variable of whether patients satisfied the HEDIS engagement quality measure. In this setting, engagement was defined as two additional in-person outpatient clinical visits within 34 days of the intake visit.
Our primary analysis investigated probability of treatment discontinuation during the 180-day period following admission based on engagement status. We defined treatment discontinuation as a gap of 60+ days in visits, consistent with clinic policies and prior literature (1618). We attributed the last day in care to the final clinic visit date. We calculated both absolute percentage differences in likelihood of successful retention, as well as adjusted odds ratios using logistic regression based on engagement status that adjusted for age, sex, and other baseline patient characteristics including initial drug test results, hepatitis C status, and HIV status. We repeated these analyses for retention at 12 and 24 months as secondary outcomes.
This study followed the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) reporting guidelines (19) and was approved and deemed exempt from requiring informed consent by the New York State Psychiatric Institute IRB.

Results

Our analysis identified 19,487 individuals meeting study eligibility criteria. The average age was 35.7 (SD=10.5 years), and 57.5% male. Among these new patients, 16,063 (82.4%) successfully engaged in care, and 3,424 (17.6%) did not. Among those successfully engaging in care, 47.0% remained in care for a minimum of 6 months versus 2.9% of those who did not meet measurement criteria for initial treatment engagement, yielding an unadjusted odds ratio of 29.1 (95% CI=23.9–35.6). This relationship between engagement and successful retention persisted but was attenuated for longer periods of retention at 12 months and 24 months (31.8% versus 1.5% and 20.8% v. 0.01%, respectively) (Figure 1, data not shown in figure). In adjusted analyses, those who engaged compared with those who did not engage had 20.7 times (95% CI=16.8, 25.5) the odds of 6-month retention. This relationship persisted but was attenuated for longer periods of retention (Table 1). Odds of 6-month retention were also increased for women (adjusted odds ratio=1.32, 95% CI=1.23–1.41), adults aged 50–64 years versus those under 30 years (adjusted odds ratio=2.02, 95% CI=1.80–2.26), those first testing positive for buprenorphine (adjusted odds ratio=1.88, 95% CI=1.75–2.01) compared with their respective reference groups (Table 1). Patients testing positive for cocaine use were less likely than those testing negative to be retained at 6 months (adjusted odds ratio=0.51, 95% CI=0.47–0.57) as well as those positive for hepatitis C at treatment entry (adjusted odds ratio=0.82, 95% CI=0.76–0.89). HIV status was not significantly associated with retention.
FIGURE 1. Retention rates at 6, 12, and 24 months among patients initiating buprenorphine, by engagementa
aTwo additional in-person outpatient clinical visits within 34 days of the intake visit.
TABLE 1. Retention rates at 6, 12, and 24 months among patients initiating buprenorphine, by baseline characteristics
 6-Month Retention12-Month Retention24-Month Retention
CharacteristicOR95% CIpOR95% CIpOR95% CIp
Met engagement criteria?a         
 NoRef  Ref  Ref  
 Yes20.7016.83, 25.46<0.00120.2115.26, 26.76<0.00118.6312.96, 26.79<0.001
Age         
 <30 yearsRef  Ref  Ref  
 30–50 years1.411.31, 1.520.761.421.31, 1.540.891.481.35, 1.620.48
 51–64 years2.021.80, 2.26<0.0012.191.94, 2.47<0.0012.282.00, 2.61<0.001
 ≥65 years1.290.82, 2.030.681.360.83, 2.220.781.731.01, 2.950.60
Sex         
 MaleRef  Ref  Ref  
 Female1.321.23, 1.41<0.0011.441.34, 1.54<0.0011.431.32, 1.55<0.001
Drug screening (positive at intake)         
 Buprenorphine1.881.75, 2.01<0.0011.991.84, 2.16<0.0012.051.87, 2.26<0.001
 Opioids0.630.59, 0.68<0.0010.610.57, 0.66<0.0010.620.56, 0.67<0.001
 Cocaine0.510.47, 0.57<0.0010.480.43, 0.54<0.0010.470.41, 0.54<0.001
 Amphetamines1.080.92, 1.260.381.070.90, 1.260.451.070.89, 1.290.47
 Benzodiazepines1.080.99, 1.190.091.000.90, 1.100.950.940.84, 1.050.29
 THCb1.040.97, 1.110.321.081.00, 1.170.051.040.96, 1.140.33
Comorbid conditions         
 Hepatitis C0.820.76, 0.89<0.0010.730.66, 0.80<0.0010.700.63, 0.77<0.001
 HIV1.110.78, 1.580.550.910.61, 1.340.621.160.77, 1.780.50
a
Two additional in-person outpatient clinical visits within 34 days of the intake visit.
b
THC= delta-9-tetrahydrocannabinol.

Discussion

While we found that almost half of patients who successfully met HEDIS criteria for treatment engagement were subsequently retained in care for a minimum of 6 months, the more striking finding was that only a nominal 2.9% of those who did not engage remained in care at 6 months. This finding is clinically meaningful and could guide intervention development to prioritize stabilization of high risk patients early in treatment.
Results indicate treatment engagement is a threshold process that appears to be a generally necessary condition for adequate MOUD retention at 6 months. Monitoring HEDIS engagement among OUD populations initiating MOUD may help to identify and address barriers, facilitators, and disparities in clinical outcomes. Potential barriers include co-occurring but untreated psychiatric conditions and substance use disorders; logistics related to navigating work schedules, childcare arrangements, and travel; and underdosing of MOUD (20). Interventions including integrated and coordinated care capable of simultaneously treating multiple conditions (21) in a culturally competent manner (22); care coordination services, peer navigators, and transportation and social service assistance (23, 24); telehealth with remote visits; and typical buprenorphine dosing of a minimum 16 mg daily (20, 25) may improve early engagement.
Value based contracts between providers and insurers that reimburse these interventions might enable scaling access to wraparound services. While generic SUD treatment disorder measures such as NQF #0004 appear to be relevant to the process of care for individuals with OUD, development and deployment of additional measures that are specific to the OUD population and to receipt of evidence-based treatments for this disorder, such as MOUD, is also needed to support data-driven continuous quality improvement. Given that patients testing positive for cocaine at intake were half as likely to retain in care, incorporating contingency management for stimulant use disorder among patients with OUD, payments for which are newly allowable by the US Department of Health, may better stabilize early clinical outcomes.
Our findings are subject to several limitations. While our patient population was similar to those in other multisite observational studies of buprenorphine patients (16, 17), it was predominantly non-Hispanic white. Results may not generalize to other patient populations, and we were unable to account for patients who transferred care to other providers, although our prior research suggests this represents fewer than 20% of patients (15). Additionally, while we did not account for buprenorphine dose, all clinics’ protocols guided for a typical daily maintenance dose of 16 mg. To be able to follow all patients for a minimum of 24 months, the study inclusion window closed in mid-2017, prior to the meteoric rise of fentanyl in the illicit drug market. Further, we were unable to account for censoring due to mortality.
Ongoing research is needed to identify patients at greatest risk for overdose, and to develop and refine performance measures that can help guide clinical care decisions, care networks, insurance plans, and administrative data reporting efforts. Rates of fatal opioid overdose have worsened in the last 3 years, particularly among vulnerable subpopulations such as Black individuals who may experience heightened barriers to treatment engagement and retention. We hope this study underscores the need for building an empiric evidence base for optimizing treatment pathways and related performance measures for the diverse array of patients with OUD to help reduce overdose risk.

References

1.
Williams AR, Nunes EV, Bisaga A, et al: Developing an opioid use disorder treatment cascade: a review of quality measures. J Subst Abuse Treat 2018; 91:57–68
2.
Goldman ML, Spaeth-Rublee B, Nowels AD, et al: Quality measures at the interface of behavioral health and primary care. Curr Psychiatry Rep 2016; 18:39
3.
National Committee for Quality Assurance: Proposed Changes to existing Measure for HEDIS 1 MY 2022: initiation and engagement of alcohol and other drug abuse or dependence treatment (IET). Washington, DC, 2021
4.
HEDIS®: Technical Specifications for Health Plans. Washington, DC, National Committee for Quality Assurance, 2021
5.
Garnick DW, Lee MT, Horgan CM, et al: Adapting Washington Circle performance measures for public sector substance abuse treatment systems. J Subst Abuse Treat 2009; 36:265–277
6.
Garnick DW, Lee MT, Chalk M, et al: Establishing the feasibility of performance measures for alcohol and other drugs. J Subst Abuse Treat 2002; 23:375–385
7.
National Academies of Sciences Engineering, and Medicine; Health and Medicine Division; Board on Health Sciences Policy; Committee on Medication-Assisted Treatment for Opioid Use Disorder, Mancher M, Leshner AI, (eds): Medications for Opioid Use Disorder Save Lives. Washington, DC, National Academies Press (US), 2019
8.
Olfson M, Zhang VS, Schoenbaum M, et al: Trends in buprenorphine treatment in the United States, 2009-2018. JAMA 2020; 323:276–277
9.
Morgan JR, Schackman BR, Leff JA, et al: Injectable naltrexone, oral naltrexone, and buprenorphine utilization and discontinuation among individuals treated for opioid use disorder in a United States commercially insured population. J Subst Abuse Treat 2018; 85:90–96
10.
Santo T Jr, Clark B, Hickman M, et al: Association of opioid agonist treatment with all-cause mortality and specific causes of death among people with opioid dependence: a systematic review and meta-analysis. JAMA Psychiatry 2021; 78:979–993
11.
Sordo L, Barrio G, Bravo MJ, et al: Mortality risk during and after opioid substitution treatment: systematic review and meta-analysis of cohort studies. BMJ 2017; 357:j1550
12.
Williams AR, Nunes EV, Bisaga A, et al: Development of an opioid use disorder cascade of care to address the addiction treatment gap. Am J Drug Alc Abuse 2019; 45:1
13.
National Quality Forum Behavioral Health Draft Report for Comment 2017. 2016-2017
14.
Quality ID#468 (NQF 3175): Continuity of Pharmacotherapy for Opioid Use Disorder (OUD)
15.
Williams AR, Mauro CM, Feng T, et al: Non-prescribed buprenorphine preceding treatment intake and clinical outcomes for opioid use disorder. J Subst Abuse Treat 2022; 139:108770
16.
Williams AR, Samples H, Crystal S, et al: Retention on buprenorphine beyond six months and risk of acute care service utilization, opioid prescription use, and overdose. Am J Psych 2019; 177:117–124
17.
Samples H, Williams AR, Crystal S, et al: Impact of long-term buprenorphine treatment on adverse health care outcomes in Medicaid. Health Aff 2020; 39:747–755
18.
Krawczyk N, Mojtabai R, Stuart EA, et al: Opioid agonist treatment and fatal overdose risk in a state-wide US population receiving opioid use disorder services. Addiction 2020; 115:1683–1694
19.
von Elm E, Altman DG, Egger M, et al: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Ann Intern Med 2007; 147:573–577
20.
Martin SA, Chiodo LM, Bosse JD, et al: The next stage of buprenorphine care for opioid use disorder. Ann Intern Med 2018; 169:628–635
21.
Center for Substance Abuse Treatment: Substance Abuse Treatment for Persons with Co-Occurring Disorders. Treatment Improvement Protocol (TIP) Series 42. DHHS Publication No. (SMA) 05-3992. Rockville, MD, Substance Abuse and Mental Health Services Administration, 2005
22.
Alegría M, Frank RG, Hansen HB, et al: Transforming mental health and addiction services. Health Aff 2021; 40:226–234
23.
Bassuk EL, Hanson J, Greene RN, et al: Peer-delivered recovery support services for addictions in the United States: a systematic review. J Subst Abuse Treat 2016; 63:1–9
24.
Powell KG, Treitler P, Peterson NA, et al: Promoting opioid overdose prevention and recovery: an exploratory study of an innovative intervention model to address opioid abuse. Int J Drug Policy 2019; 64:21–29
25.
Meinhofer A, Williams AR, Johnson P, et al: Prescribing decisions at buprenorphine treatment initiation: do they matter for treatment discontinuation and adverse opioid-related events? J Subst Abuse Treat 2019; 105:37–43

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 454 - 457
PubMed: 36285405

History

Received: 19 May 2022
Revision received: 5 July 2022
Accepted: 9 August 2022
Published online: 26 October 2022
Published in print: June 01, 2023

Keywords

  1. Substance-Related and Addictive Disorders
  2. Opioids
  3. Medication-Assisted Treatment

Authors

Details

Arthur Robin Williams, M.D., M.B.E. [email protected]
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Christine M. Mauro, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Tianshu Feng, M.S.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Amanda Wilson, M.D., M.A.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Angelo Cruz, B.S.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Mark Olfson, M.D., M.P.H.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Stephen Crystal, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Hillary Samples, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).
Lisa Chiodo, Ph.D.
Department of Psychiatry, New York State Psychiatric Institute, Columbia University Medical Center (Williams, Olfson); Columbia University Mailman School of Public Health (Mauro, Olfson); Research Foundation for Mental Hygiene, New York (Feng); Addiction Research and Education Foundation, Florence, Mass. (Wilson, Cruz); North-Star Care, Inc. Gig Harbor, Wash. (Wilson); Institute for Health, Health Care Policy, and Aging Research, Rutgers University, New Brunswick, N.J. (Crystal, Samples); University of Massachusetts Amherst, School of Nursing, Amherst, Mass. (Chiodo).

Notes

Send correspondence to Dr. Williams ([email protected]).

Competing Interests

The authors report no financial relationships with commercial interests.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share