In the United States, opioid overdose deaths have increased significantly over the past two decades (
1,
2). This trend has been attributed to several factors, including an increased rate of prescription of opioid painkillers (
3), subsequent cross-conversion to heroin use (
4), and a dramatic rise in the availability of fentanyl and related high-potency synthetic opioids (
5). A substantial body of evidence has shown that treatment with medication for opioid use disorder (MOUD) can decrease both overdose risk and all-cause mortality among people with opioid use disorder (OUD) (
6). Therefore, MOUD treatment is one of the critical pathways for overdose prevention (
7,
8) in addition to other effective public health–oriented and systems-level interventions (
9–
11). However, although substantially lower compared with periods out of care, an excess risk of drug-related death seems to remain during pharmacological treatment (
12–
15), with a particularly elevated risk of mortality during the induction phase to MOUD and the time immediately after leaving treatment (
16,
17).
It is important to understand what factors place an individual at increased risk for opioid overdose, and this has been a target of predictive modeling. For example, based on a retrospective cohort, a model including five variables (age, age-squared, medications dispensed, tobacco use, and mental health and substance use diagnoses) predicted 66%–82% of overdoses that occurred among individuals on chronic opioid treatment over the next 2 years (c-statistic=0.75) (
18). Another retrospective cohort study, using Prescription Drug Monitoring Program data, showed that patterns of prescription fills (including long- and short-acting opioids, buprenorphine, benzodiazepines, and muscle relaxants) can help identify those at risk of fatal overdose events (
19). The focus of these efforts is on using information gathered by primary care, pain management, and other physicians at the time of initial engagement with patients to make a decision to either reduce or eliminate opioid prescriptions (
20). Risk prediction models can also make a specific but not sensitive estimate of opioid overdose risk within the general population (
21), and given that drug overdose is a statistically rare event in the general population, it is difficult to apply these models in clinical contexts.
On an individual level, the risk of an overdose event during a course of treatment with MOUD has not been clearly delineated. Therefore, a complementary goal for risk scoring modeling in this field is to focus on the patient population that is more relevant to addiction treatment professionals, rather than the overall population or patients who are receiving opioid prescriptions for pain control: Once a patient is diagnosed with opioid use disorder (OUD) and engaged in MOUD treatment, what is the risk of this individual having an overdose event? Another relevant question is whether the medication used influences the risk of overdose in the period immediately after treatment initiation. Retrospective cohort studies have suggested that buprenorphine treatment is associated with lower overdose risk compared with methadone (
22) and extended-release naltrexone (
23), while crude mortality rates of patients treated with methadone, buprenorphine, or naltrexone seem to be comparable (
24). Another retrospective comparative effectiveness study (
25) indicated that treatment with buprenorphine or methadone, but not naltrexone, was associated with a reduced risk of overdose compared with no treatment during the 12-month follow-up period. However, given the lack of randomization, these studies are limited by differences between cohorts in baseline characteristics and confounding by indication.
Our aim in this study was to address these research gaps by leveraging a new data set, harmonizing three large pragmatic clinical trials of MOUD treatment conducted within the National Institute on Drug Abuse’s National Drug Abuse Treatment Clinical Trials Network (CTN), where the treatment group was randomly assigned and harmonized safety monitoring data were used to track fatal and nonfatal overdose events. Using a panel of baseline predictors, we constructed predictive models that estimate the risk of overdose during MOUD treatment and compared the overall risk for each of the treatment groups (methadone, buprenorphine, and extended-release injection naltrexone). We hypothesized that several common predictor variables, such as baseline substance use, particularly use of benzodiazepines and opioids (
19,
26), and medication nonadherence (
16,
17) would be associated with an increased overdose risk during MOUD treatment.
Methods
Clinical Trial Data Sources
Data from three large randomized controlled MOUD clinical trials from the CTN were included in our analysis: CTN0027 (START) (
27), CTN0030 (POATS) (
28), and CTN0051 (X:BOT) (
29). Full protocols for the individual studies have been published. Briefly, all three trials enrolled adult participants who met DSM-IV-TR criteria for opioid dependence or DSM-5 criteria for OUD. The studies employed broad pragmatic inclusion criteria and few exclusion criteria other than major medical and unstable psychiatric comorbidities (and individuals with heroin use only [CTN0030] and current methadone treatment [CTN0051]). Given the open-label design of these studies, participants who failed to initiate the study medication or stopped their medication during the trial were not automatically excluded from the study. Rather, induction failure (
29) or treatment exposure (i.e., percentage of dispensed medication doses) (
27) were assessed as secondary outcomes.
CTN0027, which had a 24-week treatment period, randomized participants to open-label outpatient methadone or buprenorphine treatment after 12–24 hours of abstention from opioids and presenting with mild withdrawal. The maximum maintenance dosage for buprenorphine was 32 mg/day (mean maximum daily dose, 22.1 mg [SD=8.2]), and no maximum methadone maintenance dosage was specified (mean maximum daily dose, 93.2 mg [SD=42.2]).
CTN0030 had two phases. In phase 1, participants who were primary prescription opioid users seeking outpatient treatment were inducted on buprenorphine, with a maintenance dosage of 8–32 mg/day. Participants were randomized to standard medical management (a manual-based brief intervention delivered by the study physician) or opioid dependence counseling (longer sessions by trained nonphysician psychotherapy providers). Buprenorphine was tapered at weeks 3–4, and participants were followed for another 4–8 weeks. About 6.8% of participants succeeded by week 12 in maintaining abstinence, and the rest were invited to enter phase 2, which had a 16-week treatment period: a 12-week buprenorphine stabilization treatment followed by a 4-week taper; the study also included an 8-week posttreatment follow-up. For the present analysis, we considered baseline data collected at the start of phase 1 and clinical data from phase 2, given that this portion of the study matched the condition of the other two trials. There were no recorded overdose events in phase 1.
In CTN0051, which had a 24-week treatment period, participants were initially detoxified (using a variety of pragmatic protocols) in an inpatient setting and were randomized to outpatient treatment with buprenorphine or extended-release naltrexone. Naltrexone was given every 28 days, and initial dosing required passing a naloxone challenge, with rechallenge in case of a missed dose before reinitiation of naltrexone. The maximum maintenance dosage of buprenorphine was 24 mg/day.
A helical team approach for harmonization was used, where data integrity was verified by two teams of statisticians for the baseline covariates. For the present analyses, we included the following harmonized baseline characteristics: age, sex, race/ethnicity; self-reported use of heroin, prescription opioids, benzodiazepines, cannabis, and stimulants (using the timeline followback method [
30]); alcohol intoxication (defined as ≥3 drinks/day, assessed with the Addiction Severity Index–Lite [
31] for CTN0030 and the timeline followback for CTN0027 and CTN0051) in the 28 days before baseline; current nicotine dependence (using the Fagerström Test for Nicotine Dependence [
32]); and lifetime diagnoses of panic disorder, anxiety disorder, and major depression. We also harmonized the adverse event logs with case report forms from all three trials. Adverse event and serious adverse event forms were completed weekly until week 24 for CTN0027 and CTN0051, and biweekly until week 16 for CTN0030. Nonfatal self-reported overdose events and deaths were queried using standard adverse event and serious adverse event forms and were reviewed by an independent medical monitor.
Identification of Overdose Events in the Data
We first compiled a list of events that contained the term “overdose” in any row in available safety data from both the adverse event form and the serious adverse event narratives of the randomized sample (N=2,199). The following information was abstracted for each event: any information reported on the adverse event form, the Medical Dictionary for Regulatory Activities (MedDRA) preferred term for the event, event onset date, name of serious adverse event, description of serious adverse event, treatment information (including type of treatment, dosage, starting date, and most recent date of treatment administration), relevant history, and study. Three independent raters (L.B., F.C., S.X.L.) reviewed this list to identify likely overdose events using clinical judgment. Events were coded 1, 2, or 3, indicating likely opioid overdose, likely non-opioid overdose, and not overdose, respectively. The raters achieved substantial agreement (Fleiss’ kappa=0.74) (
33).
Subsequently, any disagreements in the ratings were discussed in consultation with a fourth author (E.V.N.). The final categorization of overdose events followed a classification that had been used previously to explore CTN0051 overdose data (
34). Events were categorized as a likely overdose if “overdose” or “opioid overdose” was the MedDRA preferred term for the event. Alternatively, “overdose” or “opioid overdose” was not the MedDRA preferred term for the event, but the word “overdose” appeared in the listing on the adverse event form or in the serious adverse event narrative.
Type of overdose (opioid, other substance, substance unknown) was coded as a separate variable. Any likely overdose event that met at least one of the following criteria was classified as a likely opioid overdose: the adverse event or serious adverse event name or MedDRA preferred term indicated heroin, opioid, or opiate overdose or toxicity; the adverse event or serious adverse event was treated with naloxone; the death certificate indicated heroin, opioid, or opiate overdose; the patient was treated for the adverse event or serious adverse event in the hospital and the narrative indicated heroin or opioids.
Data Analysis
We included only the first overdose for participants with multiple events and censored cases without an overdose event by study week 24. A log-rank test was used to test differences in the probability of an overdose event by the time of last follow-up or week 24 between groups with different demographic and baseline characteristics. Binary indicators of baseline substance use, rather than continuous indicators (number of days of use in the 28 days before baseline), were used because there was no linear relationship between days of use and overdose risk. In addition, binary indicators may be more useful in clinical practice given their ease of assessment and computation and their straightforward clinical interpretability. We report the observed percentage of having an overdose event in the 24 weeks after randomization by assigned treatment (buprenorphine, methadone, and extended-release naltrexone) overall and depending on induction status (inducted onto medication, yes/no) and baseline benzodiazepine use (yes/no).
Survival analysis with a time-dependent Cox proportional hazard model (
35) was used to test the effects of treatment group assignment (CTN0027: buprenorphine; CTN0027: methadone; CTN0030: buprenorphine; CTN0051: extended-release naltrexone; CTN0051: buprenorphine) on drug overdose. The model controlled for sociodemographic variables (sex, age, race/ethnicity), any self-reported use, in the 28 days before baseline, of heroin, prescription opioids, and benzodiazepines (yes/no for each), and three time-varying covariates—dummy variables for not having been inducted on the assigned medication at the time of overdose, having stopped the assigned medication after initial induction and before end of treatment, and number of days stopping the assigned medication. Two cases without information on baseline substance use were excluded from these analyses.
A sensitivity analysis confirmed the conclusion from the Cox proportional hazard model with a competing risk model (the Fine-Gray model) (
36), which aims to correctly estimate the probability of an event (here, overdose) irrespective of the outcome of another variable (competing event; here, study dropout). If the censoring is confounded with the outcome, the competing risk model estimates the marginal probability of overdose in the presence of a competing event (study dropout), and thus the overdose probability is unbiased. In addition, we repeated the proportional hazard model testing the effects of treatment group assignment and other covariates on the subsample of participants who received at least one dose of the assigned study medication. Statistical analyses were performed with
proc phreg in SAS, version 9.4.
Results
Overdose events and the substance involved in the overdose are tabulated in
Table 1. We identified 57 likely overdose events total, and opioids were either the only substance or one of multiple substances involved in 28 of these events. Among the events without opioid involvement, the majority were likely benzodiazepine overdoses (N=7), followed by cocaine/stimulant overdoses (N=4), and one polysubstance overdose involving benzodiazepines, alcohol, and a cold and flu medication that contains acetaminophen, dextromethorphan, and doxylamine. The 57 overdose events were experienced by 51 participants. Forty-six participants experienced one overdose, four participants experienced two overdoses, and one participant experienced three overdoses during their time in the study. Twelve “likely overdoses” occurred after week 24 (two in CTN0027 in weeks 27 and 29, and 10 in CTN0051 in weeks 26, 28, 29, 29, 31, 34, 36, 36, 36, and 47) and were not counted as overdose events in subsequent analyses.
Overall, 1.78% of participants (39 of 2,199) experienced at least one overdose event by the time of their last follow-up or week 24, whichever occurred first.
Table 2 summarizes the overdose events by sociodemographic characteristics, treatment group, baseline substance use, and lifetime anxiety, panic, or major depression diagnosis.
The observed percentages of having an overdose event in the 24 weeks after randomization by medication group are presented in
Table 3. Overall, the observed rate of having an overdose event was 5.30% (15/283) among patients assigned to naltrexone, 1.51% (8/529) among those assigned to methadone, and 1.15% (16/1,387) among those assigned to buprenorphine. Self-reported use of benzodiazepines at baseline was associated with an increased observed percentage of having an overdose event in all three groups (
Table 3). Notably, more than one-fourth of patients (27.9%) assigned to extended-release naltrexone never initiated the medication, compared with only 2.2% of those assigned to buprenorphine and 1.7% of those assigned to methadone. Among those who initiated extended-release naltrexone, the overdose rate was 3.9% (8/204), compared with 8.9% (7/79) among patients who failed to initiate.
Fifteen participants who experienced an overdose by week 24 stopped their medication prior to the event. Among participants assigned to methadone (eight overdose events total), one participant stopped the medication 1 day before the overdose event. In the three buprenorphine groups (16 overdose events total), eight participants stopped their medication 1 (N=2), 16, 21, 30, 91, 96, and 119 days before the overdose event. In the naltrexone group (15 overdose events total), six participants stopped their medication 5, 14, 27, 45, 59, and 121 days before the overdose event. An additional eight participants (one assigned to buprenorphine and seven to naltrexone) were not inducted on their assigned study medication before the overdose event.
A proportional hazard model (
Table 4) testing the effects of study medication group assignment (five groups) on overdose, controlling for sociodemographic variables, baseline use of benzodiazepines, heroin, and prescription opioids, and three time-varying medication adherence covariates, revealed significant effects of baseline benzodiazepine use (χ
2=13.46, p<0.001), noninduction to the assigned medication (χ
2=10.81, p=0.001), and stopping the assigned medication after induction (χ
2=8.00, p=0.005) on overdose. The overall effect of naltrexone assignment on overdose was not significant (χ
2=8.63, df=4, p=0.071). Those who reported use of benzodiazepines in the 28 days before baseline (hazard ratio=3.36, 95% CI=1.76, 6.42, p<0.001) and those who either were never inducted on their assigned study medication (hazard ratio=6.64, 95% CI=2.12, 19.54, p=0.001) or stopped their medication after initial induction (hazard ratio=4.04, 95% CI=1.54, 10.65, p<0.001) had a significantly higher probability of experiencing an overdose event. However, the number of days stopping the assigned medication did not have a significant effect on overdose risk. In addition, there was no significant interaction between assigned medication and having stopped the medication (χ
2=0.498, df=2, p=0.780) or between the assigned medication and baseline benzodiazepine use (χ
2=5.55, df=2, p=0.062).
A sensitivity analysis on a competing risk model to estimate the marginal probability of overdose in the presence of a competing event (study dropout) did not alter the main findings (see Table S1 in the online supplement). Note that this model does not include the three time-varying medication adherence covariates. In a competing risk model on the subsample that initiated their assigned medication, the main effect of study medication group assignment (five groups) on overdose was no longer significant (χ2=5.99, df=4, p=0.200). Another sensitivity analysis on a proportional hazard model on the subsample that initiated their assigned medication also found that those who reported benzodiazepine use in the 28 days before baseline and/or stopped their assigned medication after initial induction had a significantly higher probability of experiencing an overdose event. However, overdose rates did not differ by treatment group (see Table S2 in the online supplement).
Discussion
The aim of this study was to estimate the risk of overdose events once a patient is diagnosed with OUD and engaged in MOUD treatment and to test whether the assignment to a medication (methadone, buprenorphine, extended-release naltrexone) influences this risk. Our data, drawn from three previously completed clinical trials, indicate that patients undergoing MOUD treatment have a nonnegligible risk of overdose events in the first 24 weeks of treatment (39 of 2,199 patients; 1.78%). The overall prevalence of overdose was comparable with that in a nationally representative sample of commercial insurance and Medicare Advantage enrollees with OUD, of whom 1.7% (N=707) experienced an overdose within a 12-week follow-up period (
25).
Most overdoses by week 24 were observed in CTN0051. A defining feature of the study was recruitment of patients from inpatient detoxification units who, compared with patients initiating outpatient medication treatment, may be at greater risk of early “treatment failure” (i.e., dropout or induction failure) and overdose after leaving the controlled setting (
37,
38). Compared with CTN0051 and CTN0027 (
27,
29), both of which included patients who primarily used heroin, notably fewer overdoses were observed among CTN0030 participants, who were primary prescription opioid users seeking outpatient treatment (
28). Prescription opioid use has been associated with lower health risks and less severe patterns of psychopathology compared with heroin use (
39,
40). In addition, both CTN0030 and CTN0027 were conducted earlier than CTN0051 and likely predate the occurrence of fentanyl in the heroin supply (
41).
In addition to sample differences, differences in medication dispensing need to be considered. In CTN0027, study medication was dispensed daily (methadone) or three times weekly (buprenorphine; clinic schedule permitting). In CTN0030, buprenorphine was dispensed during weekly follow-up visits. And in CTN0051, buprenorphine was dispensed to participants weekly until week 4 and then biweekly, and extended-release naltrexone injections were given approximately every 4 weeks or sooner if clinically indicated, with a minimum of 21 days between injections. Different dispensing schedules and methods may have an impact on medication adherence and overdose risk, respectively. In our data, we observed more patients who stopped their medication prior to an overdose event in the buprenorphine group (eight of 16 participants who overdosed) and the naltrexone group (six of 15 participants who overdosed) compared with the methadone group (one of eight participants who overdosed). Treatment with naltrexone, along with the required detoxification period before initiation, increases sensitivity to the effects of opioids, and when naltrexone is stopped, the patient is in a nontolerant state, with the accompanying risk of overdose that is clearly articulated in the official prescribing information for extended-release naltrexone (
42). In our model, discontinuation of medication after induction, but not length of discontinuation, predicted overdose. Therefore, any interruption in treatment may substantially increase the risk of overdose, regardless of MOUD option (
16,
17). However, the confidence intervals of medication adherence effects on overdose were wide, and these findings should be viewed as hypotheses to be tested on new data in future research. To achieve longer MOUD retention and better adherence in clinical practice, it is also important to identify and address demand-side barriers, such as patient cost sharing (
43), structural barriers such as accessibility (
44), and socioeconomic barriers such as unemployment and housing instability (
45).
Among the three medication groups, assignment to extended-release naltrexone was associated with the highest observed rate of having an overdose event within 24 weeks. Retrospective cohort studies have suggested that treatment with methadone and buprenorphine, but not naltrexone, are associated with a reduced risk of overdose (
23,
25,
46). However, no previous large clinical trial data set has provided a clear signal that treatment with extended-release naltrexone increases the risk of overdose compared with other MOUD options. In the primary intent-to-treat analyses of CTN0051, there were more overdoses among patients on extended-release injection naltrexone than among those on buprenorphine, but the difference did not reach significance (
29). A secondary analysis of CTN0051 (
47) suggests a higher risk of overdose on extended-release naltrexone, although much of this risk was attributable to naltrexone induction failure (
34). The present analysis used a larger sample, which included data from CTN0051 and two other studies and therefore had enhanced power to detect a risk difference. However, in our model controlling for sociodemographic variables, baseline use of opioids and benzodiazepines, and medication adherence (induction failure, medication discontinuation, and length of time off medication), the overall effect of naltrexone assignment on overdose was nonsignificant.
Naltrexone is more difficult to initiate than methadone or buprenorphine (
29), and the present results suggest that the observed increased overdose risk associated with naltrexone assignment is attributable, at least in part, to failed induction attempts. This assumption is corroborated by our sensitivity analysis on a proportional hazard model after first induction on the assigned medication, which showed no significant difference in overdose rate between treatment groups. If naltrexone initiation is not feasible, clinicians should encourage patients to pivot to another MOUD option. For example, buprenorphine can be easily started when an attempt to initiate naltrexone appears to be failing (
48), and it would protect against overdose.
Finally, benzodiazepine use in the 28 days before starting MOUD was a predictor of overdose risk during treatment. This finding extends previous results showing that benzodiazepines, either coprescribed (
49) or used illicitly (
50,
51), are associated with an increased risk of overdose mortality among people with OUD. A comparison of blood toxicology in drug-related fatalities among patients with OUD treated with methadone, buprenorphine, or naltrexone identified opioids and benzodiazepines in more than three-fourths of postmortem blood samples, with no difference between medication groups (
52). Adding to these results, we did not find a significant interaction effect on overdose risk between assigned treatment and baseline benzodiazepine use. Benzodiazepines could be a marker for co-occurring mental health problems associated with overdose risk (
18), and they increase the respiratory depressant effect of opioids (
53).
Among this study’s strengths is that the data set represents the largest individual-level clinical trial data set in OUD treatment, harmonized through the multi-institutional CTN infrastructure, with commonly collected baseline predictors that are practical and interpretable in clinical practice. The randomized treatment assignment offered some protection against unmeasured confounding common in models derived from observational data sets. However, whereas participants were randomized to condition, they were not randomized to trial, and because not all trials included all MOUD options, there is the possibility of unmeasured confounding between those nonoverlapping study arms.
We took a systematic team approach to identifying overdose events in available safety monitoring data. However, a previous in-depth examination of adverse event and serious adverse event forms in CTN0051 suggests that there are some likely overdose events that are described with terminology other than “overdose” (
34). In addition, standard adverse event and serious adverse event assessments do not specifically probe for overdose events, but rather for adverse events in general, and some participants may have neglected to report nonfatal overdoses. Moreover, for some fatalities in the trials, cause of death was unknown or not specified. Thus, the events examined here may be an underestimate of the true number of fatal and nonfatal overdoses in the samples. In addition, we were limited to the adverse event description provided by site clinicians based on all available clinical information, with varying detail and sources (i.e., some participants received care for their overdose and hospital records were available, while other events were self-reported or reported by relatives). Of note, some adverse event/serious adverse event records explicitly listed overdose events as suicide attempts; however, overall, there was not enough information to clearly differentiate between overdoses that were suicide attempts and those that were “accidental.” As previously recommended (
34), employing a specific overdose survey instrument in future trials and systematically probing for and characterizing overdose events at each visit (including substances involved and suicidal intent) would enhance our ability to track and subsequently predict overdoses among patients with OUD during MOUD treatment (
54).
The application of our model results also has some real-world challenges. Many individuals with OUD receive intermittent treatment and do not return to the clinic on a regular basis, and their risk of experiencing an overdose event may be poorly estimated by the current set of models. CTN trial participants received reimbursements for attending scheduled visits, and outreach efforts were made to keep them engaged with the study (e.g., calls and appointment reminders by study staff on a regular basis). Without these research-specific retention efforts, community patients may be at higher risk of treatment nonadherence or dropout, and consequently at higher risk of overdose. Additionally, participants who discontinued study medication may have started treatment with another MOUD option; however, use of nonstudy or nonassigned medication and adherence (i.e., periods on and off another medication) were not consistently tracked in all three trials, and we were unable to include this information in our models. Finally, other factors, such as prior hospitalizations with a diagnosis of opioid poisoning or cardiovascular problems (
55), might be relevant in identifying patients at risk of experiencing an overdose event during MOUD treatment, but were not measured consistently in the clinical trials included in our analyses.