Comprehensive Analysis of Remission (COMPARE) with Venlafaxine versus SSRIs

Individual patient data were obtained from all studies completed by Wyeth Pharmaceuticals comparing venlafaxine and an SSRI (circa January 2007). For inclusion, we required that studies employ randomization, double-blind treatment, and evaluation with a standard dependent measure, such as the Hamilton Rating Scale for Depression (HAM-D) (14). In addition, studies had to enroll patients meeting criteria for major depressive disorder, as determined by the Diagnostic and Statistical Manual of Mental Disorders (edition III-R or IV) or International Disease Classification-10 criteria (15). An extensive search of the research activities of all divisions and affiliates of Wyeth Pharmaceuticals worldwide identified 34 such studies (16–43). Only 16 of the studies have been published in their entirety; 11 have been presented at scientific congresses or published as abstracts, and results of the remaining 7 studies have not been presented or published. Eight of these studies (S211, S360, S367, S372, S340, S347, S348, S349), representing less than 25% of the total patient group, were included in earlier analyses of pooled individual patient data (12, 13).

Most of the trials used standard exclusion criteria such as the presence of a primary Axis I disorder other than depression, severe Axis II pathology (by investigator's discretion), history of any significant medical disorder, and a history of drug or alcohol abuse for at least 6 months before entering the study. Most studies excluded patients with a history of nonresponse to either venlafaxine or the particular comparator SSRI being studied. With the exception of one study that enrolled patients who had not responded to two antidepressant trials in the current depressive episode (37), all of the studies required that patients be off antidepressants for at least 2 weeks before study participation.

The studies were conducted in accordance with the principles of the Declaration of Helsinki, including written informed consent. Table 1 summarizes the individual design characteristics of the 34 studies (16–43). Twenty studies used venlafaxine immediate release (IR); 14 studies used venlafaxine extended release (ER). The SSRI comparators were fluoxetine (20 studies), paroxetine (8 studies), sertraline (3 studies), citalopram (2 studies), and fluvoxamine (1 study). Nine studies also included a placebo control group.

Because the inclusion criteria we chose for our analysis necessitated that studies be double-blind randomized trials and that original patient data be available, we recognized that a number of studies could potentially be excluded as a result. As such, we conducted a funnel plot analysis to extend the primary data set by including all available (as of January 2007) studies in the public domain, regardless of sponsor, and by broadening the inclusion criteria to include studies that were open-label, provided that patients were randomized to the treatment groups. Published studies were identified via a literature search. Unpublished studies that have been presented at the scientific meetings of the American Psychiatric Association, American College of Neuropsychopharmacology, European College of Neuropsychopharmacology, World Congress of Biological Psychiatry, Collegium Internationale Neuropsychopharmacologicum also were reviewed. To our knowledge, all randomized controlled trials comparing venlafaxine to an SSRI for treatment of depression were included. In addition, the first author wrote the sponsor or corresponding author of all studies not included in the Wyeth data set and, when feasible, obtained remission rates using the same uniform criteria (HAM-D₁₇ score of 7 or less at week 8 using the last observation carried forward [LOCF] method).

Fourteen additional studies comparing venlafaxine/venlafaxine ER to SSRIs (citalopram, escitalopram, fluoxetine, fluvoxamine, paroxetine, or sertraline) were identified and included in this analysis: 3 Wyeth-sponsored studies previously excluded because of open-label design and 11 RCTs conducted by other organizations (Table 2) (44–56). One additional independently sponsored study was not included because neither response nor remission data were available (57).

The study groups had a mean age of 42 years (range: 17–88). The female to male ratio was approximately 2:1, and 7% of the participants were inpatients. Most patients presented with moderate to severe depression, with a mean pretreatment HAM-D₂₁ scores of 23.6 (SD = 4.25), 23.7 (SD = 4.25), and 23.3 (SD = 3.67) for the venlafaxine, SSRI, and placebo groups, respectively (see Table 1).

Patients in each study were randomly assigned to double-blind treatment with venlafaxine (n = 4191; IR, n = 1653; ER, n = 2538) or an SSRI (n = 3621). The SSRIs included fluoxetine (n = 1970), paroxetine (n = 692), sertraline (n = 652), citalopram (n = 273), and fluvoxamine (n = 34). Mean doses were computed at study endpoint (Table 1), with the LOCF) method used to account for dropouts. For studies longer than 8 weeks, the last observed dose at the 8-week time point was used. Weighted means with treatment group size as their weight were used to compute the overall grand mean for the data set.

In the meta-analysis, the intent to treat (ITT) study group included all patients randomly assigned to treatment who received at least one dose of study medication and had at least one on-therapy efficacy assessment. The studies ranged in length from 4 to 24 weeks. Because only 14 studies extended beyond 8 weeks of therapy, week 8 was chosen a priori as the primary endpoint. For patients who did not complete 8 weeks of therapy, the LOCF method was used (i.e., the last efficacy evaluation was counted for all subsequent time points). The primary efficacy outcome was remission, defined as a HAM-D₁₇ total score of 7 or less. For the one study that did not use the HAM-D, a Montgomery-Asberg Depression Rating Scale (MADRS) score of 10 or less was used to define remission.

To compare results across studies by using funnel plot analysis, we used a standardized measure of efficacy, the odds ratio (OR) for remission with venlafaxine versus SSRIs, at one consistent time point. For those studies in which individual patient data were available, remission was defined as a HAM-D₁₇ total score of 7 or less, and efficacy analyses were performed on the ITT population using the last observation carried forward method to account for missing data. Because the majority of studies did not extend beyond 8 weeks, this time point was chosen as the primary endpoint. For those studies in which individual patient data were not available, summary data from the published articles and abstracts were used to compute an OR for remission using the most stringent definition provided. If available, week 8 data were used; if not, the study endpoint was used.

For each individual study, odds ratios and 95% confidence intervals (CIs) were computed, and a combined effect size was estimated using fixed- and random-effect models (with the former reported given absence of statistically significant heterogeneity) for the overall data sets and for each individual SSRI. Funnel plot analysis was used to detect the presence of selection bias using the trim and fill method (58), the linear regression test (59), and the rank correlation test (60).

Safety and tolerability in the individual studies were evaluated on the basis of adverse events recorded throughout the study period and changes in physical examination, vital signs, and clinical laboratory findings before and after acute-phase treatment. Study 469 data were included in the analysis of discontinuation rates. However, adverse event data for week 8 were not available.

Remission rate differences (and 95% CIs) for the individual studies and the combined data sets are presented in Figure 1. Remission rate differences for the individual studies ranged from −7% to 31%; differences numerically favored venlafaxine over SSRIs in 28 studies, with 6 studies numerically favoring the SSRI over venlafaxine. Overall, venlafaxine therapy was associated with a 5.9% (95% CI: .038–.081) advantage. Remission rate differences for venlafaxine compared with each specific SSRI ranged from 3.4% to 14.1% (Figure 1). Only the results versus fluoxetine (remission rate difference = 6.6% [95% CI: .030–.095; p < .0011 based on 20 studies) were statistically significant.

Figure 2 demonstrates that the results did not differ significantly depending on the use of the IR or ER formulation of venlafaxine or whether the patient population included inpatients or outpatients. Results of the sensitivity analyses indicated that the venlafaxine-SSRI difference was not dependent on any one particular study or study characteristic (data available from authors on request). For example, a similar difference favored venlafaxine over the SSRIs in the nine placebo-controlled studies (see Figure 3). With respect to drug versus placebo differences, there was a 6% (95% CI: .02–.09) advantage favoring SSRIs versus placebo and 13% (95% CI: .09–.16) advantage favoring venlafaxine versus placebo. The magnitude of the drug versus placebo difference (i.e., 13% vs. 6%) also was significantly greater for venlafaxine compared with SSRIs (p < .001).

The funnel plot analysis was based on 48 studies, including 14 additional studies, 11 of which were not funded by Wyeth. No evidence of statistically significant selection bias was observed in the updated analysis of 48 studies, suggesting that study sponsorship did not significantly influence outcomes. The estimated difference in remission rates in this expanded set of studies was 5.3% favoring venlafaxine, which was almost identical to the results of the primary analysis (see Figure 4). This difference was again statistically significant, with an OR of 1.25 (95% CI: 1.16–1.36, p < .001).

Overall discontinuation rates for any reason were 28% for the pooled venlafaxine and 27% for the pooled SSRI therapy groups. A higher percentage (11%) of venlafaxine-treated patients discontinued therapy because of adverse events compared with SSRIs (9%; p = .0011). Discontinuation rates because of lack of efficacy were 4% for venlafaxine and 5% for SSRIs.

The five most common treatment-emergent adverse events in both active treatment groups were nausea, headache, dry mouth, insomnia, and diarrhea (individual data available from authors on request). The incidences of nausea (33% vs. 26%) and headache (26% vs. 17%) were higher for venlafaxine, and the incidence of diarrhea was higher for the SSRIs (19% vs. 11%).

The focus of meta-analysis is the estimation of an effect size. In a large set of studies such as this one, “statistically significant” results may reflect differences that are so small, they would not have meaningful clinical implications. For this reason, we chose remission rates, the most rigorous measure of antidepressant efficacy, as the primary efficacy outcome and focused on the comparison of remission rates across studies and study characteristics. Research conducted from epidemiologic, naturalistic, and controlled paradigms consistently document that remission of major depressive disorder is the optimal outcome of acutephase therapy, in terms of restoration of social and vocational functioning (66, 67) and reduction of longer-term risks of relapse and recurrence (68–70). As can be seen in Figure 1, the pooled effect size across all comparisons of venlafaxine versus SSRIs reflected an average difference in remission rates of 5.9%, which reflected a NNT of 17 (1/.059), that is, one would expect to treat approximately 17 patients with venlafaxine to see one more success than if all had been treated with another SSRI. Although this difference was reliable and would be important if applied to populations of depressed patients, it is also true that it is modest and might not be noticed by busy clinicians in everyday practice. Nonetheless, an NNT of 17 may be of public health relevance given the large number of patients treated for depression and the significant burden of illness associated with this disorder.

A comparison of placebo-subtracted remission rates for venlafaxine and the SSRIs is one gauge of the clinical significance of the modest difference in efficacy observed. With this approach, the magnitude of the advantage of the SSRI versus placebo can be used to define the “assay sensitivity”of the meta-analysis. Looking at the nine placebo-controlled studies, the absolute difference in remission rates between venlafaxine and placebo treatment (i.e., 13% [95% CI: .09–.16]) was significantly greater than between SSRIs and placebo (i.e., 6% [95% CI: .02–.09]) (venlafaxine vs. SSRIs: 13% vs. 6%; p < .001). To achieve one remission more than with placebo, 8 patients would need to be treated with venlafaxine (NNT = 8 [95% CI: 6–11]) compared with 18 patients who would need to be treated with an SSRI (NNT = 18 [95% CI: 11–50]). From this perspective, the magnitude of the advantage of SSRIs versus placebo in the placebo-controlled data set (NNT = 18) is similar to the advantage of venlafaxine relative to SSRIs in the combined data set (NNT = 17).

The dual reuptake inhibition hypothesis posits that antidepressants that directly affect both serotonin and norepinephrine neurotransmission may have more robust efficacy than those with selective action at the serotonin transporter (SERT) (9, 12, 71–75). Greater benefit similarly may be obtained by combining norepinephrine- and serotonin-selective medications (10). However, it is important to note that this hypothesis is merely an explanatory construct, and several issues remain unclear. For example, it is not clear what dose of venlafaxine is needed to ensure that the average patient obtains a clinically meaningful level of inhibition of neuronal uptake of norepinephrine (50, 76, 77). Davidson et al. (50) found that venlafaxine ER at a dose of 225 mg per day produced more than 70% norepinephrine transporter occupancy using an ex vivo method (78), and these results have recently been confirmed (53). At the relatively low mean dose of paroxetine used in these studies, effects on norepinephrine reuptake are limited (78). It remains to be proven definitively that any efficacy advantage of venlafaxine compared with SSRIs is directly linked to its ability to inhibit the reuptake of both serotonin and norepinephrine. It is conceivable that other neurobiological effects of venlafaxine account for these findings. However, once unfair dosing or other methodological biases are ruled out, there is no compelling alternative explanation within the models of antidepressant action as we currently understand them. It is important to determine whether the noradrenergic effects of venlafaxine are associated with the greater rate of attrition due to side effects and concerns about potential cardiovascular toxicity in overdose (50, 55, 79, 80).

One of the most important limitations of meta-analysis is the potential for bias via selective inclusion of studies. To ensure that this did not occur, the research conducted by every worldwide affiliate of Wyeth Pharmaceuticals was painstakingly searched, and no completed study of major depressive disorder was excluded if it employed random assignment and double-blind therapy. In addition, the expanded analysis that included nonWyeth-sponsored studies showed no evidence of sample bias.

Such an inclusive approach could also introduce bias; however, if the studies are too heterogenous, particularly if a large study or a particular subset of studies yields discrepant results. To this end, statistical tests for homogeneity were performed before the meta-analyses. These procedures provided some assurance that it was reasonable to combine the effect sizes from the multiple studies.

Because there is a tendency in industry-sponsored studies to use relatively low doses of comparator drugs, the possibility of bias caused by unfair or imbalanced dosing must also be considered. Because few studies permit both medications to be titrated flexibly, across the full FDA-approved dose range, it is essential to assess dose comparability. Using an approach in which the mean doses of each of the individual comparators and venlafaxine were compared with the FDA-approved range for depression, the dosages of venlafaxine and the SSRI comparators were found to be comparable overall, although we are aware that this method could be criticized on the grounds that clinicians often use doses of these antidepressants that exceed FDA guidelines and that this phenomenon may not be equal for all antidepressants.

With respect to studies with discrepant results, we note that the results of two small studies, one in psychotic depression (56) and the other in frail elderly nursing home residents (55), strongly favored the SSRIs (paroxetine and sertraline, respectively). In one study employing titration to maximum approved doses within 8 days (49), escitalopram (20 mg/day) therapy was much better tolerated than venlafaxine ER (225 mg/day); it was also significantly more effective among the subset of patients with higher pretreatment severity levels. In the two trials of bipolar depression to compare venlafaxine with SSRIs (54, 81), there were no significant differences in efficacy. However, patients treated with venlafaxine were more likely to experience treatment-emergent affective switches. Thus the overall advantage for venlafaxine may pertain to some specific patient groups or be evident under some conditions related to dose titration.

Several limitations of this report warrant comment. First, because the generalizability of RCT findings to clinical practice is limited by the exclusion of patients with more complex conditions (e.g., comorbid psychiatric or medical disorders), the results of meta-analyses based on the data from RCTs are subject to the same limitation.

Second, these data come from short-term trials of antidepressant efficacy and may not extend across longer courses of therapy. Specifically, the SSRIs could “catch up”during the continuation phase of therapy.

Third, some question the validity of combining all of the SSRIs into a single group or class of antidepressants. It is commonplace to group together conceptually the SSRIs as the leading class of “first-line”antidepressant medications, and the SSRIs were routinely combined for classwise comparisons of efficacy, tolerability, and safety compared with the TCAs. However, these drugs are not interchangeable, and they have distinct pharmacologic properties. For example, considerable evidence suggests that paroxetine exhibits dose-dependent SERT and NE uptake blocking activity, although not at the doses of paroxetine employed in these studies (50, 78, 82, 83). Although this meta-analysis provides further evidence that venlafaxine is significantly more effective than the SSRIs as a class, the differences versus paroxetine, sertraline, and citalopram were not statistically significant. Moreover, in the primary analysis, there were only three studies with sertraline, two with citalopram, one of fluvoxamine, and none of escitalopram available for inclusion. The relative efficacy of venlafaxine versus SSRIs other than fluoxetine thus remains an open question.