Skip to main content
Full access
Perspectives
Published Online: 1 July 2013

A Model of Placebo Response in Antidepressant Clinical Trials

Abstract

Placebo response in clinical trials of antidepressant medications is substantial and has been increasing. High placebo response rates hamper efforts to detect signals of efficacy for new antidepressant medications, contributing to trial failures and delaying the delivery of new treatments to market. Media reports seize upon increasing placebo response and modest advantages for active drugs as reasons to question the value of antidepressant medication, which may further stigmatize treatments for depression and dissuade patients from accessing mental health care. Conversely, enhancing the factors responsible for placebo response may represent a strategy for improving available treatments for major depressive disorder. A conceptual framework describing the causes of placebo response is needed in order to develop strategies for minimizing placebo response in clinical trials, maximizing placebo response in clinical practice, and talking with depressed patients about the risks and benefits of antidepressant medications. In this review, the authors examine contributors to placebo response in antidepressant clinical trials and propose an explanatory model. Research aimed at reducing placebo response should focus on limiting patient expectancy and the intensity of therapeutic contact in antidepressant clinical trials, while the optimal strategy in clinical practice may be to combine active medication with a presentation and level of therapeutic contact designed to enhance treatment response.
Placebo response in antidepressant clinical trials has recently captured the attention of psychiatric researchers, clinicians, and the lay public. Scientific interest focuses on the influence of placebo response on signal detection in clinical trials and what its physiologic mechanisms reveal about the pathophysiology of major depressive disorder. The public would like to know whether responses to antidepressants are caused by specific effects of the medications or are “just” placebo effects. Clinicians may view placebo response as a challenge to their decisions to prescribe antidepressants and as a potential tool for improving patient care. Complicating much of this discourse has been a murky understanding of what contributes to placebo response in clinical trials. In this review, we present a model of placebo response in order to aid in the interpretation of randomized controlled trial results and their application to clinical practice, set an agenda for future research, and provide information to help clinicians speak with their patients about antidepressant treatments.

The Problem and the Promise of Rising Placebo Response

In antidepressant trials for adults, the mean placebo response rate is 31%, compared with a mean medication response rate of 50%, and it has risen at a rate of 7% per decade over the past 30 years (1). In children and adolescents with major depression, rates of placebo response are even higher (a mean rate of 46%, compared with a mean medication response rate of 59%), and they have also been increasing over time (2). High placebo response reduces medication-placebo differences and leads investigators to make methodological modifications (e.g., the use of multiple study sites to increase sample size) that increase measurement error, both of which make it more difficult to demonstrate a statistically significant benefit of a putative antidepressant agent over placebo. Consequently, the average difference between medication and placebo observed in published antidepressant trials has decreased from an average of 6 points on the Hamilton Rating Scale for Depression (HAM-D) in 1982 to 3 points in 2008 (3). For most currently approved antidepressants, fewer than half of the efficacy trials filed with the U.S. Food and Drug Administration for regulatory approval found active drug superior to placebo (4, 5). While not all trials that fail to distinguish medication from placebo represent false negatives, meta-analyses of antidepressant trials suggest that high placebo response rather than low medication response explains most of the variability in drug-placebo differences (2). The increasing number of failed trials in recent years has made developing psychiatric medications progressively more time-consuming (an average of 13 years to develop a new medication) and expensive (estimates range from $800 million to $3 billion per new agent) compared with medications for non-CNS indications (6). These considerations contributed to recent decisions by several large pharmaceutical companies to reduce or discontinue research and development on medications for brain disorders, prompting warnings of “psychopharmacology in crisis” (7).
From a different perspective, enhancing the therapeutic components leading to placebo response may be a way of improving the clinical treatment of patients with depression. Major depression affects approximately 120 million people worldwide (including nearly 15 million American adults each year) and is a leading cause of illness-related disability (8). With currently available treatments, many patients will not experience sustained remission of their depression (9). As described further below, treatment with antidepressant medication involves much more than simply the dispensing of pills: an expectation of improvement is instilled in patients receiving treatment, and they are exposed to a health care environment that has many supportive and therapeutic features. These nonpharmacologic aspects of clinical management likely cause a substantial portion of observed medication and placebo response in clinical trials (10), yet they are typically not provided to the same extent in standard clinical practice. Whereas it was once believed that the therapeutic effects of expectancy and contact with health care staff were transient, more recent data show that 75% of placebo responders stay well during the continuation phase of treatment (11). Thus, optimizing the therapeutic components leading to placebo response has the potential to significantly improve treatment outcomes in clinical practice.

Differentiating the Placebo Effect From Placebo Response

“Placebo response” can be defined as the change in symptoms occurring during a clinical trial in patients randomized to receive placebo. Placebo response, which is directly observed and quantified in a research study, is often conflated with the term placebo effect. A “placebo effect” can be defined as the therapeutic effect of receiving a substance or undergoing a procedure that is not caused by any inherent powers of the substance or procedure (12). For example, an inert cream has no inherent power to relieve pain, but being informed that the cream is an analgesic may result in a person feeling less pain when a painful stimulus is applied because the expectation of pain relief causes the release of endogenous opioids in the brain. While placebo effects are one contributor to the placebo response observed in a research study, many other factors may also influence placebo response.
To clarify this differentiation further, the sources of symptom change in antidepressant clinical trials can be grouped into categories (Figure 1, Table 1). Treatment factors comprise all the interventions and study procedures experienced by a patient in a clinical trial. Taking a pill that one believes to be an effective treatment for depression may generate a placebo effect (based on expectancy of improvement), while supportive contacts with study clinicians and undergoing medical procedures may also have therapeutic elements. Expectancy-based placebo effects and effects of the therapeutic setting may be moderated by the demographic and clinical characteristics of participating patients. Measurement factors represent sources of bias and error inherent in measuring depressive symptoms, and natural history factors reflect spontaneous improvement and worsening in the patient’s condition that is unrelated to the study procedures. The symptom change observed in a patient receiving placebo in a clinical trial (i.e., placebo response) is caused by the sum effects of these factors and their interactions. While large placebo effects may lead to large observed placebo response rates, it is also possible that high placebo response rates could be observed even where minimal placebo effects are operative (e.g., if there has been substantial improvement resulting from the therapeutic setting, regression to the mean, rater bias, or spontaneous fluctuation in illness severity).
FIGURE 1. A Model of Placebo Response in Antidepressant Clinical Trials
TABLE 1. Sources of Placebo Response in Antidepressant Clinical Trials
FactorContributes to Placebo ResponseInfluences Pathophysiology of DepressionSusceptible to Modification
Treatment factors   
 Expectancy-based placebo effects+++
 Therapeutic setting+++
Measurement factors++
Natural history factors++/−

Treatment Factors Contributing to Placebo Response

Expectancy

Two theoretical approaches that have been proposed for understanding the mechanisms of placebo effects are expectancy theory and classical conditioning (12). Expectancy theory postulates that placebo treatments instill a (conscious) positive expectation of improvement in the patient that actually causes the change in a patient’s symptoms. Conditioning theorists hold that the placebo response represents a type of nonconscious learning in which an individual associates improvement in symptoms (unconditioned response) with a neutral stimulus such as pills, health care providers, or procedures (conditioned stimulus) that itself becomes capable of eliciting an effect (conditioned response). In general, both conscious expectancy and nonconscious conditioning mechanisms likely contribute to the placebo effects observed in pharmacologic studies. However, given the importance of verbal information in shaping placebo effects and the fact that substantial placebo effects are observed in treatment-naive patients, most empirical studies of the mechanisms of placebo effects in antidepressant clinical trials have focused on patient expectancy.
Khan et al. (13) first reported that the number of treatment arms in a study was negatively correlated with the “success” of the trial, defined as finding a significant difference between drug and placebo. A greater number of treatment arms increases the probability of receiving active medication, which may increase patient expectations and generate higher placebo response rates. The influence of patient expectancy on antidepressant response has also been observed in comparisons of medication response between placebo-controlled trials (i.e., one or more medications compared with placebo) and active comparator trials (i.e., two or more medications with no placebo group) (Figure 2). In adults and older adults with major depression, mean medication response rates in comparator trials are significantly greater than in placebo-controlled trials (14, 15). Patients in comparator trials know they have a 100% chance of receiving an active medication, which may increase their expectancy of improvement, leading to enhanced placebo effects and greater observed antidepressant response.
FIGURE 2. Response Rates to Antidepressant Medication in Placebo-Controlled and Comparator Study Designs for Children and Adolescents, Adults, and Older Adults
*p<0.05.
Consistent with these results, Papakostas and Fava (16) reported that the probability of receiving placebo in a clinical trial was negatively correlated with antidepressant and placebo response. For each 10% decrease in the probability of receiving placebo, the probability of antidepressant response increased 1.8% and the probability of placebo response increased 2.6%. Similarly, Sinyor et al. (17) evaluated 90 randomized controlled trials of antidepressant medications for unipolar depression, comparing response and remission rates between trials comparing medication to placebo (drug-placebo), two medications to placebo (drug-drug-placebo), and one medication to another (drug-drug). They found that medication response was significantly higher in drug-drug studies (65.4%) compared with drug-drug-placebo studies (57.7%) and drug-placebo studies (51.7%) (p<0.0001). Response to placebo in placebo-controlled trials was significantly higher in drug-drug-placebo studies compared with drug-placebo studies (46.7% and 32.2%, respectively; p=0.002).
These meta-analytic results suggest that the design of a clinical trial shapes patients’ expectancy of symptom improvement during the trial, which in turn influences response to antidepressant medication and placebo. However, the veracity of this interpretation must be tested in studies that directly measure patient expectancy in different types of antidepressant clinical trials and determine the relation of expectancy to treatment outcome. Two studies that measured patient expectancy at baseline found that higher expectancy predicted greater symptom improvement during treatment of depression with antidepressant medication (18, 19). In a recent pilot study (20), expectancy was experimentally manipulated by randomizing 43 outpatients with major depression to placebo-controlled (i.e., 50% chance of receiving active drug) or comparator (i.e., 100% chance of receiving active drug) administration of antidepressant medication. Randomization to the comparator condition resulted in significantly greater patient expectancy relative to the placebo-controlled arm of the study (t=2.60, df=27, p=0.015). Among patients receiving medication, higher pretreatment expectancy of improvement was positively correlated with change in depressive symptoms observed over the study, although the relationship fell short of significance (r=0.44, p=0.058). The manipulation of expectancy in that study permits the causal inference to be made that more positive expectancy leads to greater improvement in depressive symptoms, both within a single type of clinical trial and between different trial types.
In summary, the consent procedure for pharmacotherapy trials, in which prospective participants are made aware of the study design, the past effectiveness of the drugs and placebos used in the study, and the investigator’s opinions of the treatment options, influences patients’ expectancies of how participation in a clinical trial will affect their depressive symptoms. Expectancy appears to be a primary mechanism of placebo effects and significantly influences both observed placebo response and antidepressant medication response. In both treatment groups, patients are receiving a pill that they believe may represent a treatment for their condition.

Therapeutic Setting

Since the ability to generate treatment expectancy requires relatively advanced cognitive capacities, it is puzzling to observe high placebo response in children with depression. Compared with adults, participants in pediatric major depression trials are less cognitively equipped to understand the nature of the study in which they are participating, and they actually receive less information at the time of their enrollment (since their parents provide informed consent). To evaluate the significance of expectancy effects in younger patients, our group analyzed antidepressant response between comparator and placebo-controlled studies of antidepressants for children and adolescents with depressive disorders (21). Unlike the large differences observed between these study types in adults and older adults with depression, there was no significant difference in medication response between comparator and placebo-controlled studies enrolling children and adolescents.
Rather than patient expectancy, what appeared to influence treatment response was the amount of therapeutic contact patients received: adolescents experienced greater placebo response as the number of study visits increased. In an antidepressant clinical trial, patients experiencing social isolation and decreased activity levels as part of their depressive illness enter a behaviorally activating and interpersonally rich new environment. They interact with research coordinators and medical staff, receive lengthy clinical evaluations by highly trained professionals, and are provided with diagnoses and psychoeducation that explain their symptoms. Medical procedures are performed, such as blood tests, ECG, and measurement of vital signs, and clinicians meet with patients weekly to listen to their experiences and facilitate compliance by instilling faith in the effectiveness of treatment.
Considerable empirical evidence supports the therapeutic effectiveness of these interventions. Optimistic or enthusiastic physician attitudes, as compared with neutral or pessimistic attitudes, are associated with greater clinical improvements in medical conditions as diverse as pain, hypertension, and obesity (22). A therapeutic relationship in which the clinician provides the patient with a clear diagnosis, the patient is given an opportunity for communication, and the clinician and patient agree on the problem has been shown to produce faster recovery (23). In addition, physical aspects of the treatment, such as the pill dosing regimen, the color of pills, and the technological sophistication of the treatment procedures, can influence treatment response (24).
Posternak and Zimmerman (25) investigated the influence of therapeutic contact frequency on antidepressant and placebo response in 41 randomized controlled trials of antidepressants for major depression. These investigators calculated the change in HAM-D score over the first 6 weeks of treatment in patients assigned to antidepressant medication and placebo, comparing studies that had six weekly assessments (weeks 1–6) with those that had five assessments (weeks 1–4 and week 6) or four assessments (weeks 1, 2, 4, and 6). In placebo participants who returned for a week 3 visit, the reduction in HAM-D score between weeks 2 and 4 was 0.86 points greater than in those who did not, and in placebo participants who returned for a week 5 visit, the reduction in HAM-D score between weeks 4 and 6 was 0.67 points greater than in those who did not. A cumulative therapeutic effect of additional visits on placebo response was observed: between weeks 2 and 6, the mean improvement in HAM-D score was 4.24 points in patients who made weekly visits, compared with 3.33 points in those who made one visit less and 2.49 points in those who made two visits less. Thus, the presence of additional visits appeared to explain approximately 50% of the symptom change observed between weeks 2 and 6 among patients receiving placebo. Participants who received active medication also experienced more symptomatic change with increased numbers of visits, but the relative effect of this greater therapeutic contact was approximately 50% less than that observed in the placebo group.
The intensive therapeutic contact found in clinical trials may be contrasted with what patients being treated with antidepressants receive in the community. In community samples of patients receiving antidepressant medication, 73.6% are treated exclusively by their general medical provider as opposed to a psychiatrist (26). Fewer than 20% of patients have a mental health care visit in the first 4 weeks after starting an antidepressant (27), and fewer than 5% of adults beginning treatment with an antidepressant have as many as seven physician visits in their first 12 weeks on the medication (28). Thus, assignment to placebo in an antidepressant clinical trial represents an intensive form of clinical management that has therapeutic effects.

Methods of Controlling for Expectancy and the Therapeutic Setting in Clinical Trials

Greater patient expectancy and therapeutic effects of the health care setting lead to an increased placebo response and, to a lesser degree, an increased medication response. A ceiling is placed on potential medication response by the relatively constant proportion of patients in the sample who will not respond to treatment (because of diagnostic misclassification, treatment refractoriness, or other factors). Because an increased placebo response decreases medication-placebo differences, investigators have sought to identify methods of minimizing placebo response (and the component of medication response caused by placebo response) as a means of improving signal detection in clinical trials. One strategy for dealing with expectancy-based placebo effects and therapeutic responses to the health care setting has been to conduct single-blind lead-in periods aimed at identifying and excluding participants whose symptoms respond quickly to placebo. Multiple analyses have determined that such lead-ins have not been effective in reducing placebo response or improving detection of drug-placebo differences (21, 29, 30). However, one study suggests that double-blind lead-in periods, in which study personnel are also blind to the duration of placebo lead-in, may be more effective (31).

Measurement Factors Contributing to Placebo Response

In most clinical trials, investigators assess change in the severity of patients’ depressive illness on the basis of changes in measures of symptom severity that are self-reported by patients or elicited by trained raters. Measurements of depressive symptoms are subject to random error like any other measurement, but unlike more objective measurements, such as serum cholesterol level or blood pressure, depression symptom severity scores may be subject to additional sources of bias. Conceptually, one can distinguish cases in which a patient’s depression score decreased because symptoms actually improved from cases in which the score changed for other reasons.

Regression to the Mean

One source of apparent symptom change in antidepressant trials is regression to the mean, which is a statistical phenomenon that occurs when repeated measurements associated with random error are made on the same subject over time (32). To illustrate, one can imagine that if a patient with a “true” HAM-D score of 10 underwent repeated ratings, a normal distribution with a mean of 10 would be obtained as a result of random error in measurement. If the initial value obtained happened to be unusually high or low, then the next observed value would likely be closer to the patient’s true mean score of 10 based on chance alone. Regression to the mean poses a problem at the group level in clinical trials because a threshold depression severity score is set as an inclusion criterion (e.g., a HAM-D score >16). Some of the study participants actually have true means below 16, and the tendency for the depression scores of these patients to decrease on repeated measurement will give the appearance of group-level improvement when in fact no true change has occurred. This decrease in mean HAM-D scores will not be offset by a corresponding “upward” regression to the mean in those individuals whose HAM-D scores were initially underestimated, because these individuals will have been excluded from participation in the study.

Sources of Bias

Rater bias occurs when an individual’s rating of symptom severity in an antidepressant clinical trial is influenced by underlying beliefs or motivations with respect to the treatments under study (33). For example, clinical raters typically perceive more symptom change in response to treatment than is self-reported by patients, possibly reflecting an excessive enthusiasm for detecting effects of the treatment under study (3436). Assessments of eligibility for a clinical trial may be biased toward baseline score inflation when investigators have a financial incentive to recruit patients (37). Evidence for baseline score inflation comes from studies comparing clinician-administered HAM-D data with self-reported HAM-D scores obtained using interactive voice systems (38, 39). These studies have found that clinician-rated HAM-D scores are significantly greater than self-reported scores at the time of patient enrollment, while the two assessment methods yield converging scores after randomization. This suggests that investigators may be influenced, perhaps unconsciously, by the financial and professional returns accruing from an enrolled patient (as opposed to a screened-out patient) and increase their ratings of baseline depression severity.
Conversely, a response bias in psychological measurement is the systematic tendency of a subject to respond to questionnaire items on some basis other than what the items were designed to measure (40). Response bias occurs when respondents choose the response they perceive to be the most socially desirable or the one that is favored by the study clinicians. The term “demand characteristics” has been used to describe cues that make participants in a research study aware of what results the experimenters hope to find, which can result in the participants altering their responses to conform to the researchers’ expectations (40). “Hawthorne effects” are a closely related phenomenon whereby subjects in an experiment improve or modify the aspect of their behavior under study simply by virtue of knowing that the behavior is being measured (40). Response bias can be more problematic in antidepressant clinical trials than in studies of nonpsychiatric disorders because of the inherently subjective nature of rating illness severity on the basis of the patients’ verbal reports.

Methods of Minimizing Measurement Factors in Clinical Trials

Effect sizes for antidepressant medications relative to placebo are calculated by dividing the difference between the mean improvement in the medication group and the mean improvement in the placebo group by the pooled standard deviation of the sample ([ImprovementMedication – ImprovementPlacebo] / standard deviation). As measurement error (and standard deviation) increases, the calculated effect size for antidepressant medication decreases, and the likelihood of detecting a statistically significant benefit of medication over placebo decreases. Thus, it is important for signal detection in antidepressant clinical trials to reduce measurement error. The primary method to reduce measurement error in antidepressant clinical trials is to institute a comprehensive and ongoing rater training program, in which interrater reliability is carefully measured and maintained at a minimum level. Unfortunately, information regarding interrater reliability in antidepressant clinical trials is rarely provided in published reports (41).
The problems posed by regression to the mean and rater bias (particularly baseline score inflation) in antidepressant clinical trials have been approached in several ways (42). One strategy involves specifying a minimum depression severity score required for enrollment into the study but then a priori setting a higher score threshold for inclusion in the data analysis. Another technique is to blind raters at individual study sites to the timing of the baseline assessment so that they are unaware which ratings will be used to ascertain patient eligibility for the study. Finally, many investigators now utilize two separate depression rating scales for clinical trials: one measure to determine subject eligibility and another to serve as the primary outcome measure in analyses.
A variant of these strategies is to use centralized raters to perform the screening and outcome measures in clinical trials (42). Using centralized raters provides investigators with access to a group of highly trained raters, which is not often possible at individual study sites. Centralized raters are less prone to bias by virtue of their off-site location and blinding to study entry criteria, patient phase of treatment, and treatment assignment. Thus, the use of centralized raters may improve interrater reliability, relieve pressure to enroll patients, reduce biases toward baseline score inflation and later improvement, and eliminate the effects of repeated assessments by the same clinician. A relative disadvantage of using centralized raters is the necessity of assessing patients remotely via videoconference or telephone rather than using face-to-face interviews.

Natural History Factors Contributing to Placebo Response

Given the ethical difficulties associated with following the untreated course of depression, few prospective nonintervention studies using modern diagnostic criteria have been conducted that can be used to estimate the magnitude of spontaneous improvement that can be expected in acute depressive episodes (43). Alternative sources of information about the natural course of depressive disorders are psychotherapy studies in which a waiting list control group is used as a means of determining whether psychotherapy has an effect on depression beyond the passage of time. A recent meta-analysis of acute symptom change in waiting list control conditions found that individuals with major depression experience an average improvement of 4 points on the HAM-D (effect size, Cohen’s d=0.5) over a mean follow-up duration of 10 weeks (44). For comparison, meta-analyses of medication and placebo response in antidepressant clinical trials report standardized effect sizes of approximately 1.5 for medication conditions and 1.2 for placebo conditions (10). Thus, patients in waiting list control conditions experience approximately 33% of the improvement occurring with medication treatment and 40% of the improvement seen with placebo administration.
It is intriguing to speculate that natural history factors may be playing a greater role in antidepressant clinical trials over time as the population of patients enrolling in research studies changes. Most research participants in the 1960s and 1970s were recruited from inpatient psychiatric units, whereas current participants are symptomatic volunteers responding to advertisements (45). Studies are needed to compare the baseline characteristics, treatment response, and attrition rates of self-referred depressed patients with those who respond to advertisements. Natural history factors may be more important in the latter population, with the symptoms experienced by advertisement respondents being more variable and transient, resulting in greater placebo response rates compared with self-referred patients.
It may be possible to mitigate natural history factors by requiring longer durations of current illness for inclusion in antidepressant trials, but the spontaneous fluctuation of depression severity is less subject to investigator control than measurement factors. Epidemiologic studies show that patients with major depression typically experience symptoms for several months before seeking treatment (46). Patients are most likely to seek treatment during periods of increased stress or symptomatic worsening, so those who enroll in a clinical trial at such a time may experience a natural waning of symptoms or alleviation in the precipitating stressors irrespective of the treatment they are provided.

Patient Characteristics Moderating Placebo Response

Expectancy-based placebo effects are dependent on intact cognition in order to generate placebo response (47), and a physiologic pathway must exist by which expectancy can influence the illness (e.g., minimal placebo effects are observed on tumor regression in metastatic cancer). However, among cognitively intact patients with depression, research has failed to identify consistent characteristics of patients likely to respond to placebo, giving rise to the term “the elusive placebo reactor” as early as the 1960s (48). Patient characteristics such as neuroticism, suggestibility, introversion, intelligence, and self-esteem have not been found to have significant associations with response to placebo (49). Such findings have led many to reject the hypothesis that certain people respond to placebos while others do not, and instead the consensus view arose that most individuals appear capable of being influenced by placebo effects under the appropriate conditions (50).
While evidence for patient characteristics influencing placebo response has been limited, features of the depressive illness being treated appear to influence the magnitude of placebo response observed in an antidepressant clinical trial. One of the most replicated findings in recent years has been that placebo response decreases with increasing severity of baseline depression scores. Both Kirsch et al. (51) and Fournier et al. (52) found that placebo response significantly declined as baseline HAM-D score increased (particularly as the score exceeded 25). Other studies suggest that patients suffering from major depressive disorder with psychotic features (53) and recurrent major depressive disorder (54) have lower rates of placebo response, as do elderly depressed patients with early-onset (prior to age 60) depression (55).

Relationship of Placebo Response to Medication Response in Antidepressant Clinical Trials

A fascinating and important question in pharmacologic treatments is how to conceptualize the contribution of placebo response to medication response. “Medication response” denotes the change in symptoms occurring during a clinical trial in patients randomized to receive medication. In contrast, the “medication effect” is the specific physiologic effect of the medication being studied on the target disorder (e.g., the effect of serotonin reuptake inhibition on major depressive disorder). By extension from Figure 1, medication response represents a combination of the specific medication effect with the previously described sources of placebo response (expectancy-based placebo effects, effects of the therapeutic setting, measurement factors, and natural history factors). The simplest and most common way to understand the nature of this combination is to assume that medication effects are additive with placebo response (i.e., placebo response is the same in the medication and placebo groups). In other words, if the observed placebo response rate in a clinical trial is 30% and the observed medication response rate is 50%, then the specific effects of the medication account for 50%–30%=20% response rate. If the specific effects of medication are relatively constant between similar patient samples, differences in observed medication response between different types of antidepressant studies (e.g., placebo-controlled, comparator, open) would presumably be caused by differences in expectancy-based placebo effects and other nonpharmacologic factors.
The logic of clinical trials and their application to clinical treatment are based on this “assumption of additivity” (56). Medications are approved for use after demonstration of a significant difference compared with placebo, and the “number needed to treat” is calculated relative to placebo response. It is therefore surprising that there is little or no evidence in the pharmacologic treatment of major depressive disorder to prove that medication effects and the placebo response are additive. Equally possible is that all of the observed medication response is caused by the specific medication effect without any contribution from placebo response, in which case the medication effect would be substantially larger than that calculated based on additivity. Alternatively, the presence of interactions between medication effects and sources of placebo response could result in the true contribution of medication effects to medication response being smaller than previously thought. For example, experiencing side effects known to be caused by the medication under study may “unblind” patients during a clinical trial, increasing their expectancy of improvement and leading to larger expectancy-based placebo effects.
To answer the question of how medication effects combine with sources of placebo response, it is necessary to conduct studies designed to test the assumption of additivity in antidepressant clinical trials. Kirsch (57) suggested that a modified form of the balanced placebo design may serve this function by randomizing a sample of patients with major depression to be told either that they are receiving active medication or that they are receiving placebo. Each group is then further randomized to actually receive medication or placebo, allowing researchers to estimate the true drug effect by comparing response in the “told placebo/receive medication” and “told placebo/receive placebo” groups. Utilizing an active placebo with this study design would make it possible to control for unblinding by side effects as well. While this study design represents a cogent approach to disentangling medication effects from placebo response, ethical concerns with the temporary deception of depressed patients have precluded its use to date.
Alternatively, new statistical approaches have been developed to more accurately estimate the causal effect of medication on depression using standard clinical trial data sets. Muthén and Brown (58) conceptually delimit four types of patients in a randomized controlled trial: those who would not respond to medication or placebo (“never responders”), those who would respond to both medication and placebo (“always responders”), those who would respond to medication but not placebo (“medication-only responders”), and those who would respond to placebo but not medication (“placebo-only responders”). Medication-only responders are the group of interest to pharmacologic researchers, since these subjects are assumed to be experiencing a true medication effect. Placebo-only responders are those who experience adverse effects from medication, and they are assumed to be few in number. Applying growth mixture modeling with maximum-likelihood estimation to an antidepressant clinical trial data set, Muthén and Brown report a method resulting in larger effect size estimates for medication-only responders compared with conventional analyses. While this approach appears promising, it is not clear that it accounts for the possibility of interactions between medication effects and placebo response described above.
It appears likely that the specific effect of medication is at least partially additive with placebo response, although its precise magnitude cannot be determined without knowing whether there are significant medication effect-by-placebo response interactions. The considerations discussed in this section make it clearer how rising placebo response makes it difficult to demonstrate statistically significant benefits of medications over placebo. First, rising placebo response leads to decreased medication-placebo differences (3), because the group of patients who do not respond to medication or placebo (never responders) places a ceiling on medication response in an antidepressant clinical trial. An increase in placebo response thereby causes a corresponding decrease in the medication-placebo difference. Second, investigators have attempted to compensate for the decreasing effect sizes observed for antidepressant medication by employing multiple study sites to obtain larger sample sizes. The greater measurement error associated with multicenter clinical trials leads to lower effect sizes for medication and often offsets the benefits of larger sample sizes.

Implications for the Antidepressant-Placebo Controversy

Media coverage of placebo response has been used as a platform for critiques of the pharmaceutical industry and a stalking horse for questioning the efficacy of antidepressants. For example, a recent 60 Minutes report titled “Treating Depression: Is There a Placebo Effect?” (CBS, February 19, 2012) focused on a meta-analysis of 35 clinical trials of four antidepressants for major depression published in 2008 (51). Standardized mean effect sizes were calculated for the symptom change observed from baseline to end of treatment in participants randomized to antidepressant medication and placebo, resulting in an effect size of 1.24 for medication and 0.92 for placebo (p<0.001). However, when standardized mean differences between drug and placebo were examined as a function of initial depression severity, the difference in mean effect size exceeded the threshold for a “clinically significant” difference (defined as an effect size difference of 0.5) only among patients whose baseline HAM-D score was ≥28.
Criticism of this meta-analysis has focused on its relatively small and selective sample of the available studies. In addition, comparing overall mean differences between drug and placebo groups does not account for different trajectories of treatment response (59) and is relatively insensitive to large and significant changes experienced by subgroups of the sample (60). However, other analyses using different methods and samples have reported similar findings, suggesting that the mean HAM-D difference between antidepressant medication and placebo may be modest for patients with milder depression (52).
A frequent conclusion drawn from these studies by the media as well as the public is that “antidepressants do not work better than no treatment at all.” This conclusion represents an incorrect interpretation of the data and may have the dangerous public health consequence of dissuading patients with depression from accessing treatment. First, patients receiving antidepressants in clinical trials improve a great deal—the standardized mean effect size of 1.24 for antidepressant treatment is large. Second, being assigned to placebo in an antidepressant trial is far from “no treatment,” since it entails intensive contact with health care staff that greatly exceeds what is delivered in standard community treatment. More accurately, the meta-analytic findings discussed above suggest that eliciting placebo effects and providing a therapeutic setting are powerful treatments for mild to moderate depression, and the specific effects of antidepressant medication result in small additional decreases in HAM-D scores over these interventions.
In order to benefit from placebo effects and a therapeutic setting, patients must receive some type of treatment. Most psychiatrists would agree that deception and the covert prescription of placebo are unethical for patients with depression. The question facing clinicians then becomes the following: Of currently available treatments, what is the optimal way to elicit placebo effects and provide a therapeutic setting for patients with milder forms of depression? Some policy makers have advised utilizing psychotherapy as the initial treatment approach, presumably as a means of eliciting placebo response without the cost and potential side effect burden associated with antidepressants (61). While this may be reasonable for some patients, we would caution against blanket recommendations in favor of a thoughtful consideration of the risks and benefits of medication and psychotherapy for each individual. Psychotherapy is not always cheaper than antidepressant medication; analyses of their comparative cost-effectiveness have mostly shown minimal differences (62), and in some populations psychotherapy may be more expensive than medication as a treatment for depression (63). Like medication, psychotherapy may be associated with significant side effects, such as worsening symptoms and the fostering of dependence and regression (64). Finally, both psychotherapy and antidepressant medication may have therapeutic effects other than decreasing HAM-D scores that should be considered. For example, treatment with antidepressant medication has been shown to result in salutary personality change (decreased neuroticism) compared with cognitive therapy or placebo (65).

Future Directions: Maximizing and Minimizing Placebo Response in the Treatment of Depression

Valid evaluation of putative antidepressant agents requires that placebo response be minimized in the drug development setting, while the best care for patients with depression may involve maximizing placebo response in clinical treatments. Data presented in this review suggest that the next generation of research aimed at reducing placebo response should focus on limiting patient expectancy and the intensity of therapeutic contact in antidepressant clinical trials (Table 2). More research is needed to elucidate how antidepressant study design, the content and process of informed consent discussions, and clinician attitudes affect patient expectancy and treatment outcome. Designs in which patients have a higher probability of receiving placebo (i.e., 50%) may be preferable to designs in which patients are randomized to multiple active treatment arms and placebo. In terms of therapeutic contact intensity, future studies should examine whether clinical trials could be made more efficient and generalizable to clinical practice by reducing the amount of contact with health care staff to levels resembling those associated with treatment in the community. However, it must be determined whether acceptable attrition rates and patient safety can be maintained while reducing placebo response.
TABLE 2. Study Design Features Influencing Placebo Response in Antidepressant Clinical Trials
Increase Placebo ResponseDecrease Placebo ResponseStrength of Evidence
More study sitesFewer study sitesStrong
Poor rater blindingGood rater blinding with blind assessmentStrong
Multiple active treatment armsSingle active treatment armStrong
Lower probability of receiving placeboHigher probability of receiving placeboStrong
Single baseline ratingMultiple baseline ratingsMedium
Briefer duration of illness in current episodeLonger duration of illness in current episodeMedium
More study visitsFewer study visitsMedium
Sample of symptomatic volunteersSample of self-referred patientsWeak
Optimistic/enthusiastic cliniciansPessimistic/neutral cliniciansWeak
Conversely, the optimal strategy in clinical practice may be to combine active medication with a presentation and level of therapeutic contact designed to enhance placebo effects, leading to greater medication response. Updated clinical management techniques may involve educating patients about the effectiveness of the prescribed medication and utilizing a confident and enthusiastic interpersonal style. While efforts to identify the “elusive placebo reactor” have historically been unsuccessful, it is possible that demographic or clinical characteristics related to the formulation of treatment expectancies or patients’ experience of the treatment setting are associated with placebo response. Identifying patients who are likely to respond to these factors may permit them to be targeted with enhanced interventions. In developing these interventions, it may be useful to employ more “objective” measures of treatment response, such as neuroimaging, to ensure that these interventions actually improve depression rather than simply introducing response bias.
Studies of the neurobiology of placebo effects, although not within the scope of this review, may provide useful data on the mechanisms of placebo response. Functional MRI studies of expectancy-based placebo effects have provided converging evidence suggesting that the brain areas associated with generating and maintaining expectancies include prefrontal cortex subregions, the orbitofrontal cortex, and the rostral anterior cingulate cortex (66). In treatment for depression, response to placebo has been associated with region-specific alterations in brain metabolism that represent a subset of the areas associated with response to antidepressant medication (67). Research aimed at further elucidating the biological pathways that lead to placebo effects is under way, and results of these studies are likely to yield information about the pathophysiology of major depressive disorder and the mechanisms of action of antidepressant treatments.
Placebo response in antidepressant clinical trials is a fascinating and complex phenomenon worthy of scientific investigation. Investigating the mechanisms of placebo effects has the potential to illuminate the pathophysiology of depression as well as the active ingredients of clinical trials. The public health benefit of research on placebo effects is that knowledge of their mechanisms may permit the development of strategies to modulate their magnitude depending on the context, thereby improving signal detection in drug development studies and increasing antidepressant response in clinical treatment.

References

1.
Walsh BT, Seidman SN, Sysko R, Gould M: Placebo response in studies of major depression: variable, substantial, and growing. JAMA 2002; 287:1840–1847
2.
Bridge JA, Birmaher B, Iyengar S, Barbe RP, Brent DA: Placebo response in randomized controlled trials of antidepressants for pediatric major depressive disorder. Am J Psychiatry 2009; 166:42–49
3.
Khan A, Bhat A, Kolts R, Thase ME, Brown W: Why has the antidepressant-placebo difference in antidepressant clinical trials diminished over the past three decades? CNS Neurosci Ther 2010; 16:217–226
4.
Khan A, Khan S, Brown WA: Are placebo controls necessary to test new antidepressants and anxiolytics? Int J Neuropsychopharmacol 2002; 5:193–197
5.
Hooper M, Amsterdam JD: Do clinical trials reflect drug potential? A review of FDA evaluation of new antidepressants, in 39th Annual Meeting Abstracts of Poster Presentations, New Clinical Drug Evaluation Unit Program, 1999
6.
Nutt D, Goodwin G: ECNP Summit on the future of CNS drug research in Europe 2011: report prepared for ECNP by David Nutt and Guy Goodwin. Eur Neuropsychopharmacol 2011; 21:495–499
7.
Cressey D: Psychopharmacology in crisis. Nature, Jun, 14, 2011 (http://www.nature.com/news/2011/110614/full/news.2011.367.html)
8.
World Health Organization: The World Health Report 2004: Changing History, Annex Table 3: Burden of Disease in DALYs by Cause, Sex, and Mortality Stratum in WHO Regions, Estimates for 2002. Geneva, WHO, 2004
9.
Rush AJ, Trivedi MH, Wisniewski SR, Nierenberg AA, Stewart JW, Warden D, Niederehe G, Thase ME, Lavori PW, Lebowitz BD, McGrath PJ, Rosenbaum JF, Sackeim HA, Kupfer DJ, Luther J, Fava M: Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. Am J Psychiatry 2006; 163:1905–1917
10.
Kirsch I, Sapirstein G: Listening to Prozac but hearing placebo: a meta-analysis of antidepressant medication. Prev Treat 1998 (
11.
Khan A, Redding N, Brown WA: The persistence of the placebo response in antidepressant clinical trials. J Psychiatr Res 2008; 42:791–796
12.
Stewart-Williams S, Podd J: The placebo effect: dissolving the expectancy versus conditioning debate. Psychol Bull 2004; 130:324–340
13.
Khan A, Kolts RL, Thase ME, Krishnan KR, Brown W: Research design features and patient characteristics associated with the outcome of antidepressant clinical trials. Am J Psychiatry 2004; 161:2045–2049
14.
Rutherford BR, Sneed JR, Roose SP: Does study design influence outcome? The effects of placebo control and treatment duration in antidepressant trials. Psychother Psychosom 2009; 78:172–181
15.
Sneed JR, Rutherford BR, Rindskopf D, Lane DT, Sackeim HA, Roose SP: Design makes a difference: a meta-analysis of antidepressant response rates in placebo-controlled versus comparator trials in late-life depression. Am J Geriatr Psychiatry 2008; 16:65–73
16.
Papakostas GI, Fava M: Does the probability of receiving placebo influence clinical trial outcome? A meta-regression of double-blind, randomized clinical trials in MDD. Eur Neuropsychopharmacol 2009; 19:34–40
17.
Sinyor M, Levitt AJ, Cheung AH, Schaffer A, Kiss A, Dowlati Y, Lanctôt KL: Does inclusion of a placebo arm influence response to active antidepressant treatment in randomized controlled trials? Results from pooled and meta-analyses. J Clin Psychiatry 2010; 71:270–279
18.
Meyer B, Pilkonis PA, Krupnick JL, Egan MK, Simmens SJ, Sotsky SM: Treatment expectancies, patient alliance, and outcome: further analyses from the National Institute of Mental Health Treatment of Depression Collaborative Research Program. J Consult Clin Psychol 2002; 70:1051–1055
19.
Krell HV, Leuchter AF, Morgan M, Cook IA, Abrams M: Subject expectations of treatment effectiveness and outcome of treatment with an experimental antidepressant. J Clin Psychiatry 2004; 65:1174–1179
20.
Rutherford BR, Marcus SM, Wang P, Sneed JR, Pelton G, Devanand D, Duan N, Roose SP: A randomized, prospective pilot study of patient expectancy and antidepressant outcome. Psychol Med (Epub ahead of print, Sept 13, 2012)
21.
Rutherford BR, Sneed JR, Tandler JM, Rindskopf D, Peterson BS, Roose SP: Deconstructing pediatric depression trials: an analysis of the effects of expectancy and therapeutic contact. J Am Acad Child Adolesc Psychiatry 2011; 50:782–795
22.
Di Blasi Z, Kleijnen J: Context effects: powerful therapies or methodological bias? Eval Health Prof 2003; 26:166–179
23.
Bass MJ, Buck C, Turner L, Dickie G, Pratt G, Robinson HC: The physician’s actions and the outcome of illness in family practice. J Fam Pract 1986; 23:43–47
24.
Benedetti F: Mechanisms of placebo and placebo-related effects across diseases and treatments. Annu Rev Pharmacol Toxicol 2008; 48:33–60
25.
Posternak MA, Zimmerman M: Therapeutic effect of follow-up assessments on antidepressant and placebo response rates in antidepressant efficacy trials: meta-analysis. Br J Psychiatry 2007; 190:287–292
26.
Mojtabai R, Olfson M: National patterns in antidepressant treatment by psychiatrists and general medical providers: results from the National Comorbidity Survey Replication. J Clin Psychiatry 2008; 69:1064–1074
27.
Stettin GD, Yao J, Verbrugge RR, Aubert RE: Frequency of follow-up care for adult and pediatric patients during initiation of antidepressant therapy. Am J Manag Care 2006; 12:453–461
28.
Morrato EH, Libby AM, Orton HD, Degruy FV, Brent DA, Allen R, Valuck RJ: Frequency of provider contact after FDA advisory on risk of pediatric suicidality with SSRIs. Am J Psychiatry 2008; 165:42–50
29.
Stein DJ, Baldwin DS, Dolberg OT, Despiegel N, Bandelow B: Which factors predict placebo response in anxiety disorders and major depression? An analysis of placebo-controlled studies of escitalopram. J Clin Psychiatry 2006; 67:1741–1746
30.
Trivedi MH, Rush H: Does a placebo run-in or a placebo treatment cell affect the efficacy of antidepressant medications? Neuropsychopharmacology 1994; 11:33–43
31.
Faries DE, Heiligenstein JH, Tollefson GD, Potter WZ: The double-blind variable placebo lead-in period: results from two antidepressant clinical trials. J Clin Psychopharmacol 2001; 21:561–568
32.
Barnett AG, van der Pols JC, Dobson AJ: Regression to the mean: what it is and how to deal with it. Int J Epidemiol 2005; 34:215–220
33.
Marcus SM, Gorman JM, Tu X, Gibbons RD, Barlow DH, Woods SW, Shear MK: Rater bias in a blinded randomized placebo-controlled psychiatry trial. Stat Med 2006; 25:2762–2770
34.
Rief W, Nestoriuc Y, Weiss S, Welzel E, Barsky AJ, Hofmann SG: Meta-analysis of the placebo response in antidepressant trials. J Affect Disord 2009; 118:1–8
35.
Lambert MJ, Hatch DR, Kingston MD, Edwards BC: Zung, Beck, and Hamilton rating scales as measures of treatment outcome: a meta-analytic comparison. J Consult Clin Psychol 1986; 54:54–59
36.
Landin R, DeBrota DJ, DeVries TA, Potter WZ, Demitrack MA: The impact of restrictive entry criterion during the placebo lead-in period. Biometrics 2000; 56:271–278
37.
Mundt JC, Greist JH, Jefferson JW, Katzelnick DJ, DeBrota DJ, Chappell PB, Modell JG: Is it easier to find what you are looking for if you think you know what it looks like? J Clin Psychopharmacol 2007; 27:121–125
38.
Greenberg RP, Bornstein RF, Greenberg MD, Fisher S: A meta-analysis of antidepressant outcome under “blinder” conditions. J Consult Clin Psychol 1992; 60:664–669, discussion 670–677
39.
DeBrota DJ, Demitrack MA, Landin R, Kobak KA, Greist JH, Potter W: A comparison between interactive voice response system-administered HAM-D and clinician-administered HAM-D in patients with major depressive episode, in 39th Annual Meeting Abstracts of Poster Presentations, New Clinical Drug Evaluation Unit Program, 1999
40.
Paulhus DL: Measurement and control of response bias, in Measures of Personality and Social Psychological Attitudes. Edited by, Robinson JP, Shaver PR, Wrightsman LS. San Diego, Academic Press, 1991, pp 17–59
41.
Mulsant BH, Kastango KB, Rosen J, Stone RA, Mazumdar S, Pollock BG: Interrater reliability in clinical trials of depressive disorders. Am J Psychiatry 2002; 159:1598–1600
42.
Kobak KA, Kane JM, Thase ME, Nierenberg AA: Why do clinical trials fail? The problem of measurement error in clinical trials: time to test new paradigms? J Clin Psychopharmacol 2007; 27:1–5
43.
Keller MB, Klerman GL, Lavori PW, Coryell WH, Endicott J, Taylor J: Long-term outcome of episodes of major depression: clinical and public health significance. JAMA 1984; 252:788–792
44.
Rutherford BR, Mori S, Sneed JR, Pimontel MA, Roose SP: Contribution of spontaneous improvement to placebo response in depression: a meta-analytic review. J Psychiatr Res 2012; 46:697–702
45.
Brody B, Leon AC, Kocsis JH: Antidepressant clinical trials and subject recruitment: just who are symptomatic volunteers? Am J Psychiatry 2011; 168:1245–1247
46.
Kisely S, Scott A, Denney J, Simon G: Duration of untreated symptoms in common mental disorders: association with outcomes. Br J Psychol 2006; 189:79–80
47.
Benedetti F, Arduino C, Costa S, Vighetti S, Tarenzi L, Rainero I, Asteggiano G: Loss of expectation-related mechanisms in Alzheimer’s disease makes analgesic therapies less effective. Pain 2006; 121:133–144
48.
Liberman RP: The elusive placebo reactor. Neuropsychopharmacology 1967; 5:557–566
49.
Shapiro AK, Morris LA: The placebo effect in medical and psychological therapies, in Handbook of Psychotherapy and Behavior Change: An Empirical Analysis. Edited by Garfield SL, Bergins AE. New York, Aldine Publishing, 1978, pp 477–536
50.
Doongaji DR, Vahia VN, Bharucha MP: On placebos, placebo responses, and placebo responders: a review of psychological, psychopharmacological, and psychophysiological factors, II: psychopharmacological and psychophysiological factors. J Postgrad Med 1978; 24:147–157
51.
Kirsch I, Deacon BJ, Huedo-Medina TB, Scoboria A, Moore TJ, Johnson BT: Initial severity and antidepressant benefits: a meta-analysis of data submitted to the Food and Drug Administration. PLoS Med 2008; 5:e45
52.
Fournier JC, DeRubeis RJ, Hollon SD, Dimidjian S, Amsterdam JD, Shelton RC, Fawcett J: Antidepressant drug effects and depression severity: a patient-level meta-analysis. JAMA 2010; 303:47–53
53.
Glassman AH, Roose SP: Delusional depression: a distinct clinical entity? Arch Gen Psychiatry 1981; 38:424–427
54.
Lespérance F, Frasure-Smith N, Koszycki D, Laliberté MA, van Zyl LT, Baker B, Swenson JR, Ghatavi K, Abramson BL, Dorian P, Guertin MCCREATE Investigators: Effects of citalopram and interpersonal psychotherapy on depression in patients with coronary artery disease: the Canadian Cardiac Randomized Evaluation of Antidepressant and Psychotherapy Efficacy (CREATE) trial. JAMA 2007; 297:367–379
55.
Roose SP, Sackeim HA, Krishnan KRR, Pollock BG, Alexopoulos G, Lavretsky H, Katz IR, Hakkarainen HOld-Old Depression Study Group: Antidepressant pharmacotherapy in the treatment of depression in the very old: a randomized, placebo-controlled trial. Am J Psychiatry 2004; 161:2050–2059
56.
Kirsch I: Are drug and placebo effects in depression additive? Biol Psychiatry 2000; 47:733–735
57.
Kirsch I: Changing Expectations: A Key to Effective Psychotherapy. Pacific Grove, Calif, Brooks/Cole, 1990
58.
Muthén B, Brown HC: Estimating drug effects in the presence of placebo response: causal inference using growth mixture modeling. Stat Med 2009; 28:3363–3385
59.
Gueorguieva R, Mallinckrodt C, Krystal JH: Trajectories of depression severity in clinical trials of duloxetine: insights into antidepressant and placebo responses. Arch Gen Psychiatry 2011; 68:1227–1237
60.
Thase ME, Larsen KG, Kennedy SH: Assessing the “true” effect of active antidepressant therapy v placebo in major depressive disorder: use of a mixture model. Br J Psychiatry 2011; 199:501–507
61.
Depression: The Treatment and Management of Depression in Adults (NICE clinical guideline 90). London, National Institute for Health and Clinical Excellence, 2009
62.
Lave JR, Frank RG, Schulberg HC, Kamlet MS: Cost-effectiveness of treatments for major depression in primary care practice. Arch Gen Psychiatry 1998; 55:645–651
63.
Domino ME, Foster EM, Vitiello B, Kratochvil CJ, Burns BJ, Silva SG, Reinecke MA, March JS: Relative cost-effectiveness of treatments for adolescent depression: 36-week results from the TADS randomized trial. J Am Acad Child Adolesc Psychiatry 2009; 48:711–720
64.
Barlow DH: Negative effects from psychological treatments: a perspective. Am Psychol 2010; 65:13–20
65.
Tang TZ, DeRubeis RJ, Hollon SD, Amsterdam J, Shelton R, Schalet B: Personality change during depression treatment: a placebo-controlled trial. Arch Gen Psychiatry 2009; 66:1322–1330
66.
Petrovic P, Dietrich T, Fransson P, Andersson J, Carlsson K, Ingvar M: Placebo in emotional processing: induced expectations of anxiety relief activate a generalized modulatory network. Neuron 2005; 46:957–969
67.
Mayberg HS, Silva JA, Brannan SK, Tekell JL, Mahurin RK, McGinnis S, Jerabek PA: The functional neuroanatomy of the placebo effect. Am J Psychiatry 2002; 159:728–737

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 723 - 733
PubMed: 23318413

History

Received: 11 April 2012
Revision received: 13 July 2012
Accepted: 13 August 2012
Published online: 1 July 2013
Published in print: July 2013

Authors

Details

Bret R. Rutherford, M.D.
From Columbia University College of Physicians and Surgeons and New York State Psychiatric Institute, New York.
Steven P. Roose, M.D.
From Columbia University College of Physicians and Surgeons and New York State Psychiatric Institute, New York.

Notes

Address correspondence to Dr. Rutherford ([email protected]).

Funding Information

Dr. Rutherford reports no financial relationships with commercial interests. Dr. Roose has served as a consultant to Pfizer and Forest Laboratories.Supported by NIMH grant K23 MH085236 to Dr. Rutherford and grant T32 MH015144 to Dr. Roose; by a Hope for Depression Research Foundation grant to Dr. Rutherford; and by a NARSAD Young Investigator Award to Dr. Rutherford.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share