Assuring That Double-Blind Is Blind
Publication: American Journal of Psychiatry
The gold standard for evidence in psychiatry, as elsewhere in medicine, is often considered to be the randomized, placebo-controlled, double-blind study. The use of blinding or masking plays a key role in these designs by addressing the problem of expectancy. First, if participants anticipate greater benefit from a particular treatment, they may be more likely to respond to it, which is considered a component of placebo response. Not surprisingly, participants have been found to report greater anticipated benefits when they were randomized to enter an active-comparator, versus a placebo-comparator, study (1). Likewise, raters may anticipate greater benefit from active drug and thus favor it in their ratings, whether consciously or unconsciously. Greater response rates in both active and placebo arms occur when a greater proportion of participants receive active treatment—that is, when patients (1) or raters (2) expect more participants to benefit.
Double-blinding, typically by providing drug and placebo in identical capsules, is intended to minimize the impact of expectancy and the related concept of credibility. The blind may be compromised in a variety of ways, however, beginning with differences in medication taste or smell. Of particular concern may be the emergence of adverse effects, particularly when those adverse effects are known to be associated with a specific medication. The requirement that informed consent forms delineate common adverse effects may increase this risk (3). Indeed, when the degree of unblinding is assessed in antidepressant trials, multiple reports suggest that it is extensive: at least three-quarters of patients are typically able to correctly guess at their treatment assignment (4, 5). Moreover, even the sudden absence of adverse effects may contribute to unblinding, as might occur when a participant stabilized on a sedating medication is abruptly switched to placebo at randomization in a relapse-prevention study.
If such unblinding occurs, does it meaningfully affect trial results? A meta-analysis of antidepressant trials using active placebos, such as those with antihistaminergic or anticholinergic effects, suggested smaller effect sizes than those observed in the presumably less blinded trials with inert placebo (6). Estimating the potential impact in published studies is difficult, but certain findings when results are stratified by potentially unblinding adverse effects raise concern. In a trial of quetiapine in bipolar depression (7), for example, when investigators examined only the groups reporting sedation, mean change in the Montgomery-Åsberg Depression Rating Scale total score at week 8 was –18.8 in the quetiapine groups (N=195) and –18.9 in the placebo group (N=24). Conversely, when the subset of participants without sedation were examined, the mean change in the Montgomery-Åsberg Depression Rating Scale total score was –19.3 and –11.7 in the quetiapine and placebo groups, respectively. While only a small subset of patients were in the placebo/sedation arm, the disparity in placebo response might suggest that clinical raters were attempting to "guess" at treatment assignment.
Unfortunately, for psychotropic drugs, CNS side effects may be inevitable. Therefore, we call for more uniform application of standards in the design, reporting, and review of clinical trials.
1. Consistent with CONSORT (8) and international guidelines (9), participants and raters should be asked to guess treatment assignment, and the degree of true and false unblinding should be reported in the primary publication of results. Statistical techniques to formally test for unblinding have been described and are readily available (10). However, while this approach may help to identify flawed trials, it does nothing to prevent them, and guesses at the end of a trial may be confounded by "true" efficacy.
2. To minimize the impact of adverse effects on efficacy ratings, one rater should evaluate symptoms but not side effects, while another rater scores side effects and not symptoms.
3. Where the risk of unblinding through adverse effects is substantial, the use of an "active" placebo should be considered, with adverse effects mimicking those of the active drug. This design is rarely used in modern psychotropic studies: A MEDLINE search for "active placebo" identified only one randomized controlled antidepressant trial since 2000 with this design. However, the ethical problem of deliberately inducing risk for adverse effects, even if they are benign or even potentially therapeutic, requires further study.
All of these recommendations are reflected in existing guidance documents for clinical trial design and analysis, and some date back more than 25 years. If readers, reviewers, and journal editors ensure that they are applied where appropriate, confidence in the gold standard for determining clinical efficacy could be enhanced.
References
1.
Rutherford BR, Sneed JR, Roose SP: Does study design influence outcome? the effects of placebo control and treatment duration in antidepressant trials. Psychother Psychosom 2009; 78:172–181
2.
Papakostas GI, Fava M: Does the probability of receiving placebo influence clinical trial outcome? a meta-regression of double-blind, randomized clinical trials in MDD. Eur Neuropsychopharmacol 2009; 19:34–40
3.
Brownell KD, Stunkard AJ: The double-blind in danger: untoward consequences of informed consent. Am J Psychiatry 1982; 139:1487–1489
4.
Rabkin JG, Markowitz JS, Stewart J, McGrath P, Harrison W, Quitkin FM, Klein DF: How blind is blind? assessment of patient and doctor medication guesses in a placebo-controlled trial of imipramine and phenelzine. Psychiatry Res 1986; 19:75–86
5.
Bystritsky A, Waikar SV: Inert placebo versus active medication: patient blindability in clinical pharmacological trials. J Nerv Ment Dis 1994; 182:485–487
6.
Moncrieff J, Wessely S, Hardy R: Active placebos versus antidepressants for depression. Cochrane Database Syst Rev 2004; 1:CD003012
7.
Calabrese JR, Keck PE, Macfadden W, Minkwitz M, Ketter TA, Weisler RH, Cutler AJ, McCoy R, Wilson E, Mullen J BOLDER Study Group: A randomized, double-blind, placebo-controlled trial of quetiapine in the treatment of bipolar I or II depression. Am J Psychiatry 2005; 162:1351–1360
8.
Moher D, Schulz KF, Altman D: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. JAMA 2001; 285:1987–1991
9.
International Conference of Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use: ICH Harmonised Tripartite Guideline: Choice of Control Group and Related Issues in Clinical Trials (E10). Jul 20, 2000. http://www.ich.org/LOB/media/MEDIA486.pdf
10.
Bang H, Ni L, Davis CE: Assessment of blinding in clinical trials. Control Clin Trials 2004; 25:143–156
Information & Authors
Information
Published In
History
Accepted: November 2009
Published online: 1 March 2010
Published in print: March 2010
Authors
Competing Interests
Dr. Fava has received research support or advisory, consulting, speaking, or publishing fees from Abbott Laboratories, Advanced Meeting Partners, Alkermes, Amarin, APA, Aspect Medical Systems, AstraZeneca, Auspex Pharmaceuticals, Bayer AG, Belvoir Publishing, Best Practice Project Management, Inc., BioMarin Pharmaceuticals, Inc., Bio Research, BrainCells, Biovail Pharmaceuticals, Boehringer-Ingelheim, BrainCells, Bristol-Myers Squibb Company, Cephalon, Clinical Trial Solutions, CNS Response, Compellis, Cypress Pharmaceuticals, Dov Pharmaceuticals, Eli Lilly, EPIX Pharmaceuticals, Euthymics Bioscience, Fabre-Kramer Pharmaceuticals, Forest Pharmaceuticals, Ganeden, GlaxoSmithKline, Grunenthal GmbH, Imedex, J&J Pharmaceuticals, Janssen Pharmaceutica, Jazz Pharmaceuticals, Knoll Pharmaceutical Company, Labopharm, Lichtwer Pharma GmbH, Lorex Pharmaceuticals, Lundbeck, MedAvante, Merck, Methylation Sciences, MGH Psychiatry Academy/Primedia, MGH Psychiatry Academy/Reed-Elsevier, NARSAD, National Center for Complementary and Alternative Medicine, National Institute on Drug Abuse, Neuronetics, NIMH, Novartis, Nutrition 21, Organon, PamLab, Pfizer, PharmaStar, Pharmavite, Precision Human Biolaboratory, PsychoGenics, Roche, Sanofi-Aventis, Sepracor, Schering-Plough, Shire, Solvay Pharmaceuticals, Somaxon, Somerset Pharmaceuticals, Synthelabo, Takeda, Tetragenex, TransForm Pharmaceuticals, Transcept Pharmaceuticals, UBC, Vanda Pharmaceuticals, and Wyeth-Ayerst; he has equity holdings in Compellis, has patent applications for "sequential parallel comparison of design" (SPCD) and for a combination of azapirones and bupropion in major depression, and receives royalties for the Massachusetts General Hospital Cognitive and Physical Functioning Questionnaire, the Discontinuation-Emergent Signs and Symptoms scale, and SAFER. Dr. Ostacher has received research support or advisory, consulting, or speaking fees from AstraZeneca, Bristol-Myers Squibb, Concordant Rater Systems, Eli Lilly, Forest Pharmaceuticals, GlaxoSmithKline, Janssen Pharmaceutica, Pfizer, and Massachusetts General Hospital Psychiatry Academy (lectures supported through Independent Medical Education grants from AstraZeneca, Eli Lilly, and Janssen Pharmaceuticals). Dr. Perlis has received research support or advisory, consulting, or speaking fees from AstraZeneca, Bristol-Myers Squibb, Elan/Eisai, Eli Lilly, GlaxoSmithKline, Pfizer, and Proteus Biomedical, and has equity holdings and patents for Concordant Rater Systems, LLC. Dr. Sachs has received research support or advisory, consulting, or speaking fees from Abbott, AstraZeneca, Bristol-Myers Squibb, Cephalon, CNS Response, Elan Pharmaceuticals, Eli Lilly, GlaxoSmithKline, Janssen, Memory Pharmaceuticals, Merck, NIMH, Novartis, Organon, Pfizer, Repligen, Sanofi-Aventis, Shire, Sigma-Tau, Solvay, and Wyeth; his spouse is a shareholder with Concordant Rater Systems. Dr. Nierenberg has received research support or advisory or consulting fees or honoraria from American Drug Utilization Review, American Society for Clinical Psychopharmacology, APA (travel expenses), Appliance Computing Inc. (Mindsite), Baystate Medical Center, Belvoir Publishing, Brain Cells, Inc., Brandeis University, Columbia University, Eli Lilly, Hillside Hospital, IMEDEX, MBL Publishing, MJ Consulting, New York State, NIMH, Novartis, PamLabs, Pfizer Pharmaceuticals, Physicians Postgraduate Press, PGx Health, Schering-Plough, Shire, SUNY Buffalo, Targacept, Takeda Pharmaceuticals, University of Texas Southwestern Dallas, University of Wisconsin, and University of Pisa; he is a presenter for the Massachusetts General Hospital Psychiatry Academy, which has been supported through Independent Medical Education grants from Astra Zeneca, Bristol-Myers Squibb, Eli Lilly, and Janssen Pharmaceuticals; he owns stock options in Appliance Computing, Inc., and Brain Cells, Inc.; through Massachusetts General Hospital (MGH), he is named for copyrights to the Clinical Positive Affect Scale and the MGH Structured Clinical Interview for the Montgomery-Åsberg Depression Rating Scale exclusively licensed to the MGH Clinical Trials Network and Institute; also through MGH, he has a patent extension application for the combination of buspirone, bupropion, and melatonin for the treatment of depression. Dr. Rosenbaum has consulted for or is a member of scientific advisory boards for Auspex, Medavante, Neuronetics, and Supernus, and he holds equity in Compellis and Medavante. Dr. Freedman has reviewed this editorial and found no evidence of influence from these relationships.
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBGet Access
Login options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).