What Can Large Simple Trials Do for Psychiatry?
Publication: American Journal of Psychiatry
An article in this issue by Strom and colleagues (1) on the Ziprasidone Observational Study of Cardiac Outcomes (ZODIAC) trial nicely illustrates the promise and the limitations of large simple trials (LSTs). LSTs may be unfamiliar to some readers of the Journal because they are rare in psychiatry. Briefly, LSTs are pragmatic randomized clinical trials that are narrowly focused on clearly defined outcomes that are important to patients as well as clinicians. Their goal is to detect modest but meaningful differences between treatments on important outcomes in typical clinical situations (2). Procedures and data collection are greatly simplified compared with typical randomized trials. A large sample is usually needed to detect differences between treatments that would be missed in smaller trials because of inadequate statistical power (3). To enhance generalizability, participants in LSTs are recruited from a variety of clinical sites and are meant to represent typical patients receiving routine care. To enroll large numbers of typical patients, LSTs need the collaboration of clinicians who care for many patients. Simple procedures mean that routine clinical practice is minimally disrupted, which helps keep costs down so that many patients can be enrolled.
ZODIAC
The U.S. Food and Drug Administration (FDA) approval letter for ziprasidone, dated February 5, 2001, reminded the drug's maker of its “postmarketing study commitments,” including “a study of sudden unexpected death with ziprasidone and other atypical antipsychotics” (4). The commitment resulted from concern that ziprasidone's known risk of prolonged cardiac repolarization, measured by the electrocardiographic QTc interval, might cause an increased rate of potentially fatal arrhythmias (e.g., torsade de pointes).
The ZODIAC study carefully adhered to the major conventions of LSTs—a huge number of participants, a simple protocol with minimal data collection, and an important and well-defined outcome measure (nonsuicide mortality). The study was well designed, conducted, and reported. The authors' conclusions are cautiously worded to reflect proper statistical inferences. A plain-language interpretation is that rates of nonsuicide mortality were similar for patients taking ziprasidone and olanzapine over 1 year, but the finding is imprecise because mortality rates were low over the study period. However, it is important to remember that people using antipsychotics are at increased risk of sudden cardiac death compared with those not taking such medications, and that this risk is dose-related (5).
Readers may see ZODIAC, the largest prospective randomized study of patients with schizophrenia yet conducted, as a missed opportunity to learn much more about effects of antipsychotic drugs on other outcomes of interest, including functioning, symptoms, weight, and extrapyramidal side effects. This is the major trade-off in an LST—to obtain a reliable answer about a single outcome, a huge number of patients must participate, but extensive data are not collected. Nevertheless, important effectiveness information is included in the ZODIAC report. Time to treatment -discontinuation for any cause was longer for people assigned to olanzapine than for those assigned to ziprasidone. Psychiatric hospitalizations were significantly more likely for those assigned to ziprasidone. Thus the ZODIAC study confirms effectiveness findings from earlier randomized trials and meta-analyses (6–9).
As illustrated by the Method section of the ZODIAC report and the study timeline, even though procedures at clinical research sites are minimal, LSTs can be enormously complex undertakings that require extensive planning and years to conduct. Surely, 7 years (the time from FDA approval for ziprasidone until ZODIAC was first publicly presented) is too long to wait for the results of a study addressing an increased risk of mortality. Because of this, LSTs are not the optimal way to examine the risk of rare but serious adverse events.
Postmarketing randomized controlled trials such as ZODIAC provide information about longer-term drug safety, but better, faster, and cheaper ways to get this information are desperately needed. One promising new program is the FDA's Sentinel Initiative, which aims to build a national automated health care data system to monitor the safety of FDA-regulated products “continuously and in real time” (10). The Sentinel Initiative has already begun multiple projects that will shape an “active surveillance” system that will augment existing systems that rely on external sources to report potential adverse events (11).
Role for Large Simple Trials in Psychiatry
LSTs can and should have an important role in assessing the effectiveness of newly approved drugs compared with standard treatments in psychiatry (12). Little is known about the long-term effects of new drugs when they come to market. The relatively small and brief trials conducted to achieve regulatory approval are carefully designed to show short-term efficacy and safety but are clearly not concerned with long-term adverse effects. Even major safety problems, including increased risk of sudden cardiac death, may be undetected when a new drug is first available. The widespread use of patented new drugs in preference to existing treatments, based only on results from short-term registration trials and with minimal long-term safety data, is expensive and potentially dangerous.
As prospective and randomized trials, LSTs represent the gold standard of comparative effectiveness research and can provide the most reliable information possible about the real-world effectiveness of new medications. By keeping goals simple and costs low, LSTs may be affordable for public funders that need objective information. LSTs can help identify true advances and avoid costly adoption of new medications that offer no real advantage over old ones. LSTs can also be used to evaluate common but unproven practices, such as the simultaneous use of multiple antipsychotics for people with schizophrenia.
Some aspects of psychiatric practice do not fit easily into the LST model. Psychiatry generally lacks the commonly accepted, discrete, and clearly important outcomes that are the primary endpoints of LSTs. Recovery may be the most important outcome for mental disorders, but it is not simple to measure. Treatment discontinuation for any cause has many desirable properties, but its clinical significance is unclear to some. Hospitalization, relapse, and efficacy failure may be the best outcome measures for LSTs involving severe mental disorders.
An excellent recent example of a pragmatic or large simple trial in psychiatry is the U.K. Mental Health Research Network's Bipolar Affective Disorder: Lithium/Anticonvulsant Evaluation (BALANCE) trial (13). BALANCE compared lithium alone, valproate alone, and the combination of lithium and valproate for maintenance treatment of bipolar disorder. The primary outcome measure used to indicate relapse was time to new intervention for new mood episode. Because the use of a new intervention is important but occurs commonly, the study did not require a huge number of participants to judge a meaningful difference. Simple procedures meant that study costs were not enormous. The study's important findings—namely, that combination therapy with valproate and lithium and lithium monotherapy are more likely to prevent relapse than valproate alone—should influence practice (13).
There is an important potential role for LSTs in psychiatry to evaluate the comparative effectiveness of new treatments and other common but unproven treatment strategies. LSTs can provide essential information for clinicians, patients, and policy makers at limited public expense. However, to ensure that drugs are safe and to provide adequate monitoring for rare but serious adverse events, the current active surveillance initiatives of the FDA are more likely to yield timely information.
Footnote
Editorial accepted for publication November 2010
References
1.
Strom BL, Eng SM, Faich G, Reynolds RF, D'Agostino RB, Ruskin J, Kane JM: Comparative Mortality Associated With Ziprasidone and Olan-zapine in Real-World Use Among 18,154 Patients With Schizophrenia: The Ziprasidone Observational Study of Cardiac Outcomes (ZODIAC). Am J Psychiatry 2010; 168:193–201
2.
Geddes JR: Large simple trials in psychiatry: providing reliable answers to important clinical questions. Epidemiol Psichiatr Soc 2005; 14:122–126
3.
Peto R, Baigent C: Trials: the next 50 years: large scale randomised evidence of moderate benefits. BMJ 1998; 317:1170–1171
4.
US Food and Drug Administration: NDA 20-825: Approval Letter and Labeling, Feb 5, 2001. http://www.accessdata.fda.gov/drugsatfda_docs/appletter/2001/20825ltr.pdf
5.
Ray WA, Chung CP, Murray KT, Hall K, Stein CM: Atypical antipsychotic drugs and the risk of sudden cardiac death. N Engl J Med 2009; 360:225–235
6.
Lieberman JA, Stroup TS, McEvoy JP, Swartz MS, Rosenheck RA, Perkins DO, Keefe RS, Davis SM, Davis CE, Lebowitz BD, Severe J, Hsiao JK Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) Investigators: Effectiveness of antipsychotic drugs in patients with chronic schizophrenia. N Engl J Med 2005; 353:1209–1223
7.
Stroup TS, Lieberman JA, McEvoy JP, Swartz MS, Davis SM, Rosenheck RA, Perkins DO, Keefe RS, Davis CE, Severe J, Hsiao JK; CATIE Investigators: Effectiveness of olanzapine, quetiapine, risperidone, and ziprasidone in patients with chronic schizophrenia following discon-tinuation of a previous atypical antipsychotic. Am J Psychiatry 2006; 163:611–622
8.
Komossa K, Rummel-Kluge C, Hunger H, Schwarz S, Bhoopathi PS, Kissling W, Leucht S: Ziprasidone versus other atypical antipsychotics for schizophrenia. Cochrane Database of Systematic Reviews 2009; 4:CD006627
9.
Leucht S, Komossa K, Rummel-Kluge C, Corves C, Hunger H, Schmid F, Asenjo Lobos C, Schwarz S, Davis JM: A meta-analysis of head-to-head comparisons of second-generation antipsychotics in the treatment of schizophrenia. Am J Psychiatry 2009; 166:152–163
10.
US Food and Drug Administration: FDA's Sentinel Initiative. http://www.fda.gov/Safety/FDAsSentinelInitiative/default.htm
11.
US Food and Drug Administration: The Sentinel Initiative: an update on FDA's progress in building an electronic system for monitoring the postmarket safety of FDA-approved drugs and other products. 7 2010. http://www.fda.gov/downloads/Safety/FDAsSentinelInitiative/UCM233360.pdf
12.
Stroup TS, Alves WM, Hamer RM, Lieberman JA: Clinical trials for antipsychotic drugs: design conventions, dilemmas, and innovations. Nat Rev Drug Discov 2006; 5:133–146
13.
BALANCE investigators and collaborators, Geddes JR, Goodwin GM, Rendell J, Azorin JM, Cipriani A, Ostacher MJ, Morriss R, Alder N, Juszczak E: Lithium plus valproate combination therapy versus monotherapy for relapse prevention in bipolar I disorder (BALANCE): a ran-domised open-label trial. Lancet 2010; 375:385–395
Information & Authors
Information
Published In
History
Accepted: November 2010
Published online: 1 February 2011
Published in print: February 2011
Authors
Funding Information
Dr. Stroup reports no financial relationships with commercial interests.
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBGet Access
Login options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).