1. Introduction
Despite the effectiveness of antipsychotic drugs in treating acute psychosis and in preventing relapse, many patients with schizophrenia continue to experience psychotic symptoms. Although estimates vary, most surveys indicate that between 25 and 50% of patients with schizophrenia experience persistent psychotic symptoms even with optimal pharmacological treatment (
Curson et al., 1988;
Kane and Marder, 1993;
Carpenter and Buchanan, 1994). The search for complimentary interventions to decrease residual psychotic symptoms has led some researchers to cognitive therapy (CT). Cognitive-therapy for psychosis focuses on altering the thoughts, emotions, and behaviors of patients by teaching them skills to challenge and modify beliefs about delusions and hallucinations, to engage in experimental reality testing, and to develop better coping strategies for the management of hallucinations. The goals of these interventions are to decrease the conviction of delusional beliefs, and hence their severity, and to promote more effective coping and reductions in distress.
Although the initial applications of CT for psychosis date back two decades, the vast majority of controlled CT studies have been published within the past 5 years, and conducted almost exclusively in Great Britain (
Bouchard et al., 1996;
Haddock et al., 1997). The relative lag in controlled research on CT for psychosis can be traced to common assumptions that the cognitive deficits of schizophrenia preclude the use of CT approaches or that such approaches, which assume basic reasoning skills, are inappropriate for clients with psychosis. Nevertheless, the recent acceleration of activity in this research area raises a number of questions. Is CT for psychosis an effective treatment? How can we quantify its effectiveness? How can we combine the results of diverse outcome studies in a meaningful way to draw reliable conclusions about its effects?
In the present paper, we will employ meta-analytic techniques to address these questions. Meta-analysis can be a powerful tool for an outcome researcher in several ways. First, making meaningful comparisons between studies is complicated by a number of methodological issues. Studies vary widely in their use of outcome measures, which include clinician-rated instruments, and self-report measures of cognitive and mood change. Consequently, finding a common metric to compare these ‘apples and oranges’ is an elusive proposition. Meta-analysis provides this common metric in the form of an effect size that can be measured uniformly across studies. Second, studies often differ on several other methodological components, including whether they use control groups, the types of control groups employed (e.g. wait-list, treatment as usual, or psychological placebo), lengths of treatment, and differences in sample selection. Meta-analysis supplies a systematic and quantitative method to explore these differences. Third, interpreting findings from some studies may be complicated by problems of statistical power. Studies comparing two active treatments and reporting null statistical findings actually may be underpowered to detect clinically meaningful treatment effects due to small sample sizes (e.g. <10 subjects per cell). Employing meta-analysis, effect sizes can be combined across studies to increase the power to detect differential treatment or methodological effects. Finally, effect sizes offer advantages over literary reviews that compare findings based on levels of statistical significance because studies with different levels of significance can, in fact, have very similar effect sizes (
Glass et al., 1981).
3. Results
Effect sizes for changes in psychotic symptoms from pretreatment to posttreatment are presented in Table 1, along with the type of control group employed, sample size, length of treatment, and drop-out rates for each experimental and control group. Follow-up effect sizes are presented for the four studies that assessed it. All studies satisfied Rosenthal’s Chi-square test for heterogeneity.
3.1. Sample characteristics
We were initially interested in examining whether several variables related to sample characteristics (e.g. sex, duration of illness) had a systematic effect on the magnitude of the effect size. Nearly all studies (six of seven) assessed the male/female ratio in their samples; 70% of subjects were men, and 30% were women. Simple regression analyses revealed no significant relationship between sex distribution across studies and the effectiveness of the active treatment (P = 0.31; df = 1, 5; P = 0.60). In other words, studies with a high proportion of men did not appear to have significantly higher or lower effect sizes. This conclusion is tentative, however, given that study results were not broken down by sex, precluding a more definitive evaluation.
The duration of illness was determinable in six of seven studies; the mean duration of the disorder was 14.0 years (S.D. = 3.2; range = 11.0–18.2), suggesting a chronically ill sample. In only one study (
Drury et al., 1996) were patients less chronic. In this study, 66% were experiencing their first or second episode of psychosis, and 70% of the participants were within the first 5 years of presentation. The total number of past hospital admissions was assessed in six of seven studies with a mean of 3.4 (S.D. = 0.8; range = 2.5–4.8).
The medication status of patients in these studies was nearly uniform, with 100% taking psychotropic medication in six studies and 95% of patients taking medication in one study. In five of the studies, subjects were outpatients, and in two, they were inpatients.
Diagnostically, patients in these studies were a representative sample of community patients with schizophrenia-spectrum disorders. Eighty-nine per cent of the sample met criteria for schizophrenia, 7% had schizoaffective disorder, and 4% had delusional disorder. Patients with comorbid primary drug and alcohol abuse were excluded from these studies, as were patients with organic brain pathology. In most studies, patients were required to have at least one positive symptom that was distressing to them.
3.2. Treatment outcome and characteristics
The mean effect size for change in psychotic symptoms from pre- to posttreatment was 0.65 (95% CI = 0.56–0.71). This effect size is categorized as a ‘large effect size’ according to estimates designated by
Glass et al. (1981). This finding is consistent with the ‘qualitative’ clinical findings reported in these studies. All seven studies reported significant decreases in positive symptoms at posttreatment, and five of seven reported significant decreases for CT relative to the control condition at posttreatment. The overall drop-out rate in these studies was 12.4%. The two studies with the lowest levels of attrition (
Milton et al., 1978;
Drury et al., 1996) used inpatients. Participation refusal rates were not uniformly assessed across studies, even though these statistics may be more meaningful than attrition rates in studies of schizophrenia.
The number of sessions of CT treatment and treatment duration are also included in Table 1. The mean number of sessions of CT treatment was 13.6 (S.D. = 5.7) with a range of five to 20 sessions. Simple regression analyses revealed no significant relationship between number of sessions of CT treatment and change in psychotic symptoms (
R = 0.28;
df = 1,4;
p = 0.64). In three studies, the treatment intensity varied across subjects (
Garety et al., 1994;
Kuipers et al., 1997;
Sensky et al., 2000) and, as such, these studies were excluded from this analysis.
CT treatment format was fairly consistent across studies; six of seven studies employed an individual therapy format, and one study (
Drury et al. 1996) used combined individual and group therapy. The content of the CT interventions was also fairly similar across studies. All studies focused on modifying beliefs about delusions and hallucinations in order to decrease the impact that these phenomena had on patients’ lives. Therapists used a collaborative process in which they worked closely with a patient to understand the delusions or hallucinations from his/her perspective. They often employed specific strategies such as identifying cognitive errors, Socratic questioning, acting on beliefs to test their validity, and seeking the assistance of others in collecting disconfirming evidence for their beliefs. Study therapists also frequently used a hierarchical approach to change delusions by starting with the least strongly held beliefs and then progressing to more firmly held beliefs. The two studies by Tarrier and his colleagues used an intervention called Coping Strategy Enhancement in which the aim is to determine which environmental factors maintain psychotic symptoms as well as to teach better coping strategies; hypothesis testing skills and relapse prevention skills were also taught. In addition to modifying delusional beliefs, the
Kuipers et al. (1997) and
Garety et al. (1994) studies focused on changing dysfunctional schemas (e.g. that the patient was a bad and worthless person).
Treatment was conducted by doctoral-level (‘clinical doctorate’ in the UK) psychologists in four of the studies and psychiatric nurses in one study (
Sensky et al., 2000), and the level of training was unclear in the two remaining studies (
Milton et al., 1978;
Drury et al., 1996). Although assessment raters were not the providers of treatment, they were not blind to treatment allocation. Use of independent raters was not mentioned in either the
Drury et al. (1996) or the
Milton et al. (1978) studies and therefore was assumed not to have been employed.
3.3. Long-term treatment outcome
Examination of the long-term efficacy of controlled research studies may be restricted by the difficulties in maintaining patients in control conditions over time. In the present meta-analysis, four studies assessed outcome past 6 months posttreatment. Interestingly, in all four studies, patients continued to improve significantly over the follow-up periods, and their combined mean effect size at follow-up was 0.93. In the
Drury et al. (1996) study, only 5% of CT subjects showed moderate or severe residual symptoms of psychosis at follow-up compared to 56% of patients in the control group. Similarly, in the
Kuipers et al. (1997) study, patients in the CT group continued to make a modest improvement in BPRS scores, while control patients got worse. In the
Sensky et al. (2000) study, CBT and Befriending Control subjects were not different at posttreatment but were significantly different at 9 month follow-up. Patients in the
Tarrier et al. (1999) trial maintained their posttreatment gains during the 12 month follow-up.
4. Discussion
This is the first meta-analysis of the effects of CT for psychotic symptoms in schizophrenia. The effect size of 0.65 across seven controlled studies is large, and indicates that cognitive interventions represent a promising strategy for decreasing the severity of persistent delusions and hallucinations, or improving patients’ abilities to manage those distressing symptoms. Considering the high proportion of patients with schizophrenia who experience continued psychotic symptoms despite optimal pharmacological treatment, CT may represent an important, new intervention in the management of this serious disorder. In addition, the effects of CT over time appear to be quite robust (ES = 0.93).
Although the results of this meta-analysis demonstrate the strong effects of CT for schizophrenia, there are limitations to the studies conducted thus far, and many questions remain. Despite promising early research on CT for psychosis (
Milton et al., 1978), research on this treatment has been conducted almost exclusively in Great Britain by the developers of the cognitive interventions. There is a need to evaluate the replicability of CT for schizophrenia in additional treatment settings and to determine the generalizability of the intervention when performed by clinicians not working directly under the treatment innovators. In addition, although some studies successfully used independent evaluators, (e.g.
Kuipers et al., 1997), others used evaluators who were blind to group allocation but not to the timing of the assessments (e.g.
Tarrier et al., 1993,
1999). Future research would benefit from more consistent use of ‘blind’ evaluators.
The patients included in the studies reviewed were mostly males who were treated in outpatient settings. Although there are no a priori reasons for hypothesizing that CT would be less effective for women, or when conducted in inpatient settings, studies need to evaluate the effects of CT in more heterogeneous patient populations. Another methodological issue concerns the strength of the control group used in deriving effect sizes. The relative strength of a control group and its effect size when compared to the experimental treatment are inversely proportional (
Gould et al., 1995). In the present meta-analysis, two studies employed control groups that were matched to the CT group in level of treatment (
Tarrier et al., 1998;
Sensky et al., 2000). Thus, the effect sizes of the CT intervention in these studies might be an underestimate of the ‘true’ effect size of CT when compared to ‘treatment as usual’.
Another important question raised by research on CT for psychosis is the clinical and functional significance of treatment gains. There is a broad consensus that poor functioning in the areas of social relationships, work, and self-care in schizophrenia is more strongly related to the severity of negative symptoms and cognitive impairment than psychotic symptoms (
Liddle, 1987;
Bellack et al., 1990;
Glynn et al., 1992;
Brekke et al., 1994). However, persistent psychotic symptoms are associated with higher levels of anxiety and depression (
Tarrier, 1987;
Mueser et al., 1991) and with increased vulnerability to relapse and rehospitalization. Only two studies of CT evaluated effects on relapse and rehospitalization, with one study reporting no relapses in the CT and supportive counselling groups (
Tarrier et al., 1998), and the other failing to find significantly lower relapse and rehospitalization rates (
Kuipers et al., 1997). The
Kuipers et al. (1998) study did, however, find that the CT group experienced fewer (but non-significant) in-patient care days in hospital relative to the control condition. Even a modest effect of CT on rehospitalization rates would be of considerable clinical and economic importance. Aside from its effects on relapse, CT may benefit patients by reducing distress associated with psychotic symptoms. More work is needed to evaluate the effects of CT on the course of the illness and patient distress in order to determine its proper place in the comprehensive treatment of schizophrenia.
Conventional wisdom has held that patients with schizophrenia are not amenable to CT because of psychosis, cognitive impairment, and the lack of insight that often accompanies it. Clearly, this is not the case. It remains to be determined which patients are most able to benefit from CT.
Garety et al. (1997) reported that cognitive flexibility, which was correlated with insight, predicted benefit from CT, while a brief test of cognitive impairment did not. Further research is needed to evaluate this in larger samples of patients and to determine whether reliable predictors of treatment response can be identified.
The results of this meta-analysis indicate that CT has a significant effect on improving symptoms in patients with schizophrenia who experience psychotic symptoms. Although research evaluating the effects of CT with this population is limited, the studies reviewed here included strong experimental designs, well-articulated treatment interventions (which were in most cases standardized in the form of a treatment manual), and comprehensive assessment batteries. These encouraging findings warrant further research on CT for schizophrenia designed to replicate findings by other investigators, to evaluate which patients are most likely to benefit, and to better understand the effects of CT on other areas of functioning presumably related to severity of psychotic symptoms, including relapses and rehospitalizations, distress, and quality of life.