Combined Cognitive Remediation and Functional Skills Training for Schizophrenia: Effects on Cognition, Functional Competence, and Real-World Behavior
Publication: American Journal of Psychiatry
Abstract
Objective:
Cognitive remediation is an efficacious treatment for schizophrenia and, when used within broader psychosocial treatments, improves transfer to real-world behavior change. The authors examined whether cognitive remediation effectively generalizes to functional competence and real-world functioning as a standalone treatment and when combined with a functional skills treatment.
Method:
Outpatients with schizophrenia (N=107) were randomly assigned to receive cognitive remediation, functional adaptation skills training, or combined treatment, with cognitive remediation preceding functional skills training. Clinical symptoms, neurocognition, social competence, functional competence, and case-manager-rated real-world behavior were assessed at baseline, at end of treatment, and at a 12-week durability assessment.
Results:
Neurocognition improved, with durable effects, after cognitive remediation but not after functional skills training. Social competence improved both with functional skills training and with combined treatment but not with cognitive remediation alone. Improvements in functional competence were greater and more durable with combined treatment. Cognitive remediation alone did not produce significant improvements in real-world behavior, but when combined with functional skills training, statistically significant improvements from baseline to end of treatment and follow-up were observed in community or household activities and work skills. Number-needed-to-treat analyses suggest that as few as three cases are required for treatment to induce a meaningful improvement in functional skills.
Conclusions:
In a short intervention, cognitive remediation produced robust improvements in neurocognition. Generalization to functional competence and real-world behavior was more likely when supplemental skills training and cognitive remediation were combined.
Cognitive impairment is a persistent and functionally relevant feature of schizophrenia. Deficits span multiple ability domains and are more closely linked to outcomes than overall clinical symptoms, making them a treatment priority (1). Cognitive remediation treatments for schizophrenia have flourished over the past decade after a long period of refinement. Early approaches, which were borrowed from restorative techniques for traumatic brain injury (2), produced equivocal results. Positive studies were criticized for generating small effects of questionable durability and modest transfer to everyday functioning (3). Substantial recent refinements in cognitive remediation have produced greater success. Two recent meta-analyses suggest that cognitive remediation produces durable improvements in cognition with moderate effect sizes (4, 5).
Although contemporary cognitive remediation strategies result in statistically significant effects, the true measure of effectiveness is improved everyday functioning. The likelihood that changes in cognition alone would result in behavioral changes is questionable, considering that schizophrenia is a neurodevelopmental condition with cognitive and functional impairments that predate illness onset. Moreover, these early difficulties likely reduce the individual's achievement of functional milestones (e.g., work and residential independence) prior to onset. Furthermore, the relationship of cognitive performance and real-world functional outcome may be indirect, mediated by functional competence (6–9). Thus, whether cognitive improvements result in improved everyday functioning likely requires supplemental approaches to support the acquisition of living skills. Skills training treatments have a long history in schizophrenia but only moderate success in terms of magnitude of effects and durability.
The meta-analyses supporting the efficacy of cognitive remediation reveal that it has greater transfer to everyday functioning when it is delivered in conjunction with other evidence-based programs, such as work therapy (10), job placement (11), and intensive social cognitive training (12). However, no published studies to date have directly compared the benefits of cognitive remediation to functional competence and real-world functioning in a randomized trial of cognitive remediation with and without supplemental skills training. In this study, we examined the effects, in individuals with schizophrenia living in community settings, of cognitive remediation on functional competence and real-world functional behaviors when the treatment was delivered alone or in conjunction with supplemental skills training; a third group received the skills training alone. We hypothesized that cognitive remediation and functional skills training alone would produce domain-specific effects (i.e., changes in cognition or functional skills, respectively). We further hypothesized that combining cognitive remediation with functional skills training would result in larger and more durable effects on both functional competence and real-world functioning.
Method
Participants
Clinicians at outpatient centers affiliated with three sites—Mount Sinai School of Medicine, New York; Bronx VA Medical Center, New York; and Queen's University, Kingston, Ontario—referred patients who met study entry criteria. Inclusion criteria were a diagnosis of schizophrenia or schizoaffective disorder, current enrollment in outpatient psychiatric treatment, a reading level at or above grade 6, and age between 18 and 65 years. Exclusion criteria were psychiatric hospitalization of more than 24 hours within 1 month before baseline and comorbid psychiatric or neurological conditions. There were no medication exclusions. All participants provided written informed consent approved by the local ethics boards.
Measures
Cognition.
Cognitive performance was assessed with the Brief Assessment of Cognition in Schizophrenia (13). Six subtests are used to assess the domains of reasoning and problem solving (Tower of London), processing speed (verbal fluency, token motor task, symbol coding), verbal memory (list learning), and working memory (digit sequencing). Raw scores are transformed to z-scores (mean=0, SD=1) based on performance relative to the age- and gender-matched healthy comparison subjects and converted to a neurocognitive composite score in which all domains are given equal weight (14). The battery has been used in multiple treatment studies and has been shown to have practice effects in the range of 0.1 standard deviations per retest assessment.
Clinical symptoms.
Severity of clinical symptoms was examined with the Positive and Negative Syndrome Scale (PANSS) (15). After chart review and a structured interview with the patient and an informant, seven positive symptoms, seven negative symptoms, and 16 general aspects of psychopathology were rated on a 7-point scale. Interrater reliability for the PANSS for our raters ranged from 0.77 to 0.87. For the present analyses, we report the mean item score for the positive and negative symptom subscales derived from the five-factor model (16).
Social competence.
Social competence was examined using the Social Skills Performance Assessment (17). In this brief interactive assessment, participants engage in role playing tasks that simulate two everyday social situations: greeting a new neighbor and attempting to persuade a recalcitrant landlord to repair a leak. Sessions were audiorecorded and scored by a trained rater who was blind to diagnostic, cognitive, and treatment status. Dimensions of social competence scored include interest, affect, fluency, clarity, focus, negotiation ability, persistence, and social appropriateness. The rater was trained to the gold standard ratings proposed by the instrument developers (intraclass correlation coefficient=0.84). We report total scores for the two scenes; higher scores indicate better performance.
Functional competence.
Functional competence refers to skills that are important for independent functioning (18). We included three measures of everyday functional skills and computed a composite score with equal weights across the three measures. The composite score had adequate internal consistency (Cronbach's alpha=0.78) and was converted to a standard score ranging from 0 to 100; higher scores indicate better performance.
In the University of California San Diego Performance-Based Skills Assessment Battery (UPSA) (19), participants are examined with a series of role playing tasks for their comprehension and planning of recreational activities, financial skills in handling money and writing checks, use of a telephone for instrumental communication, and ability to use information from bus schedules and maps to use public transportation effectively. We developed location-specific measures for the transportation/mobility and comprehension/planning items, as the initial version of the UPSA had items based on San Diego. We excluded the household chores subtest because it was not portable enough to be used in this study, since we collected data at various outpatient centers. This modified version was used in our previous studies with the UPSA (6) and demonstrated substantial correlations with neuropsychological testing performance that was consistent with the UPSA (20).
In the advanced finances test (21), participants perform higher-level financial management skills, including depositing a check, paying several bills, planning to leave money in the account, and balancing a checkbook. Raw scores range from 0 to 11.
The Medication Management Ability Assessment (22) is a role playing task similar in complexity to what someone receiving multiple medications is likely to encounter. Correct responses include taking the correct medication at the appropriate time, with or without food as prescribed, the correct number of doses per day, and the correct number of pills per dose.
Real-world functional behavior.
Real-world functional behavior was rated using the Specific Levels of Functioning Scale (23). This observer-rated scale indexes the patient's behavior and functioning. Ratings are made by an observer on a 5-point Likert scale for each item based on frequency of the behavior or the amount of assistance required for the subject to perform real-world skills. Informants in this study were case workers who indicated that they knew the patient at least “well” on a 5-point Likert scale. This scale has excellent interrater reliability, factorial validity, and internal consistency (23). Consistent with validating measures of real-world outcome in schizophrenia study recommendations (9, 20), we used only three of the original five domains of the Specific Levels of Functioning Scale: interpersonal relationships (e.g., initiating, accepting), activities (e.g., shopping, using the telephone, paying bills, use of leisure time, use of public transportation), and work skills (e.g., employable skills, level of supervision required to complete tasks, ability to stay on task, punctuality), and we did not collect self-reports of functioning. We report percent of total score, with higher scores representing better functioning.
Assessments for all of these domains were completed at baseline, at end of treatment (immediately after completion of the active treatments), and 12 weeks after end of treatment (durability assessment). Testing technicians completed the assessments of cognition and functional competence, and more experienced examiners conducted the symptom interviews. The patients' clinicians rated real-world functioning on the Specific Levels of Functioning Scale and were not involved in any of the other assessments. All parties were unaware of the other two sources of data as well as group assignment, study hypotheses, and study design.
Treatment
Participants were randomly assigned, in a predetermined sequence, to one of three treatment conditions: 12 weeks of cognitive remediation therapy followed by 12 weeks of treatment as usual; 12 weeks of functional adaptation skills training (24) followed by 12 weeks of treatment as usual; or 12 weeks of cognitive remediation followed by 12 weeks of functional skills training. Participants received $20 per evaluation, and they received transportation funds but not compensation for attending treatment sessions. See Figure 1 for a description of the treatments. Treatment as usual consisted of a mean of 1.6 (SD=1.1) visits per month for case management services. These services did not include cognitive-enhancing or functional-adaptive strategies, and they did not differ significantly by group in number of visits.
Cognitive remediation was based on a previously validated treatment, the Thinking Skills for Work Program (25). It used computer-based exercises (Cogpack, Version 5.1 [Marker Software, Ladenburg, Germany], PSSCogRehab [Psychological Software Services, Inc., Indianapolis], and Scientific Brain Training PRO [HAPPYneuron, Inc., Mountain View, Calif.]) and included a large role for therapist involvement in stimulating the forming and testing of alternative strategies and discussing how the cognitive skills are used in everyday life. Bridging strategies to help transfer cognitive skills to everyday activities were informed by the Thinking Skills for Work Program (25) and the Neuropsychological Educational Approach to Remediation programs (26). Functional adaptation skills training (24) is a standardized psychosocial intervention developed for outpatients with schizophrenia that uses props and role playing to increase competence in social skills and various aspects of independent living. Systematic therapist training was provided by the developers of the treatments (all of them investigators in this study: S.R.M., B.M., T.L.P.), using treatment manuals, didactic instruction, and role playing. These investigators remained available for periodic teleconferences for follow-up training and to address specific issues as needed. The first author was responsible for ensuring completion of training, adherence to protocol, and review of session notes on a weekly basis. Two therapists—doctoral-level clinical psychologists or doctoral clinical psychology students—were used at each site.
Data Analysis
Univariate analyses of variance were used to examine differences between groups on demographic and illness variables at baseline. Mixed models for repeated measures were used to analyze changes in the dependent variables by treatment group, including all subjects in an intent-to-treat analysis. A diagonal covariance structure was used, with treatment site and treatment dose (number of hours of treatment actually received) as random effects with intercept and slope modeled and variance components selected as the covariance type. The restricted maximum likelihood method was selected for estimation. Pairwise comparisons for main effects were made with the Bonferroni adjustment. Interaction effects were examined with a Bonferroni adjustment for the six primary analyses set to an alpha of 0.008 (0.05/6). Bonferroni-corrected significant interactions were followed by pairwise comparisons. We calculated effect sizes for the change scores in two ways. Cohen's d (27) was calculated for all treatment completers for the baseline assessment to the end-of-treatment assessment and the baseline assessment to the 12-week durability assessment. We also calculated the number-needed-to-treat effect size using the formula described by Furukawa and Leucht (28). In these analyses, the number needed to treat refers to the number of patients who would need to receive the combined treatment in order to show improvement at the various levels of change (10% through 60%) compared with a patient who received only the functional adaptation skills training.
Results
Participants (cognitive remediation, N=36; functional skills training, N=35; combined treatment, N=36) who completed baseline assessment were considered in the intent-to-treat analyses (Figure 2). The proportion of the intended treatment dose (120 minutes per week) that was completed did not differ significantly between the cognitive remediation (mean=0.87, SD=0.13), functional skills training (mean=0.94, SD=0.09), and combined treatment (mean=0.93, SD=0.16) groups.
Baseline Analyses
There were no significant differences between groups at baseline on demographic or clinical variables (Table 1) or on antipsychotic medication type at baseline (Table 2).
| Cognitive Remediation (N=36) | Functional Adaptation Skills Training (N=35) | Combined Treatment (N=36) | ||||
|---|---|---|---|---|---|---|
| Characteristic | Mean | SD | Mean | SD | Mean | SD |
| Age (years) | 39.1 | 10.5 | 42.7 | 9.7 | 39.9 | 8.5 |
| Education (years) | 13.3 | 1.8 | 13.1 | 1.7 | 12.9 | 1.1 |
| Wide-Range Achievement Test reading score | 44.5 | 4.3 | 44.6 | 4.7 | 46.1 | 5.2 |
| Age at first hospitalization (years) | 21.4 | 3.9 | 19.8 | 8.4 | 19.9 | 6.7 |
| Total time institutionalized (months) | 38.5 | 40.8 | 31.2 | 57.2 | 43.7 | 46.7 |
| Time since last hospitalization (months) | 50.8 | 57.0 | 61.9 | 64.0 | 39.7 | 51.0 |
| Time in current outpatient treatment (months) | 80.6 | 84.0 | 72.9 | 74.0 | 87.6 | 89.0 |
| Case management visits per monthb | 2.9 | 2.5 | 3.3 | 3.0 | 3.2 | 2.9 |
a
No significant difference between groups on any variable.
b
Number of visits to a case manager for the 3 months prior to treatment; ascertained by chart review.
| Cognitive Remediation | Functional Adaptation Skills Training | Combined Treatment | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Baseline (N=36) | Endpoint (N=29) | Baseline (N=35) | Endpoint (N=28) | Baseline (N=36) | Endpoint (N=26) | |||||||
| Medication Class | N | % | N | % | N | % | N | % | N | % | N | % |
| Atypical antipsychotic | 33 | 92 | 29 | 100 | 32 | 91 | 25 | 89 | 32 | 89 | 23 | 90 |
| Conventional antipsychotic | 3 | 8 | 0 | 0 | 5 | 14 | 3 | 11 | 4 | 11 | 3 | 10 |
| Benzodiazepine | 5 | 14 | 3 | 10 | 3 | 8 | 2 | 7 | 4 | 11 | 2 | 8 |
| SSRI | 10 | 28 | 5 | 17 | 5 | 14 | 3 | 11 | 4 | 11 | 2 | 8 |
| Lithium | 2 | 5 | 1 | 3 | 2 | 6 | 1 | 4 | 1 | 3 | 1 | 4 |
Intent-to-Treat Analysis
Symptom changes were not part of the primary analyses; exploratory analyses revealed no significant main or interaction effects on negative or positive symptoms. Estimated marginal means derived from linear mixed-model analyses with the intent-to-treat sample are presented in Table 3. Improvement in fit was identified for each of the subsequent models when random effects were entered. Degrees of freedom using linear mixed models produce noninteger variables because they are estimates based on nonexact F distributions and thus they do not reflect sample sizes. We rounded to integers in the results below for clarity. The group-by-time interaction for neurocognition was significant (F=28.9, df=4, 72, p<0.001). The cognitive remediation and combined treatment groups improved significantly from baseline to end of treatment, and these effects were maintained at the 12-week durability assessment. The functional skills training group did not significantly improve at either time point. Both the cognitive remediation (F=42.7, df=2, 48, p<0.001) and combined (F=44.8, df=2, 51, p<0.001) treatment groups showed greater improvement in the neurocognitive composite score compared with the functional skills training group, but they did not differ from each other.
| Baseline | End of Active Treatment | 12 Weeks After End of Active Treatment | ||||||
|---|---|---|---|---|---|---|---|---|
| Measurea and Treatment Group | EMMb | SE | EMMb | SE | Cohen's dc | EMMb | SE | Cohen's dd |
| Brief Assessment of Cognition in Schizophrenia | ||||||||
| Composite score (z-score) | ||||||||
| Cognitive remediation | –1.60 | 0.15 | –0.90 | 0.15 | 0.77 | –0.88 | 0.15 | 0.72 |
| Functional skills training | –1.54 | 0.15 | –1.45 | 0.15 | 0.05 | –1.43 | 0.15 | 0.12 |
| Combined treatment | –1.70 | 0.15 | –1.01 | 0.15 | 0.73 | –1.12 | 0.14 | 0.71 |
| Adaptive composite (% of total) | ||||||||
| Cognitive remediation | 60.0 | 2.9 | 65.5 | 2.9 | 0.25 | 63.9 | 3.0 | 0.13 |
| Functional skills training | 60.8 | 2.9 | 68.5 | 2.9 | 0.51 | 65.9 | 3.0 | 0.41 |
| Combined treatment | 57.3 | 2.8 | 69.6 | 2.8 | 0.63 | 71.8 | 3.0 | 0.71 |
| Social Skills Performance Assessment total score (% of total) | ||||||||
| Cognitive remediation | 68.4 | 2.1 | 71.2 | 2.0 | 0.16 | 69.6 | 2.1 | 0.07 |
| Functional skills training | 69.2 | 2.2 | 76.9 | 2.0 | 0.52 | 76.1 | 2.1 | 0.60 |
| Combined treatment | 68.9 | 2.1 | 76.2 | 2.0 | 0.67 | 76.5 | 2.1 | 0.59 |
| Specific Levels of Functioning Scale | ||||||||
| Interpersonal subscale (% of total) | ||||||||
| Cognitive remediation | 57.3 | 2.4 | 58.5 | 2.4 | 0.12 | 55.5 | 2.3 | –0.08 |
| Functional skills training | 55.3 | 2.4 | 57.1 | 2.3 | 0.22 | 57.4 | 2.2 | 0.25 |
| Combined treatment | 53.5 | 2.2 | 55.5 | 2.2 | 0.21 | 54.9 | 2.4 | 0.15 |
| Community activities subscale (% of total) | ||||||||
| Cognitive remediation | 77.3 | 1.7 | 79.4 | 1.8 | 0.13 | 80.3 | 1.8 | 0.18 |
| Functional skills training | 78.8 | 1.7 | 81.1 | 1.7 | 0.21 | 81.0 | 1.7 | 0.17 |
| Combined treatment | 75.9 | 1.7 | 78.7 | 1.7 | 0.36 | 81.1 | 1.7 | 0.46 |
| Work skills subscale (% of total) | ||||||||
| Cognitive remediation | 73.8 | 2.3 | 75.8 | 2.4 | 0.19 | 75.0 | 2.4 | 0.14 |
| Functional skills training | 67.4 | 2.2 | 71.1 | 2.2 | 0.25 | 71.4 | 2.2 | 0.29 |
| Combined treatment | 71.7 | 2.2 | 79.1 | 2.3 | 0.44 | 85.8 | 2.3 | 0.92 |
| Positive and Negative Syndrome Scale | ||||||||
| Negative symptoms (mean item score) | ||||||||
| Cognitive remediation | 2.7 | 0.13 | 2.7 | 0.13 | 0.05 | 2.8 | 0.13 | 0.08 |
| Functional skills training | 2.4 | 0.13 | 2.3 | 0.13 | –0.03 | 2.2 | 0.13 | –0.11 |
| Combined treatment | 2.7 | 0.13 | 2.6 | 0.12 | –0.14 | 2.6 | 0.12 | –0.13 |
| Positive symptoms (mean item score) | ||||||||
| Cognitive remediation | 2.3 | 0.13 | 2.2 | 0.16 | –0.10 | 2.3 | 0.14 | –0.04 |
| Functional skills training | 2.6 | 0.12 | 2.8 | 0.14 | 0.12 | 2.6 | 0.12 | 0.02 |
| Combined treatment | 2.4 | 0.12 | 2.3 | 0.15 | –0.08 | 2.3 | 0.13 | –0.07 |
a
Higher scores indicate better performance on the Brief Assessment of Cognition in Schizophrenia composite and adaptive composite subscales, the Social Skills Performance Assessment, and the Specific Levels of Functioning Scale subscales. For symptom measures, higher scores indicate greater severity.
b
EMM=estimated marginal mean, derived from linear mixed-model analyses with the intent-to-treat sample.
c
Calculated using raw score change for the completers sample between the baseline assessment and the end-of-treatment assessment.
d
Calculated using raw score change for the completers sample between the baseline assessment and the 12-week durability assessment.
The group-by-time interaction for social competence was significant (F=9.1, df=4, 85, p<0.001). The functional skills training and combined treatment groups improved from baseline to end of treatment, and both groups maintained these treatment effects at the 12-week durability assessment. The cognitive remediation group did not significantly improve on social competence. Both the functional skills training (F=3.7, df=2, 53, p=0.03) and combined treatment (F=12.1, df=2, 53, p<0.001) groups had greater improvement in social competence compared with the cognitive remediation group, and their treatment effects did not differ significantly. The group-by-time interaction for functional competence was significant (F=19.5, df=4, 68, <0.001). The combined treatment group improved to a greater extent than the cognitive remediation group (F=40.7, df=2, 43, p<0.001) and the functional skills training group (F=19.7, df=2, 46, p<0.001). The functional skills training group demonstrated significant improvement from baseline to end of treatment, but these effects were not statistically significant at the 12-week durability assessment relative to baseline.
Main effects for time but not group were significant for social functioning. The group-by-time interaction was not significant. The group-by-time interaction for real-world community activities was significant (F=3.9, df=4, 70, p=0.007). For the combined treatment group, improvement was significantly greater than the functional skills training group (F=9.1, df=2, 50, p<0.001); the combined treatment group also had greater improvement than the cognitive remediation group, but this difference fell short of significance (F=3.2, df=2, 44, p=0.051). The functional skills training and cognitive remediation groups did not differ statistically. The group-by-time interaction for real-world work skills was significant (F=12.8, df=4, 72, p<0.001). The functional skills training and combined treatment groups improved from baseline to end of treatment, and both groups maintained these improvements at the 12-week durability assessment. However, the combined treatment group had significantly larger treatment effects than the functional skills training group (F=3.5, df=2, 43, p=0.037) and the cognitive remediation group (F=32.5, df=2, 37, p<0.001).
Number-needed-to-treat analyses were conducted with the functioning variables for which we observed a significantly greater improvement in the combined treatment group compared with the functional skills training group. For functional competence, the number needed to treat with both treatments compared with functional skills training alone was 10.2 for a treatment response of 10%; 3.3 for a treatment response of 20%; 3.0 for a treatment response of 30%; 7.2 for a treatment response of 40%; 9.0 for a treatment response of 50%; and 18.0 for a treatment response of 60%. For clinician-rated real-world work skills, the number needed to treat was 5.4 for a treatment response of 10%; 3.3 for a treatment response of 20%; 9.4 for a treatment response of 30%; 19.6 for a treatment response of 40%; and 42.0 for a treatment response of 50%. For clinician-rated real-world community activities, the number needed to treat was 18.5 for a treatment response of 10%; 18.0 for a treatment response of 20%; and 36.0 for a treatment response of 30%.
Discussion
This study is, to our knowledge, the first to directly compare the independent and additive effects of cognitive remediation therapy and a psychosocial intervention designed to improve real-world behavior in schizophrenia. The major findings are that cognitive remediation produces robust improvements in cognition, has limited transfer to everyday behavior as a standalone treatment, and increases the effects and durability of treatments that directly target functional disability.
The major implication of these findings is that cognitive remediation can potentiate other psychological treatments, making them more substantial and more durable. The additive effects were pronounced in the performance-based measure of adaptive skills, in real-world community or household responsibilities, and in real-world work skills. All groups showed improvement in the real-world ratings of social behavior, suggesting an effect neither specific to treatment type nor facilitated by their combination. Similarly, preceding functional skills training with cognitive remediation did not improve the effects of the former treatment on social skills or behavior. Previous studies have found cognition to have smaller relationships with social, compared to adaptive, skills (7). Social skills are also influenced more by individual characteristics such as social cognition, negative symptoms, and disordered speech than cognition or social competence (7, 29), as well as by external factors such as living circumstances and financial strain (30, 31).
Cognitive remediation without a supplemental skills intervention produced less robust effects on measures of functional competence and on clinician ratings of everyday functional behaviors. This restricted transfer of skills was observed in spite of robust improvements in neurocognition. The relationship between cognition and everyday functioning is well replicated, and thus it is important to consider why a treatment that improves these deficits does not manifest in measures of functioning. Skill acquisition is disrupted early in the illness process, when cognitive impairments are present but psychosis has not emerged. Limited opportunities to learn and utilize skills (30) might explain why cognitive improvements need to be supplemented by habilitative functional opportunities. In contrast to this idea, data from one study suggested that performance on measures of competence were minimally related to differences in environmental enrichment, while real-world outcomes (independence in residence) were notably different across environments (8). Another study, following 1 year of similarly nonsocial cognitive remediation, found significant improvements in UPSA scores (32). However, a study of 15 weeks of nonsocial cognitive remediation treatment failed to find transfer of cognitive gains to UPSA results (33). The ideal dose or duration of cognitive remediation for transfer to functional competence is thus still in question.
Transfer of cognitive gains to everyday behaviors will likely require time and opportunities to practice new skill sets and for others to adapt to these changes. In cognitive remediation studies with longer follow-up assessment intervals and a psychosocial treatment component (11, 12), transfer of behavior to real-world indices such as work outcomes has been greater than that observed in this study. Other intrinsic and extrinsic factors are likely to limit the extent to which cognitive abilities transfer to everyday performance. Mood symptoms (6), defeatist beliefs (34), social cognition (35), and reduced motivation (36, 37) have been identified as factors more closely associated with behavioral performance than competence and should also be considered as treatment targets or potential mediators.
There are potential clinical and health care policy implications to these findings. In a mental disorder characterized by severe and persistent impairments in everyday functioning, we were able to see meaningful changes in patients' ability to acquire community living skills and use those skills when cognitive remediation was combined with functional skills training. The extra cost of combining these interventions must be considered in the context of the impressive number-needed-to-treat statistics—as few as three patients for the combined treatments to improve functioning by 20% to 30%, an effect size that is relative to an active treatment comparison group. These results may be even more impressive when one considers the short-term nature and financial and resource burden of the treatments relative to pharmacologic treatments.
Our study had several limitations. The duration and intensity of cognitive remediation have been variable across previous studies; treatment duration in this study was short. However, a weekly 1-hour treatment for 3 months might reflect clinical reality in many health care models, and we nevertheless observed a robust effect on cognition. Functional adaptation skills training was modified from its original form, which may have changed its effectiveness as a standalone intervention. Milestone changes in everyday behavior, such as work status, romantic relationships, and independence in living, were not examined; however, these measures might not be expected to undergo change in short-term trials. Our sample consisted primarily of male patients who were well connected with outpatient treatment centers and had low symptom severity, so we do not know whether our findings generalize to samples with other characteristics. However, the degree of cognitive impairment in our sample is consistent with that in other studies. Finally, the combined treatment group received more total treatment sessions than the other two groups. Thus, the effects, despite statistical control for time-related dosing, cannot be conclusively proven not to derive from more contact. A design with inactive cognitive remediation and inactive functional skills training-like treatment would be required to address this point and would be particularly valuable for informing time- and resource-limited clinics about the necessary type and amount of treatment needed to reduce functional disability, although the number-needed-to-treat statistics in this study provide some insight into these issues.
Acknowledgments
The authors thank Hannah Anderson, Winnie Leung, Amelia Bowman, Shannon Xavier, Stephanie Taillefer, Emma Bassett, Jeremy Stewart, Allisha Patterson, Talia Troister, and Sylvia Magrys for assistance with data collection and treatment delivery.
Footnotes
Received Sept. 6, 2011; revisions received Jan. 31, Feb. 22, and March 5, 2012; accepted March 12, 2012.
Clinicaltrials.gov registration number: NCT01175642.
References
1.
Green MF, Nuechterlein KH: The MATRICS initiative: developing a consensus cognitive battery for clinical trials. Schizophr Res 2004; 72:1–3
2.
Spring BJ, Ravdin L: Cognitive remediation in schizophrenia: should we attempt it? Schizophr Bull 1992; 18:15–20
3.
Hogarty GE, Flesher S: Cognitive remediation in schizophrenia: proceed…with caution! Schizophr Bull 1992; 18:51–57
4.
McGurk SR, Twamley EW, Sitzer DI, McHugo GJ, Mueser KT: A meta-analysis of cognitive remediation in schizophrenia. Am J Psychiatry 2007; 164:1791–1802
5.
Wykes T, Huddy V, Cellard C, McGurk SR, Czobor P: A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes. Am J Psychiatry 2011; 168:472–485
6.
Bowie CR, Reichenberg A, Patterson TL, Heaton RK, Harvey PD: Determinants of real-world functional performance in schizophrenia subjects: correlations with cognition, functional capacity, and symptoms. Am J Psychiatry 2006; 163:418–425
7.
Bowie CR, Depp C, McGrath JA, Wolyniec P, Mausbach BT, Thornquist MH, Luke J, Patterson TL, Harvey PD, Pulver AE: Prediction of real-world functional disability in chronic mental disorders: a comparison of schizophrenia and bipolar disorder. Am J Psychiatry 2010; 167:1116–1124
8.
Harvey PD, Helldin L, Bowie CR, Heaton RK, Olsson AK, Hjärthag F, Norlander T, Patterson TL: Performance-based measurement of functional disability in schizophrenia: a cross-national study in the United States and Sweden. Am J Psychiatry 2009; 166:821–827
9.
Harvey PD, Raykov T, Twamley EW, Vella L, Heaton RK, Patterson TL: Validating the measurement of real-world functional outcomes: phase I results of the VALERO study. Am J Psychiatry 2011; 168:1195–1201
10.
McGurk SR, Mueser KT, Feldman K, Wolfe R, Pascaris A: Cognitive training for supported employment: 2–3 year outcomes of a randomized controlled trial. Am J Psychiatry 2007; 164:437–441
11.
Bell MD, Zito W, Greig T, Wexler BE: Neurocognitive enhancement therapy with vocational services: work outcomes at two year follow-up. Schizophr Res 2008; 105:18–29
12.
Eack SM, Greenwald DP, Hogarty SS, Cooley SJ, DiBarry AL, Montrose DM, Keshevan MS: Cognitive enhancement therapy for early-course schizophrenia: effects of a two-year randomized controlled trial. Psychiatr Serv 2009; 60:1468–1476
13.
Keefe RS, Goldberg TE, Harvey PD, Gold JM, Poe MP, Coughenour L: The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery. Schizophr Res 2004; 68:283–297
14.
Keefe RS, Harvey PD, Goldberg TE, Gold JM, Walker TM, Kennel C, Hawkins K: Norms and standardization of the Brief Assessment of Cognition in Schizophrenia (BACS). Schizophr Res 2008; 102:108–115
15.
Kay SR, Fiszbein A, Opler LA: The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull 1987; 13:261–276
16.
White L, Harvey PD, Opler L, Lindenmayer JP: Empirical assessment of the factorial structure of clinical symptoms in schizophrenia: a multisite, multimodel evaluation of the factorial structure of the Positive and Negative Syndrome Scale (the PANSS Study Group). Psychopathology 1997; 30:263–274
17.
Patterson TL, Moscona S, McKibbin CL, Davidson K, Jeste DV: Social skills performance assessment among older patients with schizophrenia. Schizophr Res 2001; 48:351–360
18.
Mausbach BT, Bowie CR, Harvey PD, Twamley EW, Goldman SR, Jeste DV, Patterson TL: Usefulness of the UCSD Performance-Based Skills Assessment (UPSA) for predicting residential independence in patients with chronic schizophrenia. J Psychiatr Res 2008; 42:320–327
19.
Patterson TL, Goldman S, McKibbin CL, Hughs T, Jeste DV: UCSD Performance-Based Skills Assessment: development of a new measure of everyday functioning for severely mentally ill adults. Schizophr Bull 2001; 27:235–245
20.
Leifker FR, Patterson TL, Heaton RK, Harvey PD: Validating measures of real-world outcome: the results of the VALERO expert survey and RAND panel. Schizophr Bull 2011; 37:334–343
21.
Heaton RK, Marcotte TD, Mindt MR, Sadek J, Moore DJ, Bentley H, McCutchan JA, Reicks C, Grant I HNRC Group: The impact of HIV-associated neuropsychological impairment on everyday functioning. J Int Neuropsychol Soc 2004; 10:317–331
22.
Patterson TL, Lacro J, McKibbin CL, Moscona S, Hughs T, Jeste DV: Medication Management Ability Assessment: results from a performance-based measure in older outpatients with schizophrenia. J Clin Psychopharmacol 2002; 22:11–19
23.
Schneider LC, Struening EL: SLOF: a behavioral rating scale for assessing the mentally ill. Soc Work Res Abstr 1983; 19:9–21
24.
Patterson TL, Mausbach BT, McKibbin C, Goldman S, Bucardo J, Jeste DV: Functional adaptation skills training (FAST): a randomized trial of a psychosocial intervention for middle-aged and older patients with chronic psychotic disorders. Schizophr Res 2006; 86:291–299
25.
McGurk SR, Mueser KT, Pascaris A: Cognitive training and supported employment for persons with severe mental illness: one-year results from a randomized controlled trial. Schizophr Bull 2005; 31:898–909
26.
Medalia A, Revheim N, Herlands T: Cognitive Remediation for Psychological Disorders: Therapist Guide. New York, Oxford University Press, 2009
27.
Cohen J: Statistical Power Analysis for Behavioral Sciences. Hillsdale, NJ, Lawrence Erlbaum Associates, 1988
28.
Furukawa TA, Leucht S: How to obtain NNT from Cohen's d: comparison of two methods. PLoS One 2011; 6(4):e19070
29.
Bowie CR, Gupta M, Holshausen K: Disconnected and underproductive speech in schizophrenia: unique relationships across multiple indicators of social functioning. Schizophr Res 2011; 131:152–156
30.
Gupta M, Bassett E, Iftene F, Bowie CR: Functional outcomes in schizophrenia: understanding the competence-performance discrepancy. J Psychiatr Res 2012; 46:205–211
31.
Mattsson M, Topor A, Cullberg J, Forsell Y: Association between financial strain, social network, and five-year recovery from first-episode psychosis. Soc Psychiatry Psychiatr Epidemiol 2008; 43:947–952
32.
Kurtz MM, Seltzer JC, Fujimoto M, Shagan DS, Wexler BE: Predictors of change in life skills in schizophrenia after cognitive remediation. Schizophr Res 2009; 107:267–274
33.
Dickinson D, Tenhula W, Morris S, Brown C, Peer J, Spencer K, Li L, Gold JM, Bellack AS: A randomized controlled trial of computer-assisted cognitive remediation for schizophrenia. Am J Psychiatry 2010; 167:170–180
34.
Grant PM, Beck AT: Defeatist beliefs as a mediator of cognitive impairment, negative symptoms, and functioning in schizophrenia. Schizophr Bull 2009; 35:798–806
35.
Brekke J, Kay DD, Lee KS, Green MF: Biopsychosocial pathways to functional outcome in schizophrenia. Schizophr Res 2005; 80:213–225
36.
Nakagami E, Xie B, Hoe M, Brekke JS: Intrinsic motivation, neurocognition, and psychosocial functioning in schizophrenia: testing mediator and moderator effects. Schizophr Res 2008; 105:95–104
37.
Medalia A, Brekke J: In search of a theoretical structure for understanding motivation in schizophrenia. Schizophr Bull 2010; 36:912–918
Information & Authors
Information
Published In
History
Received: 6 September 2011
Revision received: 31 January 2012
Revision received: 22 February 2012
Revision received: 5 March 2012
Accepted: 12 March 2012
Published online: 1 July 2012
Published in print: July 2012
Authors
Funding Information
Dr. Bowie has served as a consultant for Abbott Pharmaceuticals. Dr. Harvey has served as a consultant for Abbott Labs, Genentech, Johnson & Johnson, Novartis, PharmaNeuroBoost, Roche, Shire, and Sunovion. All other authors report no financial relationships with commercial interests.Supported by a NARSAD Young Investigator Award to Dr. Bowie.
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).