The MATRICS Consensus Cognitive Battery: What We Know 6 Years Later
Publication: American Journal of Psychiatry
Following a competitive application process sponsored by the National Institute of Mental Health (NIMH), the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative was launched. After 2 years of large consensus meetings, a five-site psychometric and validation study, complex intellectual property agreements, and an endorsement by NIMH and the U.S. Food and Drug Administration (FDA), the MATRICS Consensus Cognitive Battery (MCCB) was initially presented in a series of three articles in the Journal in 2008 (1–3). Since then, the MCCB has been evaluated and scrutinized in a way that few test assessment batteries have been. Over time its strengths and limitations have come into sharper focus, and we believe it is a good time to review what we know about the MCCB 6 years later.
The MATRICS initiative was designed to address a particular issue—the FDA was previously unwilling to approve a drug for enhancing cognition in schizophrenia without consensus on domains, measurement, and study design (4, 5). The overarching goal of MATRICS was to construct a pathway for drug approval in this area. Identifying consensus cognitive domains and developing a consensus battery were part of the broader MATRICS agenda that included agreement on study design, subject selection, neuropharmacological targets, and government-industry interactions. Though it was only one component of a much larger initiative, the MCCB was the most concrete deliverable. The components of the MCCB were selected through both consensus and data collection methods (1, 6). The first step was to agree on cognitive domains that should be represented in schizophrenia treatment trials (7) and then to select tests at the domain level on the basis of a priori criteria. It was hoped that the MCCB would behave well in clinical trials, but that was an educated guess at the time. In this commentary we will summarize recent results regarding the test qualities of the MCCB when used in multisite clinical trials, its sensitivity to treatment effects, and its covariation with biomarkers.
MCCB Psychometric Properties in Multisite Clinical Trials
•
The completeness of the MCCB data in clinical trials is impressive. In a 29-site study in which 323 patients were tested twice, 98.5% of the assessments were complete (8). Because data can be imputed (recommendations are a minimum of five of seven domains assessed at baseline and four of seven domains at follow up), only one assessment out of 646 was missing.
•
The MCCB tests were selected for high test-retest reliability (reliability of the overall composite score was 0.90 in the initial validation study). This value has been consistently found in multisite clinical trials. For example, the reliability was 0.88 in the 29-site study mentioned above (8) and has been even higher (0.93, 0.95) in other published clinical trials (9, 10).
•
Practice effects of the MCCB seen in the context of clinical trials are modest. The practice effect, measured before initiation of treatment, in the 29-site study was 0.18, or about one-fifth of a standard deviation (8). Other multisite studies (e.g., 10) obtained similar values for practice effects.
MCCB Sensitivity to Training and Psychopharmacological Interventions
Numerous studies have examined the MCCB’s sensitivity to treatment effects. The published results have been most impressive for the cognitive training interventions, and results are now also emerging for psychopharmacological interventions. Some of the studies started after the tests in the MCCB were selected but before the packaged commercial battery was available. These studies are still informative about the sensitivity of the battery, even though they did not use the MCCB scoring program.
•
The MCCB was sensitive to the cognition-enhancing effects of 50 hours of neuroplasticity-based auditory training when compared with a control condition (11).
•
A more recent publication with 40 hours of neuroplasticity-based training in recent-onset patients similarly found improvements in the MCCB (12).
•
The MCCB was sensitive to the effects of a cognitive remediation program in a multisite feasibility study. The effects were significant at the midpoint assessment, relative to the effects of a control condition, and showed a nonsignificant tendency at the end of the study, when the sample size was smaller (13).
•
A randomized controlled (2×2) trial of both long-acting versus oral antipsychotic medication and cognitive remediation versus healthy behavior training in first-episode schizophrenia found that the MCCB detected significant cognitive improvement for antipsychotic medication adherence (14) and also for cognitive remediation (15).
•
A clinical trial with patients in a partial hospital program showed that the MCCB reflected improvements with attention-shaping procedures versus a control condition in these low-functioning patients (16).
•
Transcranial direct current stimulation showed significant improvement on the MCCB composite, when compared with a sham control condition (17).
•
In a study with an α7 nicotinic partial agonist, beneficial results were at the trend level on the MCCB composite for the entire sample, and effects were significant for patients who were retested at the same time of day as they were tested at baseline and for patients who were age 45 years or less (18).
•
The MCCB showed significant beneficial effects of add-on sodium benzoate therapy (a d-amino acid oxidase inhibitor) when compared with placebo. This study focused on the MCCB neurocognitive composite (composite of all of the domains except social cognition) (19).
•
A study with an α7 nicotinic agonist demonstrated a significant group-by-smoking interaction, in that nonsmoking patients showed a significant improvement on the MCCB neurocognitive composite that was larger than the effect in smoking patients (20).
Biomarkers of MCCB Performance
Therapeutic development for cognitive deficits in schizophrenia is greatly facilitated if we can identify biomarkers to determine whether the therapeutic candidates elicit their targeted biological effects. Two studies illustrate the utility of the MCCB in this regard.
•
In a study using magnetic resonance spectroscopy, NAA/Cr correlated with the composite MCCB score (r=0.52), as well as with scores for the domains of attention/vigilance, verbal learning, and social cognition (21).
•
Right hippocampal fMRI hyperactivity identified in patients with schizophrenia was associated with lower MCCB composite scores (r=0.53). Exploratory analyses revealed the effect was driven by associations between activity and attention/vigilance, working memory, and visual learning (22).
New Developments
Two updates to the MCCB are reflected in some of the bulleted items above and deserve mention. First, the MCCB was developed to facilitate drug approval from the U.S. FDA. Because clinical trials are often international, it soon became obvious that a key limitation of the MCCB was that it was available only in English. Hence, the MCCB has now been professionally translated and is commercially available in over 20 languages (see www.matricsinc.org for a listing). With the help of an industry-academic-government consortium (MATRICS-CT) (23), we also collected representative normative data in key countries and are using these norms to create international scoring programs. A second change reflects the growing awareness that nonsocial cognition and social cognition are separable dimensions. It is possible that a treatment will affect social cognition and nonsocial cognition differently, and that is assumed for specific interventions, such as oxytocin, that are focused on one area or the other. To allow trial investigators to examine nonsocial cognition only, the MCCB scoring program now provides an option for a “neurocognitive composite” that does not include social cognition. A limitation of the MCCB is that it does not have an option for a social cognition composite, because there is only one test in that domain.
Summary
After substantial use in the testing ground of multisite clinical trials, the MCCB has demonstrated impressive psychometrics. It has shown sensitivity to improvement from interventions, most notably for cognitive training interventions so far. We do not believe that the MCCB is inherently more sensitive to training than to pharmacological interventions; that pattern most likely reflects the state of that field, in which we have few validated cognition-enhancing drugs. The MCCB also tracks with key biomarkers, which is an important feature as efforts are made to apply experimental medicine principles, such as target engagement, to psychiatric treatment trials.
References
1.
Nuechterlein KH, Green MF, Kern RS, Baade LE, Barch DM, Cohen JD, Essock S, Fenton WS, Frese FJ 3rd, Gold JM, Goldberg T, Heaton RK, Keefe RSE, Kraemer H, Mesholam-Gately R, Seidman LJ, Stover E, Weinberger DR, Young AS, Zalcman S, Marder SR: The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. Am J Psychiatry 2008; 165:203–213
2.
Kern RS, Nuechterlein KH, Green MF, Baade LE, Fenton WS, Gold JM, Keefe RSE, Mesholam-Gately R, Mintz J, Seidman LJ, Stover E, Marder SR: The MATRICS Consensus Cognitive Battery, part 2: co-norming and standardization. Am J Psychiatry 2008; 165:214–220
3.
Green MF, Nuechterlein KH, Kern RS, Baade LE, Fenton WS, Gold JM, Keefe RSE, Mesholam-Gately R, Seidman LJ, Stover E, Marder SR: Functional co-primary measures for clinical trials in schizophrenia: results from the MATRICS Psychometric and Standardization Study. Am J Psychiatry 2008; 165:221–228
4.
Hyman SE, Fenton WS: What are the right targets for psychopharmacology? Science 2003; 299:350–351
5.
Marder SR, Fenton W: Measurement and Treatment Research to Improve Cognition in Schizophrenia: NIMH MATRICS initiative to support the development of agents for improving cognition in schizophrenia. Schizophr Res 2004; 72:5–9
6.
Green MF, Nuechterlein KH, Gold JM, Barch DM, Cohen J, Essock S, Fenton WS, Frese F, Goldberg TE, Heaton RK, Keefe RSE, Kern RS, Kraemer H, Stover E, Weinberger DR, Zalcman S, Marder SR: Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biol Psychiatry 2004; 56:301–307
7.
Nuechterlein KH, Barch DM, Gold JM, Goldberg TE, Green MF, Heaton RK: Identification of separable cognitive factors in schizophrenia. Schizophr Res 2004; 72:29–39
8.
Keefe RS, Fox KH, Harvey PD, Cucchiaro J, Siu C, Loebel A: Characteristics of the MATRICS Consensus Cognitive Battery in a 29-site antipsychotic schizophrenia clinical trial. Schizophr Res 2011; 125:161–168
9.
Javitt DC, Buchanan RW, Keefe RS, Kern R, McMahon RP, Green MF, Lieberman J, Goff DC, Csernansky JG, McEvoy JP, Jarskog F, Seidman LJ, Gold JM, Kimhy D, Nolan KS, Barch DS, Ball MP, Robinson J, Marder SR: Effect of the neuroprotective peptide davunetide (AL-108) on cognition and functional capacity in schizophrenia. Schizophr Res 2012; 136:25–31
10.
Buchanan RW, Keefe RS, Lieberman JA, Barch DM, Csernansky JG, Goff DC, Gold JM, Green MF, Jarskog LF, Javitt DC, Kimhy D, Kraus MS, McEvoy JP, Mesholam-Gately RI, Seidman LJ, Ball MP, McMahon RP, Kern RS, Robinson J, Marder SR: A randomized clinical trial of MK-0777 for the treatment of cognitive impairments in people with schizophrenia. Biol Psychiatry 2011; 69:442–449
11.
Fisher M, Holland C, Merzenich MM, Vinogradov S: Using neuroplasticity-based auditory training to improve verbal memory in schizophrenia. Am J Psychiatry 2009; 166:805–811
12.
Fisher M, Loewy R, Carter C, Lee A, Ragland JD, Niendam T, Schlosser D, Pham L, Miskovich T, Vinogradov S: Neuroplasticity-based auditory training via laptop computer improves cognition in young individuals with recent onset schizophrenia. Schizophr Bull (Epub ahead of print, Jan 20, 2014)
13.
Keefe RS, Vinogradov S, Medalia A, Buckley PF, Caroff SN, D’Souza DC, Harvey PD, Graham KA, Hamer RM, Marder SM, Miller DD, Olson SJ, Patel JK, Velligan D, Walker TM, Haim AJ, Stroup TS: Feasibility and pilot efficacy results from the multisite Cognitive Remediation in the Schizophrenia Trials Network (CRSTN) randomized controlled trial. J Clin Psychiatry 2012; 73:1016–1022
14.
Nuechterlein KH, Subotnik KL, Ventura J, Gretchen-Doorly D, Casaus LR, Luo JS, Turner L, Kurtz AS, DeTore NR: Long-acting injectable risperidone and medication adherence enhance cognition and work functioning after a first psychotic episode (abstract). Schizophr Bull 2013; 39(suppl 1):S347
15.
Nuechterlein KH, Ventura J, Subotnik KL, Gretchen-Doorly D, Turner L, Casaus LR, Luo JS, Medalia A, Bell MD: Broad-spectrum cognitive remediation after a first episode of schizophrenia: impact on cognition and work/school functioning (abstract). Schizophr Bull 2013; 39(suppl 1):S347
16.
Silverstein SM, Roché MW, Khan Z, Carson SJ, Malinovsky I, Newbill WA, Menditto AA, Wilkniss SM: Enhancing and promoting recovery in attentionally impaired people diagnosed with schizophrenia: results from a randomized controlled trial of attention shaping in a partial hospital program. Am J Psychiatr Rehabil 2014; 17:272–305
17.
Smith RC, Tobe RH, Boules S, Mattiuz S, Ravishankar H, Youssef M, Baranwal N, Amiaz R, Davis JM: Effects of transcranial direct current stimulation (TDCS) on cognition and symptoms in schizophrenia (abstract). Biol Psychiatry 2014; 75(suppl):20S
18.
Hilt DC, Lombardo I, Gawryl M, Dgetluck N, Keefe R: Optimizing treatment and signal detection with encenicline in a CIAS phase 2b study (abstract). http://www.eventscribe.com/2014/posters/SIRS/home.asp
19.
Lane HY, Lin CH, Green MF, Hellemann G, Huang CC, Chen PW, Tun R, Chang YC, Tsai GE: Add-on treatment of benzoate for schizophrenia: a randomized, double-blind, placebo-controlled trial of D-amino acid oxidase inhibitor. JAMA Psychiatry 2013; 70:1267–1275
20.
Haig G, Baker J, Robieson W, Bain E, Othman A: Efficacy and safety of ABT-126, an α7 nicotinic cholinergic agonist, in treatment of cognitive impairment associated with schizophrenia: results from a proof of concept study (abstract). http://ascpmeeting.org/wp-content/uploads/2014/05/ASCP-Poster-Abstract-Book-Online.pdf
21.
Jarskog LF, Dong Z, Kangarlu A, Colibazzi T, Girgis RR, Kegeles LS, Barch DM, Buchanan RW, Csernansky JG, Goff DC, Harms MP, Javitt DC, Keefe RS, McEvoy JP, McMahon RP, Marder SR, Peterson BS, Lieberman JA: Effects of davunetide on N-acetylaspartate and choline in dorsolateral prefrontal cortex in patients with schizophrenia. Neuropsychopharmacology 2013; 38:1245–1252
22.
Tregellas JR, Smucny J, Harris JG, Olincy A, Maharajh K, Kronberg E, Eichman LC, Lyons E, Freedman R: Intrinsic hippocampal activity as a biomarker for cognition and symptoms in schizophrenia. Am J Psychiatry 2014; 171:549–556
23.
Stover EL, Brady L, Marder SR: New paradigms for treatment development. Schizophr Bull 2007; 33:1093–1099
Information & Authors
Information
Published In
History
Accepted: August 2014
Published online: 1 November 2014
Published in print: November 01, 2014
Authors
Competing Interests
Dr. Green has been a paid consultant for AbbVie, DSP, Forum, and Roche, has been a member of the Scientific Board of Mnemosyne, and has received research funds from Amgen. Dr. Nuechterlein has been a paid consultant to Genentech, Otsuka, and Janssen Scientific Affairs and has received research funds from Janssen Scientific Affairs, Genentech, and PositScience. Drs. Green and Nuechterlein are officers in MATRICS Assessment, Inc., which publishes the MATRICS Consensus Cognitive Battery (MCCB), but they receive no financial compensation from those roles or from the sale of the MCCB. Dr. Freedman has reviewed this commentary and found no evidence of influence from these relationships. Dr. Harris reports no financial relationships with commercial interests.
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).