Skip to main content
Full access
Influential Publications
Published Online: 1 October 2013

Comparative Effectiveness of Collaborative Chronic Care Models for Mental Health Conditions Across Primary, Specialty, and Behavioral Health Care Settings: Systematic Review and Meta-Analysis

Abstract

Objective

Collaborative chronic care models (CCMs) improve outcome in chronic medical illnesses and depression treated in primary care settings. The effect of such models across other treatment settings and mental health conditions has not been comprehensively assessed. The authors performed a systematic review and meta-analysis to assess the comparative effectiveness of CCMs for mental health conditions across disorders and treatment settings.

Method

Randomized controlled trials comparing CCMs with other care conditions, published or in press by August 15, 2011, were identified in a literature search and through contact with investigators. CCMs were defined a priori as interventions with at least three of the six components of the Improving Chronic Illness Care initiative (patient self-management support, clinical information systems, delivery system redesign, decision support, organizational support, and community resource linkages). Articles were included if the CCM effect on mental health symptoms or mental quality of life was reported. Data extraction included analyses of these outcomes plus social role function, physical and overall quality of life, and costs. Meta-analyses included comparisons using unadjusted continuous measures.

Results

Seventy-eight articles yielded 161 analyses from 57 trials (depression, N=40; bipolar disorder, N=4; anxiety disorders, N=3; multiple/other disorders, N=10). The meta-analysis indicated significant effects across disorders and care settings for depression as well as for mental and physical quality of life and social role function (Cohen's d values, 0.20–0.33). Total health care costs did not differ between CCMs and comparison models. A systematic review largely confirmed and extended these findings across conditions and outcome domains.

Conclusions

CCMs can improve mental and physical outcomes for individuals with mental disorders across a wide variety of care settings, and they provide a robust clinical and policy framework for care integration.
(Reprinted with permission The American Journal of Psychiatry 2012; 169:790–804)
Organized care management processes—the systematic use of guidelines supported by clinical information systems and care management—are the cornerstone of quality improvement in both primary care and multispecialty group practice (13). They are a key component (2) of patient-centered medical homes (4, 5) and accountable care organizations (6, 7). Multiple randomized controlled trials have indicated that care management processes, such as collaborative chronic care models (CCMs), improve outcomes for various chronic medical illnesses. These models, originally articulated by Wagner et al. (8) and Von Korff et al. (9) and subsequently included as part of the Robert Wood Johnson Improving Chronic Illness Care initiative (http://www.improvingchroniccare.org/), represent a framework for care that consists of several or all of the following six components: patient self-management support, delivery system redesign, use of clinical information systems, provider decision support, linkage to community resources, and health care organization support (10, 11). The effect of CCMs and related disease management strategies for treatment of chronic medical illnesses has been the subject of both qualitative reviews (1113) and meta-analyses (1417).
Disease management strategies, including CCMs and other care process innovations, have been used to enhance depression treatment in primary care. Two meta-analyses of disease management programs (broadly defined) have a demonstrated beneficial effect of such programs on symptoms (18, 19) as well as satisfaction with care (18) and treatment quality (18), accompanied by greater service utilization and health care costs (18). A more recent review has underscored these findings (20). A meta-analysis of cost-effectiveness assessed in eight randomized controlled trials of disease management for depression in primary care found that compared with the control condition, the care management model was more effective but cost more (21). The investigators concluded that data on costs and effects in settings other than primary care are needed before care management models can be widely implemented.
Addressing the needs of individuals with serious mental health conditions in addition to depression is critical, since mental disorders affect more than 25% of the U.S. population at any one time (22), and the lifespan of individuals with serious mental illness is 25 years shorter than the U.S. average (23). CCMs are being applied to treatment for various mental health conditions across a variety of care settings and have been entered into clinical practice guidelines for the treatment of some chronic mental illnesses (24, 25).
However, treatment for mental health conditions presents more complex clinical and organizational challenges than primary care treatment for medical illnesses. For example, individuals with serious mental health conditions may at times have impaired executive or decision-making capability; at the same time, participating effectively in a care system that is fragmented across mental health and medical sectors demands substantial motivation, organization, and persistence in order for clinical needs to be met comprehensively (26). If CCMs do have a beneficial effect on a wide variety of mental health conditions across various settings, these models could provide a coherent approach by which to structure care for patients with mental illness, integrating with patient-centered medical homes that use CCM-based approaches (2).
We therefore conducted a systematic review and meta-analysis of randomized controlled trials to determine the comparative effectiveness of CCMs relative to other care conditions for individuals with mental illness. If broad-based effects are demonstrated across conditions and care settings, two effects could result. First, these findings could lead to mechanism and moderator studies, as has been done previously for primary care management of depression (19) and medical CCMs (11), in order to support further model development. Second, these findings could guide the efforts of policymakers and administrators to incorporate the needs of individuals with mental health conditions into new models stimulated by U.S. health care reform (37).
This investigation represents several innovations. First, CCMs were identified a priori based on the presence of explicitly defined operational components, regardless of whether their conceptual “lineage” was derived from the Improving Chronic Illness Care (811) model. Second, in order to provide the most comprehensive analysis of CCM effects on mental health conditions, we included all trials that measured effect on a mental health outcome, regardless of the targeted underlying physical or mental disorder or care setting. Third, to provide the most comprehensive assessment of effect, we extracted not only symptomatic outcomes but also other outcomes relevant to mental health outcomes, including social role function, overall quality of life, physical quality of life, and health care costs. Fourth, we systematically identified analyses across these outcome domains using a priori decision rules to include only those analyses that contributed nonredundant information. Fifth, we complemented the meta-analysis with a systematic review to ensure consideration of informative data that did not meet the restrictive requirements for meta-analysis. This review provides a comprehensive assessment of the comparative effectiveness of CCMs on a broad group of outcome domains across various mental health conditions treated in a wide variety of care settings.

Method

Data Sources and Search Strategy

Relevant randomized controlled trials that were either published or in press through August 15, 2011, were identified via MEDLINE, PsycINFO, Embase, Scopus, Cochrane Library, and clinicaltrials.gov; this search was supplemented by review of article bibliographies plus contact with investigators in the field. The MEDLINE MeSH terms, or equivalent terms for other databases, were as follows: case management, combined modality therapy, continuity of patient care, cooperative behavior, mental health services, primary health care/organization and administration, patient care team, practice guidelines, and delivery of health care/methods. The search was continued until no new articles were identified. Candidate article titles and abstracts were screened by one or two authors (H.G., M.S.B.), and full-text reviews were independently extracted by two or more authors (E.W., A.G.K., B.P., H.G., M.S.B.) for relevant outcome analyses.

Trial Inclusion and Exclusion Criteria

CCM was defined a priori as an intervention with at least three of the following six components according to criteria from the Improving Chronic Illness Care initiative (10, 11): patient self-management support, delivery system redesign, use of clinical information systems, provider decision support, health care organization support, and linkage to community resources (Table 1). The intraclass coefficient across raters for the number of CCM criteria met was 0.93, and the kappa for CCM identification was 1.00. The threshold of three criteria was chosen for two reasons. First, to require only two criteria would yield many psychotherapy studies that included only self-management support plus work-role redesign (the addition of a therapist). Second, the earliest articulations of the model (8, 9) consisted of four (12) rather than six elements, so including studies with three rather than all four original criteria would provide a more stringent test of the model and allow for future dose-response analyses.
Table 1. Collaborative Chronic Care Model (CCM) Core Elementsa
ElementFocusExample
Patient self-management support
Coaching, problem solving, or skills-focused psychotherapy or psychoeducation targeting ability to self-manage symptoms and participate more effectively in clinical care and decision making.
Behavioral change strategies or coaching, illness-specific psychoeducation, shared decision-making interventions, cognitive-behavioral or problem-solving therapies.
Clinical information systems use
Facilitation of information flow from relevant clinical sources to treating clinicians for optimal management of individuals, panels, or populations.
Case registries, reminder systems, provision of timely clinical information (e.g., laboratory and study results) regarding individuals in treatment, and/or feedback to providers.
Delivery system redesign
Redefinition of work roles for physicians and support staff to facilitate anticipatory or preventive rather than reactive care; allocation of staff to implement other CCM elements, such as self-management support and information flow.
Licensed clinical staff or health educators to provide psychoeducation, ensure provision of appropriately timed clinical information for specific cases, or review of panel or population data for anticipatory and preventive management needs.
Provider decision support
Facilitated provision of expert-level input to generalist clinicians managing cases without need for specialty consultation separated in time and space from clinical needs.
On-site or facilitated expert consultation or provision of simplified clinical practice guidelines supported by local clinician champions.
Community resource linkage
Support for clinical and nonclinical needs from resources outside the health care organization proper.
Referral to peer support groups, exercise programs, housing resources, home care programs.
Health care organization supportOrganization-level leadership and tangible resources to support CCM goals and practices.Provision of adequate clinical staff for CCM training and implementation; support from key nonclinical services, such as informatics; championship by organization leadership, optimally with a commitment to sustainability after the research phase of the intervention ends.
a
Adapted from references 10 and 118.
Trials were included if the intervention met these explicit operational criteria, regardless of whether the investigators cited criteria from the Improving Chronic Illness Care initiative or explicitly considered the intervention to be a CCM. It is important to note that not all disease management programs included in other reviews (for example, references 18, 19, 21) met CCM criteria, and therefore not all such programs are included in this model-driven study.
Trials were required to compare an intervention meeting the CCM definition with another intervention or with treatment as usual. Trials that compared two or more interventions that met CCM criteria were excluded (for example, reference 27), since such trials could not provide information on the comparative effectiveness of a CCM. Because CCMs are frameworks applied to the outpatient clinic setting, interventions that included a mobile treatment team component and other comprehensive rehabilitation programs (for example, reference 28) were excluded; similarly, trials in schizophrenia were excluded because this disorder is typically treated by these more intensive interventions. Both parallel-group and within-subject randomized controlled trials were considered for inclusion, although none of the latter were identified. Among identified trials, all articles reporting CCM effects on any mental health symptom or on mental quality of life were included, whether or not the sample primarily consisted of individuals with formally diagnosed mental disorders.

Data Extraction

Study characteristics and outcome analyses were extracted as noted earlier, with differences reconciled by consensus. Outcome analyses were included regardless of whether they were identified as primary outcome analyses and regardless of their reported power. In addition to analyses of mental health symptoms and mental quality of life, we extracted other analyses relevant to mental health effects, including those of social role function, physical and overall quality of life, and health care cost. We did not include analyses of guideline concordance or other quality indices given the uncertain relationship of such measures to health outcomes in mental health (29) and medical-surgical (3032) conditions.
CCM trials often report multiple outcome analyses at multiple time points. Therefore, an a priori strategy was developed to ensure that an exhaustive but nonredundant set of analyses was identified. First, we extracted only one measure per domain (e.g., depressive symptoms, physical quality of life). Second, we chose continuous variables over categorical variables (e.g., the raw symptom score over the percentage of participants who achieved remission); if an outcome domain was represented only by categorical data, then the analysis was extracted. Third, when the same variable was reported over time, the measure from the longest time point during active treatment was chosen. Fourth, for cost outcomes, the most inclusive measure was chosen, and among these measures, we used the longest outcome interval (e.g., total direct treatment costs over 2 years rather than ambulatory treatment costs over 1 year). Fifth, analyses were excluded if they examined subsamples of a larger sample for which data were already reported (e.g., an analysis of depression in diabetic patients was not included if depression data for the overall sample were reported elsewhere). Last, we excluded analyses for which the variable represented a subset of previously reported items from a higher-order scale (e.g., an analysis of sleep was not reported if sleep was represented by an item on a depression scale analysis that was included).

Meta-Analytic Methods

The aforementioned outcome analyses established the data set for systematic review. Meta-analyses consisted of the subset of analyses that reported continuous variables as unadjusted means plus the sample size and a measure of dispersion (typically the standard deviation or confidence interval). A meta-analysis was carried out for each outcome domain for which at least two analyses were available. Since outcome variables from different studies are often measured in different units, we used Cohen's d (33), calculating the standardized mean difference between the treatment and comparison groups using the difference in means divided by the pooled standard deviation. For each qualifying outcome domain, an overall meta-analytic estimate of the combined effect of the included analyses on the outcome of interest was calculated using the random-effects estimator described by DerSimonian and Laird (34; also see reference 35). A check for systematic bias (36) in reporting was performed by constructing a funnel plot of each trial's effect size against its standard error and applying Begg and Egger tests (37) and by computing a Spearman's rank correlation coefficient between the study effect sizes and respective sample sizes (38).

Standardized Assessment of Systematic Review Data

To provide a more comprehensive assessment of CCM effects than that which could be achieved by meta-analysis alone, we also performed a standardized assessment of all analyses that met inclusion criteria for the review. We categorized each qualifying analysis from each trial as favoring the CCM, favoring the control condition, or exhibiting no difference between the CCM and control condition based on the statistical significance (p value) reported by the authors. To identify overall effect, analyses were then summarized as percentages across mental health conditions and across outcome domains.

Results

Trial Characteristics

The search yield is summarized in Figure 1 in the data supplement that accompanies the online edition of this article, according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) (39) conventions. For the overall systematic review, 57 trials were described across 78 articles, yielding 161 qualifying analyses (140 assessed clinical outcomes; 21 assessed economic outcomes). Trial characteristics are summarized in Table 1 in the online data supplement (4094). The earliest qualifying trial was reported in 1994 (40), predating the seminal conceptual study by Wagner et al. (8).
All but one trial (63) included only adults, and three trials (51, 57, 85) focused on adults over age 60. The mean age of sample participants was 49.4 years (SD=10.8; range=17.2–77.6). The mean percentage of women enrolled in trials was 63.1% (SD=25.5; range=3.5–100), and three trials included only women (52, 64, 68). The mean percentage of participants from minority groups was 37.3% (SD=26.7; range=2.7–100), and four trials examined only participants from minority groups (64, 68, 76, 77). Seven trials (12.3%) took place outside the continental United States (43, 52, 69, 76, 91, 92, 94). Forty trials (70.2%) examined depression. There were also trials examining bipolar (N=4; 7.0%), anxiety (N=3; 5.3%), and multiple/other (N=10; 17.5%) disorders. Notably, 12 trials (19.3%) were designed for populations with combined behavioral health and medical disorders or risks, including diabetes (60, 74, 75), cardiovascular risk (75, 81), cancer (64, 68), pain (71), and various other conditions (85, 86, 90, 93).
Regarding organizational setting, 16 trials (28.1%) took place in staff model health maintenance organizations (HMOs), 11 (19.3%) in U.S. Department of Veterans Affairs (VA) facilities, 27 (47.4%) in nonintegrated systems, and three (5.3%) across multiple types of organizations. Thirty-nine (68.4%) trials took place in primary care settings, nine (15.8%) exclusively in behavioral health settings, and nine (15.8%) in medical specialty or multiple settings.
Regarding trial design, sample sizes ranged from 55 to 2,796 participants (mean=387.3, SD=437.3). Most trials were randomized at the patient level, with a mean of 3.9 [SD=0.6] CCM components for the intervention. Five trials delivered the patient intervention predominantly or exclusively via telephone (61, 66, 67, 70, 72). The most common control condition was usual care (N=33; 57.9%); however, there were trials comparing the intervention with a variety of enhanced usual care conditions (e.g., clinician notification or patient education) or with less integrated models, such as consultation-liaison.
Outcome analyses (N=161) are summarized in Table 2 in the online data supplement (40117). Follow-up intervals typically paralleled active treatment intervals, with a mean length of 13.7 months (SD=9.8; range=3–36) of treatment. Eight analyses also investigated residual CCM effects or costs months to years after the cessation of active treatment (103, 106, 111115, 117).

Meta-Analytic Data

Forty-six of the 163 analyses (28.2%) qualified for meta-analysis (33 assessed clinical outcomes, 13 assessed economic outcomes) (Figure 1, Figure 2). These analyses derived from 30 trials reported across 28 articles. Moderate (33) beneficial effects of CCMs were seen in trials for depression, the only clinical symptom for which there was more than one qualifying analysis (Cohen's d=0.31; 95% confidence interval [CI]=0.16–0.47; 14 analyses). Beneficial effects were also observed on mental quality of life (Cohen's d=0.20; 95% CI=0.04–0.36; six analyses), physical quality of life (Cohen's d=0.33; 95% CI=0.17–0.49; six analyses), and social role function (Cohen's d=0.23; 95% CI=0.02–0.44; three analyses). Estimates for the effect size of CCMs on overall quality of life (two analyses) yielded wide confidence intervals (Cohen's d=0.20, 95% CI=–0.02 to 0.42), and differences between CCMs and control conditions did not reach statistical significance. Estimates for the effect of CCMs on global mental health (two analyses) also did not reach statistical significance (Cohen's d=0.09, 95% CI=–0.17 to 0.35). The CCM effect on total health care costs did not differ from the control condition effect on total costs (Cohen's d=0.05; 95% CI=–0.02 to 0.12).
Figure 1. Meta-Analysis of Clinical Outcomesa
a The individual comparisons extracted for these meta-analyses reflect data from the longest time interval for a given trial (see the Method section). The individual comparisons at these longest time points may or may not have been significantly different but were extracted for meta-analyses as the most rigorous test of the model. In complementary fashion, the systematic review results (see Table 2; also see the online data supplement) report the planned analyses as reported in each given trial, which typically included repeated-measures analyses that incorporated tests of change over time between the chronic care model and the control condition.
b Weights are from random-effects analysis.
Figure 2. Meta-Analysis of Economic Outcomes
a Weights are from random-effects analysis.
Bias statistics were calculated separately for clinical and economic domains. All clinical outcomes were aggregated for this analysis. Funnel plots revealed no significant evidence of bias for either clinical or economic outcomes (37). In line with previous meta-analytic research on psychosocial interventions for mental disorders (38), we also tested for publication bias by calculating a Spearman's rank correlation coefficient between sample size and effect size. Correlation for each outcome was nonsignificant, providing evidence that studies with larger effect sizes in one direction were no more likely to be published than studies with smaller effect sizes (36).

Systematic Review Data

Of 140 clinical analyses, 133 (95.0%) reported p values (Table 2, Table 3). Of these, 66 (49.6%) favored the CCM, one (0.8%) favored the control condition, and 66 (49.6%) revealed no significant difference between the CCM and the comparison model. Among 21 analyses reporting economic outcomes, 10 (47.6%) reported p values. Of these, nine (90.0%) reported no difference in costs between the CCM and the control condition, while one (10.0%) favored the control condition.
Table 2. By-Diagnosis Tabulation of Systematic Review Clinical Analyses Comparing the Chronic Care Model (CCM) With the Control Condition
 Analysis FavorsaTotalsb
 CCMControl ConditionNonsignificantTotal InformativeIndeterminateOverall Total
DiagnosisN%N%N%N%N% 
Depressive disorders
41
46.6
0
0.0
47
53.4
88
95.7
4
4.3
92
Bipolar disorders
5
41.7
1
8.3
6
50.0
12
85.7
2
14.3
14
Anxiety disorders
10
83.3
0
0.0
2
16.7
12
100.0
0
0.0
12
Multiple/other disorders
10
47.6
0
0.0
11
52.4
21
95.5
1
4.5
22
Total6649.610.86649.613395.075.0140
a
Each qualifying analysis from each trial was categorized as favoring the CCM, favoring the control condition, or exhibiting no difference between the CCM and the control condition. Percentages reflect the proportion of total informative analyses (e.g., for depressive disorders, 41 of 88 informative analyses [46.6%] favored the CCM).
b
Percentages reflect the proportion of analyses that were informative compared with those that were indeterminate (trials that did report the significance level explicitly compared with those that did not) (e.g., 88 of 92 analyses [95.7%] for depressive disorders reported significance).
Table 3. Tabulation By Outcome of Systematic Review Analysis Comparing the Chronic Care Model (CCM) With the Control Condition
 Analysis FavorsaTotalsb
 CCMControl ConditionNonsignificantTotal InformativeIndeterminateOverall Total
Outcome DomainN%N%N%N%N% 
Clinical outcomes

Anxiety
5
100.0
0
0.0
0
0.0
5
100.0
0
0.0
5
Cognition
1
100.0
0
0.0
0
0.0
1
100.0
0
0.0
1
Depression
29
54.8
0
0.0
24
45.2
53
93.0
4
6.7
57
Global mental health
2
33.3
0
0.0
4
66.7
6
85.7
1
14.3
7
Mania
1
50.0
0
0.0
1
50.0
2
67.0
1
33.0
3
Mental quality of life
11
52.4
0
0.0
10
47.6
21
100.0
0
0.0
21
Mortality
0
0.0
0
0.0
1
100.0
1
50.0
1
50.0
2
Overall quality of life
2
50.0
0
0.0
2
50.0
4
100.0
0
0.0
4
Physical quality of life
6
28.8
0
0.0
15
71.4
21
100.0
0
0.0
21
Social role function
8
53.3
1
6.7
6
40.0
15
100.0
0
0.0
15
Substance abuse
1
33.0
0
0.0
2
67.0
3
100.0
0
0.0
3
Suicidality
0
0.0
0
0.0
1
100.0
1
100.0
0
0.0
1
Total
66
49.6
1
0.8
66
49.6
133
95.0
7
4.7
140
Economic outcomes

Health care costs
0
0.0
1
10.0
9
90.0
10
47.6
11
52.4
21
a
Each qualifying analysis from each trial was categorized as favoring the CCM, favoring the control condition, or exhibiting no difference between the CCM and the control condition. Percentages reflect the proportion of total informative analyses (e.g., for anxiety disorders, five of five informative analyses [100.0%] favored the CCM).
b
Percentages reflect the proportion of analyses that were informative compared with those that were indeterminate (trials that did report the significance level explicitly compared with those that did not).

Aggregating results by diagnostic group across outcome domains.

Trials enrolling individuals with depressive disorders included 88 analyses reporting significance across all clinical outcome domains; of these, 41 (46.6%) favored the CCM. Results favored CCMs in trials enrolling individuals with anxiety disorders (10/12; 83.3%), and the effect was somewhat lower overall in trials enrolling individuals with multiple/other disorders (10/21; 47.6%) and bipolar disorder (5/12; 31.7%).

Aggregating results by outcome domain across diagnostic groups.

Systematic review of the less restrictive set of analyses confirmed the meta-analytic findings. Among depression analyses, 29/53 (54.8%) favored the CCM, with none favoring the control condition. Among mental quality of life analyses, 11/21 (52.4%) favored the CCM, with none favoring the control condition. Among social role function analyses, 8/15 (53.3%) favored the CCM and one (6.7%) favoring the control condition. Overall quality of life analyses, for which there was a nonsignificant meta-analysis with only two qualifying analyses, revealed beneficial CCM effects by systematic review methodology using a larger sample size, with two of four outcomes (50%) favoring the CCM and none favoring the control condition. Similarly, global mental health was typically a secondary outcome measure and was also represented in the meta-analysis by only two analyses; systematic review indicated that two of six analyses (33.3%) favored the CCM, while none favored the control condition. For physical quality of life, in contrast to positive meta-analysis findings, significance counts indicated that six of 21 outcomes (28.8%) favored the CCM, with none favoring the control condition.
Additionally, systematic review identified a broader variety of symptom outcomes than those represented in each meta-analysis, including measures of anxiety, cognition, global mental health, mania, substance abuse, and suicidality. Of symptom domains with more than one nonredundant analysis reporting significance, five of five anxiety disorders analyses (100%) favored the CCM, and one of two mania analyses (50%) also favored the CCM.
Systematic review results across mental health conditions and outcome domains are summarized in Figure 3 in comprehensive analysis displays (CADgrams), which allow for graphical inspection of the data across both mental health condition and outcome domain simultaneously. For example, for mental quality of life, it can be seen that while the majority of analyses derived from studies of depressive disorders, a similar pattern of results was obtained for populations with bipolar, anxiety, and multiple/other disorders.
Figure 3. Comprehensive Analysis Displays (CADgrams) for Specific Outcome Domains Across Diagnosesa
a The bar graphs depict comprehensive analysis displays, which summarize chronic care model (CCM) significance across outcome domains. These comprehensive analysis displays appear in an order consistent with that of Table 2 for domains with four or more informative analyses, with each outcome categorized by disorder. The horizontal axis represents the raw count of informative analyses according to the number of analyses that favored the CCM, revealed no significant difference between the CCM and control condition, or favored the control condition. The dimension of the horizontal axis varies by the number of informative analyses in order to accommodate the length of the bars, ranging from 4 (overall quality of life) to 133 (total clinical outcomes).

Discussion

Key Findings

In this most inclusive analysis to date of CCM comparative effectiveness for mental health conditions, meta-analysis of unadjusted outcomes for continuous variables demonstrated significant small to medium (33) effects of CCMs across multiple disorders with regard to clinical symptoms, mental and physical quality of life, and social role function, with no net increase in total health care costs. In some cases, meta-analysis identified significant effects even though the majority of individual meta-analyzed comparisons were negative (e.g., for mental quality of life). In complementary fashion, systematic review of the less restrictive set of analyses largely confirmed and extended the meta-analytic findings.
This study has several strengths. First, we included CCMs based on a priori operational criteria, regardless of stated conceptual “lineage,” thereby allowing us to comprehensively identify and assess interventions consistent with the Improving Chronic Illness Care model. Second, we examined CCM comparative effectiveness across multiple disorders and care settings. Third, we employed a meticulous method to ensure exhaustive, yet nonredundant, identification of all relevant outcome analyses. Fourth, we included all qualifying analyses, regardless of whether they represented primary outcomes or were reported to have adequate power. Fifth, we complemented powerful but restrictive meta-analytic techniques with more inclusive but still standardized and quantitative systematic review.
Several patterns in the results deserve note. The majority of analyses derive from studies of depressive disorders treated in primary care; however, the number of trials for populations treated outside of primary care is growing quickly. Importantly, an increasing number of trials now address mental disorders that are by definition chronic (which may or may not be the case for depression) and treated in specialty care settings. Not surprisingly, compared with primary care trials for depression and anxiety, trials for chronic conditions, such as bipolar disorder, show a somewhat more variable effect. This is likely due to several factors. Specifically, such disorders are by definition chronic and typically accompanied by multiple comorbidities (118). Additionally, mental health treatment settings may represent more complex organizational challenges (26) than primary care for implementation of care management models.
It is interesting that no substance abuse interventions that were identified qualified as CCMs, although several candidate trials were identified (119124). These trials typically focused on collocating or coordinating primary care with ongoing psychosocially oriented substance use programs, suggesting that these already integrated specialty programs identified and attempted to address a focal quality gap (i.e., lack of primary care) rather than reorganizing care more extensively. Among CCM trials, only two (86, 88) included qualifying substance use outcome analyses, with one of three analyses (33.3%) favoring the CCM. Our search also identified only one CCM trial for schizophrenia (125), which yielded indeterminate results according to our systematic review criteria (see the Method section) for overall, mental, and physical quality of life as well as for depression.
In aggregate, meta-analyses of unadjusted continuous outcome measures were congruent with the more comprehensive systematic review. For outcome domains in which only two studies qualified for meta-analysis (overall quality of life, global mental health), meta-analysis indicated substantial heterogeneity (Figure 1), and the larger sample of systematic review analyses may provide a more stable estimate of effect. For physical quality of life, the meta-analysis of six studies indicated a CCM advantage, while significance count in the 24 systematic review studies revealed no difference between CCMs and control conditions in a majority of studies.

Comparison With Other Studies

There have been three other meta-analyses of broadly defined disease management trials for depression in primary care (18, 19, 21) and none, to our knowledge, for other mental health conditions or settings. None of the previous reviews used an established model to identify interventions, nor did they complement meta-analysis with systematic review to address limitations entailed in using a more highly selected sample of trials or analyses. Nonetheless, it is notable that two previous meta-analyses (18, 19) also demonstrated beneficial effects of disease management, albeit at some increased costs (18). One meta-analysis of costs from a smaller number of trials (21) also demonstrated increased total health care costs, with cost per quality-adjusted life years ranging from $21,478 to $49,500 and cost per additional depression-free days ranging from $20 to $24. Our economic meta-analysis across conditions and care settings revealed no net difference in the total health care cost difference between CCMs and control conditions. Importantly, net costs were not consistently higher for CCMs targeting chronic conditions treated in specialty settings (81, 82) than for CCMs treating depression in primary care settings (Figure 3). These findings address earlier recognition of the need for more comprehensive data on CCMs regarding costs and effects in settings other than primary care (21).

Next Steps

Mediators, moderators, and mechanisms research.

Several questions remain to be answered. A better understanding of mediators, moderators, and mechanisms is essential to further development and application of the model. Four potential applications of mediator, moderator, and mechanism research may be particularly helpful in developing and deploying the CCM for maximum public health effect.
First, patient clinical and demographic characteristics can help to identify target populations that will benefit from the model. For instance, minority participants in the VA primary care setting responded better to a depression CCM than did Caucasian participants (126). Our work in bipolar disorder, in both the VA (127) and a staff model HMO (80) provides the good news that comorbid substance dependence does not reduce CCM effect, nor do anxiety disorders (127).
Second, it is not clear how many, or which, of the CCM components are necessary. The multicomponent model evolved out of the recognition that single-component interventions are not sufficient to improve health outcomes that depend on the complex interaction of multiple organizational components (8, 12, 20). For medical CCMs, circumstantial evidence indicates that self-management support is important, as 19 of 20 positive trials included this component (11). A meta-analysis of depression care management effects identified staffing and training characteristics associated with positive effect, but it was not designed to identify specific CCM components (19).
Third, while early CCM work took place in the staff model HMO setting, CCMs for mental illnesses have now been applied across a wide variety of care organizations. However, it is not yet clear whether CCMs have equal effects in less integrated care settings. To provide a compelling framework for care on a policy level, CCMs should demonstrate benefit across the broad spectrum of care settings represented in U.S. health care.
Fourth, scrutiny of other aspects of study design will provide data relevant to CCM dissemination. For example, assessment of the effect of duration of treatment and follow-up evaluation on CCM effects can provide an indicator of the time frame for return on investment for providers and payers who implement CCMs.

From effectiveness to implementation and dissemination.

Another critical issue is the identification of the most effective implementation strategies by which to establish and sustain the model. Case studies of depression care management in the VA (128, 129) and a recent quasi-experimental implementation study of community health centers (130) provide some lessons, and a randomized controlled trial of two implementation strategies for a bipolar disorder CCM in community mental health centers is currently under way (131).
How can these results support further research that responds to the exigencies of the current health care environment? Clearly, there is a need to integrate care for patients with mental health conditions into new organizational models emerging under health care reform. Additionally, since it is increasingly unlikely in the current health care climate that multiple diagnosis-specific care management programs can be deployed to treat multiple conditions in a single individual or population, cross-diagnosis CCMs and CCMs that address highly comorbid populations will have to be a particular focus, and results from our review indicate that such models can be effective. Similarly, development of population- and health plan-level CCMs will be important to reach individuals treated in venues too small to mount practice-based care management strategies (132).
Several lessons can be drawn from our results to guide CCM implementation in the current health care environment. First and most fundamentally, the potential benefit of CCMs for mental health conditions extends beyond depressive disorders and beyond the primary care setting. Second, CCMs designed for mental health conditions can improve physical as well as mental health outcomes. Third, CCMs can address the needs of populations with multiple chronic conditions, an emerging focus of the U.S. Department of Health and Human Services (133). Fourth, it should be recognized that as one moves from disorders treated in primary care to more chronic or severe disorders requiring specialty sector treatment, it becomes more challenging to achieve an effect, as noted earlier with regard to bipolar disorder. However, the fact that even highly comorbid chronic disorders benefit from CCMs (80, 127) is reason for optimism. Finally, it should be recognized that most of the CCMs tested to date have been clinic-based models, which require a sufficient critical mass of patients with a given condition, as well as local infrastructure, for implementation. However, promising results with CCMs that are implemented primarily or exclusively via telephone (61, 66, 67, 70, 72) indicate that population- and health plan-level implementation of CCMs may indeed be feasible, thus extending CCM benefits to settings in which a CCM cannot be applied independently (132).

Policy and Organizational Implications

Thus, CCMs are effective in a broad group of outcome domains across mental health conditions treated in a variety of care settings at no net increase in overall health care treatment costs. These findings have important implications for improving outcomes for individuals with mental illnesses. As stated in one national practice guideline, CCMs can serve as a “foundation of management” (24, p. 722) for such conditions.
Given the dual potential of CCMs to improve both physical and mental health outcomes in a wide variety of mental health conditions, the CCM model can serve as a framework for patient-centered medical homes (25) and support management of quality and risk in accountable care organizations (6, 7). The effectiveness of these models in populations identified as having dual mental and physical disorders (60, 64, 68, 71, 75, 81, 85, 86, 90, 93) is particularly important in this regard. Additionally, the utility of CCMs particularly for chronic mental disorders takes on greater importance in light of the Patient Protection and Affordable Care Act, which allows state Medicaid programs to establish reimbursement models to manage individuals who have a “serious and persistent mental health condition” and chronic medical conditions. The development of state-level health care exchanges and accountable care organizations, which involves bundled payments to providers, can facilitate utilization among care managers in providing CCM-related services.
Given their broad applicability to complex mentally ill populations, the potential benefit of CCMs for the Medicaid population is clear. Additionally, CCMs for serious mental illness can have potential for substantial effect for the Medicare population, since as individuals with serious mental illnesses (such as bipolar disorder) grow older, they consume an increasingly disproportionate share of both behavioral health and medical resources (134, 135).
Health care cost reductions are critical in each of these settings. Importantly, CCM benefits are associated with no net increase in health care costs (Figure 3). We as well as other investigators have pointed out the limitations of economic analyses derived from clinical trials (136). These concerns, particularly germane to efficacy trials, are mitigated somewhat in effectiveness-oriented health services designs. Nonetheless, it is critical to determine the economic outcomes of CCM implementation in the more heterogeneous environments encountered in policy-based or other roll-out efforts (137). Meanwhile, creative modeling efforts using research trial results have been employed to propose viable insurance benefit designs to support the sustainability of CCMs in the current health care environment (138).

Limitations

The most notable limitation of this comprehensive analysis is that the bulk of the evidence reviewed was derived from studies of depression treated in primary care. However, the evidence base across other disorders and care settings is growing quickly, and our results support the robustness of CCM effects in broader populations and more diverse care venues. A second limitation is that we defined CCMs as interventions with at least three of the six components of the Improving Chronic Illness Care model (10, 11), and thus some heterogeneity of effect may be attributable to the use of different components across interventions. Further analyses of this and other data sets can address this issue. Third, the study likely underestimates CCM effects by including analyses that were not primary trial outcomes and thus not necessarily adequately powered. Finally, the meta-analyses included a selective sample of published analyses that reported unadjusted continuous outcomes. However, no evidence of reporting bias was found quantitatively, and the more inclusive yet highly structured quantitative systematic review largely corroborated our meta-analysis results.

Summary

Our systematic review and meta-analysis yield what is likely a lower bound for CCM effects. Despite this conservative approach, CCM effects were robust across populations, settings, and outcome domains, achieving effects at little or no net treatment costs. Thus, CCMs provide a framework of broad applicability for management of a variety of mental health conditions across a wide range of treatment settings, as they do for chronic medical illnesses.
A recent commentary (139) argued that policymakers have championed many foci for cost savings that amount to “false cost control.” The author argues that the major focus of health care cost reduction efforts must be in reducing avoidable complications of chronic illnesses, which account for up to 22% of all health care expenditures. Reducing these complications could realistically result in a $40-billion per-year savings. Such tertiary prevention has been the orienting focus of CCMs since their inception (8), and our analyses indicate that these benefits can extend to patients with a wide variety of mental health conditions, including those with chronic or highly comorbid disorders.

Supplementary Material

Supplemental Material (552_ds001.pdf)

References

1.
Casalino L, Gillies RR, Shortell SM, Schmittdiel JA, Bodenheimer T, Robinson JC, Rundall T, Oswald N, Schauffler H, Wang MC: External incentives, information technology, and organized processes to improve health care quality for patients with chronic diseases. JAMA 2003; 289:434–441
2.
Rittenhouse DR, Casalino LP, Gillies RR, Shortell SM, Lau B: Measuring the medical home infrastructure in large medical groups. Health Aff (Millwood) 2008; 27:1246–1258
3.
Rittenhouse DR, Thom DH, Schmittdiel JA: Developing a policy-relevant research agenda for the patient-centered medical home: a focus on outcomes. J Gen Int Med 2010; 25:593–600
4.
Carrier E, Gourevitch MN, Shah NR: Medical homes: challenges in translating theory into practice. Med Care 2009; 47:714–722
5.
Nutting PA, Miller WL, Crabtree BF, Jaen CR, Stewart EE, Stange KC: Initial lessons from the first National Demonstration Project on practice transformation to a patient-centered medical home. Ann Fam Med 2009; 7:254–260
6.
Fisher ES, McClellan MB, Bertko J, Lieberman SM, Lee JJ, Lewis JL, Skinner S: Fostering accountable health care: moving forward in Medicare. Health Aff 2009; 28:w219–w231
7.
Shortell SM, Casalino LP: Implementing qualifications criteria and technical assistance for accountable care organizations. JAMA 2010; 303:1747–1748
8.
Wagner EH, Austin BT, Von Korff M: Organizing care for patients with chronic illness. Milbank Q 1996; 74:511–544
9.
Von Korff M, Gruman J, Schaefer J, Curry SJ, Wagner EH: Collaborative management of chronic illness. Ann Intern Med 1997; 127:1097–1102
10.
Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness: the chronic care model, part 1. JAMA 2002; 288:1775–1779
11.
Bodenheimer T, Wagner EH, Grumbach K: Improving primary care for patients with chronic illness: the chronic care model, part 2. JAMA 2002; 288:1909–1914
12.
Coleman K, Austin BT, Brach C, Wagner EH: Evidence on the chronic care model in the new millennium. Health Aff 2009; 28:75–85
13.
Ofman JJ, Badamgarav E, Henning JM, Knight K, Gano AD, Levan RK, Gur-Arie S, Richards MS, Hasselblad V, Weingarten SR: Does disease management improve clinical and economic outcomes in patients with chronic diseases? a systematic review. Am J Med 2004; 117:182–192
14.
Renders CM, Valk GD, Griffin S, Wagner EH, Eijk JT, Assendelft WJ: Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings. Cochrane Database Syst Rev 2001; (1):CD001481
15.
Tsai AC, Morton SC, Mangione CM, Keeler EB: A meta-analysis of interventions to improve care for chronic illnesses. Am J Manag Care 2005; 11:478–488
16.
Krause DS: Economic effectiveness of disease management programs: a meta-analysis. Dis Manag 2005; 8:114–134
17.
Weingarten SR, Henning JM, Badamgarav E, Knight K, Hasselblad V: Interventions used in disease management programmes for patients with chronic illness: which ones work? meta-analysis of published reports. BMJ 2002; 325:925
18.
Badamgarav E, Weingarten SR, Henning JM, Knight K, Hasselblad V, Gano A, Ofman JJ: Effectiveness of disease management programs in depression: a systematic review. Am J Psychiatry 2003; 160:2080–2090
19.
Gilbody S, Bower P, Fletcher J, Richards D, Sutton AJ: Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Arch Intern Med 2006; 166:2314–2321
20.
Katon W, Unützer J, Wells K, Jones L: Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. Gen Hosp Psychiatry 2010; 32:456–464
21.
Steenbergen-Weijenburg KM, van der Feltz-Cornelis CM, Horn EK, van Marwijk HW, Beekman AT, Rutten FH, Hakkaart-van Roijen L: Cost-effectiveness of collaborative care for the treatment of major depressive disorder in primary care: a systematic review. BMC Health Serv Res 2010; 10:19
22.
Kessler RC, Wang PS: The descriptive epidemiology of commonly occurring mental disorders in the United States. Ann Rev Public Health 2008; 29:115–129
23.
Parks J, Svendsen D, Singer P, Foti ME: Morbidity and Mortality in People with Serious Mental Illness. Alexandria, Va, National Association of State Mental Health Program Directors, 2006
24.
Yatham LN, Kennedy SH, O'Donovan C, Parikh SV, MacQueen G, McIntyre RS, Sharma V, Beaulieu S: Canadian Network for Mood and Anxiety Treatments (CANMAT) guidelines for the management of patients with bipolar disorder: update 2007. Bipolar Disord 2006; 8:721–739
25.
Department of Veterans Affairs & Department of Defense: Clinical Practice Guideline for Management of Bipolar Disorder in Adults, version 2.0. Washington, DC, Office of Quality and Performance, US Army MEDCOM Quality Management Division, Department of Veterans Affairs, 2009
26.
Hogan MF: New Freedom Commission report: The president's New Freedom Commission: recommendations to transform mental health care in America. Psychiatr Serv 2003; 54:1467–1474
27.
Krahn DD, Bartels SJ, Coakley E, Oslin DW, Chen H, McIntyre J, Chung H, Maxwell J, Ware J, Levkoff SE: PRISM-E: comparison of integrated care and enhanced specialty referral models in depression outcomes. Psychiatr Serv 2006; 57:946–953
28.
Phillips SD, Burns BJ, Edgar ER, Mueser KT, Linkins KW, Rosenheck RA, Drake RE, McDonel Herr EC: Moving assertive community treatment into standard practice. Psychiatr Serv 2001; 52:771–779
29.
Bauer MS: A review of quantitative studies of adherence to mental health clinical practice guidelines. Harv Rev Psychiatry 2002; 10:138–153
30.
Schröder FH, Hugosson J, Roobol MJ, Tammela TL, Ciatto S, Nelen V, Kwiatkowski M, Lujan M, Lilja H, Zappa M, Denis LJ, Recker F, Berenguer A, Määttänen L, Bangma CH, Aus G, Villers A, Rebillard X, van der Kwast T, Blijenberg BG, Moss SM, de Koning HJ, Auvinen A; ERSPC investigators: Screening and prostate-cancer mortality in a randomized European study. N Engl J Med 2009; 360:1320–1328
31.
Andriole GL, Crawford ED, Grubb RL, Buys SS, Chia D, Church TR, Fouad MN, Gelmann EP, Kvale PA, Reding DJ, Weissfeld JL, Yokochi LA, O'Brien B, Clapp JD, Rathmell JM, Riley TL, Hayes RB, Kramer BS, Izmirlian G, Miller AB, Pinsky PF, Prorok PC, Gohagan JK, Berg CD; PLCO Project team: Mortality results from a randomized prostate-cancer screening trial. N Engl J Med 2009; 360:1310–1319
32.
Barry MJ: Screening for prostate cancer: the controversy that refuses to die. N Engl J Med 2009; 360:1351–1354
33.
Cohen J: Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ, Lawrence Erlbaum Associates, 1988
34.
DerSimonian R, Laird N: Meta-analysis in clinical trials. Control Clin Trials 1986, 7:177–188
35.
Bradburn MJ, Deeks JJ, Altman DG: METAN: a command for meta-analysis in Stata, in Meta-Analysis in Stata: An Updated Collection from the Stata Journal. Edited by, Sterne JAC. College Station, Tex, Stata Press, 2009
36.
Begg C: Publication bias, in The Handbook of Research Synthesis. Edited by, Cooper H. New York, Russell Sage Publications, 1995, pp 399–409
37.
Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L: Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. J Clin Epidemiol 2008; 61:991–996
38.
Leichsenring F, Rabung S: Effectiveness of long-term psychodynamic psychotherapy: a meta-analysis. JAMA 2008; 300:1551–1565
39.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol 2009; 62:e1–e34
40.
Callahan CM, Hendrie HC, Dittus RS, Brater DC, Hui SL, Tierney WM: Improving treatment of late life depression in primary care: a randomized clinical trial. J Am Geriatr Soc 1994; 42:839–846
41.
Katon W, Von Korff M, Lin E, Walker E, Simon GE, Bush T, Robinson P, Russo J: Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA 1995; 273:1026–1031
42.
Katon W, Robinson P, Von Korff M, Lin E, Bush T, Ludman E, Simon G, Walker E: A multifaceted intervention to improve treatment of depression in primary care. Arch Gen Psychiatry 1996; 53:924–932
43.
Mann AH, Blizard J, Murray J, Smith JA, Botega N, Macdonald E, Wilkinson G: An evaluation of practice nurses working with general practitioners to treat people with depression. Br J Gen Med 1998; 48:875–879
44.
Katon W, Von Korff M, Lin E, Simon G, Walker E, Unützer J, Bush T, Russo J, Ludman E: Stepped collaborative care for primary care patients with persistent symptoms of depression: a randomized trial. Arch Gen Psychiatry 1999; 56:1109–1115
45.
Katzelnick DJ, Simon GE, Pearson SD, Manning WG, Helstad CP, Henk HJ, Cole SM, Lin EH, Taylor LH, Kobak KA: Randomized trial of a depression management program in high utilizers of medical care. Arch Fam Med 2000; 9:345–351
46.
Simon GE, Von Korff M, Rutter C, Wagner E: Randomized trial of monitoring, feedback, and management of care by telephone to improve treatment of depression in primary care. Br Med J 2000; 320:550–554
47.
Wells KB, Sherbourne C, Schoenbaum M, Duan N, Meredith L, Unützer J, Miranda J, Carney MF, Rubenstein LV: Impact of disseminating quality improvement programs for depression in managed primary care: a randomized controlled trial. JAMA 2000; 283:212–220
48.
Katon W, Rutter C, Ludman EJ, Von Korff M, Lin E, Simon G, Bush T, Walker E, Unützer J: A randomized trial of relapse prevention of depression in primary care. Arch Gen Psychiatry 2001; 58:241–247
49.
Rost K, Nutting P, Smith J, Werner J, Duan N: Improving depression outcomes in community primary care practice. J Gen Int Med 2001; 16:143–149
50.
Simon GE, Manning WG, Katzelnick DJ, Pearson SD, Henk HJ, Helstad CP: Cost-effectiveness of systematic depression treatment for high utilizers of general medical care. Arch Gen Psychiatry 2001; 58:181–187
51.
Unützer J, Katon W, Callahan CM, Williams JW, Hunkeler E, Harpole L, Hoffing M, Della Penna RD, Noël PH, Lin EH, Areán PA, Hegel MT, Tang L, Belin TR, Oishi S, Langston C; IMPACT Investigators: Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA 2002; 288:2836–2845
52.
Araya R, Rojas G, Fritsch R, Gaete J, Rojas M, Simon G, Peters TJ: Treating depression in primary care in low-income women in Santiago, Chile: a randomized controlled trial. Lancet 2003; 361:995–1000
53.
Datto CJ, Thompson R, Horowtiz D, Disbot M, Oslin DW: The pilot study of a telephone disease management program for depression. Gen Hosp Psychiatry 2003; 25:169–177
54.
Hedrick SC, Chaney EF, Felker B, Liu CF, Hasenberg N, Heagerty P, Buchanan J, Bagala R, Greenberg D, Paden G, Fihn SD, Katon W: Effectiveness of collaborative care depression treatment in Veterans Affairs primary care. J Gen Intern Med 2003; 18:9–16
55.
Swindle RW, Rao JK, Helmy A, Plue L, Zhou XH, Eckert GJ, Weinberger M: Integrating clinical nurse specialists into the treatment of primary care patients with depression. Int J Psychiatry Med 2003; 33:17–37
56.
Adler DA, Bungay KM, Wilson IB, Pei Y, Supran S, Peckham E, Cynn DJ, Rogers WH: The impact of a pharmacist intervention on 6-month outcomes in depressed primary care patients. Gen Hosp Psychiatry 2004; 26:199–209
57.
Bruce ML, Ten Have TR, Reynolds CF, Katz II, Schulberg HC, Mulsant BH, Brown GK, McAvay GJ, Pearson JL, Alexopoulos GS: Reducing suicidal ideation and depressive symptoms in depressed older primary care patients: a randomized controlled trial. JAMA 2004; 291:1081–1091
58.
Capoccia KL, Boudreau DM, Blough DK, Ellsworth AJ, Clark DR, Stevens NG, Katon WJ, Sullivan SD: Randomized trial of pharmacist intervention to improve depression care and outcomes in primary care. Am J Health Syst Pharm 2004; 61:364–372
59.
Dietrich AJ, Oxman TE, Williams JW, Schulberg HC, Bruce ML, Lee PW, Barry S, Raue PJ, Lefever JJ, Heo M, Rost K, Kroenke K, Gerrity M, Nutting PA: Re-engineering systems for the treatment of depression in primary care: cluster randomised controlled trial. BMJ 2004; 329:602
60.
Katon WJ, Von Korff M, Lin EH, Simon G, Ludman E, Russo J, Ciechanowski P, Walker E, Bush T: The Pathways Study: a randomized trial of collaborative care in patients with diabetes and depression. Arch Gen Psychiatry 2004; 61:1042–1049
61.
Simon GE, Ludman EJ, Tutty S, Operskalski B, Korff MV: Telephone psychotherapy and telephone care management for primary care patients starting antidepressant treatment: a randomized controlled trial. JAMA 2004; 292:935–942
62.
Trivedi MH, Rush AJ, Crismon ML, Kashner TM, Toprac MG, Carmody TJ, Key T, Biggs MM, Shores-Wilson K, Witte B, Suppes T, Miller AL, Altshuler KZ, Shon SP: Clinical results for patients with major depressive disorder in the Texas Medication Algorithm Project. Arch Gen Psychiatry 2004; 61:669–680
63.
Asarnow JR, Jaycox LH, Duan N, LaBorde AP, Rea MM, Murray P, Anderson M, Landon C, Tang L, Wells KB: Effectiveness of a quality improvement intervention for adolescent depression in primary care clinics: a randomized controlled trial. JAMA 2005; 293:311–319
64.
Dwight-Johnson M, Ell K, Lee PJ: Can collaborative care address the needs of low-income Latinas with comorbid depression and cancer? results from a randomized pilot study. Psychosomatics 2005; 46:224–232
65.
Obscha SK, Corson K, Hickam DH, Perrin NA, Kraemer DF, Gerrity MS: Depression decision support in primary care: a cluster randomized trial. Ann Intern Med 2006; 145:477–487
66.
Simon GE, Ludman EJ, Operskalski BH: Randomized trial of a telephone care management program for outpatients starting antidepressant treatment. Psychiatr Serv 2006; 57:1441–1445
67.
Fortney JC, Pyne JM, Edlund MJ, Williams DK, Robinson DE, Mittal D, Henderson KL: A randomized trial of telemedicine-based collaborative care for depression. J Gen Intern Med 2007; 22:1086–1093
68.
Ell K, Xie B, Quon B, Quinn DI, Dwight-Johnson M, Lee PJ: Randomized controlled trial of collaborative care management of depression among low-income patients with cancer. J Clin Oncol 2008; 26:4488–4496
69.
Richards DA, Lovell K, Gilbody S, Gask L, Torgerson D, Barkham M, Bland M, Bower P, Lankshear AJ, Simpson A, Fletcher J, Escott D, Hennessy S, Richardson R: Collaborative care for depression in UK primary care: a randomized controlled trial. Psychol Med 2008; 38:279–287
70.
Ross JT, Ten Have T, Eakin AC, Difilippo S, Oslin DW: A randomized controlled trial of a close monitoring program for minor depression and distress. J Gen Intern Med 2008; 23:1379–1385
71.
Kroenke K, Bair MJ, Damush TM, Wu J, Hoke S, Sutherland J, Tu W: Optimized antidepressant therapy and pain self-management in primary care patients with depression and musculoskeletal pain: a randomized control trial. JAMA 2009; 301:2099–2110
72.
Rollman BL, Belnap BH, LeMenager MS, Mazumdar S, Houck PR, Counihan PJ, Kapoor WN, Schulberg HC, Reynolds CF: Telephone-delivered collaborative care for treating post-CABG depression: a randomized controlled trial. JAMA 2009; 302:2095–2103
73.
Davidson KW, Rieckmann N, Clemow L, Schwartz JE, Shimbo D, Medina V, Albanese G, Kronish I, Hegel M, Burg MM: Enhanced depression care for patients with acute coronary syndrome and persistent depressive symptoms: coronary psychosocial evaluation studies randomized controlled trial. Arch Intern Med 2010; 170:600–608
74.
Ell K, Katon W, Xie B, Lee PJ, Kapetanovic S, Guterman J, Chou CP: Collaborative care management of major depression among low-income, predominantly Hispanic subjects with diabetes. Diabetes Care 2010; 33:706–713
75.
Katon WJ, Lin EH, Von Korff M, Ciechanowski P, Ludman EJ, Young B, Peterson D, Rutter CM, McGregor M, McCulloch D: Collaborative care for patients with depression and chronic illnesses. N Engl J Med 2010; 363:2611–2620
76.
Vera M, Perez-Pedrogo C, Huertas SE, Reyes-Rabanillo ML, Juarbe D, Huertas A, Reyes-Rodriguez ML, Chaplin W: Collaborative care for depressed patients with chronic medical conditions: a randomized trial in Puerto Rico. Psychiatr Serv 2010; 61:144–150
77.
Yeung A, Shyu I, Fisher L, Wu S, Yang H, Fava M: Culturally sensitive collaborative treatment for depressed Chinese Americans in primary care. Am J Public Health 2010; 100:2397–2402
78.
Suppes T, Rush AJ, Dennehy EB, Crismon ML, Kashner TM, Toprac MG, Carmody TJ, Brown ES, Biggs MM, Shores-Wilson K, Witte BP, Trivedi MH, Miller AL, Altshuler KZ, Shon SP; Texas Medication Algorithm Project: Texas Medication Algorithm Project, phase 3 (TMAP-3): clinical results for patients with a history of mania. J Clin Psychiatry 2003; 64:370–382
79.
Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, Beresford T, Kilbourne AM, Sajatovic M; Cooperative Studies Program 430 Study Team: Collaborative care for bipolar disorder, part II: impact on clinical outcome, function, and costs. Psychiatr Serv 2006; 57:937–945
80.
Simon GE, Ludman EJ, Bauer MS, Unutzer J, Operskalski B: Long-term effectiveness and cost of a systematic care program for bipolar disorder. Arch Gen Psychiatry 2006; 63:500–508
81.
Kilbourne AM, Post EP, Nossek A, Drill L, Cooley S, Bauer MS: Improving medical and psychiatric outcomes among individuals with bipolar disorder: a randomized controlled trial. Psychiatr Serv 2008; 59:760–768
82.
Rollman BL, Belnap BH, Mazumdar S, Houck PR, Zhu F, Gardner W, Reynolds CF, Schulberg HC, Shear MK: A randomized trial to improve the quality of treatment for panic and generalized anxiety disorders in primary care. Arch Gen Psychiatry 2005; 62:1332–1341
83.
Roy-Byrne P, Stein MB, Russo J, Craske M, Katon W, Sullivan G, Sherbourne C: Medical illness and response to treatment in primary care panic disorder. Gen Hosp Psychiatry 2005; 27:237–243
84.
Roy-Byrne P, Craske MG, Sullivan G, Rose RD, Edlund MJ, Lang AJ, Bystritsky A, Welch SS, Chavira DA, Golinelli D, Campbell-Sills L, Sherbourne CD, Stein MB: Delivery of evidence-based treatment for multiple anxiety disorders in primary care. JAMA 2010; 303:1921–1928
85.
Coleman EA, Grothaus LC, Sandhu N, Wagner EH: Chronic care clinics: a randomized controlled trial of a new model of primary care for frail older adults. J Am Geriatr Soc 1999; 47:775–785
86.
Druss BG, Rohrbaugh RM, Levinson CM, Rosenheck RA: Integrated medical care for patients with serious psychiatric illness: a randomized trial. Arch Gen Psychiatry 2001; 58:861–868
87.
Oslin DW, Sayers S, Ross J, Kane V, Ten Have T, Conigliaro J, Cornelius J: Disease management for depression and at-risk drinking via telephone in an older population of veterans. Psychosom Med 2003; 65:931–937
88.
Zatzick D, Roy-Byrne P, Russo J, Rivara F, Droesch R, Wagner A, Dunn C, Jurkovich G, Uehara E, Katon W: A randomized effectiveness trial of stepped collaborative care for acutely injured trauma survivors. Arch Gen Psychiatry 2004; 61:498–506
89.
Callahan CM, Boustani MA, Unverzagt FW, Austrom MG, Damush TM, Perkins AJ, Fultz BA, Hui SL, Counsell SR, Hendrie HC: Effectiveness of collaborative care for older adults with Alzheimer disease in primary care: a randomized controlled trial. JAMA 2006; 295:2148–2157
90.
Smith RC, Lyles JS, Gardiner JC, Sirbu C, Hodges A, Collins C, Dwamena FC, Lein C, William Given C, Given B, Goddeeris J: Primary care clinicians treat patients with medically unexplained symptoms: a randomized controlled trial. J Gen Intern Med 2006; 21:671–677
91.
Van Straten A, Tiemens B, Hakkaart L, Nolen WA, Donker MC: Stepped care vs matched care for mood and anxiety disorders: a randomized trial in routine practice. Acta Psychiatr Scand 2006; 113:468–476
92.
van Orden M, Hoffman T, Haffmans J, Spinhoven P, Hoencamp E: Collaborative mental health care versus care as usual in a primary care setting: a randomized controlled trial. Psychiatr Serv 2009; 60:74–79
93.
Druss BG, von Esenwein SA, Compton MT, Rask KJ, Zhao L, Parker RM: A randomized trial of medical care management for community mental health settings: the Primary Care Access, Referral, and Evaluation (PCARE) study. Am J Psychiatry 2010; 167:151–159
94.
Patel V, Weiss HA, Chowdhary N, Naik S, Pednekar S, Chatterjee S, De Silva MJ, Bhat B, Araya R, King M, Simon G, Verdeli H, Kirkwood BR: Effectiveness of an intervention led by lay health counselors for depressive and anxiety disorders in primary care in Goa, India (MANAS): a cluster randomised controlled trial. Lancet 2010; 376:2086–2095
95.
Simon GE, Katon W, Rutter C, Von Korff M, Lin E, Robinson P, Bush T, Walker EA, Ludman E, Russo J: Impact of improved depression treatment in primary care on daily functioning and disability. Psychol Med 1998; 28:693–701
96.
Von Korff M, Katon W, Bush T, Lin EH, Simon GE, Saunders K, Ludman E, Walker E, Unutzer J: Treatment costs, cost offset, and cost-effectiveness of collaborative management of depression. Psychosom Med 1998; 60:143–149
97.
Lin EH, Simon GE, Katon WJ, Russo JE, Von Korff M, Bush TM, Ludman EJ, Walker EA: Can enhanced acute-phase treatment of depression improve long-term outcomes? a report of randomized trials in primary care. Am J Psychiatry 1999; 156:643–645
98.
Lin EH, Von Korff M, Russo J, Katon W, Simon GE, Unützer J, Bush T, Walker E, Ludman E: Can depression treatment in primary care reduce disability? a stepped care approach. Arch Fam Med 2000; 9:1052–1058
99.
Katon WJ, Roy-Byrne P, Russo J, Cowley D: Cost-effectiveness and cost offset of a collaborative care intervention for primary care patients with panic disorder. Arch Gen Psychiatry 2002; 59:1098–1104
100.
Simon GE, Katon WJ, Von Korff M, Unützer J, Lin EH, Walker EA, Bush T, Rutter C, Ludman E: Cost-effectiveness of a collaborative care program for primary care patients with persistent depression. Am J Psychiatry 2001; 158:1638–1644
101.
Sherbourne CD, Wells KB, Duan N, Miranda J, Unützer J, Jaycox L, Schoenbaum M, Meredith LS, Rubenstein LV: Long-term effectiveness of disseminating quality improvement for depression in primary care. Arch Gen Psychiatry 2001; 58:696–703
102.
Schoenbaum M, Unützer J, Sherbourne C, Duan N, Rubenstein LV, Miranda J, Meredith LS, Carney MF, Wells K: Cost-effectiveness of practice-initiated quality improvement for depression: results of a randomized controlled trial. JAMA 2001; 286:1325–1330
103.
Wells K, Sherbourne C, Schoenbaum M, Ettner S, Duan N, Miranda J, Unützer J, Rubenstein L: Five-year impact of quality improvement for depression: results of a group-level randomized controlled trial. Arch Gen Psychiatry 2004; 61:378–386
104.
Simon GE, Von Korff M, Ludman EJ, Katon WJ, Rutter C, Unützer J, Lin EH, Bush T, Walker E: Cost-effectiveness of a program to prevent depression relapse in primary care. Med Care 2002; 40:941–950
105.
Pyne JM, Smith J, Fortney J, Zhang M, Williams DK, Rost K: Cost-effectiveness of a primary care intervention for depressed females. J Affect Disord 2003; 74:23–32
106.
Rost K, Smith JL, Dickinson M: The effect of improving primary care depression management on employee absenteeism and productivity: a randomized trial. Med Care 2004; 42:1202–1210
107.
Callahan CM, Kroenke K, Counsell SR, Hendrie HC, Perkins AJ, Katon W, Noel PH, Harpole L, Hunkeler EM, Unützer J; IMPACT Investigators: Treatment of depression improves physical functioning in older adults. J Am Geriatr Soc 2005; 53:367–373
108.
Unützer J, Katon WJ, Fan MY, Schoenbaum MC, Lin EH, Della Penna RD, Powers D: Long-term cost effects of collaborative care for late-life depression. Am J Manag Care 2008; 14:95–100
109.
Araya R, Flynn T, Rojas G, Fritsch R, Simon G: Cost-effectiveness of a primary care treatment program for depression in low-income women in Santiago, Chile. Am J Psychiatry 2006; 163:1379–1387
110.
Liu CF, Hedrick SC, Chaney EF, Heagerty P, Felker B, Hasenberg N, Fihn S, Katon W: Cost-effectiveness of collaborative care for depression in a primary care veteran population. Psychiatr Serv 2003; 54:698–704
111.
Bogner HR, Morales KH, Post EP, Bruce ML: Diabetes, depression, and death: a randomized controlled trial of a depression treatment program for older adults based in primary care (PROSPECT). Diabetes Care 2007; 30:3005–3010
112.
Alexopoulos GS, Reynolds CF, Bruce ML, Katz IR, Raue PJ, Mulsant BH, Oslin DW, Ten Have T; PROSPECT Group: Reducing suicidal ideation and depression in older primary care patients: 24-month outcomes of the PROSPECT study. Am J Psychiatry 2009; 166:882–890
113.
Simon GE, Katon WJ, Lin EH, Rutter C, Manning WG, Von Korff M, Ciechanowski P, Ludman EJ, Young BA: Cost-effectiveness of systematic depression treatment among people with diabetes mellitus. Arch Gen Psychiatry 2007; 64:65–72
114.
Ludman EJ, Simon GE, Tutty S, Von Korff M: A randomized trial of telephone psychotherapy and pharmacotherapy for depression: continuation and durability of effects. J Consult Clin Psychol 2007; 75:257–266
115.
Simon GE, Ludman EJ, Rutter CM: Incremental benefit and cost of telephone care management and telephone psychotherapy for depression in primary care. Arch Gen Psychiatry 2009; 66:1081–1089
116.
Pyne JM, Fortney JC, Tripathi SP, Maciejewski ML, Edlund MJ, Williams DK: Cost-effectiveness analysis of a rural telemedicine collaborative care intervention for depression. Arch Gen Psychiatry 2010; 67:812–821
117.
Katon W, Russo J, Sherbourne C, Stein MB, Craske M, Fan MY, Roy-Byrne P: Incremental cost-effectiveness of a collaborative care intervention for panic disorder. Psychol Med 2006; 36:353–363
118.
Bauer MS, McBride L, Williford WO, Glick H, Kinosian B, Altshuler L, Beresford T, Kilbourne AM, Sajatovic M; Cooperative Studies Program 430 Study Team: Collaborative care for bipolar disorder, part I: intervention and implementation in a randomized effectiveness trial. Psychiatr Serv 2006; 57:927–936
119.
Willenbring ML, Olson DH: A randomized trial of integrated outpatient treatment for medically ill alcoholic men. Arch Intern Med 1999; 159:1946–1952
120.
Weisner C, Mertens J, Parthasarathy S, Moore C, Lu Y: Integrating primary medical care with addiction treatment: a randomized controlled trial. JAMA 2001; 286:1715–1723
121.
Parthasarathy S, Mertens J, Moore C, Weisner C: Utilization and cost impact of integrating substance abuse treatment and primary care. Med Care 2003; 41:357–367
122.
Samet JH, Larson MJ, Horton NJ, Doyle K, Winter M, Saitz R: Linking alcohol- and drug-dependent adults to primary medical care: a randomized controlled trial of a multi-disciplinary health intervention in a detoxification unit. Addiction 2003; 98:509–516
123.
Saxon AJ, Malte CA, Sloan KL, Baer JS, Calsyn DA, Nichol P, Chapko MK, Kivlahan DR: Randomized trial of on-site versus referral primary medical care for veterans in addictions treatment. Med Care 2006; 44:334–342
124.
McGuire J, Gelberg L, Blue-Howells J, Rosenheck RA: Access to primary care for homeless veterans with serious mental illness or substance abuse: a follow-up evaluation of co-located primary care and homeless social services. Adm Policy Ment Health 2009; 36:255–264
125.
Miller AL, Crismon ML, Rush AJ, Chiles J, Kashner TM, Toprac M, Carmody T, Biggs M, Shores-Wilson K, Chiles J, Witte B, Bow-Thomas C, Velligan DI, Trivedi M, Suppes T, Shon S: The Texas Medication Algorithm Project: clinical results for schizophrenia. Schizophr Bull 2004; 30:627–647
126.
Davis TD, Deen T, Bryant-Bedell K, Tate V, Fortney J: Does minority racial-ethnic status moderate outcomes of collaborative care for depression? Psychiatr Serv 2011; 62:1282–1288
127.
Kilbourne AM, Biswas K, Pirraglia PA, Sajatovic M, Williford WO, Bauer MS: Is the collaborative chronic care model effective for complex patients with bipolar disorder? analyzing treatment moderators in an effectiveness trial. J Affect Disord 2009; 112:256–261
128.
Luck J, Hagigi F, Parker LE, Yano EM, Rubenstein LV, Kirchner JE: A social marketing approach to implementing evidence-based practice in VHA QUERI: the TIDES depression collaborative care model. Implement Sci 2009; 4:64
129.
Blevins D, Farmer MS, Edlund C, Sullivan G, Kirchner JE: Collaborative research between clinicians and researchers: a multiple case study of implementation. Implement Sci 2010; 5:76
130.
Bauer AM, Azzone V, Goldman HH, Alexander L, Unützer J, Coleman-Beatie B, Frank RG: Implementation of collaborative depression management at community-based primary care clinics: an evaluation. Psychiatr Serv 2011; 62:1047–1053
131.
Kilbourne AM, Neumann MS, Pincus HA, Bauer MS, Stall R: Implementing evidence-based interventions in health care: application of the replicating effective programs framework. Implement Sci 2007; 2:42
132.
Bauer MS, Leader D, Un H, Lai Z, Kilbourne AM: Primary care and behavioral health practice size: the challenge for health care reform. Med Care (in press)
133.
US Department of Health and Human Services: Multiple Chronic Conditions: A Strategic Framework: Optimum Health and Quality of Life for Individuals with Multiple Chronic Conditions. Washington, DC, Department of Health and Human Services, 2010
134.
Bartels SJ, Forester B, Miles KM, Joyce T: Mental health service use by elderly patients with bipolar disorder and unipolar major depression. Am J Geriatr Psychiatry 2000; 8:160–166
135.
Sajatovic M, Blow FC, Ignacio RV, Kales HC: Age-related modifiers of clinical presentation and health service use among veterans with bipolar disorder. Psychiatr Serv 2004; 55:1014–1021
136.
Polsky D, Doshi JA, Bauer MS, Glick HA: Clinical trial-based cost-effectiveness analyses of antipsychotic use. Am J Psychiatry 2006; 163:2047–2056
137.
Solberg LI, Glasgow RE, Unützer J, Jaeckels N, Oftedahl G, Beck A, Maciosek MV, Crain AL: Partnership research: a practical trial design for evaluation of a natural experiment to improve depression care. Med Care 2010; 48:576–582
138.
Bao Y, Casalino LP, Ettner SL, Bruce ML, Solberg LI, Unutzer J: Designing payment for collaborative care for depression in primary care. Health Serv Res 2011; 46:1436–1451
139.
Emanuel EJ: Where are the health care cost savings? JAMA 2012; 307:39–40

Information & Authors

Information

Published In

History

Published online: 1 October 2013
Published in print: Fall 2013

Authors

Details

Andrew Grogan-Kaylor, Ph.D.
Amy M. Kilbourne, Ph.D.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - Focus

PPV Articles - Focus

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share