Development of the National Network of Depression Centers Mood Outcomes Program: A Multisite Platform for Measurement-Based Care
Abstract
Objectives:
Mood disorders are among the most burdensome public health concerns. The National Network of Depression Centers (NNDC) is a nonprofit consortium of 26 leading clinical and academic member centers in the United States providing care for patients with mood disorders, including depression and bipolar disorder. The NNDC has established a measurement-based care program called the Mood Outcomes Program whereby participating sites follow a standard protocol to electronically collect patient-reported outcome assessments on depression, anxiety, and suicidal ideation in routine clinical care. This article describes the approaches taken to develop and implement the program.
Methods:
Since 2015, eight pilot sites have implemented the program and followed more than 10,000 patients. This pilot study presents descriptive statistics based on the first 24-month period of data collection.
Results:
In this sample, 58.6% of patients with bipolar disorder (N=849) and 57.5% of patients with unipolar depression (N=3,998) remained symptomatic at follow-up. Lifetime rates of planned or actual suicide attempts were high, ranging from 27.6% for patients with unipolar mood disorders to 33.5% for patients with bipolar disorder. Men, unmarried individuals, and those with comorbid anxiety had a poorer longitudinal course. This initial snapshot of clinical burden is consistent with public health data indicating that mood disorders are severely debilitating.
Conclusions:
This study demonstrates the potential of the Mood Outcomes Program to create a nationwide “learning health system” for mood disorders. This goal will be further realized as the program expands in reach and scope across additional NNDC sites.
HIGHLIGHTS
•
The National Network of Depression Centers is implementing a measurement-based care program to capture standardized patient-reported outcome assessments at each clinic visit as part of routine care.
•
The goal of the measurement-based care program is to improve patient outcomes and establish a foundation for creating a nationwide "learning health system" for mood disorders.
•
A pilot phase of the program has been completed demonstrating its feasibility, and over 10,000 patients have been enrolled across eight pilot sites.
Mood disorders are among the most burdensome public health concerns in the world. The lifetime prevalence of major depression in the United States is 13% to 17% (1, 2), and the World Health Organization (WHO) has ranked major depression among the most disabling disorders on the globe (3). Depression is strongly associated with suicide, particularly in populations at high risk, such as veterans, elderly persons, and those struggling with chronic pain (4, 5). Management of depression in medical specialty care is also critical because depression is strongly associated with morbidity and nonsuicide mortality in chronic conditions such as heart disease and diabetes (6, 7). Mrazek and associates (8) estimated that treatment-resistant depression occurs in 12% to 20% of cases and incurs an annual added societal cost of $29 to $48 billion.
There has been progress during the past 5 decades in improving pharmacologic and psychotherapy treatments of mood disorders. However, despite these gains, the etiology of these disorders remains poorly understood. As a result, patients and providers must often work through multiple medication trials before finding an effective treatment and achieving remission. The Sequenced Treatment Alternatives to Relieve Depression (STAR*D) trial found that only 37% of patients responded to the first antidepressant prescribed, and up to four medication changes were needed to achieve a 67% response rate overall (9–11). Sustaining wellness then becomes an incremental challenge.
New approaches are needed to develop personalized treatments that are tailored to the specific needs of individual patients and can achieve more effective and timely remission and maintenance of wellness. Such precision treatments require improved understanding of the multifactorial etiologies and longitudinal course of these complex disorders. To help meet this challenge, large, well-characterized samples of patients with extended follow-up over time are needed to identify more meaningful clinical phenotypes and their underlying biological substrates. Within the United States, the medical communities surrounding cancer and heart disease have successfully developed longitudinal patient cohorts and registries. For example, the Framingham Heart Study (12–15) and registry programs sponsored by the National Heart, Lung, and Blood Institute (16) and the National Cancer Institute (17) have contributed clinical insights that are transforming these formerly acute illnesses with high mortality into chronic illnesses with remarkable recovery, survivorship, and improved functioning.
Comparable efforts are needed to produce similar gains for the millions receiving treatment for mood disorders in psychiatric and primary care settings (18). Nordic and Asian countries have developed longitudinal registries of psychiatric disorders, based on information collected in the context of their national health services (19–22), but the United States does not have a comparable health care infrastructure, making it challenging to support similar nationwide registries. The closest the U.S. has to such registries are efforts to study clinical data from large health systems, such as the Mental Health Research Network (23) or the Veterans Health Administration (5, 24). Longitudinal cohort studies of individuals recruited for research aims, such as the Collaborative Study of Depression (25–27) or the aforementioned STAR*D trial (10) have also contributed enormous insights into mood disorders. However, these studies focused on selected populations, or the sample sizes of these studies were limited because of the logistical challenges and costs of ongoing monitoring. The NIH recently initiated the “All of Us” research program (28), which seeks to overcome the limitation of small sample sizes by establishing a prospective cohort of more than 1 million. However, the depth of clinical information that will be gathered on mental illnesses in this project is unclear.
In the United States, the recent proliferation of electronic health records and physician quality reporting systems tied to the Affordable Care Act (ACA) and the subsequent Medicare Access and CHIP Reauthorization Act (MACRA) (29) have promoted development of a nationwide information technology (IT) infrastructure. Major electronic health record vendors support electronic capture of patient characteristics and health care utilization. Perhaps more important, current mature electronic health records enable electronic assessment of key patient-reported outcomes to inform and help guide clinical decision making and measurement-based care. This infrastructure has the potential to support identification and longitudinal monitoring of patients with mood disorders in real-world clinical contexts. Clinicians can then learn what works best for these patients while providing care and, in iterations, continuously improve the care overall in what is referred to as a “learning health system” (30, 31).
The National Network of Depression Centers (NNDC), founded in 2008, is a nationwide nonprofit consortium of 26 leading clinical and academic member centers in the United States (32). Its overarching mission is to integrate innovative research, clinical translation, education, and public policy to better diagnose and treat depression, bipolar disorder, and related mood disorders. In service of these goals, the NNDC is currently implementing the Mood Outcomes Program whereby participating sites follow a standard protocol to collect patient-reported outcomes in the context of routine clinical care. This systematic data collection is intended to enable measurement-based care (33–35) that can enhance patient and provider decision making at the point of care and has been shown to be effective in improving overall patient outcomes (33). The collected data are then deidentified and gathered from multiple sites into a central repository that can support population health analytics and quality improvement initiatives to define best practices and aid the development of precision health care. The repository also provides a platform for carrying out multisite research through secondary data analyses or embedded studies, such as pragmatic clinical trials. In this way, the Mood Outcomes Program will provide the crucial infrastructure for a nationwide learning health system on mood disorders that can drive sustained improvement in patient outcomes.
This article describes the development of the Mood Outcomes Program as the standard of care in the NNDC and reports on a pilot study of the program at eight NNDC sites. This overview presents descriptive statistics based on the first 24-month period of data collection within the pilot sites. These data are presented to demonstrate the feasibility of collaborative data collection for the creation of a large clinical repository. As the program is expanded and disseminated across all NNDC sites, we anticipate, the repository will be able to support analyses that take advantage of ever more powerful data.
Methods
The planning and development of the Mood Outcomes Program began in 2011 and entailed the following steps: agreeing on the patient-reported outcome measures; specifying clinical workflows for administering these measures; building an IT platform to collect the measures, visualize the results in real time, and share deidentified data with the national repository; and establishing regulatory compliance and data use policies for continuous learning from the data. A pilot of the program was then initiated in 2015 and carried out in eight participating NNDC sites.
Patient-Reported Outcome Measures
Starting in 2011, a group of 20 NNDC members conducted a series of phone conference meetings to discuss and develop consensus on a battery of longitudinal rating measures to be collected as “vital signs” for a new measurement-based care program for patients with mood disorders (36). This became known as the Standard Assessment Package. The aim was to develop a reliable, valid, brief, cost-free, self-rated, standardized, and repeatable clinical tool, not just an extensive research battery, such as those employed in clinical trials. The goal was a tool that efficiently provides the most essential clinical information to inform point-of-care decisions. Initial clinical targets deemed most essential were severity of mood symptoms for both depression and mania, presence and severity of comorbid anxiety, and suicidal ideation/risk.
Balancing these considerations, the following four measures were selected: the nine-item Patient Health Questionnaire (PHQ‐9) (37, 38); the seven-item Generalized Anxiety Disorder Scale (GAD‐7) (39); the five-item Altman Self‐Rating Mania Scale (ASRM) (40); and the seven-item patient‐rated screener version of the Columbia‐Suicide Severity Rating Scale (C-SSRS) (41), with a baseline version to assess both recent and lifetime ideation and attempts and a follow-up version to assess ideation and attempts since the last clinic visit.
Clinical Workflows
The goal was for patients to complete the measures in the clinic waiting rooms prior to their initial and follow-up appointments and for the results to be available in real time for review with their clinicians to inform measurement-based care. The decision to collect the measures at the clinic was made for two reasons. The first was to establish a culture that emphasized the importance of routinely collecting these mental health “vital signs” at each visit as the standard of care (36). The second was to make it easier to address concerns about suicide risk. There were clinical and legal concerns about whether patients should be allowed to complete the assessments before they came to the clinics. For example, if patients were allowed to complete the assessments early, mechanisms would be needed to address situations in which a patient endorsed suicidal ideation or behavior on PHQ-9 item 9 or the CSSR-S. Such mechanisms could add a prohibitive burden to implementing the program. Beyond these requirements, sites were free to adopt whatever workflows worked best for their clinics in order to maximize program adoption.
Health IT Infrastructure
Central IT implementation.
The NNDC collaborated with the Altarum Institute, a nonprofit health informatics organization, to develop a health IT platform (called ePro) to support the implementation of the Mood Outcomes Program. The platform includes an on-line patient portal for collecting the patient-reported outcome measures and a clinician dashboard for reviewing the longitudinal results during the clinical encounter. The online patient portal allows patients to enter the self-rated scales directly into the clinical management system using tablet computers or other similar devices in the clinic waiting rooms. Procedures for setting up the patients’ accounts and logging into the portal were designed to be as simple as possible to minimize demands on support staff. Per best practices, logging in by the patient requires a unique username and password. Once the patient-reported outcome data are entered by the patient into the portal, they are available in real time for viewing by the clinician through an on-line clinician dashboard. Once providers have access to the clinician dashboard, they can quickly navigate to the appropriate patient and view the longitudinal results of the patient-reported outcome assessments in tabular form or displayed as graphs of trends over time. (A figure showing an example of the results is available in an online supplement to this article.) The graphs include annotation to flag values of clinical concern, including if the patient endorses items suggesting suicidal risk that needs to be addressed clinically. The patient-reported outcome results, including individual items, can also be copied and pasted into the patient’s medical record note if desired.
The clinical data are maintained in a multitenant database such that the clinical data from each participating site are virtually partitioned to ensure data security and patient confidentiality. This clinical database is hosted on the Altarum Secure Network, which is fully compliant with all HIPAA standards for a secure environment with an encrypted database. Data are encrypted “at rest” on the server and “in flight” during transmission between the application server and the Web browser. The data stored in this multitenant database support the clinical goals of the measurement-based care program.
The clinical data are automatically uploaded on a near real-time basis into a separate repository of clinical data called the NNDC KnowledgeBase. Data in the repository have been deidentified and support the population health analytics and research goals of the “learning health system.” The NNDC KnowledgeBase is housed in a secure partition of the Altarum Secure Network. A dedicated clinical coordination team at Altarum is responsible for managing the loading of the clinical data into the NNDC KnowledgeBase. The clinical data are deidentified by stripping away all protected health information (PHI), including the 18 designated “Safe Harbor” identifiers (42). Clinic site and patient identification numbers are anonymized, and all dates are randomly shifted using an algorithm that preserves the day of the week. The clinical coordination team at Altarum retains the crosswalk between the anonymous clinic site and patient identification numbers and any personally identifying information.
Local IT implementation.
Many sites have existing local IT platforms that they would prefer to use instead of the Altarum platform. To accommodate such preferences and maximize uptake, a local IT implementation pathway was developed for these sites. A distinct advantage of the local IT implementation pathway is that clinicians do not have to bounce between dueling systems when caring for their patients in the program, which reduces the resistance to adoption. Under the local IT implementation pathway, sites build the assessments and graphical views of the results into their local platforms. The local builds are then reviewed by the Mood Outcomes Program Steering Committee to ensure the implemented measures are consistent with NNDC standards. Once the local builds are approved, local sites upload their data into the NNDC KnowledgeBase on a quarterly basis through a data loader after the data have been suitably deidentified and transformed into the appropriate data model according to NNDC specifications.
Given that more than two-thirds of the NNDC sites use Epic as their electronic health record, the NNDC established a collaboration with Epic to build the Mood Outcomes Program assessment package within Epic’s foundation system to allow for more efficient implementation of the program at these sites. The Mood Outcomes Program assessments can be deployed to patients either through Epic’s welcome self-service check-in and registration module or MyChart (Epic’s patient portal), and the results can be viewed in graphical form by clinicians in the patient synopsis view.
Regulatory Compliance and Data Use Policies
Each NNDC site participating in the program executes a Business Associate Agreement with Altarum to manage the necessary PHI and support the clinical care functions of the program. In addition, each site consults with its institutional review board as required to contribute the clinical data to the NNDC KnowledgeBase for research purposes. Because the clinical data are collected as part of standard of care and are fully deidentified prior to inclusion in any research data set, patient consent is not obtained. This approach to consent was decided upon after extensive consultation with an advisory board that included members of the NNDC Mood Outcomes Program Steering Committee as well as several bioethics experts, institutional review board representatives, and patient advocates from NNDC sites participating in the pilot study. The approach and the discussions were greatly influenced by recent thinking about learning health systems (43, 44).
The NNDC also established a data use policy to govern access to the deidentified clinical data for research purposes. NNDC members from sites that have contributed clinical data to the Mood Outcomes Program may request access to the deidentified research data set by submitting a data request form that must be preapproved by the NNDC Mood Outcomes Steering Committee. Qualified researchers outside the NNDC may also request access to the deidentified data by submitting a data request form that must be approved by the NNDC Mood Outcomes Steering Committee, as well as the NNDC executive committee, which consists of the NNDC leadership, and, as appropriate, representatives from each member site that contributed data.
Pilot Study
Eight NNDC centers participated in the pilot study of the Mood Outcomes Program. These centers were at the University of Michigan, Johns Hopkins University, the Mayo Clinic, the University of Iowa, the University of Louisville, the University of Colorado Anschutz Medical Campus, the University of Illinois Chicago, and the Medical University of South Carolina. The Mood Outcomes Program was implemented as a standard of care at outpatient psychiatry clinics in each of these centers. Patients with a primary diagnosis of any mood disorder were included in the program, and in subsequent analyses they were classified as having either unipolar depression or bipolar disorder. Patients were older than age 18 years, and one center (Johns Hopkins University) additionally recruited patients younger than age 18 years to pilot the program in a pediatric population.
Results
The pilot study of the Mood Outcomes Program at NNDC centers began in August 2015. Figure 1 shows the rate of patient enrollment over time from initiation of the pilot to the first quarter of 2019. The network reached its target of 10,000 unique patients in December 2018. Of the eight sites that contributed data, one used Epic to implement the program and integrate the assessments into the initial evaluation of all patients in its outpatient clinics. This site contributed more than double the number of patients than the next leading site, demonstrating the advantages of the Epic implementation to facilitate adoption of the program. As a result, we anticipate more sites will adopt the Epic implementation as we continue to expand the program.
FIGURE 1. Patient enrollment in the Mood Outcomes Program in eight NNDC sites between December 2015 and the first quarter of 2019a
aNNDC, National Network of Depression Centers. The program reached its target of 10,000 unique patients in December 2018.
Table 1 presents the demographic characteristics and summary results on the Mood Outcomes Program measures at the baseline visit for patients enrolled over the first 24-month period of data collection, broken down by bipolar disorder (N=849) versus unipolar depression (N=3,998). The sample is predominantly female, reflecting closely the two-to-one gender ratio reported in both treated and community samples for unipolar mood disorders. Both diagnostic subgroups were middle-aged on average, with a mean age of 42.9±15.7 years for those with bipolar disorder and 40.2±16.4 years for those with unipolar depression.
| Bipolar disorder (N=849)b | Unipolar depression (N=3,998)b | |||
|---|---|---|---|---|
| Characteristic or measure | N | % | N | % |
| Age (M±SD) | 42.9±15.7 | 40.2±16.4 | ||
| Female | 522 | 61.5 | 2,707 | 67.7 |
| PHQ-9 score (M±SD)c | 11.2±7.2 | 12.3±7.1 | ||
| GAD-7 score (M±SD)d | 9.5±6.5 | 10.5±6.4 | ||
| ASRM score (M±SD)e | 3.5±3.6 | 2.7±2.9 | ||
| Suicidal ideation or behavior | ||||
| Lifetime planned or attempted suicidef | 284 | 33.5 | 1,103 | 27.6 |
| Positive response to item 9 of the PHQ-9g | 254 | 29.9 | 1,339 | 33.5 |
a
Baseline is defined as the first available measure for each patient after enrollment in the Mood Outcomes Program. All patients were enrolled for the entire first 24 months of the program.
b
Comparisons by diagnosis of all sample characteristics and baseline symptom measures were significantly different at p<.01.
c
PHQ-9, Patient Health Questionnaire–9. Possible scores range from 0 to 27, with higher scores indicating increased symptom severity for depression.
d
GAD-7, General Anxiety Disorder–7. Possible scores range from 0 to 21, with higher scores indicating increased symptom severity for anxiety.
e
ASRM, Altman Self-Rating Mania. Possible scores range from 0 to 20, with higher scores indicating greater severity of manic symptoms.
f
Reported in response to the Columbia-Suicide Severity Rating Scale (C-SSRS).
g
Item 9 of the PHQ-9 asks the respondent how often over the past 2 weeks the respondent has been bothered by “thoughts that you would be better off dead, or of hurting yourself.”
The mean baseline PHQ-9 and GAD-7 scores fell in the mild to moderate range. They were 12.3±7.1 and 10.5±6.4, respectively, for patients with unipolar depression, and 11.2±7.2 and 9.5±6.5, respectively, for those with bipolar disorder. It is likely that few patients were in manic episodes at the time of assessment, reflected by the mean ASRM scores, which were 3.5±3.6 for those with bipolar disorder and 2.7±2.9 for unipolar depression. Nearly one-third of the patients in both diagnosis subgroups had a lifetime history of planned or actual suicide attempt. It is noteworthy that the baseline visit for the registry did not necessarily occur at treatment initiation; many patients had been in treatment before the baseline assessment.
Figure 2 reflects the longitudinal course of depression for patients who had a PHQ-9 score greater than 10 at the baseline visit and had a follow-up visit at least 30 days after the baseline assessment. A total of 57.5% of the patients with unipolar depression and 58.6% of the patients with bipolar disorder remained symptomatic, as measured by the PHQ-9, at their last follow-up. For patients with unipolar depression, 16.1% achieved remission (a score of less than 5 on the PHQ-9), while 18.7% of the patients with bipolar disorder achieved remission from depression.
FIGURE 2. Depression outcomes among patients in the Mood Outcomes Program with either bipolar disorder or unipolar depressiona
aDepression outcomes were measured by status on the Patient Health Questionnaire–9 (PHQ-9) at the last follow-up visit. A PHQ-9 score of ≥10 indicates active depression, a score of 5 to 9 indicates response to treatment, and a score of 0 to 4 indicates symptoms in remission. Data shown for patients who were enrolled over the first 24 months of data collection in the Mood Outcomes Program, who entered the program with a PHQ-9 score of ≥10, and had at least 1 follow-up visit more than 30 days from their baseline visit.
Figure 3 presents explorations of the relation between patient characteristics—gender, marital status, diagnosis, and comorbid anxiety—and the longitudinal course of depression symptom severity. For example, the trajectory diverged between men and women at approximately 6 months’ follow-up, with men showing clearly poorer recovery rates at the 12- and 24-month follow-up. Patients who were married showed improved recovery at 12 and 24 months, relative to patients in all other marital categories. Although the trajectory for depression remission was largely comparable between patients with unipolar depression and patients with bipolar disorder, having comorbid anxiety as indicated by a baseline GAD-7 score of 10 or higher, portended a significantly poorer course, with marked divergence at 24-month follow-up.
FIGURE 3. Percentage of patients in the Mood Outcomes Program with active depression over time, by gender, marital status, diagnosis, and presence of comorbid anxietya
aData shown for patients who had a Patient Health Questionnaire–9 score of ≥10 (active depression) at their baseline visit to the Mood Outcomes Program and had at least 1 follow-up visit >30 days after their baseline visit. Comorbid anxiety was indicated by a score of ≥10 on the General Anxiety Disorder–7.
Discussion and Conclusions
The progress of the NNDC Mood Outcomes Program thus far demonstrates the feasibility and potential of collaborative systematic collection of patient-reported outcomes as part of a measurement-based care program for the treatment of patients with mood disorders. The program has met its initial goals of enrolling more than 10,000 patients (current enrollment is 10,570 patients) and using standard assessments routinely collected through a flexible health informatics infrastructure to inform treatment at the point of care. As we disseminate the program to additional sites across the network and continue to follow the patients with multiple assessments, we anticipate rapid growth of a progressively richer data set to explore the longitudinal course of mood disorders. The pilot study, therefore, provides an important step toward achieving our goal of a fully realized “learning health system” (30, 31) for mood disorders.
Preliminary analysis of the data collected in the pilot study demonstrates that new and more powerful precision-driven treatments, ideally guided by biomarkers, are needed to understand and optimally treat mood disorders. In this sample, nearly 60% of the patients with mood disorder remained symptomatic at follow-up. The analyses of the association between patient characteristics and longitudinal course revealed a poorer course for men, unmarried individuals, and those with comorbid anxiety. This initial snapshot of clinical burden, chronicity, and risk for suicide concurs with the converging public health data from the World Health Organization and others indicating that mood disorders are among the most debilitating health conditions (45, 46).
These results reflect the common experience of treating mood disorders; that is, the best treatments and most skilled clinicians still provide most patients with only partial improvement in their mood disorders (9, 26). Although this should give one pause, the results should be interpreted with several important caveats in mind. The data were collected in a naturalistic setting as patients received usual care. As a result, patients may have entered the program at different points in their episode of care, and those who were doing better may have been less likely to return to the clinic for additional treatment. Thus, with the data collected during this pilot study, we may be observing only a partial snapshot of the full trajectory of illness, especially among patients with more challenging outcomes. We anticipate that as we continue to follow more patients over longer periods of time, we will get a more complete picture of the different illness trajectories, and we will be able to examine how differential follow-up affects the interpretation of the results.
Despite the initial excitement generated by the introduction of selective serotonin reuptake inhibitors and, more recently, by multiple-mechanism antidepressants (47) or the promise of new findings in psychiatric genetics (48), our field has stalled in its ability to significantly reduce the medical burden of a large proportion of patients with mood disorders. Larger, longitudinal, measurement-based databases are essential if we are to advance to more precise and effective treatments. The current pilot study illustrates that collection of such data are achievable, and it provides important lessons that can facilitate the wider implementation of this program and others like it (Table 2).
| Component | Lesson learned |
|---|---|
| Patient experience | Minimize barriers and friction to patient participation |
| Clinician experience | Optimize the clinician’s workflow by integrating into the electronic health record |
| Sustainability | Find the balance between a comprehensive versus practical data set |
| Education | Patient and clinician buy-in is critical to engagement |
| Leadership | A local champion is essential to success |
| Planning | Start early to secure information technology support and local governance |
Encouraged by the success of the pilot study, we are currently working to expand the reach and scope of the Mood Outcomes Program. We are using the lessons of the pilot study to rapidly disseminate the program to other NNDC sites and additional clinics within these sites, which should further accelerate the enrollment of patients into the program. Particularly noteworthy is that we seek to expand the program into primary care, where the majority of patients with mood disorders often receive care, as well as into other specialty clinics, such as women’s mood disorders clinics or brain stimulation clinics. In addition, we are working on plans to collect detailed clinical data extracted from participating sites’ electronic medical records—such as health care utilization, diagnostic information, treatment histories, and laboratory results—to link with the patient-reported outcome measures in the NNDC KnowledgeBase. We envision using the infrastructure of the Mood Outcomes Program and the rich, longitudinal data gathered in the NNDC KnowledgeBase as a platform to support large-scale, multisite quality improvement and research efforts across the NNDC centers. This may involve using big-data analytics with the gathered data, as well as conducting embedded studies in real-world settings to generate new data. The goal will be to rapidly translate what is learned from these efforts back into improved care for our patients and thus achieve the vision of a nationwide learning health system for mood disorders.
Acknowledgments
This work was made possible by a research collaboration supported by the National Network of Depression Centers. The authors thank Edie Douglas, M.P.H., Kara Glazer, Marjorie Gresbrink, Deanna Hofschulte, C.C.R.P., Dane Larsen, Martha Shaw, Dana Steidtmann, Ph.D., and Carol Wahl. Altarum provided technical expertise to build and maintain the mood outcomes system, including operational support from Rachelle May-Gentile, Mike Grim, and Ryan Callahan. The authors also thank Katie Hurtis and members of the Epic staff for their ongoing assistance and support during this effort.
Supplementary Material
File (appi.ps.201900481.ds001.pptx)
- Download
- 442.67 KB
References
1.
Hasin DS, Goodwin RD, Stinson FS, et al: Epidemiology of major depressive disorder: results from the National Epidemiologic Survey on Alcoholism and Related Conditions. Arch Gen Psychiatry 2005; 62:1097–1106
2.
Kessler RC, Petukhova M, Sampson NA, et al: Twelve-month and lifetime prevalence and lifetime morbid risk of anxiety and mood disorders in the United States. Int J Methods Psychiatr Res 2012; 21:169–184
3.
GBD 2016 Disease and Injury Incidence and Prevalence Collaborators: Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet 2017; 390:1211–1259
4.
Suicide Among Veterans and Other Americans 2001–2014. Department of Veterans Affairs, Office of Suicide Prevention, 2017. https://www.mentalhealth.va.gov/docs/2016suicidedatareport.pdf
5.
Conner KR, Bohnert AS, McCarthy JF, et al: Mental disorder comorbidity and suicide among 2.96 million men receiving care in the Veterans Health Administration health system. J Abnorm Psychol 2013; 122:256–263
6.
Noël PH, Williams JW Jr, Unützer J, et al: Depression and comorbid illness in elderly primary care patients: impact on multiple domains of health status and well-being. Ann Fam Med 2004; 2:555–562
7.
Unützer J, Powers D, Katon W, et al: From establishing an evidence-based practice to implementation in real-world settings: IMPACT as a case study. Psychiatr Clin North Am 2005; 28:1079–1092
8.
Mrazek DA, Hornberger JC, Altar CA, et al: A review of the clinical, economic, and societal burden of treatment-resistant depression: 1996–2013. Psychiatr Serv 2014; 65:977–987
9.
Fava M, Rush AJ, Trivedi MH, et al: Background and rationale for the sequenced treatment alternatives to relieve depression (STAR*D) study. Psychiatr Clin North Am 2003; 26:457–494
10.
Rush AJ, Fava M, Wisniewski SR, et al: Sequenced treatment alternatives to relieve depression (STAR*D): rationale and design. Control Clin Trials 2004; 25:119–142
11.
Rush AJ, Trivedi MH, Wisniewski SR, et al: Acute and longer-term outcomes in depressed outpatients requiring one or several treatment steps: a STAR*D report. Am J Psychiatry 2006; 163:1905–1917
12.
Dogan MV, Beach SRH, Simons RL, et al: Blood-based biomarkers for predicting the risk for five-year incident coronary heart disease in the Framingham Heart Study via machine learning. Genes (Basel) 2018; 9:641
13.
Dogan MV, Grumbach IM, Michaelson JJ, et al: Integrated genetic and epigenetic prediction of coronary heart disease in the Framingham Heart Study. PLoS One 2018; 13:e0190549
14.
Enserro DM, Vasan RS, Xanthakis V: Twenty-year trends in the American Heart Association cardiovascular health score and impact on subclinical and clinical cardiovascular disease: the Framingham Offspring Study. J Am Heart Assoc 2018; 7:e008741
15.
Vasan RS, Xanthakis V, Lyass A, et al: Epidemiology of left ventricular systolic dysfunction and heart failure in the Framingham study: an echocardiographic study over 3 decades. JACC Cardiovasc Imaging 2018; 11:1–11
16.
Gupta N, Lee HS, Ryu JH, et al: The NHLBI LAM Registry: prognostic physiologic and radiologic biomarkers emerge from a 15-Year prospective longitudinal analysis. Chest 2019; 155:288–296
17.
Sirirungreung A, Buasom R, Jiraphongsa C, et al: Data reliability and coding completeness of cancer registry information using reabstracting method in the National Cancer Institute: Thailand, 2012 to 2014. J Glob Oncol 2018; 4:1–9
18.
Sowa NA, Jeng P, Bauer AM, et al: Psychiatric case review and treatment intensification in collaborative care management for depression in primary care. Psychiatr Serv 2018; 69:549–554
19.
Kawanishi C, Ishii T, Yonemoto N, et al: Protocol for a prospective multicentre registry cohort study on suicide attempters given the assertive case management intervention after admission to an emergency department in Japan: post-ACTION-J Study (PACS). BMJ Open 2018; 8:e020517
20.
Munk-Jørgensen P, Mortensen PB: The Danish Psychiatric Central Register. Dan Med Bull 1997; 44:82–84
21.
Vernal DL, Kapoor S, Al-Jadiri A, et al: Outcome of youth with early-phase schizophrenia-spectrum disorders and psychosis not otherwise specified treated with second-generation antipsychotics: 12 week results from a prospective, naturalistic cohort study. J Child Adolesc Psychopharmacol 2015; 25:535–547
22.
Saito S, Horinouchi T, Nakagami Y, et al: Approaches to suicide prevention: ideas and models presented by Japanese and international early career psychiatrists. Psychiatry Clin Neurosci 2018; 72:741–742
23.
Coleman KJ, Stewart C, Waitzfelder BE, et al: Racial-ethnic differences in psychiatric diagnoses and treatment across 11 health care systems in the mental health research network. Psychiatr Serv 2016; 67:749–757
24.
Desai MM, Rosenheck RA, Craig TJ: Case-finding for depression among medical outpatients in the Veterans Health Administration. Med Care 2006; 44:175–181
25.
Coryell W, Endicott J, Maser JD, et al: The likelihood of recurrence in bipolar affective disorder: the importance of episode recency. J Affect Disord 1995; 33:201–206
26.
Coryell W, Winokur G, Solomon D, et al: Lithium and recurrence in a long-term follow-up of bipolar affective disorder. Psychol Med 1997; 27:281–289
27.
Fiedorowicz JG, Coryell WH, Rice JP, et al: Vasculopathy related to manic/hypomanic symptom burden and first-generation antipsychotics in a sub-sample from the Collaborative Depression Study. Psychother Psychosom 2012; 81:235–243
28.
All of Us Research Program. Department of Health and Human Services, National Institutes of Health. https://allofus.nih.gov. Accessed May 18, 2019
29.
Clough JD, McClellan M: Implementing MACRA: implications for physicians and for physician leadership. JAMA 2016; 315:2397–2398
30.
Friedman C, Rubin J, Brown J, et al: Toward a science of learning systems: a research agenda for the high-functioning learning health system. J Am Med Inform Assoc 2015; 22:43–50
31.
Grossman C, Powers B, McGinnis JM: Digital Infrastructure for the Learning Health System: The Foundation for Continuous Health Improvement in Health and Health Care. Washington, DC, National Academies Press, 2011
32.
Greden JF: The National Network of Depression Centers: progress through partnership. Depress Anxiety 2011; 28:615–621
33.
Guo T, Xiang YT, Xiao L, et al: Measurement-based care versus standard care for major depression: a randomized controlled trial with blind raters. Am J Psychiatry 2015; 172:1004–1013
34.
Rush AJ: Isn’t it about time to employ measurement-based care in practice? Am J Psychiatry 2015; 172:934–936
35.
Trivedi MH, Rush AJ, Wisniewski SR, et al: Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry 2006; 163:28–40
36.
Trivedi MH, Jha MK, Kahalnik F, et al: VitalSign6: a primary care first (PCP-First) model for universal screening and measurement-based care for depression. Pharmaceuticals (Basel) 2019; 12:71
37.
Thekkumpurath P, Walker J, Butcher I, et al: Screening for major depression in cancer outpatients: the diagnostic accuracy of the 9-item patient health questionnaire. Cancer 2011; 117:218–227
38.
Kroenke K, Spitzer RL, Williams JB: The Patient Health Questionnaire-2: validity of a two-item depression screener. Med Care 2003; 41:1284–1292
39.
Spitzer RL, Kroenke K, Williams JB, et al: A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006; 166:1092–1097
40.
Altman EG, Hedeker D, Peterson JL, et al: The Altman Self-Rating Mania Scale. Biol Psychiatry 1997; 42:948–955
41.
Posner K, Brown GK, Stanley B, et al: The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry 2011; 168:1266–1277
42.
Guidance on satisfying the Safe Harbor Method, in Guidance Regarding Methods for De-identification of Protected Health Information in Accordance with the Health Insurance Portability and Accountability Act (HIPAA) Privacy Rule. Washington, DC, Department of Health and Human Services, Office for Civil Rights, November 26, 2012. https://www.hhs.gov/hipaa/for-professionals/privacy/special-topics/de-identification/index.html#safeharborguidance. Accessed Oct 21, 2019
43.
Faden RR, Beauchamp TL, Kass NE: Informed consent for comparative effectiveness trials. N Engl J Med 2014; 370:1959–1960
44.
Faden RR, Beauchamp TL, Kass NE: Informed consent, comparative effectiveness, and learning health care. N Engl J Med 2014; 370:766–768
45.
Edlund MJ, Wang J, Brown KG, et al: Which mental disorders are associated with the greatest impairment in functioning? Soc Psychiatry Psychiatr Epidemiol 2018; 53:1265–1276
46.
Global Burden of Disease Study 2013 Collaborators: Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet 2015; 386:743–800
47.
Connolly KR, Thase ME: Emerging drugs for major depressive disorder. Expert Opin Emerg Drugs 2012; 17:105–126
48.
Howard DM, Adams MJ, Clarke TK, et al: Genome-wide meta-analysis of depression identifies 102 independent variants and highlights the importance of the prefrontal brain regions. Nat Neurosci 2019; 22:343–352
Information & Authors
Information
Published In
History
Received: 27 September 2019
Revision received: 23 October 2019
Accepted: 31 October 2019
Published online: 21 January 2020
Published in print: May 01, 2020
Keywords
Authors
Funding Information
National Network of Depression Centers:
Altarum:
Dr. Katzelnick has commercial interests with Principle Healthcare Technology Systems. Dr. Wright has an equity interest in Empower Interactive and Mindstreet; this conflict of interest is managed with an agreement with the University of Louisville. He receives book royalties from American Psychiatric Press, Inc., Guilford Press, and Simon and Schuster. Dr. Ajilore is the co-founder and chief medical officer of Keywise, Inc., is on the Advisory Board of both Blueprint Health and Embodied Labs, and is a consultant for Quartet Health. Dr. Guille is a member of Sage Therapeutics advisory board and speakers bureau. Dr. Saunders received an honorarium for work as an associate editor from the Journal of Clinical Psychiatry. Dr. Selvaraj received speaking honoraria from Global Medical Education and honoraria from British Medical Journal Publishing Group, owns shares at Flow Med Tech, and is a site investigator for a clinical trial by COMPASS Pathways Limited. Dr. Greden is a consultant for Clarigent, Genomind, Med-IQ, Inc., MoldX, and Sage Therapeutics and is involved in a pharmacogenomics study funded by AssureX and Myriad Neuroscience. He is involved commercially with Janssen Pharmaceutical, Naurex (Allergan) Pharmaceutical, Cerecor Pharmaceutical, and NeuralStem. Dr. DePaulo is an unpaid consultant for the Assurex Health/Myriad Company; he owns stock in CVS, which now owns Aetna Insurance. The other authors report no financial relationships with commercial interests.Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).