Skip to main content
Full access
Articles
Published Online: 21 April 2020

20-Year Trends in the Pharmacologic Treatment of Bipolar Disorder by Psychiatrists in Outpatient Care Settings

Abstract

Objective:

Pharmacological options for treating bipolar disorder have increased over the past 20 years, with several second-generation antipsychotics receiving regulatory approval in the 1990s. The authors describe trends in use of pharmacological agents in the outpatient management of bipolar disorder.

Methods:

Using nationally representative data from the 1997–2016 National Ambulatory Medical Care Surveys, the authors examined trends in the use of mood stabilizers, first- and second-generation antipsychotics, and antidepressants among psychiatrist visits for which bipolar disorder was listed among the primary diagnoses. A logistic regression model was used to identify statistically significant trends, with covariates including age, gender, race/ethnicity, and primary insurance.

Results:

Antipsychotics were increasingly more commonly prescribed, increasing from 12.4% of outpatient visits for bipolar disorder in the 1997–2000 period to 51.4% in the 2013–2016 period (adjusted odds ratio=5.05, 95% CI=3.65–7.01). Use of mood stabilizers decreased from 62.3% of visits for bipolar disorder in the 1997–2000 period to 26.4% in the 2013–2016 period (adjusted odds ratio=0.18, 95% CI=0.13–0.27). Prescription of antidepressants occurred in 47.0% of visits for bipolar disorder in the 1997–2000 period and 57.5% in the 2013–2016 period. Prescription of an antidepressant without a mood stabilizer increased substantially, from 17.9% in the 1997–2000 period to 40.9% in the 2013–2016 period (adjusted odds ratio=2.88, 95% CI=2.06–4.03).

Conclusions:

Substantial changes have occurred in the treatment of bipolar disorder over the past 20 years, with second-generation antipsychotics in large measure supplanting traditional mood stabilizers. Antidepressant prescriptions persisted despite a lack of evidence for their efficacy in bipolar disorder and concerns about increasing the risk of mania. Research is needed to compare the real-world effectiveness and tolerability of newer antipsychotics with those of traditional mood stabilizers.
Bipolar disorder affects up to 4.5% of the adult population in the United States (1) and can lead to significant adverse mental and physical health outcomes as well as a substantial economic burden (2). Traditionally, lithium was considered the treatment of choice for bipolar disorder, with evidence suggesting that lithium has a specific protective effect against suicide (3, 4), even compared with other mood stabilizers (5).
Over the past 20 years, the pharmacological options for treating bipolar disorder have increased. Most notably, several second-generation antipsychotics received regulatory approval in the 1990s and 2000s for the treatment of bipolar disorder (6). A study of prescribing patterns in Scotland showed large increases in the use of second-generation antipsychotics for the treatment of bipolar disorder after their regulatory approval (7), and similar trends were seen in Denmark (8). Few studies have examined how the availability of these new medications has affected prescribing patterns for patients with bipolar disorder in the United States. One study provided evidence that U.S. Food and Drug Administration (FDA) approval of olanzapine led to a substantial increase in olanzapine use for bipolar disorder between 1998 and 2009 and a smaller overall increase in use of second-generation antipsychotics (9).
Psychiatrists represent a major source of care for patients with bipolar disorder (10). It is therefore important to understand how trends in outpatient psychiatric prescribing practices may have shifted after regulatory approval of second-generation antipsychotics and how these practices compare with evidence-based guidelines. The purpose of this study was to document these trends and to compare recent national prescribing patterns with evidence-based guidelines for the management of bipolar disorder.

Methods

Data Source

Data from 1997 to 2016 (the most recent data available) from the National Ambulatory Medical Care Survey (NAMCS) were used to examine trends in prescribing by psychiatrists for patients with bipolar disorder. The National Center for Health Statistics (NCHS) of the Centers for Disease Control and Prevention conducted the survey annually by sampling a nationally representative group of office-based visits to physicians. To evaluate changes over time with improved stability of estimates (11), we made an a priori decision to combine annual visit observations into 4-year blocks: 1997–2000, 2001–2004, 2005–2008, 2009–2012, and 2013–2016. Physicians or their staff were queried about demographic and clinical information on each patient visit (11). This study was exempted from the Institutional Review Board at Yale School of Medicine. Further details of the survey, including descriptions, questionnaires, sampling methodology, and data sets are available on the NCHS web site (11). This study adhered to the reporting guidelines of the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement (12).

Survey Methods

The NAMCS survey is conducted using a three-stage sampling design. First, a sample of 112 primary sampling units is drawn, then a sample of practicing physicians within these sampling units is drawn, and, finally, a systematic random sampling of patient visits to these physicians is performed. The analysis was limited to visits to psychiatric providers by patients of all ages for whom bipolar disorder was a listed diagnosis. The NAMCS collects up to three diagnoses for each visit, using ICD-9-CM codes from 1997 to 2015 and ICD-10 codes in 2016. Bipolar disorder was defined using these diagnosis codes (see Table S1 in the online supplement). Comorbidity was assessed at each visit by the additional diagnoses of psychotic disorders, anxiety disorders, substance use disorders, and other disorders (see Table S2 in the online supplement).

Medication Classification

The NAMCS collected up to six medications prescribed in the 1997–2003 surveys; up to eight medications prescribed in the 2004–2011 surveys; up to 10 medications prescribed in the 2012–2013 surveys; and up to 30 medications prescribed in the 2014–2016 surveys. We used generic names to identify prescription medications and included generic names that are virtually synonymous according to several drug databases (e.g., UpToDate and American Hospital Formulary Service). For example, valproic acid includes valproate sodium, divalproex sodium, and other similar terms. Mood stabilizers were defined to included lithium, carbamazepine, lamotrigine, and valproic acid. Based on a lack of evidence for efficacy in bipolar disorder in treatment guidelines and systematic reviews (1316), gabapentin, oxcarbazepine, and topiramate were not included as mood stabilizers but were analyzed separately, as these medications are commonly prescribed for patients with bipolar disorder. We used definitions from the 2019 American Hospital Formulary Service (AHFS) Compendium (17) to classify second-generation antipsychotics: aripiprazole, asenapine, cariprazine, iloperidone, lurasidone, paliperidone, risperidone, quetiapine, olanzapine, clozapine, and ziprasidone. First-generation antipsychotics were classified according to AHFS definitions and included haloperidol, chlorpromazine, fluphenazine, perphenazine, prochlorperazine, thioridazine, trifluoperazine, thiothixene, loxapine, molindone, and pimozide. Antidepressants included monoamine oxidase (MAO) inhibitors, tricyclic antidepressants, selective serotonin reuptake inhibitors, serotonin-norepinephrine inhibitors, and “other” antidepressants (bupropion, mirtazapine, vilazodone, nefazodone, vortioxetine, and trazodone). We also analyzed trends in the use of benzodiazepines and stimulants (1820) in visits for which bipolar disorder was listed among the primary diagnoses.

Demographic and Clinical Data

Demographic data collected by the NAMCS included age, gender, race/ethnicity, payment source (Medicare, Medicaid, private insurance, and other), whether the reason for the visit was acute or chronic, whether the patient received any psychotherapy, and how much time the patient spent with the physician.

Analysis

We compared demographic variables, diagnostic subtype, and the psychopharmacological management composition of psychiatric visits of patients diagnosed with bipolar disorder over time. We then analyzed trends of medication classes (mood stabilizers, antipsychotics, and antidepressants). We separately examined trends in use of antidepressants without a mood stabilizer and in use of antidepressants without a mood stabilizer or an antipsychotic. In the main analysis, we included all medications. Given the change in number of medications recorded by the NAMCS over the period studied, we conducted a sensitivity analysis, limiting the analysis to the first six medications prescribed only (see Table S3 in the online supplement). As a control against which to compare the trends discovered in visits for bipolar disorder, we examined trends of visits for schizophrenia in a post hoc analysis.
A series of logistic regression models were fitted to assess the strength of associations between survey year as the independent variable of interest and age, gender, and race/ethnicity as dependent variables. For the survey year variable, the first time period (1997–2000) was assigned a value of 0, the second (2001–2004) a value of 0.25, the third (2005–2008) a value of 0.5, the fourth (2009–2012) a value of 0.75, and the fifth (2013–2016) a value of 1. We calculated unadjusted and adjusted odds ratios for the study period effect; covariates included age, gender, race/ethnicity, and the primary source of payment. We used Stata 15.1 MP/6-Core (Stata Corp., College Station, Tex.) for all analyses, and we employed the svy commands to account for the complex survey sampling design of the NAMCS (i.e., unequal probability of selection, clustering, and stratification).

Results

Sample Characteristics

A total of 4,419 visits to a psychiatric provider by a patient diagnosed with bipolar disorder were sampled by NAMCS during the period 1997–2016, which represents approximately 4.2 million visits nationally. Throughout the 20-year period examined, more women than men had outpatient visits for bipolar disorder (Table 1). The proportion of outpatient visits for black and Hispanic patients increased over time (p=0.007). There were no statistically significant trends in the proportion of visits covered by private as compared with public insurance or in the regional distribution of outpatient visits. Over time, a smaller percentage of patients received psychotherapy (p=0.009) and a smaller percentage had visits exceeding 30 minutes in duration as compared with visits of 16–30 minutes (p=0.014). The total number of visits for bipolar disorder increased from approximately 467,000 in the 1997–2000 period to 1.06 million in the 2013–2016 period. The total number of visits for schizophrenia did not increase during this interval (approximately 380,000 in the 1997–2000 period and approximately 370,000 in the 2013–2016 period) (see Table S4 in the online supplement).
TABLE 1. Demographic and clinical characteristics of outpatient visits to psychiatrists among patients with bipolar disorder by period, 1997–2016a
      Secular Trends
Measure or Variable1997–20002001–20042005–20082009–20122013–2016Unadjusted Odds Ratio95% CIpAdjusted Odds Ratiob95% CIp
 NNNNN      
Unweighted visits5048898641,313849      
Weighted visits (row %)467,057 (11.1%)753,228 (17.8%)867,632 (20.6%)1,074,923 (25.5%)1,059,311 (25.1%)      
 MeanMeanMeanMeanMean      
Age           
 ≤1812.316.29.97.08.40.450.20, 0.990.0470.410.20, 0.830.013
 19–4444.842.743.344.243.30.990.75, 1.310.9471.020.77, 1.360.869
 45–6435.634.539.641.535.51.090.79, 1.490.5971.070.78, 1.470.657
 ≥657.36.57.27.312.92.141.26, 3.640.0052.211.28, 3.800.004
Gender           
 Male40.639.132.239.636.20.910.67, 1.230.5301.090.82, 1.460.562
 Female59.460.967.860.463.81.120.81, 1.500.5300.920.69, 1.230.562
Race/ethnicity           
 Non-Hispanic white91.487.285.551.581.30.460.29, 0.720.0010.440.27, 0.710.001
 Non-Hispanic black3.65.36.07.86.11.600.95, 2.670.0761.620.97, 2.730.068
 Hispanic2.64.25.97.76.22.101.18, 3.750.0122.191.17, 4.090.014
 Non-Hispanic other2.53.42.53.06.42.740.99, 7.560.0522.860.98, 8.290.054
Insurance coverage           
 Private45.248.448.143.846.00.960.64, 1.430.8331.020.68, 1.540.913
 Medicare16.112.320.017.718.61.400.96, 2.040.0821.100.74, 1.620.635
 Medicaid9.117.915.517.516.41.370.75, 2.530.3081.580.86, 2.900.142
 Other29.721.416.521.019.10.710.42, 1.180.1800.730.44, 1.220.232
Major reason for visit           
 Acute problem12.83.64.24.34.10.370.16, 0.880.0240.440.19, 1.000.049
 Chronic problem85.796.294.093.794.21.380.67, 2.850.3811.820.68, 2.550.411
 Other1.60.21.82.01.82.070.30, 14.450.4641.700.25, 11.390.584
Region           
 Northeast27.519.025.921.630.01.310.64, 2.690.4551.330.67, 2.630.416
 Midwest22.521.615.421.419.30.90.46, 17.760.7520.980.49, 1.960.959
 South27.636.038.635.030.60.960.53, 1.760.9030.950.51, 1.760.862
 West22.423.420.222.020.10.860.45, 1.650.6560.80.42, 1.510.487
Time spent with doctor           
 ≤15 minutes22.621.037.624.825.11.090.63, 1.870.7661.090.62, 1.930.756
 16–30 minutes33.045.135.544.245.61.450.93, 2.260.1011.470.94, 2.300.094
 >30 minutes44.533.926.931.029.30.620.40, 0.960.0330.590.36, 0.980.039
Comorbid disorders           
 Anxiety disorder11.517.318.916.024.31.881.13, 3.140.0151.851.10, 3.110.020
 Psychotic disorder0.91.51.62.42.22.140.56, 8.150.2651.910.52, 7.080.331
 Substance use disorder7.37.17.810.79.81.571.01, 2.460.0471.530.95, 2.460.078
 Other4.35.04.14.24.50.950.48, 1.880.8850.910.45, 1.830.783
 %%%%%      
Metropolitan Statistical Area83.889.590.793.395.43.611.38, 9.450.0093.961.42, 11.070.009
Psychotherapy50.957.346.850.835.70.500.30, 0.820.0070.440.26, 0.730.001
a
Data are from the National Ambulatory Medical Care Survey, 1997–2016.
b
Accounted for age, gender, race/ethnicity, and source of payment.

Prescriptions for Psychotropic Medications

Antipsychotics.

The percentage of visits for bipolar disorder that included antipsychotic prescriptions increased markedly, from 19.1% in the 1997–2000 period to 52.7% in the 2013–2016 period (Table 2). This was driven by a large increase in use of second-generation antipsychotics during this interval, from 12.4% to 51.4%, while use of first-generation antipsychotics decreased, from 7.0% to 1.7% (Figure 1). Sensitivity analyses revealed a similar pattern of use (see Table S3 in the online supplement).
TABLE 2. Trends for medications prescribed during office-based visits to psychiatrists for patients with bipolar disorder by secular period, 1997–2016a
      Secular Trends
Measure or Variable1997–20002001–20042005–20082009–20122013–2016Unadjusted Odds Ratio95% CIpAdjusted Odds Ratiob95% CIp
 NNNNN      
Unweighted visits5048898641,313849      
Weighted visits (row %)467,057 (11.1%)753,228 (17.8%)867,632 (20.6%)1,074,923 (25.5%)1,059,311 (25.1%)      
 MeanMeanMeanMeanMean      
Any antipsychotic19.131.851.553.052.73.802.77, 5.21<0.0014.002.94, 5.45<0.001
 First-generation antipsychotics7.03.12.83.11.70.320.17, 0.60<0.0010.230.12, 0.45<0.001
 SGAs12.429.449.651.451.44.643.34, 6.46<0.0015.053.65, 7.01<0.001
 FDA-approved SGAs12.128.249.148.650.14.433.18, 6.19<0.0014.803.45, 6.69<0.001
Any mood stabilizer62.350.328.523.726.40.200.14, 0.29<0.0010.180.13, 0.27<0.001
 Lithium30.420.717.313.917.60.500.33, 0.760.0010.460.29, 0.71<0.001
 Carbamazepine or valproic acid35.424.87.67.44.90.070.05, 0.11<0.0010.070.04, 0.11<0.001
 Lamotrigine2.19.75.84.14.70.730.46, 1.150.1730.700.44, 1.120.137
Other anticonvulsants6.319.912.312.312.50.960.62, 1.480.8590.910.59, 1.410.684
 Gabapentin6.09.13.94.14.70.530.34, 0.850.0080.450.28, 0.730.001
 Oxcarbazepine0.05.74.53.35.31.850.83, 4.130.1341.820.82, 4.030.143
 Topiramate0.35.74.55.03.11.200.75, 1.930.4491.280.76, 2.150.345
Any antidepressant47.050.255.149.957.51.371.02, 1.840.0361.270.93, 1.750.133
 TCAs or MAOIs6.23.53.12.22.90.440.20, 0.980.0440.360.17, 0.770.009
 SSRIs24.031.430.726.025.70.870.65, 1.160.3490.850.63, 1.140.272
 SNRIs4.56.613.713.011.42.161.41, 3.31<0.0011.981.33, 2.960.001
 Other19.017.519.819.229.81.941.33, 2.840.0011.861.22, 2.840.004
  Bupropion9.811.810.910.412.41.150.78, 1.690.4881.130.75, 1.720.560
  Mirtazapine2.42.11.91.74.11.960.90, 4.280.0921.690.76, 3.780.201
  Other8.45.07.88.415.83.061.76, 5.32<0.0012.931.62, 5.30<0.001
Antidepressant without mood stabilizer17.920.738.935.640.92.982.16, 4.11<0.0012.882.06, 4.03<0.001
Antidepressant without antipsychotic38.034.828.721.925.50.490.36, 0.67<0.0010.450.33, 0.61<0.001
Antidepressant without mood stabilizer or antipsychotic14.913.019.514.216.61.130.78, 1.630.5121.050.73, 1.510.793
Benzodiazepines24.227.630.333.431.21.411.00, 1.970.0471.300.95, 1.780.097
Stimulants5.33.56.37.89.82.671.38, 5.160.0042.751.44, 5.270.002
a
Data are from the National Ambulatory Medical Care Survey, 1997–2016. FDA=U.S. Food and Drug Administration; MAOI=monoamine oxidase inhibitor; SGA=second-generation antipsychotic; SNRI=serotonin-norepinephrine reuptake inhibitor; SSRI=selective serotonin reuptake inhibitor; TCA=tricyclic antidepressant.
b
Accounted for age, gender, race/ethnicity, and source of payment.
FIGURE 1. Prescribing trends for second-generation antipsychotics (SGAs) and mood stabilizers in the treatment of bipolar disorder in office-based visits to psychiatrists, 1997–2016a
a Data are from the National Ambulatory Medical Care Survey, 1997–2016.

Mood stabilizers.

Visits for bipolar disorder that included prescriptions for any mood stabilizer decreased from 62.3% in the 1997–2000 period to 26.4% in the 2013–2016 period. This was driven primarily by a decrease in use of non-lithium mood stabilizers (carbamazepine and valproic acid) from 35.4% to 4.9% (adjusted odds ratio=0.07, 95% CI=0.04–0.11) and by a decrease in use of lithium from 30.4% to 17.6% (adjusted odds ratio=0.46, 95% CI=0.29–0.71). Sensitivity analyses revealed a similar pattern of use (see Table S3 in the online supplement).

Antidepressants.

Antidepressant prescriptions for the study period, with and without antipsychotics and mood stabilizers, are summarized in Figure 2. The prescription rate for any antidepressant was 47.0% of visits for bipolar disorder in the 1997–2000 period and 57.5% of visits in the 2013–2016 period (odds ratio=1.37, 95% CI=1.02–1.84; adjusted odds ratio=1.27, 95% CI=0.93–1.75). There was a decrease in the percentage of visits for bipolar disorder that included use of MAO inhibitors (adjusted odds ratio=0.36, 95% CI=0.17–0.77) and an increase in the percentage of those that included use of serotonin-norepinephrine reuptake inhibitors (adjusted odds ratio=1.98, 95% CI=1.33–2.96) or “other” antidepressants (adjusted odds ratio=1.86, 95% CI=1.22–2.84), which included bupropion, mirtazapine, vilazodone, nefazodone, and vortioxetine.
FIGURE 2. Prescribing trends for antidepressants in the treatment of bipolar disorder in office-based visits to psychiatrists, 1997–2016a
a Data are from the National Ambulatory Medical Care Survey, 1997–2016. AD=antidepressant; AP=antipsychotic; MS=lithium and antiepileptic mood stabilizers.

Other psychotropic medication use.

There was no significant change in the prescription rate of benzodiazepines. There was an overall increase in the use of stimulants, from 5.3% in the 1997–2000 period to 9.8% in the 2013–2016 period (adjusted odds ratio=2.75, 95% CI=1.44–5.27).

Unopposed antidepressant use.

The proportion of visits to psychiatrists for bipolar disorder in which any antidepressant was prescribed without a mood stabilizer increased from 17.9% in the 1997–2000 period to 40.9% in the 2013–2016 period (adjusted odds ratio=2.88, 95% CI=2.06–4.03). There was no change in use of any antidepressant without either a mood stabilizer or an antipsychotic (adjusted odds ratio=1.05, 95% CI=0.73–1.51).

Psychotherapy

Among visits for which bipolar disorder was listed among the primary diagnoses, the use of psychotherapy decreased from 50.9% in the 1997–2000 period to 35.7% in the 2013–2016 period (adjusted odds ratio=0.44, 95% CI=0.26–0.73).

Discussion

Substantial changes have occurred over the past two decades in the pharmacological management of bipolar disorder by outpatient psychiatrists. Second-generation antipsychotics have in large measure supplanted lithium and other mood stabilizers in the absence of any comparative effectiveness data indicating improvement in outcomes. There has also been a persistence of the prescribing of antidepressants despite a consistent lack of evidence for their efficacy in bipolar disorder in clinical trials and concerns about inducing manic switch (2123). Finally, the use of psychotherapy by psychiatrists in the outpatient management of bipolar disorder has decreased substantially.

Second-Generation Antipsychotics and Mood Stabilizers

Several factors may have contributed to the switch from traditional mood stabilizers to second-generation antipsychotics in the outpatient psychiatric management of bipolar disorder. During the study period, the following second-generation antipsychotics received regulatory approval for the treatment of bipolar disorder: olanzapine (2000; manic and mixed phases), olanzapine/fluoxetine combination (2003; depressed phase), risperidone (2003; manic and mixed phases), ziprasidone (2004; manic and mixed phases), quetiapine (2004; manic and depressed phases), aripiprazole (2004; manic and mixed phases), lurasidone (2013; depressed phase), asenapine (2015; manic and mixed phases), and cariprazine (2015; depressed phase) (24). After each regulatory approval, intensive marketing campaigns were initiated to promote products to physicians and patients. Such marketing efforts can have a substantial impact on the utilization of psychotropic medications, including antipsychotics (25).
Direct-to-consumer advertising of pharmaceutical products is associated with much more rapid adoption of second-generation antipsychotics in the United States compared with countries with more restrictive policies on this type of marketing (13). After regulatory approval, marketing campaigns were initiated to promote the new medications to physicians. Such marketing efforts could have had a substantial impact on the use of psychotropic medications, including antipsychotics (25). In 2005, for example, about $513 million was estimated to have been devoted to U.S. promotional spending on antipsychotic medications, some 10% of which was for direct-to-consumer advertising (26), although an unknown percentage was specifically for bipolar disorder. Policies that limit marketing (i.e., gift restriction policies) have in turn been associated with lower rates of prescribing newly marketed medications (27). Taken together, this literature suggests that pharmaceutical marketing may have contributed to the substantial increase in second-generation antipsychotic prescriptions by U.S. psychiatrists in outpatient visits for bipolar disorder over the past 20 years.
Many of the traditional mood stabilizers were off patent during this period and therefore were not the focus of major marketing efforts, which may have accounted for their decline in use. Within these broader trends, and supporting the hypothesis that marketing was a large driver of changes in prescribing patterns, increases in the use of valproic acid (approved in 1995) (28) and lamotrigine (approved in 2003) were seen after their regulatory approval. Alternatively, it is possible that the increase in second-generation antipsychotic prescribing was a result of other factors. For instance, clinicians may find that second-generation antipsychotics are more tolerable in the short term than traditional mood stabilizers or that they are effective therapeutic options when treating patients with comorbid disorders that are typically excluded in randomized controlled trials (29).
During the study period, the total number of visits for bipolar disorder nationwide increased from approximately 467,000 in the 1997–2000 period to 1.06 million in the 2013–2016 period. Given that the frequency of visits per patient for other mood disorders tended to decline during this period (30), it is likely that there was a substantial increase in the total number of individuals diagnosed with bipolar disorder by U.S. psychiatrists. Our post hoc analysis revealed that the total number of visits for schizophrenia did not increase during the same period, suggesting that changes to the NAMCS methodology are not related to the increase seen in visits for bipolar disorder. Some factors that may have contributed to this increase include expansion in insurance coverage for mental health conditions (31) and marketing campaigns by manufacturers of second-generation antipsychotics to broaden the concept of bipolar disorder in order to increase sales (32, 33). It is noteworthy that the clinical criteria for bipolar disorder have not changed significantly between editions of DSM during the period examined (34, 35).
Physician factors may also contribute to these trends in pharmacological management. Psychiatrists may have become increasingly uncomfortable prescribing medications with the potential for serious and acute medical side effects (such as lithium), as evidenced by the declining use of MAO inhibitors. The need for blood level monitoring with some of the mood stabilizers could also be a factor driving physician preference and the decreased use of mood stabilizers over the past 20 years. This may also be influenced by the fact that a large proportion of psychiatrists are solo practitioners and may not have a readily available mechanism for drawing and following blood levels (36). Finally, the increase in use of second-generation antipsychotics for adults with bipolar disorder may also be part of a broader trend in increasing use of these agents for a variety of indications and patient groups (37), including schizophrenia, the treatment of children, elderly individuals, adults with nonpsychotic depression, and individuals with anxiety disorders and insomnia (3842).

Implications for Public Health

An increase in second-generation antipsychotic use coincident with declining use of traditional mood stabilizers may have important implications for public health. Relatively little research has been conducted evaluating the comparative effectiveness of second-generation antipsychotics and traditional mood stabilizers. In a small randomized controlled trial, Berk et al. found more favorable outcomes with lithium compared with quetiapine among individuals with bipolar disorder after a first-time manic episode (43). The Bipolar CHOICE (Clinical Health Outcomes Initiative in Comparative Effectiveness) study also compared these drugs in a study of 482 patients with bipolar disorder and found no significant difference in improvements in symptom severity on standardized rating scales (44). These prospective studies are too small to detect changes in relatively rare but significant health outcomes, such as emergency department visits, hospital admissions, suicide attempts, and suicide. Several studies have shown that lithium has protective effects against suicide and suicidal behavior (3, 4, 45), with evidence that non-lithium mood stabilizers can also have some protective effects against suicidal behavior (46). We are aware of only one large observational study (N=6,671 patients with bipolar disorder) that has compared quetiapine and lithium (along with other mood stabilizers) for their effects on self-harm and suicide (5); the study found lower rates of self-harm among individuals treated with lithium compared with those treated with quetiapine or other mood stabilizers (205 compared with 417 per 10,000 person-years of exposure, p<0.01). Individuals treated with lithium also had lower rates of suicide (7 compared with 19 per 10,000 person-years of exposure), although the difference was not statistically significant. In light of the transformation in the pharmacological management of bipolar disorder, further studies are warranted to better understand the comparative safety and effectiveness of second-generation antipsychotics and traditional mood stabilizers.

Antidepressant Use in Bipolar Disorder

Several reasons may underlie the finding that antidepressant prescribing has persisted over the past 20 years. Individuals with bipolar disorder generally spend the majority of time in depressive phases as opposed to manic phases (47), which may prompt providers to treat these symptoms with antidepressants. In addition, treatment refractoriness is a common and serious problem in the management of bipolar disorder. Relatedly, many mood stabilizers and second-generation antipsychotics can have side effects that prove difficult to tolerate. Providers may prescribe antidepressants for bipolar disorder if traditional “on-label” medications have failed to achieve remission or proven intolerable. Nonetheless, the practice of using antidepressants in the management of bipolar disorder is generally given a lower priority in treatment algorithms, given the lack of evidence for efficacy (16, 48).
The use of antidepressants without a concomitant mood stabilizer increased substantially during the study period, which was likely related to an overall decline in mood stabilizer use. The use of antidepressants without either a mood stabilizer or an antipsychotic did not significantly change. Notably, evidence suggests that antidepressants, when combined with mood stabilizers or antipsychotics, are not associated with an increased risk of hospital readmissions (49, 50). However, unopposed antidepressant use has been shown in large samples to heighten the risk of mania (50). Although the NAMCS survey data do not permit evaluation of the quality of care of patients and individual patient characteristics that likely influence treatment practices, the prescribing patterns in community practice nevertheless suggest a possible need for quality improvement initiatives to educate and provide feedback for practicing psychiatrists.
In addition, it is possible that the increases seen in the use of antidepressants and antipsychotics are related to the FDA approval of the olanzapine/fluoxetine combination in 2003 for the treatment of bipolar disorder. However, we conducted a sensitivity analysis of second-generation antipsychotic prescribing trends without olanzapine/fluoxetine (see Figure S1 in the online supplement), which showed similar trends over time. Hence, we believe that the regulatory approval of olanzapine/fluoxetine for treating bipolar disorder is unlikely to have driven the increase use in antidepressant use.

Use of Psychotherapy

Our study showed a substantial decrease in the use of psychotherapy in psychiatric outpatient visits for bipolar disorder over the past 20 years, from 50.9% to 35.7%, which is part of a larger trend of decreasing psychotherapy provided by psychiatrists (51). Psychosocial interventions, including psychotherapy and psychoeducation, are a critical component of comprehensive management, to enhance treatment adherence, address psychosocial consequences from previous episodes, and manage residual symptoms or mood instability between major episodes (52). Individuals who received intensive psychotherapy have been found to have improved outcomes compared with those who did not receive intensive psychotherapy (53).

Limitations

Several limitations of this study deserve comment. First, the diagnoses of bipolar disorder were based on clinical judgment rather than independent research diagnostic assessments. In addition, the NAMCS samples are not sufficiently large to generate stable estimates of treatments by bipolar subtype (i.e., bipolar I disorder versus bipolar II disorder) or by single antipsychotic. In our preliminary analyses, we found that the proportion of visits to psychiatrists in which bipolar II disorder was listed among the primary diagnoses was stable over time, from 2.1% in the 1997–2000 period to 2.2% in the 2013–2016 period (adjusted odds ratio=0.94, 95% CI=0.80–1.11). We further conducted a sensitivity analysis excluding bipolar II disorder (see Table S5 in the online supplement) and found that the prescribing trends were similar to those in the main findings. Further research is needed, however, to examine the pharmacoepidemiology of bipolar II disorder and ascertain whether patients with this disorder receive different treatments. Second, the results concern visits in which bipolar disorder was listed among the primary diagnoses rather than individual patients. NAMCS captures an unknown number of patients who made repeat visits during the survey period. Third, although we controlled for relevant covariates, there may be unmeasured clinical factors that contributed to or explain the observed changes in prescribing patterns. Fourth, the NAMCS samples patient visits and does not permit assessment of long-term use of pharmacological treatment. Fifth, the data are derived from physician reports of patient visits and do not provide measures of symptom severity or treatment history that might account for the observed trends. Finally, the survey does not cover all outpatient settings in which patients with bipolar disorder receive care, such as clinics based in hospitals, and no effort was made to evaluate the treatment of bipolar disorder in primary care.

Conclusions

There has been a substantial increase in the use of second-generation antipsychotics in the outpatient psychiatric management of adults diagnosed with bipolar disorder, accompanied by a decrease in the use of lithium and other mood stabilizers. These findings could have important implications for public health and demonstrate a need for comparative analyses between second-generation antipsychotics and older mood stabilizers such as lithium and valproic acid with respect to efficacy, tolerability, and side effects. The data also revealed an enduring use of antidepressants in adults with bipolar disorder, suggesting that quality improvement initiatives may be useful in an effort to bring practice into better harmony with evidence-based guidelines for the outpatient management of bipolar disorder.

Supplementary Material

File (appi.ajp.2020.19091000.ds001.pdf)

References

1.
Merikangas KR, Akiskal HS, Angst J, et al: Lifetime and 12-month prevalence of bipolar spectrum disorder in the National Comorbidity Survey replication. Arch Gen Psychiatry 2007; 64:543–552
2.
Dilsaver SC: An estimate of the minimum economic burden of bipolar I and II disorders in the United States: 2009. J Affect Disord 2011; 129:79–83
3.
Cipriani A, Hawton K, Stockton S, et al: Lithium in the prevention of suicide in mood disorders: updated systematic review and meta-analysis. BMJ 2013; 346:f3646
4.
Song J, Sjölander A, Joas E, et al: Suicidal behavior during lithium and valproate treatment: a within-individual 8-year prospective study of 50,000 patients with bipolar disorder. Am J Psychiatry 2017; 174:795–802
5.
Hayes JF, Pitman A, Marston L, et al: Self-harm, unintentional injury, and suicide in bipolar disorder during maintenance mood stabilizer treatment: a UK population-based electronic health records study. JAMA Psychiatry 2016; 73:630–637
6.
Hooshmand F, Miller S, Dore J, et al: Trends in pharmacotherapy in patients referred to a bipolar specialty clinic, 2000–2011. J Affect Disord 2014; 155:283–287
7.
Lyall LM, Penades N, Smith DJ: Changes in prescribing for bipolar disorder between 2009 and 2016: national-level data linkage study in Scotland. Br J Psychiatry 2019; 215:415–421
8.
Kessing LV, Vradi E, Andersen PK: Nationwide and population-based prescription patterns in bipolar disorder. Bipolar Disord 2016; 18:174–182
9.
Pillarella J, Higashi A, Alexander GC, et al: Trends in use of second-generation antipsychotics for treatment of bipolar disorder in the United States, 1998–2009. Psychiatr Serv 2012; 63:83–86
10.
Wang PS, Lane M, Olfson M, et al: Twelve-month use of mental health services in the United States: results from the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005; 62:629–640
11.
National Center for Health Statistics, Centers for Disease Control and Prevention: Ambulatory Health Care Data: Questionnaires, Datasets, and Related Documentation. 2019. https://www.cdc.gov/nchs/ahcd/ahcd_questionnaires.htm
12.
Enhancing the Quality and Transparency of Health Research (EQUATOR) Network: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. 2019. http://www.equator-network.org/reporting-guidelines/strobe/
13.
Vasudev A, Macritchie K, Vasudev K, et al: Oxcarbazepine for acute affective episodes in bipolar disorder. Cochrane Database Syst Rev 2011; (12):CD004857
14.
Vasudev A, Macritchie K, Watson S, et al: Oxcarbazepine in the maintenance treatment of bipolar disorder. Cochrane Database Syst Rev 2008; (1):CD005171
15.
Hirschfeld R, Bowden CL, Gitlin MJ, et al: Practice guideline for the treatment of patients with bipolar disorder. Washington, DC, American Psychiatric Association, 2002 (https://psychiatryonline.org/pb/assets/raw/sitewide/practice_guidelines/guidelines/bipolar.pdf)
16.
Calabrese JR, Kasper S, Johnson G, et al: International Consensus Group on Bipolar I Depression Treatment Guidelines. J Clin Psychiatry 2004; 65:571–579
17.
American Society of Hospital Pharmacists: American Hospital Formulary Service (AHFS) Drug Information. Bethesda, Md, published by authority of the Board of Directors of the American Society of Hospital Pharmacists, 2019
18.
Rhee TG, Rosenheck RA: Initiation of new psychotropic prescriptions without a psychiatric diagnosis among US adults: rates, correlates, and national trends from 2006 to 2015. Health Serv Res 2019; 54:139–148
19.
Rhee TG: Coprescribing of benzodiazepines and opioids in older adults: rates, correlates, and national trends. J Gerontol A Biol Sci Med Sci 2019; 74:1910–1915
20.
Rhee TG, Rosenheck RA: Psychotropic polypharmacy reconsidered: between-class polypharmacy in the context of multimorbidity in the treatment of depressive disorders. J Affect Disord 2019; 252:450–457
21.
Pacchiarotti I, Bond DJ, Baldessarini RJ, et al: The International Society for Bipolar Disorders (ISBD) task force report on antidepressant use in bipolar disorders. Am J Psychiatry 2013; 170:1249–1262
22.
Allain N, Leven C, Falissard B, et al: Manic switches induced by antidepressants: an umbrella review comparing randomized controlled trials and observational studies. Acta Psychiatr Scand 2017; 135:106–116
23.
Tundo A, Calabrese JR, Proietti L, et al: Short-term antidepressant treatment of bipolar depression: are ISBD recommendations useful in clinical practice? J Affect Disord 2015; 171:155–160
24.
Agency for Healthcare Research and Quality (AHRQ): Treatment for Bipolar Disorder in Adults: A Systematic Review (Comparative Effectiveness Review No 208). Rockville, Md, AHRQ, August 2018
25.
King M, Essick C: The geography of antidepressant, antipsychotic, and stimulant utilization in the United States. Health Place 2013; 20:32–38
26.
Donohue JM, Cevasco M, Rosenthal MB: A decade of direct-to-consumer advertising of prescription drugs. N Engl J Med 2007; 357:673–681
27.
King M, Essick C, Bearman P, et al: Medical school gift restriction policies and physician prescribing of newly marketed psychotropic medications: difference-in-differences analysis. BMJ 2013; 346:f264
28.
Blanco C, Laje G, Olfson M, et al: Trends in the treatment of bipolar disorder by outpatient psychiatrists. Am J Psychiatry 2002; 159:1005–1010
29.
Wong JJ, Jones N, Timko C, et al: Exclusion criteria and generalizability in bipolar disorder treatment trials. Contemp Clin Trials Commun 2018; 9:130–134
30.
Marcus SC, Olfson M: National trends in the treatment for depression from 1998 to 2007. Arch Gen Psychiatry 2010; 67:1265–1273
31.
Beronio K, Po R, Skopec L, et al: Affordable Care Act expands mental health and substance use disorder benefits and federal parity protections for 62 million Americans. Washington, DC, US Department of Health and Human Services, 2013
32.
Moncrieff J: The medicalisation of “ups and downs”: the marketing of the new bipolar disorder. Transcult Psychiatry 2014; 51:581–598
33.
Yutzy SH, Woofter CR, Abbott CC, et al: The increasing frequency of mania and bipolar disorder: causes and potential negative impacts. J Nerv Ment Dis 2012; 200:380–387
34.
Akiskal HS: The prevalent clinical spectrum of bipolar disorders: beyond DSM-IV. J Clin Psychopharmacol 1996; 16(suppl 1):4S–14S
35.
Angst J: Bipolar disorders in DSM-5: strengths, problems, and perspectives. Int J Bipolar Disord 2013; 1:12
36.
Kane CK, Emmons DW: New Data on Physician Practice Arrangements: Private Practice Remains Strong Despite Shifts Toward Hospital Employment (Policy Research Perspectives). Chicago, American Medical Association, 2013
37.
Drake R, Skinner J, Goldman HH: What explains the diffusion of treatments for mental illness? Am J Psychiatry 2008; 165:1385–1392
38.
Rosenheck RA, Leslie DL, Doshi JA: Policy implications of CATIE. Psychiatr Serv 2008; 59:695
39.
Gerhard T, Akincigil A, Correll CU, et al: National trends in second-generation antipsychotic augmentation for nonpsychotic depression. J Clin Psychiatry 2014; 75:490–497
40.
Olfson M, Blanco C, Liu L, et al: National trends in the outpatient treatment of children and adolescents with antipsychotic drugs. Arch Gen Psychiatry 2006; 63:679–685
41.
Pringsheim T, Gardner DM: Dispensed prescriptions for quetiapine and other second-generation antipsychotics in Canada from 2005 to 2012: a descriptive study. CMAJ Open 2014; 2:E225–E232
42.
Pringsheim T, Lam D, Patten SB: The pharmacoepidemiology of antipsychotic medications for Canadian children and adolescents: 2005–2009. J Child Adolesc Psychopharmacol 2011; 21:537–543
43.
Berk M, Daglas R, Dandash O, et al: Quetiapine v lithium in the maintenance phase following a first episode of mania: randomised controlled trial. Br J Psychiatry 2017; 210:413–421
44.
Nierenberg AA, McElroy SL, Friedman ES, et al: Bipolar CHOICE (Clinical Health Outcomes Initiative in Comparative Effectiveness): a pragmatic 6-month trial of lithium versus quetiapine for bipolar disorder. J Clin Psychiatry 2016; 77:90–99
45.
Toffol E, Hätönen T, Tanskanen A, et al: Lithium is associated with decrease in all-cause and suicide mortality in high-risk bipolar patients: a nationwide registry-based prospective cohort study. J Affect Disord 2015; 183:159–165
46.
Tsai CJ, Cheng C, Chou PH, et al: The rapid suicide protection of mood stabilizers on patients with bipolar disorder: a nationwide observational cohort study in Taiwan. J Affect Disord 2016; 196:71–77
47.
Tondo L, Vázquez GH, Baldessarini RJ: Depression and mania in bipolar disorder. Curr Neuropharmacol 2017; 15:353–358
48.
Suppes T, Dennehy EB, Hirschfeld RM, et al: The Texas implementation of medication algorithms: update to the algorithms for treatment of bipolar I disorder. J Clin Psychiatry 2005; 66:870–886
49.
O’Hagan M, Cornelius V, Young AH, et al: Predictors of rehospitalization in a naturalistic cohort of patients with bipolar affective disorder. Int Clin Psychopharmacol 2017; 32:115–120
50.
Viktorin A, Lichtenstein P, Thase ME, et al: The risk of switch to mania in patients with bipolar disorder during treatment with an antidepressant alone and in combination with a mood stabilizer. Am J Psychiatry 2014; 171:1067–1073
51.
Mojtabai R, Olfson M: National trends in psychotherapy by office-based psychiatrists. Arch Gen Psychiatry 2008; 65:962–970
52.
Chatterton ML, Stockings E, Berk M, et al: Psychosocial therapies for the adjunctive treatment of bipolar disorder in adults: network meta-analysis. Br J Psychiatry 2017; 210:333–341
53.
Miklowitz DJ, Otto MW, Wisniewski SR, et al: Psychotherapy, symptom outcomes, and role functioning over one year among patients with bipolar disorder. Psychiatr Serv 2006; 57:959–965

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 706 - 715
PubMed: 32312111

History

Received: 29 September 2019
Revision received: 4 December 2019
Revision received: 24 January 2020
Accepted: 3 February 2020
Published online: 21 April 2020
Published in print: August 01, 2020

Keywords

  1. Bipolar Disorder
  2. Lithium
  3. Antipsychotics
  4. Outpatient

Authors

Details

Taeho Greg Rhee, Ph.D., M.S.W. [email protected]
Department of Public Health Sciences, School of Medicine, University of Connecticut, Farmington (Rhee); Department of Psychiatry, School of Medicine, Yale University, New Haven, Conn. (Rhee, Wilkinson); Department of Psychiatry, College of Physicians and Surgeons, Columbia University, New York (Olfson); and Center for Bipolar Treatment Innovation, Massachusetts General Hospital, and Department of Psychiatry, Harvard Medical School, Harvard University, Boston (Nierenberg).
Mark Olfson, M.D., M.P.H.
Department of Public Health Sciences, School of Medicine, University of Connecticut, Farmington (Rhee); Department of Psychiatry, School of Medicine, Yale University, New Haven, Conn. (Rhee, Wilkinson); Department of Psychiatry, College of Physicians and Surgeons, Columbia University, New York (Olfson); and Center for Bipolar Treatment Innovation, Massachusetts General Hospital, and Department of Psychiatry, Harvard Medical School, Harvard University, Boston (Nierenberg).
Andrew A. Nierenberg, M.D.
Department of Public Health Sciences, School of Medicine, University of Connecticut, Farmington (Rhee); Department of Psychiatry, School of Medicine, Yale University, New Haven, Conn. (Rhee, Wilkinson); Department of Psychiatry, College of Physicians and Surgeons, Columbia University, New York (Olfson); and Center for Bipolar Treatment Innovation, Massachusetts General Hospital, and Department of Psychiatry, Harvard Medical School, Harvard University, Boston (Nierenberg).
Samuel T. Wilkinson, M.D.
Department of Public Health Sciences, School of Medicine, University of Connecticut, Farmington (Rhee); Department of Psychiatry, School of Medicine, Yale University, New Haven, Conn. (Rhee, Wilkinson); Department of Psychiatry, College of Physicians and Surgeons, Columbia University, New York (Olfson); and Center for Bipolar Treatment Innovation, Massachusetts General Hospital, and Department of Psychiatry, Harvard Medical School, Harvard University, Boston (Nierenberg).

Notes

Send correspondence to Dr. Rhee ([email protected]).

Competing Interests

Dr. Nierenberg has served as a consultant for Abbott Laboratories, Alkermes, American Psychiatric Association, Appliance Computing (MindSite), Basliea, Brain Cells, Brandeis University, Bristol-Myers Squibb, Celexio, Clintara, Corcept, Dainippon Sumitomo (now Sunovion Pharmaceuticals), Dey Pharmaceuticals, Eli Lilly, EpiQ, Forest, Genaissance, Genentech, GlaxoSmithKline, Healthcare Global Village, Hoffman LaRoche, Infomedic, Intra-Cellular Therapies, Janssen Pharmaceutica, Jazz Pharmaceuticals, L.P./Mylan, Lundbeck, MedAvante, Merck, MSI Methylation Sciences, Naurex, Neurocrine, Neuronetics, NeuroRx, Novartis, Otsuka, Pamlab, Parexel, Pfizer, PGx Health, Ridge Diagnostics, Sage Pharmaceuticals, Schering-Plough, Shire, Somerset, Sunovion Pharmaceuticals, Supernus, Takeda Pharmaceuticals, Targacept, and Teva, and he has also served as a consultant through the MGH Clinical Trials Network and Institute (CTNI) for Assurex, AstraZeneca, BrainCells, Dainippon Sumitomo/Sepracor, Johnson & Johnson, LaboPharm, Merck, MSI Methylation Sciences, NeuroRx Pharma, Novartis, Pfizer, PGx Health, Physician’s Postgraduate Press, Schering-Plough, Shire, Takeda/Lundbeck, and Targacept; he has received honoraria from American Drug Utilization Review, American Professional Society of ADHD and Related Disorders, American Society of Clinical Psychopharmacology, Baystate Medical Center, Belvoir Publishing, Brandeis University, Bristol-Myers Squibb, CME Institute, Columbia University, Congress of the Hellenic Society for Basic and Clinical Pharmacology, CRICO, Dartmouth Medical School, Guilford Publications, Harold Grinspoon Charitable Foundation, Health New England, Hillside Hospital, IMEDEX, Institute of Medicine, International Society for Bipolar Disorders, International Society for CNS Clinical Trials and Methodology, Israel Society for Biological Psychiatry, Johns Hopkins University, MBL Publishing, Medscape, MGH Psychiatry Academy, MJ Consulting, NAMI, National Association of Continuing Education, National Network of Depression Centers, New Clinical Drug Evaluation Unit, New York State, Nova Southeastern University, Physicians Postgraduate Press, Psychiatric Annals, Rush Medical College, SciMed, Slack Publishing, SUNY Buffalo, University of Miami, University of Michigan, University of Pisa, University of Texas Southwestern Dallas, University of Wisconsin at Madison, UpToDate, Wiley Publications, Wolters Kluwer Publishing, World Congress on Brain Behavior and Emotion, and Yale University School of Medicine; he has served on advisory boards of Appliance Computing, Brain Cells, Eli Lilly, Genentech, InfoMedic, Johnson & Johnson, Takeda/Lundbeck Pharmaceuticals, and Targacept; he owns stock options in Appliance Computing (MindSite), Brain Cells, and MedAvante; and he has copyrights on the Clinical Positive Affect Scale and the MGH Structured Clinical Interview for the Montgomery-Åsberg Depression Rating Scale exclusively licensed to the MGH Clinical Trials Network and Institute. Dr. Wilkinson has received contract funding from Janssen and Sage Therapeutics for the conduct of clinical trials administered through Yale University, and he anticipates receiving contract funding from LivaNova for conducting clinical trials; he has received consulting fees from Biohaven Pharmaceuticals, Janssen, and Oui Therapeutics. The other authors report no financial relationships with commercial interests.

Funding Information

National Institute on Drug Abusehttp://dx.doi.org/10.13039/100000026: R01DA019606, R01DA039137
Agency for Healthcare Research and Qualityhttp://dx.doi.org/10.13039/100000133: K12HS023000
National Institute of Mental Healthhttp://dx.doi.org/10.13039/100000025: R01MH107452
National Institute on Aginghttp://dx.doi.org/10.13039/100000049: T32AG019134
Supported by NIH grant T32AG019134 (Dr. Rhee), NIH grants R01MH107452, R01DA039137, and R01DA019606 (Dr. Olfson), the Thomas P. Hackett, M.D., Endowed Chair in Psychiatry at Massachusetts General Hospital (Dr. Nierenberg), the Dauten Family Center for Bipolar Treatment Innovation (Dr. Nierenberg), Agency for Healthcare Research and Quality grant K12HS023000 (Dr. Wilkinson), the Brain and Behavior Research Foundation (Dr. Wilkinson), the Robert E. Leet and Clara Guthrie Patterson Trust (Dr. Wilkinson), and the American Foundation for Suicide Prevention (Dr. Wilkinson).

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share