Site maintenance Wednesday, November 13th, 2024. Please note that access to some content and account information will be unavailable on this date.
Skip to main content
Full access
Articles
Published Online: 8 December 2021

Trends in Outpatient Psychotherapy Provision by U.S. Psychiatrists: 1996–2016

Abstract

Objective:

Previous work has demonstrated significant declines in the provision of outpatient psychotherapy by U.S. psychiatrists. The objective of this study was to characterize patterns and trends of psychotherapy by U.S. psychiatrists from 1996 to 2016.

Methods:

A retrospective, nationally representative analysis of psychiatrist visits from 21 waves of the U.S. National Ambulatory Medical Care Survey between 1996 and 2016 (N=29,673) was conducted to assess rates of outpatient psychotherapy provision by U.S. psychiatrists. Provision was modeled as risk differences and adjusted by clinical, sociodemographic, geographic, and financial characteristics.

Results:

Between 1996 and 2016, the weighted percentage of visits involving psychotherapy declined significantly from 44.4% in 1996–1997 to 21.6% in 2015–2016. Declines were most marked among patients diagnosed with social phobia (29% to 8%), dysthymic disorder (65% to 30%), and personality disorders (68% to 17%). For patients diagnosed with schizophrenia, psychotherapy provision remained stable (10%–12%). In the 2010–2016 period, about half of psychiatrists (53%) no longer provided psychotherapy at all. Antidepressant, antipsychotic, and sedative-hypnotic prescriptions were negatively associated with psychotherapy provision. During the study period, sociodemographic disparities grew, with older, White patients residing in metropolitan areas in the Northeast or West increasingly becoming the most likely to receive psychotherapy. Self-pay predicted access to solo-practice psychiatrists, who saw fewer patients but more frequently, and were more likely to provide psychotherapy.

Conclusions:

Previously reported declines in psychiatrist provision of psychotherapy continued through 2016, affecting nearly all clinical categories. In the 2010s, about half of psychiatrists practiced no psychotherapy at all, creating new challenges to the integration of neurobiological and psychosocial elements of clinical care.
For much of the 20th century, psychotherapy was viewed as synonymous with psychiatry and was the primary treatment modality employed by outpatient psychiatrists (1). Psychiatrists still view psychotherapy as core to their practice (2). APA’s most recent practice guidelines recommend that patients be provided psychotherapy across a range of diagnoses, such as schizophrenia, major depressive disorder, bipolar disorder, panic disorder, and obsessive-compulsive disorder (OCD). Additionally, the 2020 program requirements of the Accreditation Council for Graduate Medical Education (ACGME) expect residents to have proficiency in the use of various psychotherapeutic approaches (3). Indeed, clinical research demonstrates that state-of-the-art evidence-based individualized care often requires a combination of pharmacotherapy and psychotherapy (4). Yet, since the 1980s, significant declines in psychiatrist provision of psychotherapy have been recorded. Between 1996–1997 and 2004–2005, the proportion of U.S. outpatient psychiatrist visits involving psychotherapy declined from 44.4% to 28.9% (5). Increases in the use of pharmaceuticals and changing payment methods have been hypothesized to contribute to this decline (5).
However, little is known about the state of psychotherapy provision by U.S. psychiatrists from 2006 onward. The Mental Health Parity and Addiction Equity Act (2008) and the Affordable Care Act (2010) have increased mental health care insurance coverage, new pharmaceuticals have expanded treatment options, and advances in evidence-based psychotherapeutic approaches have improved the effectiveness of psychotherapy for several common psychiatric disorders (6). In light of these changes in the financing and delivery of mental health care and to help fill a gap in our understanding of recent trends in U.S. outpatient psychiatric practice, in this study we analyzed data from the 1996–2016 National Ambulatory Medical Care Survey (NAMCS), focusing on trends and patterns of psychotherapy provision.

METHODS

Data Analysis

We analyzed 21 years of data collected via NAMCS between January 1996 and December 2016 (7). Each year, the Centers for Disease Control and Prevention’s National Center for Health Statistics fields a multistage probability survey, obtaining a nationally representative sample of outpatient visits to non-federally funded and non-hospital-based physicians’ practices. NAMCS’s sampling design utilizes geographic primary sampling units and stratified secondary sampling of physicians through the comprehensive master files of the American Medical Association and the American Osteopathic Association. For each participating physician, patient visits in a randomly selected week were systematically sampled. Weighting accounted for survey nonresponse, reducing potential response bias (8). Telehealth, hospital, extended-care institution, and other nonoffice visits were excluded. To facilitate comparison with previous research (5), community mental health center visits were retained in the main analyses but excluded from sensitivity analyses.

Study Sample

The analyses were restricted to patient visits with psychiatric diagnoses with ICD codes 290–319 (ICD-9-CM) for 1996–2015 or F codes (ICD-10-CM) for 2016. Only visits in which patients saw a psychiatrist were included.

Measures

The main outcome variable was whether psychotherapy was provided. NAMCS defines psychotherapy as “all treatments involving the intentional use of verbal techniques to explore or alter the patient’s emotional life in order to effect symptom reduction or behavior change.” In line with previous research (5), this broad definition was refined to apply only to visits longer than 30 minutes. Twelve diagnostic categories were analyzed: major depressive disorder, dysthymic disorder, bipolar disorder, other mood disorders, generalized anxiety disorder, panic disorder, OCD, posttraumatic stress disorder (PTSD), social phobia, other anxiety disorders, schizophrenia, and personality disorders (see Table S1 in the online supplement). Comorbidity was coded when diagnostic categories co-occurred. Prescriptions of up to six medications per visit were coded into four classes of psychotropics: antidepressants, antipsychotics, mood stabilizers, and sedative-hypnotics (see Table S2 in the online supplement).
Other covariates included patients’ sociodemographic characteristics, including age, gender, race and ethnicity (White, Black or African American, Hispanic or Latino, or other), source of payment (private insurance, Medicare, Medicaid, patient self-pay, or other), office setting (freestanding solo practice, freestanding group practice, or health maintenance organization [HMO]/other), metropolitan or nonmetropolitan location, and region (U.S. Northeast, South, Midwest, or West).

Statistical Analysis

Visit-based analyses were weighted and adjusted using NAMCS’s complex survey design for each year, yielding nationally representative values. For temporal analyses, 1996–1997 versus 2015–2016 comparisons were conducted. A secondary analysis partitioned the study period a priori into three 7-year spans (1996–2002, 2003–2009, and 2010–2016). Risk difference modeling using binomial or multinomial logistic regression similarly adjusted for the complex survey design. Unless specified as multivariate, regression effects were individually modeled. Analyses were performed using the srvyr R package (version 1.0.0) and Stata/MP 16.0 (StataCorp, College Station, Tex.). Confidence intervals were calculated at 95%. Post hoc comparisons were reported after Bonferroni correction. All variables met National Center for Health Statistics reliability standards (≥30 observations per variable). The institutional review board at Columbia University exempted this study.

RESULTS

The mean number of physicians surveyed each year between 1996 and 2016 was 1,386; of these, 5.9% were psychiatrists. The overall sampled number of psychiatrist visits was 29,673, representing about 26 million national visits yearly. Logistic regression demonstrated a statistically significant yearly decline in the percentage of psychotherapy visits (risk difference=−0.9%, 95% CI=−1.3, −0.6, p<0.001). Whereas in 1996–1997, psychotherapy was involved in 44.4% of psychiatrist visits, the yearly mean percentages gradually and persistently trended downward, reaching 21.6% by 2015–2016 (Figure 1).
FIGURE 1. Percentage of psychiatrist visits involving psychotherapya
aData are from the National Ambulatory Medical Care Survey, 1996–2016.
Analyzing the data as three 7-year spans (1996–2002, 2003–2009, and 2010–2016) and stratifying visits by clinical, sociodemographic, geographic, and financial predictors (Table 1) revealed a decline in psychiatrist psychotherapy provision in every category examined (for detailed data from this alternative partitioning, see Table S3 in the online supplement). Except for patients over age 65 and those identifying as non-White and non-Hispanic, significant declines in psychotherapy provision occurred in all sociodemographic groups. Significant declines occurred independently of prescriptions for any psychotropic drug class and comorbidity, and for all diagnoses except schizophrenia. Significant declines were observed in the Northeast, the Midwest, and the South, in metropolitan and nonmetropolitan locations, and in all clinical settings. Sensitivity analyses excluding community mental health center visits did not meaningfully alter results (see Table S4 and Figure S1 in the online supplement).
TABLE 1. Outpatient psychiatric visits involving psychotherapy provisiona
 Number of Visits (in Millions)bPercent of Visits Involving PsychotherapybBivariate Logistic Regressionc
 1996–20022003–20092010–20161996–20022003–20092010–2016Risk Differencep
CharacteristicVisitsNVisitsNVisitsN%SE%SE%SE%95% CI
Total154.19,310185.99,818213.810,54536.81.228.41.724.42–0.9–1.3, –0.6<0.001
Age (years)               
 <2530.61,79643.22,34449.72,57229.51.822.5217.61.8–1–1.3, –0.7<0.001
 25–4456.23,44156.72,96063.93,14937.51.429.3226.82.7–0.8–1.2, –0.30.001
 45–6453.23,213703,729763,69240.41.531.42.1252.4–1.1–1.6, –0.7<0.001
 ≥6514.18601678524.31,132361.828.6330.14–0.4–1, 0.30.24
Gender               
 Male66.94,009794,20596.24,72136.61.429.71.923.82.1–1–1.3, –0.6<0.001
 Female87.25,3011075,613117.65,82436.91.227.61.724.82.2–0.9–1.3, –0.5<0.001
Race/ethnicity               
 White131.38,030154.58,216172.38,44138.91.329.71.825.72.1–1–1.4, –0.6<0.001
 Black or African American9.95791363214.982323.51.618.82.716.42.8–0.4–0.9, 0.10.08
 Hispanic or Latino9.249513.468516784232.320.23.714.72.5–0.7–1.1, –0.20.004
 Other3.82065.128510.649732.75.537.54.728.56.6–0.6–1.7, 0.60.35
Psychiatric diagnosisd               
 Major depressive disorder442,54050.32,58454.82,62032.31.526.32.323.42.6–0.7–1.2, –0.30.002
 Dysthymic disorder17.81,17113.579310.150655.82.244.93.536.55.3–1.5–2.3, –0.8<0.001
 Bipolar disorder17.21,00931.41,57432.71,671291.922.32.318.62.2–0.8–1.2, –0.4<0.001
 Other mood disorders19.11,23226.91,41037.81,89535.31.927.42.725.73.3–0.6–1.2, 00.04
 Generalized anxiety disorder7.543812.259120.788337.43.930.74.223.73.8–0.9–1.6, –0.20.01
 Panic disorder9.452410.753610.449030.12.222.83.116.53.6–1.2–1.6, –0.7<0.001
 Posttraumatic stress disorder5.93229.351811.462836.85.235.73.924.34–1.2–1.9, –0.40.002
 Social phobia1.1701.5862.611338.23.446.47.718.85.1–1.7–2.5, –0.9<0.001
 Other anxiety disorders8.452214.579525.91,31646.9330.7331.83.6–1–1.5, –0.40.001
 Obsessive-compulsive disorder6.43926.43528.742739.6241.54.529.54.3–0.9–1.6, –0.20.007
 Schizophrenia11.964911.557212.271416.11.412.72.4112.3–0.2–0.6, 0.10.17
 Personality disorders9.56449.76087.541259.72.759.64.944.56.8–1.3–2.1, –0.50.001
Comorbidity               
 No psychiatric comorbidities128.87,830150.87,986162.58,04336.51.227.91.724.32.1–0.9–1.3, –0.5<0.001
 Psychiatric comorbidities25.31,48035.11,83251.32,50238.52.130.92.824.52.7–1.1–1.5, –0.6<0.001
Medication               
 Prescribed123.57,166163.68,416181.48,85230.21.325.11.620.51.8–0.8–1.1, –0.4<0.001
 Not prescribed30.62,14420.61,31224.61,37963.21.454.33.950.54.8–0.9–1.5, –0.30.005
Medication class               
 Antidepressants88.45,194114.35,886117.95,69732.61.326.41.821.42–0.9–1.2, –0.5<0.001
 Antipsychotics30.51,65651.72,51951.52,73021.71.616.71.615.91.7–0.4–0.8, –0.10.008
 Mood stabilizers18.61,07425.21,28530.61,51427.21.8232.320.82.9–0.6–1.1, –0.10.02
 Sedative-hypnotics43.42,50260.33,00569.83,35931.41.526.22.120.72.3–0.8–1.2, –0.5<0.001
Source of paymente               
 Private insurance59.63,45785.34,38893.14,34932.71.827.52.122.62.8–0.8–1.3, –0.20.004
 Medicare15.591725.91,16129.71,50030.51.920.92.415.13.1–1–1.5, –0.5<0.001
 Medicaid14.986026.41,38026.21,58514.61.69.91.55.71–0.8–1, –0.6<0.001
 Self-pay332,06832.82,01250.12,28657.7253.2445.33.6–1.1–1.6, –0.6<0.001
 Other8.448110.6547744323.52.427.34.817.33.7–0.7–1.4, –0.10.03
Office settinge               
 Freestanding, solo practice83.85,008108.35,891129.55,96346.81.639.42.633.53.1–1–1.5, –0.40.001
 Freestanding, group practice29.91,67250.42,33744.32,09919.72.914.52.114.83.3–0.6–1, –0.10.01
 HMO or other23.21,40627.21,590402,48315.12.610.92.15.41–0.7–1, –0.4<0.001
Region               
 Northeast44.72,762482,84666.52,20250.22.538.43.733.84.6–1.1–1.9, –0.40.002
 Midwest28.61,78631.61,74834.32,48027.82.725.9415.23.5–1–1.7, –0.30.005
 South47.92,64468.92,88062.52,99826.71.818.52.210.21.9–1.3–1.7, –1<0.001
 West332,11837.52,34450.52,86540.92.636.2435.95–0.4–1.2, 0.40.37
Location               
 Metropolitan1398,4531678,920206.99,88638.11.230.41.824.82.1–1–1.3, –0.6<0.001
 Nonmetropolitan15.1857198986.965925.15.710.93.812.15.3–1.7–2.9, –0.50.008
a
Data are from the National Ambulatory Medical Care Survey, 1996–2016.
b
Visits were adjusted by survey weighting.
c
Analysis was based on weighted visit samples between 1996 and 2016.
d
Diagnosis numbers can be greater than visits because a visit can involve up to three diagnoses.
e
Data are missing for the year 1996.

Correlates of Psychotherapy

While a downward trend manifested across the board, the likelihood that visits involved psychotherapy was heterogeneous. Modeling individual correlates for psychotherapy provision revealed these disparities (Table 2). Visits by patients who were under age 25, visits by patients who identified as Black or Hispanic, and visits in which any class of psychotropic medication was prescribed were less likely to involve psychotherapy. Compared with private insurance, Medicare or Medicaid visits were also less likely to involve psychotherapy, yet self-pay visits were more likely to involve psychotherapy. Group practices and HMOs or other settings involved psychotherapy less frequently compared with solo practices. While psychiatric comorbidity was not associated with psychotherapy provision, a diagnosis of dysthymic disorder, OCD, other anxiety disorders, or personality disorders involved psychotherapy more often than other diagnoses, and a diagnosis of major depressive disorder, bipolar disorder, panic disorder, or schizophrenia involved psychotherapy less often. Metropolitan locations and those in the Northeast and the West also involved psychotherapy more frequently. A sensitivity analysis examining only the study years between 2010 and 2016 yielded similar trends (see Table S5 in the online supplement).
TABLE 2. Associations of visit characteristics with psychotherapy provision in psychiatrist visitsa
CharacteristicBivariate Logistic RegressionMultivariate Logistic Regression
Risk Difference (%)95% CIpAdjusted Risk Difference (%)95% CIp
Survey year–0.9–1.3, –0.6<0.001–0.9–1.2, –0.5<0.001
Age (years)      
 <250 [reference]  0 [reference]  
 25–448.86, 11.5<0.0014.71.9, 7.40.001
 45–649.16.2, 12<0.0015.42.7, 8.1<0.001
 ≥6594.6, 13.3<0.0018.13.8, 12.4<0.001
Gender      
 Male0 [reference]  0 [reference]  
 Female–0.1–1.7, 1.50.9–0.5–2, 0.90.48
Race/ethnicity      
 White0 [reference]  0 [reference]  
 Black or African American–11.7–14.7, –8.8<0.0011.6–1.6, 4.90.33
 Hispanic or Latino–12.3–15.9, –8.6<0.001–5.7–8.8, –2.5<0.001
 Other0.8–7.4, 9.10.844.2–3.4, 11.90.28
Psychiatric diagnosis      
 Major depressive disorder–3–5.6, –0.50.02–0.3–3.8, 3.20.88
 Dysthymic disorder17.614.7, 20.4<0.0018.95.6, 12.1<0.001
 Bipolar disorder–8.8–11.6, –5.9<0.001–1.4–5.4, 2.50.47
 Other mood disorders–0.9–4.2, 2.40.590.6–3.1, 4.30.74
 Generalized anxiety disorder–0.9–5.3, 3.50.692.4–2, 6.80.29
 Panic disorder–7.1–11, –3.3<0.001–4.2–8.1, –0.20.04
 Posttraumatic stress disorder1.9–2.7, 6.60.426.31.3, 11.20.01
 Social phobia1.7–5.1, 8.40.635.1–1.1, 11.20.1
 Other anxiety disorders5.11.4, 8.90.0075.10.7, 9.40.02
 Obsessive-compulsive disorder6.73.1, 10.4<0.0016.22.6, 9.80.001
 Schizophrenia–21.4–25.7, –17.2<0.001–6.1–10.6, –1.60.008
 Personality disorders23.719.6, 27.9<0.00117.713.9, 21.6<0.001
Comorbidity      
 No psychiatric comorbidities0 [reference]  0 [reference]  
 Psychiatric comorbidities0.6–2.1, 3.30.65–1.1–4.5, 2.30.54
Medicationb      
 Prescribed0 [reference]     
 Not prescribed3228.3, 35.7<0.001   
Medication class      
 Antidepressants–6.9–9.2, –4.6<0.001–4.6–6.8, –2.5<0.001
 Antipsychotics–17–19.6, –14.4<0.001–4.3–6.3, –2.2<0.001
 Mood stabilizers–7.4–10.2, –4.5<0.001–0.9–3.6, 1.80.52
 Sedative-hypnotics–5.8–8.1, –3.5<0.001–2.4–4.2, –0.50.01
Source of paymentc      
 Private insurance0 [reference]  0 [reference]  
 Medicare–6.3–9.5, –3.1<0.001–4.3–7.4, –1.30.006
 Medicaid–17.6–20.6, –14.6<0.001–11–14.3, –7.7<0.001
 Self-pay24.219.7, 28.7<0.00116.111.8, 20.4<0.001
 Other–3.5–8.6, 1.70.18–2.3–6.7, 2.10.3
Office settingc      
 Freestanding, solo practice0 [reference]  0 [reference]  
 Freestanding, group practice–23.1–27.9, –18.4<0.001–17.2–21.6, –12.9<0.001
 HMO or other–29.4–33.5, –25.4<0.001–19.8–24.3, –15.4<0.001
Region      
 Northeast0 [reference]  0 [reference]  
 Midwest–17.2–23.8, –10.6<0.001–7.8–13.7, –1.90.01
 South–22–27.5, –16.5<0.001–14.8–19.6, –10.1<0.001
 West–2.4–9.5, 4.60.52.8–3.3, 8.80.37
Location      
 Metropolitan0 [reference]  0 [reference]  
 Nonmetropolitan–13.9–20.1, –7.7<0.001–8.8–14.9, –2.70.005
a
Data are from the National Ambulatory Medical Care Survey, 1996–2016. Analysis was based on weighted visit samples.
b
Omitted from the multivariate model because of multicollinearity with medication class; when medication class covariates were omitted, the “not prescribed” adjusted risk difference was 18% (95% CI=14.5, 21.6, p<0.001).
c
Data were missing for the year 1996.
After adjusting for visit characteristics in a multivariate model (Table 2), a diagnosis of PTSD became significantly associated with psychotherapy provision, and a diagnosis of major depressive disorder or bipolar disorder, prescription for mood stabilizers, and racial identification as Black were no longer statistically significant. For patients who identified as Hispanic, however, psychotherapy provision remained less likely.
After controlling for all modeled visit characteristics, the downward trend through 1996–2016 remained significant and sizable (adjusted risk difference=−0.9%, 95% CI=−1.2, −0.5, p<0.001), indicating that additional unmeasured factors contributed to the decline. The model’s explanatory power increased by 23% through time, indicating that psychotherapy provision became more segregated along modeled covariates (Nagelkerke’s pseudo R2 was 0.26 for 1996–2002, 0.29 for 2003–2009, and 0.32 for 2010–2016). Between 2006 and 2011, NAMCS reported patients’ home zip code median household income and proportion of adults with bachelor’s degrees or higher quartiles. Logistic modeling showed that both variables positively predicted psychotherapy provision, even when controlling for previous covariates (income: adjusted risk difference=3.3%, 95% CI=1.6, 5.1, p<0.001; education: adjusted risk difference=5.8%, 95% CI=4.1, 7.4, p<0.001).

Provider Heterogeneity

Across the study years, the percentage of psychiatrists providing no psychotherapy in any visit significantly increased (Figure 2). Between 1996 and 2002, 133 of 491 (27%) sampled psychiatrists provided no psychotherapy; between 2003 and 2009, 189 of 547 (35%) provided no psychotherapy; and between 2010 and 2016, 355 of 673 (53%) provided no psychotherapy. Post hoc chi-square comparisons revealed all pairwise differences to be significant (p<0.001; comparison from 1996–2002 to 2003–2009, p<0.05). By contrast, no significant change was observed in the percentage of psychiatrists providing psychotherapy in all patient visits (1996–2002, 15%; 2003–2009, 11%; and 2010–2016, 12%). Alternative partitioning and provider-level weighting yielded similar results (see Figure S2 in the online supplement).
FIGURE 2. Percentage of psychiatrists by percentage of visits involving psychotherapy during three 7-year periodsa
a Data are from the National Ambulatory Medical Care Survey, 1996–2016. The numbers of psychiatrists surveyed were 491 for 1996–2002, 547 for 2003–2009, and 673 for 2010–2016.
Among psychiatrists who practiced psychotherapy in some patient visits, provision significantly decreased as well (risk difference=−0.7%, 95% CI=−1.1, −0.3, p=0.002). For this subgroup, psychotherapy was involved in 44% of visits between 1996 and 2002, 41% between 2003 and 2009, and 34% between 2010 and 2016.
Significant differences in caseload composition were observed between psychiatrists who offered psychotherapy in all visits, some visits, or no visits. Psychiatrists offering no psychotherapy had larger proportions of visits with patients diagnosed with schizophrenia or bipolar disorder (p<0.001). For psychiatrists offering psychotherapy in all visits, caseloads less frequently involved patients with major depression (p=0.04) and more often involved patients with dysthymic disorder (p<0.001), OCD (p=0.005), PTSD (p=0.005), social phobia (p=0.002), other anxiety disorders (p=0.002), and personality disorders (p<0.001). No difference was detected in the proportion of visits with patients with psychiatric comorbidities. These findings remained stable through the study period, and no temporal interactions were detected (see Table S6 in the online supplement).
A multivariate multinomial logistic regression revealed that with time, visits to psychiatrists who provided psychotherapy in all visits or to those who never provided psychotherapy became more likely, compared with visits to those who occasionally offered psychotherapy (Table 3). Adjusting for other covariates, treatment by psychiatrists who provided psychotherapy in all visits was associated with patients over age 25, as well as with diagnoses of dysthymic disorder, generalized anxiety disorder, other anxiety disorders, and personality disorders. It was also negatively linked with Medicaid or other, nonspecified payment sources, with non-solo clinic settings, with antidepressant or sedative-hypnotic prescription, and with location in the South. Treatment by psychiatrists offering no psychotherapy at all was associated with location in the South, a non-freestanding clinic setting, and a diagnosis of panic disorder or other mood disorders. It was also negatively associated with patient identification as non-White and non-Hispanic, with a diagnosis of dysthymic disorder, OCD, or personality disorder, and with self-pay.
TABLE 3. Associations of visit characteristics with psychiatrist provision of psychotherapy in all, some, or no visitsa
CharacteristicNo Psychotherapy VisitsAll Psychotherapy Visits
Relative Risk Ratio95% CIpRelative Risk Ratio95% CIp
Intercept0.190.12, 0.3<0.0010.10.06, 0.16<0.001
Survey year1.11.07, 1.13<0.0011.061.02, 1.10.004
Age (years)      
 <251 [reference]  1 [reference]  
 25–441.120.91, 1.380.281.761.31, 2.38<0.001
 45–641.030.84, 1.270.791.61.17, 2.190.003
 ≥651.070.81, 1.420.642.471.68, 3.63<0.001
Gender      
 Male1 [reference]  1 [reference]  
 Female1.080.99, 1.170.091.180.99, 1.420.07
Race/ethnicity      
 White1 [reference]  1 [reference]  
 Black or African American0.660.52, 0.850.0011.050.73, 1.520.78
 Hispanic or Latino0.990.78, 1.250.910.760.5, 1.140.18
 Other0.620.45, 0.850.0030.70.47, 1.050.09
Psychiatric diagnosis      
 Major depressive disorder1.030.85, 1.260.761.060.66, 1.690.81
 Dysthymic disorder0.740.58, 0.940.021.861.29, 2.690.001
 Bipolar disorder1.010.81, 1.240.960.680.42, 1.110.12
 Other mood disorders1.311.04, 1.640.021.540.99, 2.410.06
 Generalized anxiety disorder1.040.77, 1.410.781.71.09, 2.670.02
 Panic disorder1.241.01, 1.540.040.970.57, 1.630.9
 Posttraumatic stress disorder0.960.69, 1.320.81.430.85, 2.420.18
 Social phobia0.960.67, 1.390.841.990.96, 4.090.06
 Other anxiety disorders0.940.72, 1.220.631.951.2, 3.170.007
 Obsessive-compulsive disorder0.780.62, 0.970.031.50.99, 2.270.06
 Schizophrenia1.060.8, 1.410.690.790.45, 1.390.42
 Personality disorders0.520.37, 0.73<0.0011.631.03, 2.590.04
Comorbidity      
 No psychiatric comorbidities1 [reference]  1 [reference]  
 Psychiatric comorbidities0.820.65, 1.030.080.720.51, 1.020.07
Medication class      
 Antidepressants1.010.88, 1.160.90.670.51, 0.880.004
 Antipsychotics1.030.91, 1.170.650.90.7, 1.150.39
 Mood stabilizers1.060.91, 1.230.441.140.76, 1.710.54
 Sedative-hypnotics0.930.82, 1.060.290.810.66, 1<0.05
Source of paymentb      
 Private insurance1 [reference]  1 [reference]  
 Medicare1.070.87, 1.310.50.710.48, 1.040.08
 Medicaid0.990.75, 1.30.930.320.18, 0.57<0.001
 Self-pay0.320.24, 0.42<0.0011.470.99, 2.190.06
 Other1.120.78, 1.590.550.520.3, 0.910.02
Office settingb      
 Freestanding, solo practice1 [reference]  1 [reference]  
 Freestanding, group practice1.130.78, 1.650.520.270.13, 0.570.001
 HMO or other2.911.92, 4.4<0.0010.180.07, 0.46<0.001
Region      
 Northeast1 [reference]  1 [reference]  
 Midwest1.260.83, 1.910.280.560.29, 1.090.09
 South1.991.37, 2.88<0.0010.390.25, 0.63<0.001
 West0.810.52, 1.260.360.840.46, 1.510.55
Location      
 Metropolitan1 [reference]  1 [reference]  
 Nonmetropolitan1.480.86, 2.570.160.620.17, 2.240.47
a
Data are from the National Ambulatory Medical Care Survey, 1996–2016. Multinomial multivariate logistic regression was based on weighted visit samples; reference level refers to “some psychotherapy visits.”
b
Data were missing for the year 1996.
Adding to the multivariate model (Table 2) psychiatrist provision of psychotherapy in all visits, in some visits, or in no visits, the effects reported above largely persisted in magnitude and significance. The association with self-pay, however, diminished from an adjusted risk difference of 16.1% (95% CI=11.8, 20.4, p<0.001) to 7.2% (95% CI=2.8, 11.5, p<0.001) (see Table S7 in the online supplement). This link between patient self-pay and access to psychiatrists who favor psychotherapy highlights the centrality of payment in psychotherapy provision.

Psychotropic Prescription and Integrated Combination Care

During the study period, psychotropics were prescribed in 86% of visits. Whereas nonprescription tripled (in the multivariate model) or quadrupled (in the bivariate model) the odds of involving psychotherapy, 73% of psychotherapy visits involved medications. Of nonpsychotherapy visits, 60% involved antidepressants, and of psychotherapy visits, 52% involved antidepressants (p<0.001). Prescription rates for nonpsychotherapy and psychotherapy visits, respectively, were 28% and 14% (p<0.001) for antipsychotics, 15% and 11% (p<0.001) for mood stabilizers, and 33% and 27% (p<0.001) for sedative-hypnotics. Psychiatrists providing psychotherapy in all visits prescribed medications in 65% of the visits. Between 1996 and 2002, prescription occurred in 66% of psychotherapy visits and in 88% of other visits. Between 2003 and 2009, the percentages rose to 79% (p<0.001) and 93% (p<0.001), respectively, and between 2010 and 2016, they remained stable at 75% (p=0.26) and 92% (p=0.56), respectively. Psychiatrist visits where both pharmacotherapy and psychotherapy were provided declined from 25.4% of visits in 1996–1997 to 13.1% in 2015–2016 (risk difference=−0.6%, 95% CI=−0.8, −0.3, p<0.001).

Frequency of Patient Visits

Since 2007, NAMCS introduced exact counts of patients’ prior visits within the past 12 months (capped at 99 visits). The mean number of visits during the past 12 months among patients receiving psychotherapy was 27.2 (SD=1.6), which was larger (p<0.001) than that of other patients (mean=8.3 [SD=0.3]). Of sampled visits, 2% were by patients with 99 or more annual visits. Of these, 82% involved psychotherapy. Data available since 2014 demonstrate the association between psychotherapy and earlier return appointments: less than 1 week in 23% of psychotherapy visits, compared with 1% of other visits (p<0.001), and 2 months or more in 3% of psychotherapy visits, compared with 33% of other visits (p<0.001). A middle category of return appointments, ranging from 1 week to 2 months between appointments, accounted for 60% of psychotherapy visits and 69% of other visits (p<0.001). No difference was detected in visits where no specific return appointments were scheduled.

DISCUSSION

The downward trend in psychiatrist provision of psychotherapy in outpatient settings in the years 1996–2016 persisted and did not abate. While a small group of psychiatrists (11%−15%) continued to provide psychotherapy in all patient visits, in the 2010s, about half of psychiatrists did not provide psychotherapy at all, and those who provided psychotherapy in some patient visits came to do so more and more rarely. The decline in psychotherapy provision by U.S. psychiatrists may be related to changing economic pressures, as well as to the specialization in prescription of new psychotropic medications.
Although psychotherapy provision declined across almost all clinical groups, patients with severe diagnoses, such as major depressive disorder, bipolar disorder, panic disorder, and schizophrenia, were typically the least likely to receive psychotherapy from their psychiatrists. Differences in the availability of effective pharmacological treatments may help to explain this variation. For example, while for personality disorders, the diagnosis with the highest psychotherapy provision, no medications have indications approved by the U.S. Food and Drug Administration (FDA), for schizophrenia, the diagnosis with the lowest psychotherapy provision, psychiatrists have a range of effective antipsychotic medication options (9). The association between lower income, education, and other socioeconomic status indicators and some severe mental disorders (10) may further explain these findings through links between payment source and psychotherapy provision.
During the study period, psychiatrist provision of psychotherapy became more segregated, and declines were especially marked in nonmetropolitan areas, in the South and Midwest regions, and among patients covered by public insurance, including Medicaid. Older, White patients residing in metropolitan areas in the Northeast or West with private insurance or who were self-paying experienced more limited change. These findings harken back to a long tradition of research demonstrating associations between social class and treatment type, with higher-status sociodemographic groups likelier to receive psychotherapy (11).

Market Forces

Previous research has shown how outpatient reimbursement rates incentivize multiple shorter medication management visits over psychotherapy (12, 13). Data collected in both 2002 and 2014 estimated a 41% hourly reimbursement gap disfavoring psychotherapy (14, 15). This, together with insurers’ preference for service provision by lower-reimbursed nonphysician providers when possible (6), is likely pertinent to the association between payment source and psychotherapy provision. In the present study, self-pay had the strongest association with psychotherapy provision among all sociodemographic, geographic, and financial characteristics examined and, additionally, a significant negative relationship with treatment by psychiatrists not providing psychotherapy at all.
Between 2003 and 2013, the number of practicing psychiatrists declined, exacerbating access constraints in the face of growing demand (16). Such shortages, disproportionately occurring in rural areas, were associated with treatment using psychopharmacotherapy alone (17). Despite the increase in mental health care insurance coverage brought about by the Affordable Care Act and the Mental Health Parity and Addiction Equity Act, psychiatrist participation in public insurance programs decreased, and the proportion of psychiatrists only treating self-paying patients increased (6, 18, 19). The sociodemographic and geographic contours of psychiatrist shortages (16), which are more acute in lower-income and lower-education localities, in the South and Midwest, and in nonmetropolitan areas, align with those of the downward trend in psychotherapy provision.
Despite many patients’ preference for psychotherapy over medication, most extensively studied in depression and anxiety disorders (20), a market in which fee structures disincentivize psychiatrists from practicing psychotherapy and in which demand overwhelms supply likely drives some psychiatrists to focus on services that nonphysician professionals are typically unauthorized to provide (21).

Clinical Considerations

Psychiatrists in the expanding group that offered no psychotherapy typically had more visits involving the most severe diagnoses such as schizophrenia and bipolar disorder. Psychiatrists who provided psychotherapy in all visits had fewer visits involving diagnoses of major depression and more involving dysthymic disorder, personality disorders, OCD, PTSD, social phobia, and other anxiety disorders. Indeed, specific psychotherapies for OCD (22) and PTSD (23) are considered first-line treatments. Caseload differences remained stable and did not change throughout the study period.
The study period was also marked by considerable expansions in the number and range of psychotropic medications approved by the FDA in each major class (24). With the exception of antidepressant prescription, which remained stable, prescription rates for antipsychotics, mood stabilizers, and sedative-hypnotics significantly increased during the study period. After adjusting for other covariates, antidepressants, antipsychotics, and sedative-hypnotics were each negatively associated with psychotherapy provision. The changes in psychotherapy and psychopharmacology provision by psychiatrists coincided with increasing public acceptance of neurobiological attributions of common psychiatric disorders, public endorsement of psychopharmacotherapy use (25), and rising direct-to-consumer marketing of psychotropic medications (26).
Psychiatrists who provided psychotherapy in all visits utilized psychotropics less frequently, with prescribing reported in 66% of visits between 2010 and 2016, compared with in 91% of visits reported among psychiatrists who did not provide psychotherapy in all visits (p<0.001). As demonstrated in a previous study, more prevalent use of pharmacotherapy explained much of the decline in the provision of psychotherapy between 1996 and 2005 (5). Yet, extending the analysis to 2016 revealed that the decline persisted independently of prescription and through the 2010s, when psychiatrists’ prescription rates plateaued. Indeed, pharmacotherapy has largely become the rule in outpatient psychiatry, with psychotherapy typically indicating combination therapy rather than nonprescription (27).
In outpatient settings for much of the 20th century, psychotherapy was the defining outpatient treatment for a wide range of mental disorders. Since the 1980s, however, the psychiatric profession has shifted toward a more biomedical model of patient care (28). The ACGME regards psychotherapy as a core competency and requires residents to develop broad psychotherapy skills (3), yet, often as a result of resource considerations, limited psychotherapy training in many residency programs does not adequately reflect this perspective (29, 30). Although our study cannot decompose findings regarding the decline in psychotherapy into those due to cohort turnover and those due to individual providers’ changing practices, the decline in psychotherapy practice among psychiatrists offering it occasionally and the rising share of those practicing no psychotherapy at all suggest that both factors may be operative.

Implications

APA’s most recent evidence-based practice guidelines recommend that psychotherapy be provided to patients across diagnoses such as schizophrenia, major depressive disorder, and bipolar disorder, and indeed, combination treatments involving both psychotherapy and pharmacotherapy show superior efficacy for treatment of major depressive disorder, panic disorder, and OCD (31). State-of-the-art individualized care often requires a combination of treatment modalities for many disorders.
However, not enough is known regarding the challenges and benefits of split (multiple providers) and integrated (single provider) combination care (32). Despite accreditation requirements for competency in both models, their clinical effects have yet to be sufficiently examined (33). While increases occurred in the proportion of patients with serious psychological distress receiving psychotherapy from any provider (34), since 2010, approximately half of psychiatrists no longer practiced any psychotherapy at all. With the exception of older, White, self-paying patients in metropolitan areas in the Northeast and West, access to psychotherapeutic treatments provided by psychiatrists became increasingly scarce. We found that only a small and diminishing percentage of patients received nonsplit combination treatment and that psychiatrists not practicing psychotherapy typically had caseloads involving more severe diagnoses. This may challenge psychiatrists’ unique potential to integrate neurobiological and psychosocial elements of clinical care, a trend whose implications are thus far insufficiently studied.

Limitations

There are several limitations to this study. First, NAMCS codes repeat patient visits as though they are unique, creating a gap between visit and patient counts. Because patients receiving psychotherapy have more annual visits and schedule earlier returns, the actual percentage of psychotherapy patients is likely lower than that of psychotherapy visits. Second, NAMCS response rates are modest, and they declined during the study period. Yet, weighting reduces selection bias (8), and the uncertainty associated with sample size is reflected in relatively large confidence intervals. Third, the NAMCS definition of psychotherapy does not differentiate between different modalities of psychotherapy, nor does it capture other verbal interventions, which are important to patient-centered care (35). Refining the definition to visits longer than 30 minutes likely excluded some encounters that included brief psychotherapy. Fourth, these results do not capture changes in psychiatric practice since 2016, psychotherapy visits with nonpsychiatrist health care professionals, visits outside of office-based medical care, or telehealth visits, which have significantly increased during the COVID-19 pandemic (36). Finally, NAMCS does not provide physician-level weights before 2005; to allow for pre-2005 comparisons, provider-level analyses were unweighted.

CONCLUSIONS

Although psychotherapy provision to U.S. adult patients is stable or rising overall (34), in part as a result of increases in the allied behavioral health workforce (37), pharmacotherapy advances and market pressures may have contributed to the continuing decline in psychiatrists’ practice of psychotherapy. Psychiatrist psychotherapy provision rates decreased by more than 50% between 1996 and 2016, and starting in the 2010s, about half of psychiatrists no longer practiced any psychotherapy at all. Psychiatrists not practicing psychotherapy typically saw patients with more severe diagnoses, and while declines affected nearly all patient populations, they were most marked among patients diagnosed with social phobia, dysthymic disorder, and personality disorders. Integrated combination care, in which both psychotherapy and pharmacotherapy are provided by the same practitioner, is most often associated with patient self-pay and is gradually declining. These trends pose a challenge to psychiatrists’ unique role as integrators of biological and psychological dimensions of care, with important implications for the profession and for the delivery of U.S. mental health care as a whole.
Lastly, the COVID-19 pandemic has made mental health care issues even more salient and pressing, with significant increases reported in anxiety and depression symptoms, psychopharmacotherapy use, and psychotherapy use, as well as in the unmet demand for psychotherapy (38). Although social distancing measures have resulted in a rapid increase in mental health care delivery via telehealth methods, improving some access constraints (39), these adaptations are unlikely to have reversed the long-term trends analyzed here, and increasing demand for treatment may have even accelerated them.

Acknowledgments

The authors thank Ramin Mojtabai, M.D., Ph.D., and Peter S. Bearman, Ph.D., for editorial assistance.

Supplementary Material

File (appi.ajp.2021.21040338.ds001.pdf)

References

1.
Leland E, Campbell RJ: Psychotherapy, in Psychiatric Dictionary, 3rd ed. New York, Oxford University Press, 1960
2.
Lanouette NM, Calabrese C, Sciolla AF, et al: Do psychiatry residents identify as psychotherapists? a multisite survey. Ann Clin Psychiatry 2011; 23:30–39
3.
Accreditation Council for Graduate Medical Education: ACGME Program Requirements for Graduate Medical Education in Psychiatry. Chicago, Accreditation Council for Graduate Medical Education. https://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/400_Psychiatry_2020.pdf
4.
Guidi J, Fava GA: Sequential combination of pharmacotherapy and psychotherapy in major depressive disorder: a systematic review and meta-analysis. JAMA Psychiatry 2021; 78:261–269
5.
Mojtabai R, Olfson M: National trends in psychotherapy by office-based psychiatrists. Arch Gen Psychiatry 2008; 65:962–970
6.
Mechanic D, Olfson M: The relevance of the Affordable Care Act for improving mental health care. Annu Rev Clin Psychol 2016; 12:515–542
7.
Centers for Disease Control and Prevention: Ambulatory health care data. Atlanta, Centers for Disease Control and Prevention. https://www.cdc.gov/nchs/ahcd/index.htm
8.
Hing E, Shimizu I, Talwalkar A: Nonresponse bias in estimates from the 2012 National Ambulatory Medical Care Survey. Vital Health Stat; 2(171):1–42
9.
Smith RC, Leucht S, Davis JM: Maximizing response to first-line antipsychotics in schizophrenia: a review focused on finding from meta-analysis. Psychopharmacology (Berl) 2019; 236:545–559
10.
Chen R, Kessler RC, Sadikova E, et al: Racial and ethnic differences in individual-level and area-based socioeconomic status and 12-month DSM-IV mental disorders. J Psychiatr Res 2019; 119:48–59
11.
Hollingshead AB, Redlich FC: Social Class and Mental Illness: A Community Study. New York, John Wiley and Sons, 1958
12.
Wilk JE, West JC, Rae DS, et al: Patterns of adult psychotherapy in psychiatric practice. Psychiatr Serv 2006; 57:472–476
13.
Smith DT: Medicine Over Mind: Mental Health Practice in the Biomedical Era (Critical Issues in Health and Medicine). New Brunswick, NJ, Rutgers University Press, 2019
14.
West JC, Wilk JE, Rae DS, et al: Economic grand rounds: financial disincentives for the provision of psychotherapy. Psychiatr Serv 2003; 54:1582–1583, 1588
15.
Mark TL, Olesiuk W, Ali MM, et al: Differential reimbursement of psychiatric services by psychiatrists and other medical providers. Psychiatr Serv 2018; 69:281–285
16.
Bishop TF, Seirup JK, Pincus HA, et al: Population of US practicing psychiatrists declined, 2003–13, which may help explain poor access to mental health care. Health Aff (Millwood) 2016; 35:1271–1277
17.
Jones JM, Ali MM, Mutter R, et al: Factors that affect choice of mental health provider and receipt of outpatient mental health treatment. J Behav Health Serv Res 2018; 45:614–626
18.
Benjenk I, Chen J: Trends in self-payment for outpatient psychiatrist visits. JAMA Psychiatry 2020; 77:1305–1307
19.
Wen H, Wilk AS, Druss BG, et al: Medicaid acceptance by psychiatrists before and after Medicaid expansion. JAMA Psychiatry 2019; 76:981–983
20.
McHugh RK, Whitton SW, Peckham AD, et al: Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry 2013; 74:595–602
21.
Belcher R: Psychotherapy and the professional identity of psychiatry in the age of neuroscience. Acad Psychiatry 2020; 44:227–230
22.
Dougherty DD, Brennan BP, Stewart SE, et al: Neuroscientifically informed formulation and treatment planning for patients with obsessive-compulsive disorder: a review. JAMA Psychiatry 2018; 75(10):1081–1087
23.
Shalev A, Liberzon I, Marmar C: Post-traumatic stress disorder. N Engl J Med 2017; 376:2459–2469
24.
Food and Drug Administration: Drugs@FDA: FDA-approved drugs. Silver Spring, Md, US Food and Drug Administration. https://www.accessdata.fda.gov/scripts/cder/daf
25.
Pescosolido BA, Martin JK, Long JS, et al: “A disease like any other”? A decade of change in public reactions to schizophrenia, depression, and alcohol dependence. Am J Psychiatry 2010; 167:1321–1330
26.
Becker SJ, Midoun MM: Effects of direct-to-consumer advertising on patient prescription requests and physician prescribing: a systematic review of psychiatry-relevant studies. J Clin Psychiatry 2016; 77:e1293–e1300
27.
Olfson M, Marcus SC: National trends in outpatient psychotherapy. Am J Psychiatry 2010; 167:1456–1463
28.
Luhrmann TM: Of Two Minds: An Anthropologist Looks at American Psychiatry. New York, Vintage Books, 2001, pp 337
29.
Sudak DM, Goldberg DA: Trends in psychotherapy training: a national survey of psychiatry residency training. Acad Psychiatry 2012; 36:369–373
30.
Rim JI, Cabaniss DL, Topor D: Psychotherapy tracks in US general psychiatry residency programs: a proxy for trends in psychotherapy education? Acad Psychiatry 2020; 44:423–426
31.
Cuijpers P, Sijbrandij M, Koole SL, et al: Adding psychotherapy to antidepressant medication in depression and anxiety disorders: a meta-analysis. World Psychiatry 2014; 13:56–67
32.
Riba MB, Balon R, Weiss RL: Competency in Combining Pharmacotherapy and Psychotherapy: Integrated and Split Treatment, 2nd ed. Washington, DC, American Psychiatric Association Publishing, 2018
33.
Holmes EA, Ghaderi A, Harmer CJ, et al: The Lancet Psychiatry Commission on psychological treatments research in tomorrow’s science. Lancet Psychiatry 2018; 5:237–286
34.
Olfson M, Wang S, Wall M, et al: Trends in serious psychological distress and outpatient mental health care of US adults. JAMA Psychiatry 2019; 76:152–161
35.
Cruz M, Cruz RF, Pincus HA: Patients’ perspective on the value of medication management appointments. Healthcare (Basel) 2015; 3:284–295
36.
Shore JH, Schneck CD, Mishkind MC: Telepsychiatry and the coronavirus disease 2019 pandemic: current and future outcomes of the rapid virtualization of psychiatric care. JAMA Psychiatry 2020; 77:1211–1212
37.
US Department of Health and Human Services: Behavioral health workforce projections: 2017–2030. Washington, DC, US Department of Health and Human Services. https://bhw.hrsa.gov/data-research/projecting-health-workforce-supply-demand/behavioral-health
38.
Vahratian A, Blumberg SJ, Terlizzi EP, et al: Symptoms of anxiety or depressive disorder and use of mental health care among adults during the COVID-19 pandemic:–United States, August 2020–Feb 2021. MMWR Morb Mortal Wkly Rep 2021; 70:490–494
39.
Ridout KK, Alavi M, Ridout SJ, et al: Changes in diagnostic and demographic characteristics of patients seeking mental health care during the early COVID-19 pandemic in a large, community-based health care system. J Clin Psychiatry 2021; 82:20m13685

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 110 - 121
PubMed: 34875872

History

Received: 3 April 2021
Revision received: 10 July 2021
Revision received: 20 July 2021
Accepted: 4 August 2021
Published online: 8 December 2021
Published in print: February 2022

Keywords

  1. Psychotherapy
  2. Outpatient Psychiatry

Authors

Details

Daniel Tadmon, M.Phil. [email protected]
Interdisciplinary Center for Innovative Theory and Empirics (INCITE), Columbia University, New York (Tadmon); Department of Psychiatry, Columbia University Vagelos College of Physicians and Surgeons, New York (Olfson).
Mark Olfson, M.D., M.P.H.
Interdisciplinary Center for Innovative Theory and Empirics (INCITE), Columbia University, New York (Tadmon); Department of Psychiatry, Columbia University Vagelos College of Physicians and Surgeons, New York (Olfson).

Notes

Send correspondence to Mr. Tadmon ([email protected]).

Competing Interests

The authors report no financial relationships with commercial interests.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share