Access to mental health care in the U.S. Department of Veterans Affairs (VA) is often construed as whether veterans initiate treatment (
1,
2), but researchers and policy makers have begun to consider whether access also refers to whether veterans receive an adequate amount of care (
3,
4). This study assessed whether the doses of psychotherapy and pharmacotherapy related to posttraumatic stress disorder (PTSD) contributed to better clinical outcomes among veterans diagnosed as having PTSD.
Clinical practice guidelines provide little guidance on what constitutes an adequate dose of psychotherapy for PTSD (
5,
6). VA procedure codes indicate session length and modality (for example, individual versus group), but they do not identify a specific treatment approach, such as prolonged exposure therapy or cognitive-processing therapy. Among all VA patients who are diagnosed as having PTSD and who initiate psychotherapy, roughly 25% to 33% complete at least eight or nine sessions (
3,
4), which some researchers have proposed as an adequate amount of contact for delivery of an evidence-based treatment. The VA has set a performance target for treatment of PTSD among veterans who served in Operation Enduring Freedom (OEF), Operation Iraqi Freedom (OIF), or Operation New Dawn (OND). At least 20% of these patients who had two or more visits with a PTSD diagnosis must receive at least eight PTSD-related psychotherapy sessions within a 14-week period, unless they received a similar dose of treatment within the past two years. However, no prior studies have assessed whether this amount actually is associated with better clinical outcomes. This study explored the utility of this process measure of dose of psychotherapy.
PTSD practice guidelines endorse an adequate initial trial (at least eight to 12 weeks) of selective serotonin reuptake inhibitors (SSRIs) or serotonin norepinephrine reuptake inhibitors (SNRIs) in treating PTSD (
5,
6). Prior analyses found that fewer than two-thirds of VA patients with PTSD who were prescribed SSRIs or SNRIs refilled the prescriptions for at least three or four months (
3,
7). These guidelines do not specify standards for assessing longer-term medication adherence. One suggested measure of adherence often used in research is the medication possession ratio (MPR), which is the total days’ supply of medication (initial prescription and refills) divided by the total days in the follow-up period. Some studies, including studies that involved general medical disorders, have suggested using an MPR of 80% to define good adherence (
8,
9), although two studies that used that cut-point showed variable outcomes among veterans (
10,
11)
We tested whether rates of improvement in PTSD, depression, and mental health functioning were associated with having at least eight PTSD-related visits for psychotherapy within 14 weeks, initiation or completion of a 90-day trial of an SSRI or SNRI, and extent of medication coverage, as measured by MPR.
Methods
Study procedures were overseen by the Stanford University School of Medicine Institutional Review Board, and participants provided written informed consent.
Participants
Veterans (N=482) were recruited as part of the Longitudinal Veterans Health Survey, a study of treatment utilization and outcomes among veterans newly diagnosed as having PTSD (
7,
12). VA administrative data were used to draw a national random sample from all VA outpatients who were between the ages of 18 and 69 and who had an outpatient VA visit with a PTSD diagnosis after not having had a PTSD diagnosis in the prior two years. The index outpatient visit in which the diagnosis was made could be for any service in any VA clinic, and thereafter the participants could have any number of outpatient or inpatient visits. Half of the participants (N=250, 52%) were diagnosed in a general mental health clinic; 11% (N=54) in a PTSD specialty clinic; and 37% (N=178) in other settings, such as primary care. The final sample included 134 male OEF/OIF veterans, 109 female OEF/OIF veterans, 121 male veterans of prior eras, and 118 female veterans of prior eras, with a mean±SD age of 41.2±13.3. The sample included 327 (68%) whites, 90 (19%) African Americans, 66 (14%) Hispanics or Latinos, and 41 (9%) participants of other race or ethnicity. Additional details about the sample were published previously (
7,
8).
Procedure
Participants completed a baseline survey by mail between August 2006 and April 2008, a second survey five to 12 months (median=7.6 months) later, and a third survey eight to 28 months (median=17.9 months) after the second survey. A majority completed surveys at time 2 (N=376, 78%) and of those, 307 (82%) returned the time 3 survey, with 64% (N=307) completing both follow-up surveys. Participants who completed both follow-up surveys were more likely than those who completed only the baseline survey to be female (49% versus 39%; χ2=3.86, df=1, p<.05) and to be slightly older (41 versus 38 years; Mann-Whitney U test, z=−2.64, p<.01).
Measures
PTSD was assessed by the Impact of Event Scale–Revised (
13), and depression was measured by the Center for Epidemiologic Studies–Depression (CES-D) scale (
14). Functioning was assessed with the mental health aggregate score of version 2 of the 12-Item Short-Form Health Survey (SF-12) (
15), which measures general medical and mental health symptoms and functioning in the past 30 days.
Outpatient psychotherapy visits for a primary or secondary PTSD diagnosis were determined from VA administrative data between the baseline survey and the following year. Visits were coded in the following categories: 0, 1 or 2, 3–7, ≥8, and ≥8 within 14 weeks.
Data from the VA Pharmacy National Data Extracts database were used to identify participants who received a prescription for an SSRI or SNRI as an outpatient. To assess initiation of an SSRI or SNRI between the index visit and the baseline survey, we coded participants by whether they started but did not complete a 90-day trial of an SSRI or SNRI during that time frame. For all veterans prescribed an SSRI or SNRI, we calculated the MPR for the year following the baseline survey by dividing the total days’ supply by 365 days, excluding any inpatient stays.
Data analysis
Hierarchical linear modeling (HLM) was fit by restricted maximum likelihood by using the lme4 library from R, version 2.13 (
16,
17). Preliminary analyses indicated relatively linear slopes of the dependent variables over time (no significant quadratic or cubic functions). Separate models were run to assess the effects of psychotherapy, initiation of an SSRI or SNRI, and continuation of SSRIs and SNRIs on the course of PTSD, depression, and functioning. Each model included the grand intercept across time and subjects, the grand intercept and the grand slope for each person at level 1 of the HLM model, and within-person residuals across time at level 2 of the HLM model. Our primary focus was whether dose of care predicted rate of change in outcomes over time.
Results
Dose of psychotherapy
In the year after the baseline survey, 267 (55%) received no PTSD-related psychotherapy, 83 (17%) received one or two visits, 65 (13%) received three to seven visits, 28 (6%) received eight or more visits, and 39 (8%) received eight or more visits within 14 weeks. Ten participants (2%) were excluded from the HLM analysis because they completed eight psychotherapy visits within 14 weeks during the period between the index visit and the baseline survey. Patients with more PTSD-related psychotherapy visits had more severe symptoms, but dose of psychotherapy did not predict slope of improvement for any clinical outcome variable across time (
Table 1). Post hoc analyses comparing individual versus group psychotherapy or restricting the sample only to OEF/OIF veterans did not yield any significant findings for the effect of number of PTSD-related visits on symptom course.
Initiation of SSRIs or SNRIs
Thirty-five participants (7%) were excluded from this analysis because they had completed a 90-day course of an SSRI or SNRI prior to the baseline survey. Of the remaining 447 participants, 53% (N=235) had no prescription for an SSRI or SNRI, and 47% (N=212) started but did not complete a 90-day trial between the index visit and the baseline survey. Data about receipt of prescriptions for SSRIs and SNRIs for all patients in the year after the baseline survey indicated that 45% (N=218) had no prescription, 18% (N=85) had a prescription but less than a 90-day supply, and 37% (N=179) had at least 90 contiguous days’ supply. Excluding the 35 participants who had completed a 90-day course of an SSRI or SNRI prior to the baseline survey, participants who completed a 90-day trial of medication in the year after the baseline survey showed less improvement than participants who did not have medication (
Table 2). Post hoc analyses among OEF/OIF/OND veterans found that those who had a partial 90-day trial between the index visit and the baseline survey experienced significant improvement over time in depression (b=–.38, t=–3.07, df=320, p=.002) and mental health functioning (b=.34, t=2.60, df=291, p=.01).
Continuation of SSRIs and SNRIs
MPRs among patients prescribed an SSRI or SNRI ranged from .01 to 1.00 (mean±SD=.59±.29). Higher MPRs were associated with less improvement in depression and mental health functioning (
Table 3). Post hoc analyses among only OEF/OIF veterans, however, found no significant effect for continuous supply of medication on symptom course.
Discussion
Over half of the study participants (55%) received no PTSD-related psychotherapy, and 45% received no SSRIs or SNRIs in the year after the baseline survey, suggesting that many patients did not receive any first-line treatments for PTSD from the VA, despite clinical practice guidelines by the VA and the Department of Defense endorsing these treatments. Contrary to our hypotheses, none of the quality indicators significantly contributed to longitudinal improvement in veterans’ functioning. These findings highlight the importance of directly assessing patient outcomes rather than only process measures.
One confounding factor was that more symptomatic patients tend to seek and receive more psychotherapy and take more medications. Our surprising finding that a 90-day trial of SSRIs or SNRIs or more regular medication refills were associated with less improvement in depression and mental health functioning may be influenced by patient behavior: individuals who improve quickly may stop their medications, whereas those who experience continuing symptoms may refill their medications. Similarly, more symptomatic patients may seek more psychotherapy, or providers may insist on greater frequency of sessions.
Another issue was that administrative procedure codes cannot differentiate evidence-based psychotherapies from nonspecific psychotherapies (
18). For example, prior studies have shown that veterans who received prolonged exposure (
19) or cognitive-processing therapy (
20) reported greater improvement in PTSD symptoms (pre-post d=.87–1.52) compared with veterans in this study who received eight or more sessions of psychotherapy in 14 weeks (d=.07). This difference confirms the importance of monitoring specific therapy approaches and not only frequency and quantity of visits.
Our medication measures identified only whether patients refilled their medications, not whether they actually took them, and did not account for patients switching from SSRIs and SNRIs to other classes of medication. Thus because of our limited measures of adherence, this study was not intended to test the effectiveness of pharmacotherapy, nor could it test the effectiveness of psychotherapy because data on specific types of psychotherapy were not available. We also were unable to examine the joint effects of both psychotherapy and pharmacotherapy in the same model. Our secondary outcome measures, the CES-D and the SF-12, also may not be optimally sensitive to change over time. Although the follow-up response rate was nearly 80%, nonrandomization and a differential response among female and older veterans may have slightly biased our results.
Conclusions
This study confirmed the importance of directly assessing patient outcomes rather than using only process measures. Our results underscore the importance of measuring the type, not only the quantity, of psychotherapy that participants receive and the need for more adequate measures of medication adherence. Given that polypharmacy and concurrent pharmacotherapy and psychotherapy are common in PTSD care (
21), future studies should examine the effects of sequenced or augmented treatments rather than those of only one class of medication.
Acknowledgments and disclosures
This work was supported by the VA Sierra Pacific Mental Illness Research, Education and Clinical Center and the VA Office of Academic Affiliations. The opinions expressed are those of the authors and do not necessarily represent the policy of the VA or the United States government.
The authors report no competing interests.