Clinical Practice Guidelines In PTSD
The practice guidelines to be considered in this article are listed in
Table 1. These guidelines were selected as they met the criteria of a systematic review of the evidence, included ratings of the strength of the evidence, and included clinical recommendations generated by a working party of content experts with ratings as to level of confidence in the rating. There are many published evidence reviews that do not include the development and publication of clinical practice recommendations per se. More prominent examples of these include the Institute of Medicine (
IOM, 2007) report and the American Psychological Association’s Empirically Supported Psychological Treatments report (
Chambless & Ollendick, 2001). With the exception of the IOM report, those evidence reviews that do not provide clinical practice recommendations will not be discussed here. The IOM report is included in the discussion below due to its prominence in the field and the more unique methodological standards it applied.
Methodologies
The first issues to be considered when interpreting practice guidelines and evaluating their methodologies are (a) who comprised the working party, (b) for which constituency was the guideline primarily designed, and (c) what was the focus of the evidence review (
Raine et al., 2005).
Table 2 outlines the methodologies for the seven guidelines considered here. Although the authors of each guideline would likely claim that their findings and statements are applicable across populations, each set of guidelines has a unique focus. The constituency for whom the guidelines were designed plays a large role in understanding the methodology and focus of the evidence reviews. In this context, the American Psychiatric Association (
APA, 2004) and American Academy for Child and Adolescent Psychiatry (AACAP;
Cohen et al., 2010) guidelines stand apart from the other guidelines in terms of the working party being primarily, if not exclusively, psychiatrists, compared to multidisciplinary working party representation in the case of the other practice guidelines. These two guidelines are written primarily for their membership and the literature searches are driven largely by key words selected by the psychiatrist working parties.
The International Society for Traumatic Stress Studies (ISTSS) practice guideline (
Foa, Keane, Friedman, & Cohen, 2008) was developed primarily for its constituency, which comprises multidisciplinary practitioners working with survivors of trauma and spanning across a range of nations and theoretical paradigms. Not surprisingly, the approach taken in the development of this guideline was to identify the range of interventions potentially used by their constituency and conduct an evidence review for each intervention. The result of this approach was the development of a statement on the strength of the evidence for each intervention category, with less focus on ranking one treatment above another or on synthesizing recommendations across intervention categories.
The IOM review cannot be considered a practice guideline because no clinical recommendations were included in that report. The constituency for the IOM review was the U.S. Government’s Department of Veterans Affairs (VA), which sought statements on the strength of the evidence for a range of interventions potentially used within the VA system. The IOM conducted reviews on a systematic list of identified interventions and produced statements on the strength of evidence for each.
These methodologies contrast to those of the U.S. Veterans Affairs/Department of Defense (
VA/DoD, 2004), UK National Institute of Clinical Excellence (
NICE, 2005), and Australian National Health and Medical Research Council (
Australian Centre for Posttraumatic Mental Health, 2007) guidelines for which working parties developed a series of specific questions to be answered by the literature. These were verified and elaborated by a multidisciplinary panel representing a broad range of potential stakeholders, and then subjected to evidence reviews to answer these questions. An example of such a question is “do psychological interventions for PTSD improve outcomes compared to no interventions?” That is, they searched for research data that demonstrated the efficacy of treatment for PTSD before asking further questions about which of those treatments were most effective. As national government health bodies tasked with informing policy and practice through evidence-based recommendations, NICE and NHMRC were concerned only with those treatments that have demonstrable efficacy. Although this approach has the highest scientific rigor, it may not always take adequate account of whether the empirical data can be meaningfully translated into routine clinical practice. A distinguishing feature of the VA/DoD guideline was that it developed separate algorithms oriented to the initial point of contact being primary care and mental health settings.
The practice guidelines also varied in how the evidence reviews were conducted. Key considerations here include (a) the level of independence of the review team from the working party in the conduct of the reviews, (b) the levels of evidence that were considered acceptable, (c) the degree to which evidence statements were developed, (d) whether a prereview effect size was identified for determination of treatment effectiveness, and (e) the manner in which weighting between data and expert consensus was handled in generating statements of effectiveness. In this context, it is important to differentiate between a rating of the strength of the research evidence and a rating of the strength of the clinical recommendation derived from the evidence. Some practice guidelines report both, others report only one.
Rating the Research Evidence
Table 3 outlines the rating systems drawn from each of the seven guidelines (where available) that identify the strength of the research data according to objective levels. By these criteria, the IOM review is the most rigorous of the guidelines. The systematic literature review was conducted by the IOM, independently of the funding source (VA) and content experts, and included only the highest level RCTs. This review rejected RCTs with small sample sizes, inadequate blinding, and large numbers of dropouts, and included minimum standards in handling of missing data. Hence, the IOM review omitted a considerable portion of RCTs included in evidence reviews in all the other practice guidelines. (Of course, as previously noted, the IOM report was only intended to be an evidence review—it does not purport to be a practice guideline, although the two goals are not independent of one another).
The next level in terms of independence and rigor appears to be the VA/DOD, NICE, and NHMRC guidelines. In all these guidelines, (a) specific questions were developed beforehand to guide the systematic review; (b) the evidence review was conducted by a body independent of the working party who produced evidence statements; (c) only Level I and II studies were included where the question could be addressed by this level of evidence; and (d) in the case of the NICE and NHMRC guidelines, more formal meta-analyses were conducted and predetermined effect sizes representing clinical effectiveness were established against which research findings were rated.
Given the predetermination of effect sizes and relative risk ratios considered to represent clinically significant differences, the evidence statements in those guidelines provide a solid and as objective as possible method of interpreting study findings in relation to the review questions. (A relative risk [RR] is the probability of an event occurring—in this case likelihood of having a diagnosis of PTSD—in a group of people who have been exposed—in this case to treatment—compared to those who had not been exposed). The evidence statements include the number of studies that relate to the question asked (k), the number of cases included in all these studies (n), either the effect size (standard mean difference, which is also Hedges’ g) or relative risk ratios for determining comparisons in rates of diagnosis (RR), and the relevant confidence intervals. Two examples of evidence statements have been drawn from the NICE guidelines to illustrate this point. The first is an evidence statement that examines relative risk ratio of having a diagnosis of PTSD: “In comparing trauma focused cognitive behaviour therapy (CBT) versus stress management: There is limited evidence favouring trauma-focused CBT over stress management therapy on reducing the likelihood of having a PTSD diagnosis after treatment (k = 6; n = 284; RR = 0.78, 95% CI = 0.61 – 0.99).” The second examines the likelihood of difference between conditions on a dimensional outcome measure, e.g., PTSD severity: “In comparing trauma-focused CBT versus waitlist: There is evidence favouring trauma-focused CBT over waiting list on reducing the severity of PTSD symptoms (clinician rated measures) (k = 13; n = 609; standardized mean difference (SMD) = −1.36; 95% CI=−1.88 – −0.84).”
An additional methodological approach taken by the authors of the NICE guideline was that pharmaceutical companies were contacted for access to data in the case of studies known to have been conducted but not published. In the case of two trials, the NICE guideline development group was able to obtain posttreatment means for outcome measures but not standard deviations. The standard deviations were therefore estimated and the results from these two studies included in the meta-analysis. These studies were not included in the evidence reviews for the other guidelines.
The APA and AACAP reviews represent the next level of rigor in that the literature reviews were conducted by the working party themselves using more informal methods. The literature was searched using key terms such as PTSD or trauma to access relevant publications which were then culled to form the body of evidence upon which the recommendations were based. Although evidence tables summarizing studies were developed, clear evidence statements along the lines of those described above were not.
Finally, the ISTSS practice guideline represents a mixed process, where evidence reviews and the development of evidence summaries were conducted by different working groups for each intervention category. As such, chapters on the different interventions varied significantly in terms of, for example, whether evidence tables were reported, the nature of the evidence review methodologies used, whether effect size statistics were reported and, if they were, which was used (e.g., Cohen’s d or Hedges’ g).
Clinical Practice Guideline Recommendations
Each PTSD guideline includes up to 100 recommendations derived to varying degrees from the research evidence. Obviously, it is beyond the scope of this article to review similarities and differences across all these recommendations. Instead, the key recommendations will be compared to illustrate differences across the guidelines. The guideline recommendations often include a grade to describe the strength of each recommendation. That is, how confident can people be in using the recommendation to reliably drive practice? Rating systems used for grading the recommendations across the guidelines can be seen in
Table 4. All guidelines attempted to use the highest level of evidence available to generate recommendations and all used expert consensus to generate recommendations for which empirical research was unavailable. A key difference, however, was the extent to which that expert consensus contributed to the strength of the recommendation rating. Whereas some (e.g., NICE, NHMRC) gave the highest rating only to recommendations with level I or II research support, others (e.g., APA, AACAP) gave the highest rating based on rigorous empirical evidence (RCT) and/or overwhelming clinical consensus. The key recommendations of the seven guidelines can be seen in
Table 5.
It is important to recognize that, despite some areas of difference, there are many areas of concurrence across the guidelines in terms of their recommendations. All the guidelines strongly support the use of trauma-focused psychological treatment in PTSD for adults and, where addressed, for children. All the guidelines recognize some benefit of pharmacotherapy for the treatment of PTSD. Where addressed, all the guidelines caution against the routine use of psychological debriefing as an early preventive intervention for populations exposed to trauma. These are important areas of agreement that can do much to drive the wider adoption of evidence-based practice. Where differences exist, they are often a matter of degree. In general, they relate to the strength of recommendation rather than fundamental differences in what is, or is not, recommended.
There are probably three most obvious and important points of difference in the recommendations across these practice guidelines. These differences include (a) the extent to which pharmacotherapy, most notably selective serotonin reuptake inhibitors (SSRIs), is recommended; (b) the parameters of recommended psychological treatment and whether eye movement desensitization and reprocessing (EMDR) is an equivalent first line treatment to trauma-focused CBT (TFCBT); and (c) the degree to which guidelines seek evidence for, and provide, recommendations in the area of screening and assessment in addition to intervention.
In terms of pharmacotherapy, the key differences lie in whether SSRIs are recommended as an alternative first-line intervention (as reflected in the VA/DoD & APA guidelines) or as a second-line intervention when TFCBT is not available, acceptable, or suitable (e.g., NICE, NHMRC, AACAP). This difference is explained in part by the extent to which empirical data are the primary or sole basis upon which the recommendation is made. In the NICE and NHMRC guidelines, the independently conducted systematic literature review and predetermination of effect size parameters dictated the basis upon which the recommendations were made. The APA guidelines, however, needed to address that most physicians (to whom these guidelines are directed) do not practice cognitive–behavioral therapy. For the VA/DoD guideline, although the evidence review and determination of key questions were independent, the recommendations take into account a significant focus of the guideline on the algorithm for primary care as the initial point of contact. These differences highlight critical issues in the degree to which guideline recommendations are tailored to practical needs of constituencies and service systems, rather than being designed to inform policy makers in planning, developing, or purchasing of service systems. Finally, in terms of pharmacotherapy for children, AACAP and ISTSS recommendations were also influenced by the failure of some RCT evidence to document significant differences between SSRI and placebo responses.
For the ISTSS guideline, gradings are provided for levels of evidence for interventions in each chapter, but no gradings are provided as to the strength of recommendations. Because the recommendations relate to a particular category of intervention, it is difficult to determine a relative priority of recommendations across intervention categories, particularly where the evidence ratings appear comparable. This results, for example, in a statement that the evidence for CBT is stronger than for pharmacotherapy, yet the confidence in this statement is not rated and both CBT and pharmacotherapy recommendations receive Grade A evidence ratings.
The IOM report, as stated previously, adopts the most stringent criteria for study acceptance and review. Here pharmacotherapy (including SSRIs) failed to meet the required level of substantive evidence to support a recommendation at all. To understand this difference, it is necessary to know that the IOM evidence review rejected a number of pharmacotherapy studies that had been included in other guidelines’ evidence reviews. These studies were rejected largely due to the failure to meet the stringent minimum IOM standards in terms of study design and data analysis including the management of missing data (including use of Last Observation Carried Forward). It is noteworthy, however, that a dissenting opinion was included in the IOM report with respect to the report’s pharmacotherapy conclusions. Indeed in the IOM report only trauma-focused exposure, was identified as a recommended treatment, although this includes interventions with an exposure element such as cognitive processing therapy (CPT).
Another point of difference in pharmacotherapy recommendations among the PTSD guidelines is the more specific recommendation in the NICE guideline for paroxetine, whereas the VA/DoD, APA, ISTSS, and NHMRC guidelines recommend SSRIs more generally. A factor that may account for this is, as was outlined in the Methodologies subsection, the inclusion in the NICE evidence review of data from studies known to have been conducted but not published by pharmaceutical companies. The two studies mentioned previously for which standard deviations were not available both investigated sertraline; neither of these studies were included in the pharmacotherapy evidence reviews of the other guidelines.
The next key point of difference is the parameters of first-line recommended psychological treatments. Here there is some variation across the guidelines in how EMDR is addressed. In the IOM report, in view of the stringent criteria, only exposure is recommended, with EMDR failing to achieve a recommendation. In the NICE, NHMRC, VA/DoD, ISTSS, and APA guidelines the inclusion criteria for RCTs is less stringent. In all but the APA guideline, EMDR is given the highest rating alongside TFCBT in adults. The APA guideline gives EMDR a second strength rating. The factor that appears to contribute to this inconsistency in interpretation between the NICE, NHMRC, VA/DoD, and ISTSS guidelines on the one hand and the APA guideline, on the other, given all were reasonably consistent in terms of the level of RCTs included in the studies, was the manner in which the absence of support for the eye movement component in EMDR was addressed. The APA guideline took into account the absence of support for the eye movements per se in determining the recommendation rating, whereas the VA/DoD, NICE, NHMRC, and ISTSS guidelines were guided by the data effect sizes alone in rating the effectiveness and significance of the intervention. The Australian NHMRC guideline addressed the absence of evidence for the eye movements by adding a good practice point that followed the overarching recommendation. This practice point recommends to clinicians that as available evidence does not support the importance of eye movements per se in EMDR, they should be aware that treatment gains are more likely to be due to the engagement with the traumatic memory, cognitive processing, and rehearsal of coping and mastery responses.
Another interesting, if subtle, difference is the decision taken by the Australian NHMRC guideline group to reanalyze the EMDR data against TFCBT with and without a key study (
Ironson, Freund, Strauss, & Williams, 2002) that included in vivo exposure in the EMDR treatment arm. From those analyses it was determined that the EMDR condition merited equivalent ranking to trauma-focused CBT only if the former included in vivo exposure. Hence, this caveat was placed on the EMDR recommendation. This raises the vexed question of when more fine-grained analyses such as these are justifiable and how to ensure consistency in those aspects across different approaches. On the one hand, it has important clinical applications; on the other, it could be argued that to conduct such analyses in the case of one approach and not others is unreasonable. The reduced evidence base for EMDR in the treatment of children and adolescents resulted in it meeting a Level B recommendation in the ISTSS guideline for children although it was included as a first-line intervention along with other trauma-focused interventions in the AACAP guideline.
The absence of integrating recommendations across the intervention categories in the ISTSS guidelines can make them difficult to interpret. Exposure, EMDR, CPT, and stress inoculation therapy are all given Grade A evidence ratings, yet the CBT section in the integrating chapter reports only exposure, CPT, and stress inoculation therapy as first-line treatments. The EMDR section of the integrating chapter acknowledges the Level A rating for EMDR, but there is no statement that refers back to the CBT recommendation and addresses its place within the intervention lines for recommended treatments. It is clear from the above discussion that EMDR is the source of some disagreement across guidelines. Although it is beyond the scope of this article to provide details, suffice to say that EMDR and its efficacy has been the subject of considerable controversy and emotive debate over the years. The important point for this paper is the need for practice guidelines to rise above that debate and to provide objective and dispassionate recommendations based on the available evidence.
The final key point of difference is whether the guideline goes beyond a narrow definition of treatment to include recommendations around prevention, screening, assessment, and other aspects of care and, if so, the nature and rating of evidence used for such recommendations. Indeed, what constitutes evidence for such recommendations needs some consideration. Using screening as an example, there is evidence for the capacity of measures to accurately screen for PTSD. However, this is quite different from evidence that indicates screening as a process is effective in, for example, facilitating engagement in suitable care. The positions adopted in the guidelines range from those that provide a strong recommendation rating based largely on expert consensus (e.g., APA Rating I), through to those that provide a weak recommendation based on low levels of evidence (e.g., VA/DOD Rating C), to those that rely on strong clinical consensus but label them as “good practice points” (e.g., NICE, NHMRC) to distinguish them from those recommendations that are evidence based.
To a degree, these variations reflect a legitimate debate about whether research data alone is sufficient to dictate practice in real world settings: to what extent can laboratory findings be directly applied to routine clinical work? There is now increasing interest in effectiveness research that explores the application of evidence-based treatments in routine clinical practice settings. Although it is rarely possible to achieve the same level of methodological rigor as in RCT designs, the data from those studies provide crucial information about the practical applicability of the intervention and could reasonably serve as a useful complement to RCT studies in establishing the evidence base for key clinical questions and Level I recommendations. This would require changes to the evidence rules governing virtually all existing trauma-related guidelines. Whereas this might be met with some opposition, most would agree that a compromise is required—the findings of RCTs and other carefully designed research are of vital importance in guiding clinical decision making, but they must be translated and applied with caution.
Implications for Clinicians
It is clear from a detailed reading of the guidelines that there is insufficient empirical data to drive many of the recommendations. This presents a problem for guideline developers. Clinical practice is infinitely complex. Even within a single approach such as prolonged exposure, the clinician is required to make many decisions around the intricacies of implementation. That intervention, of course, is embedded in broader clinical care that includes, among other things, building a therapeutic alliance, comprehensive assessment, case formulation, and treatment planning. With our current state of knowledge it is unrealistic to assume that every aspect of care will be guided by Level I empirical data. Documents such as the IOM review, though an empirically rigorous document, is of limited benefit to practicing clinicians (and, of course, it was never intended to guide clinical care) because so many important questions are left unanswered. To avoid providing recommendations altogether on the grounds that no evidence is available runs the risk of producing guidelines that are of little benefit to clinicians in routine practice. The key point here is that guideline recommendations must be read carefully. Readers should be able to easily differentiate which recommendations are evidence-based and which are based on clinical consensus, as well as which are informed by the service system and which are independent of service systems. All guideline developers agree that, where possible, recommendations should be based on the available research evidence. As the body of empirical knowledge expands, we will presumably rely less and less on clinical opinion to drive recommendations for practice.
Where does all this leave the clinician in determining how best to assist people affected by trauma? First, we should reiterate that there is a high level of consensus across the various guidelines. Ideally, clinicians will take these key points as core principles of intervention, ensuring as far as possible that they receive training and supervision in those approaches that have the highest levels of support. Core recommendations should not be applied indiscriminately but, rather, should be used in the context of sound clinical judgement and decision making. Second, there is much that we do not currently know about the prevention, recognition, and management of posttraumatic mental health problems. In these areas of practice, it is reasonable to rely on the expert consensus recommendations (which, incidentally, also show strong areas of agreement across guidelines), as well as on the clinician’s own judgement and case formulation. Even where practice guidelines rely on expert consensus, consideration needs to be given to the use of potentially more robust methods to reach this consensus, such as the Delphi method (
Okoli & Pawlowski, 2004). (The Delphi method is a systematic, iterative approach that uses a panel of independent experts to generate consensus on a particular topic). Note that these guidelines are largely silent on the issue of clinician burnout secondary to what is variously termed secondary traumatization, vicarious traumatization, compassion fatigue, or counter transference associated with exposure to trauma narratives and traumatized patients. This could be an area for future development across guidelines.
Third, all the guidelines demonstrate a commitment to regular review and updating on the basis of new evidence. This is a crucial philosophical position that, we believe, should drive clinical practice. That is, we must constantly monitor our interventions as new evidence emerges, being prepared to adjust our practice accordingly. Finally, notwithstanding the caveats in ensuring the recommendations are employed in the context of clinical judgement, there is no substitute for clinicians being adequately trained and skilled in the delivery of recommended interventions. The practice guidelines establish this as a minimum standard.
All of the practice guidelines have their target constituencies and should be interpreted accordingly. However, the guidelines that best allow clinicians to make informed judgments about the applicability of the recommendations to their particular clinical circumstances: (a) minimize the subjectivity of the ratings of effectiveness, (b) clearly delineate between strengths of recommendations on the basis of evidence compared to consensus, (c) provide clear and unequivocal direction as to the recommended lines of intervention, and (d) are guided by evidence with reference to service systems rather than being organized around the service system.