Rating the Strength of Research Evidence and Recommendations
Development of guideline statements entails weighing the potential benefits and harms of the statement and then identifying the level of confidence in that determination. This concept of balancing benefits and harms to determine guideline recommendations and strength of recommendations is a hallmark of GRADE (Grading of Recommendations Assessment, Development and Evaluation), which is used by multiple professional organizations around the world to develop practice guideline recommendations ( Guyatt et al. 2013 ). With the GRADE approach, recommendations are rated by assessing the confidence that the benefits of the statement outweigh the harms and burdens of the statement, determining the confidence in estimates of effect as reflected by the quality of evidence, estimating patient values and preferences (including whether they are similar across the patient population), and identifying whether resource expenditures are worth the expected net benefit of following the recommendation ( Andrews et al. 2013 ).
In weighing the balance of benefits and harms for each statement in this guideline, our level of confidence is informed by available evidence, which includes evidence from clinical trials as well as expert opinion and patient values and preferences. Evidence for the benefit of a particular intervention within a specific clinical context is identified through systematic review and is then balanced against the evidence for harms. In this regard, harms are broadly defined and may include serious adverse events, less serious adverse events that affect tolerability, minor adverse events, negative effects of the intervention on quality of life, barriers and inconveniences associated with treatment, direct and indirect costs of the intervention (including opportunity costs), and other negative aspects of the treatment that may influence decision making by the patient, the clinician, or both.
Many topics covered in this guideline have relied on forms of evidence such as consensus opinions of experienced clinicians or indirect findings from observational studies rather than research from randomized trials. It is well recognized that there are guideline topics and clinical circumstances for which high-quality evidence from clinical trials is not possible or is unethical to obtain ( Council of Medical Specialty Societies 2012 ). For example, many questions need to be asked as part of an assessment, and inquiring about a particular symptom or element of the history cannot be separated out for study as a discrete intervention. It would also be impossible to separate changes in outcomes due to assessment from changes in outcomes due to ensuing treatment. Research on psychiatric assessments and some psychiatric interventions can also be complicated by multiple confounding factors such as the interaction between the clinician and the patient or the patient’s unique circumstances and experiences. The GRADE working group and guidelines developed by other professional organizations have noted that a strong recommendation or “good practice statement” may be appropriate even in the absence of research evidence when sensible alternatives do not exist ( Andrews et al. 2013 ; Brito et al. 2013 ; Djulbegovic et al. 2009 ; Hazlehurst et al. 2013 ). For each guideline statement, we have described the type and strength of the available evidence as well as the factors, including patient preferences, that were used in determining the balance of benefits and harms.
The authors of the guideline determined each final rating, as described in the section “Guideline Development Process,” and is endorsed by the APA Board of Trustees. A recommendation (denoted by the numeral 1 after the guideline statement) indicates confidence that the benefits of the intervention clearly outweigh harms. A suggestion (denoted by the numeral 2 after the guideline statement) indicates greater uncertainty. Although the benefits of the statement are still viewed as outweighing the harms, the balance of benefits and harms is more difficult to judge, or either the benefits or the harms may be less clear. With a suggestion, patient values and preferences may be more variable, and this can influence the clinical decision that is ultimately made. Each guideline statement also has an associated rating for the strength of supporting research evidence. Three ratings are used: high,moderate, and low (denoted by the letters A, B, and C, respectively) and reflect the level of confidence that the evidence for a guideline statement reflects a true effect based on consistency of findings across studies, directness of the effect on a specific health outcome, precision of the estimate of effect, and risk of bias in available studies (Agency for Healthcare Research and Quality 2014; Balshem et al. 2011 ; Guyatt et al. 2006 ).
Proper Use of Guidelines
The APA Practice Guidelines are assessments of current scientific and clinical information provided as an educational service. The guidelines 1) should not be considered as a statement of the standard of care or inclusive of all proper treatments or methods of care; 2) are not continually updated and may not reflect the most recent evidence, as new evidence may emerge between the time information is developed and when the guidelines are published or read; 3) address only the question(s) or issue(s) specifically identified; 4) do not mandate any particular course of medical care; 5) are not intended to substitute for the independent professional judgment of the treating provider; and 6) do not account for individual variation among patients. As such, it is not possible to draw conclusions about the effects of omitting a particular recommendation, either in general or for a specific patient. Furthermore, adherence to these guidelines will not ensure a successful outcome for every individual, nor should these guidelines be interpreted as including all proper methods of evaluation and care or excluding other acceptable methods of evaluation and care aimed at the same results. The ultimate recommendation regarding a particular assessment, clinical procedure, or treatment plan must be made by the clinician in light of the psychiatric evaluation, other clinical data, and the diagnostic and treatment options available. Such recommendations should be made in collaboration with the patient, whenever possible, and incorporate the patient’s personal and sociocultural preferences and values in order to enhance the therapeutic alliance, adherence to treatment, and treatment outcomes. For all of these reasons, the APA cautions against the use of guidelines in litigation. Use of these guidelines is voluntary. APA provides the guidelines on an “as is” basis and makes no warranty, expressed or implied, regarding them. APA assumes no responsibility for any injury or damage to persons or property arising out of or related to any use of the guidelines or for any errors or omissions.