Overview of the Development Process
Since the publication of the Institute of Medicine (2011) report Clinical Practice Guidelines We Can Trust, there has been an increasing focus on using clearly defined, transparent processes for rating the quality of evidence and the strength of the overall body of evidence in systematic reviews of the scientific literature. This guideline was developed using a process intended to be consistent with the recommendations of the Institute of Medicine (2011), the Principles for the Development of Specialty Society Clinical Guidelines of the Council of Medical Specialty Societies (2012), and the requirements of the Agency for Healthcare Research and Quality (AHRQ) for inclusion of a guideline in the National Guideline Clearinghouse. Parameters used for the guideline’s systematic review are included with the full text of the guideline; the development process is fully described in a document available on the American Psychiatric Association (APA) website (http://www.psychiatry.org/File%20Library/Psychiatrists/Practice/Clinical%20Practice%20Guidelines/Guideline-Development-Process.pdf). To supplement the expertise of members of the guideline work group, we used a “snowball” survey methodology (Yager et al. 2014) to identify experts on the treatment of agitation or psychosis in individuals with dementia. Results of this expert survey are included in Appendix B of the practice guideline.
Rating the Strength of Research Evidence and Recommendations
The guideline recommendations are rated using GRADE (Grading of Recommendations Assessment, Development and Evaluation), which is used by multiple professional organizations around the world to develop practice guideline recommendations (Guyatt et al. 2013). With the GRADE approach, the strength of a guideline statement reflects the level of confidence that potential benefits of an intervention outweigh the potential harms (Andrews et al. 2013). This level of confidence is informed by available evidence, which includes evidence from clinical trials as well as expert opinion and patient values and preferences. Evidence for the benefit of a particular intervention within a specific clinical context is identified through systematic review and is then balanced against the evidence for harms. In this regard, harms are broadly defined and might include direct and indirect costs of the intervention (including opportunity costs) as well as potential for adverse effects from the intervention. Whenever possible, we have followed the admonition to current guideline development groups to avoid using words such as “might” or “consider” in drafting these recommendations because they can be difficult for clinicians to interpret (Shiffman et al. 2005).
As described under “Guideline Development Process,” each final rating is a consensus judgment of the authors of the guideline and is endorsed by the APA Board of Trustees. A “recommendation” (denoted by the numeral 1 after the guideline statement) indicates confidence that the benefits of the intervention clearly outweigh the harms. A “suggestion” (denoted by the numeral 2 after the guideline statement) indicates uncertainty (i.e., the balance of benefits and harms is difficult to judge, or either the benefits or the harms are unclear). Each guideline statement also has an associated rating for the “strength of supporting research evidence.” Three ratings are used—high, moderate, and low (denoted by the letters A, B, and C, respectively)—and reflect the level of confidence that the evidence for a guideline statement reflects a true effect based on consistency of findings across studies, directness of the effect on a specific health outcome, and precision of the estimate of effect and risk of bias in available studies (Agency for Healthcare Research and Quality 2014; Balshem et al. 2011; Guyatt et al. 2006).
It is well recognized that there are guideline topics and clinical circumstances for which high-quality evidence from clinical trials is not possible or is unethical to obtain (Council of Medical Specialty Societies 2012). For example, many questions need to be asked as part of an assessment, and inquiring about a particular symptom or element of the history cannot be separated out for study as a discrete intervention. It would also be impossible to separate changes in outcome due to assessment from changes in outcomes due to ensuing treatment. Research on psychiatric assessments and some psychiatric interventions can also be complicated by multiple confounding factors such as the interaction between the clinician and the patient or the patient’s unique circumstances and experiences. For these and other reasons, many topics covered in this guideline have relied on forms of evidence such as consensus opinions of experienced clinicians or indirect findings from observational studies rather than being based on research from randomized trials. The GRADE working group and guidelines developed by other professional organizations have noted that a strong recommendation may be appropriate even in the absence of research evidence when sensible alternatives do not exist (Andrews et al. 2013; Brito et al. 2013; Djulbegovic et al. 2009; Hazlehurst et al. 2013).
Proper Use of Guidelines
The APA Practice Guidelines are assessments of current scientific and clinical information provided as an educational service. The guidelines 1) should not be considered as a statement of the standard of care or inclusive of all proper treatments or methods of care; 2) are not continually updated and may not reflect the most recent evidence, as new evidence may emerge between the time information is developed and when the guidelines are published or read; 3) address only the question(s) or issue(s) specifically identified; 4) do not mandate any particular course of medical care; 5) are not intended to substitute for the independent professional judgment of the treating provider; and 6) do not account for individual variation among patients. As such, it is not possible to draw conclusions about the effects of omitting a particular recommendation, either in general or for a specific patient. Furthermore, adherence to these guidelines will not ensure a successful outcome for every individual, nor should these guidelines be interpreted as including all proper methods of evaluation and care or excluding other acceptable methods of evaluation and care aimed at the same results. The ultimate recommendation regarding a particular assessment, clinical procedure, or treatment plan must be made by the clinician in light of the psychiatric evaluation, other clinical data, and the diagnostic and treatment options available. Such recommendations should be made in collaboration with the patient, whenever possible, and incorporate the patient’s personal and sociocultural preferences and values in order to enhance the therapeutic alliance, adherence to treatment, and treatment outcomes. For all of these reasons, APA cautions against the use of guidelines in litigation. Use of these guidelines is voluntary. APA provides the guidelines on an “as is” basis and makes no warranty, expressed or implied, regarding them. APA assumes no responsibility for any injury or damage to persons or property arising out of or related to any use of the guidelines or for any errors or omissions.