Enhancing Quality of Care Through Evidence-Based Practice: Training and Supervision Experiences

Electronic surveys were distributed to 108 mental health therapists, and 64% (N=69) completed the survey. Of those who completed the survey, a majority of the providers were master’s-level therapists (N=65, 94%). The remaining therapists included one (1%) with a doctoral degree (Ph.D. or Psy.D.) and three (4%) with an “other” degree or certification. Approximately 39% of therapists focused primarily on treatment of children and adolescents, whereas the remaining focused on treatment of young adults, adults, and older adults or treated people of all ages. Therapists had an average of 11.0 years of work experience after graduate school, with experience ranging from 0.5 to 35.0 years (Table 1).

The proportions of respondents who received CBT-, DBT-, and other EST-focused coursework, supervision, or both through graduate and postgraduate training are outlined in Table 2. Of the therapists who reported receiving some form of CBT training during graduate school (N=67), 85% reported completing coursework in CBT, and 33% received supervision of CBT cases. Of the therapists who reported receiving postgraduate training, approximately 60% completed coursework in CBT, and 31% received supervision of CBT cases. Overall, 49% reported receiving any supervision of CBT cases to date. Regarding current supervision, 15 therapists reported receiving some form of supervision, and four reported receiving formal supervision of CBT cases.

A similar and more striking pattern was found for DBT. Of the therapists who reported receiving some form of DBT training during graduate school (N=42), 52% reported completing coursework in DBT, and 24% received supervision of DBT cases. Moreover, whereas 67% completed postgraduate DBT coursework, 17% received postgraduate supervision of DBT cases. Overall, 24% reported receiving any supervision of DBT cases to date. Nine therapists reported receiving some form of DBT supervision from their current employer, and two reported currently receiving formal supervision of DBT cases.

Two-thirds (N=46) of our sample reported completing some form of coursework related to ESTs other than CBT or DBT. When the type of “other” EST was closely reviewed, a variety of treatment approaches were listed (e.g., interpersonal psychotherapy, acceptance and commitment therapy, psychoanalysis, motivational interviewing, mindfulness-based stress reduction therapy) or not enough information was available to properly characterize the treatment as an EST (e.g., “certificate in evidence-based practice with children and adolescents”).

Overall, a majority of therapists reported having interest in receiving training on ESTs (N=60 of 63, 95%) and interest in implementing and receiving supervision on ESTs (N=56 of 62, 90%).

EBP in mental health treatment aims to improve patient outcomes through the integration of science and clinical practice (5). This integration is important because it helps therapists gain a deeper understanding of why a particular treatment works and how they can integrate the best research available with their own clinical expertise to optimize patient outcomes in an efficient and effective manner (5, 29). Since the release of the 1995 American Psychological Association task force reports regarding EBP, the mental health field has focused on improving understanding and implementation of evidence-based treatment components, specifically ESTs, in routine practice to improve patient outcomes (10, 18, 21, 26). Although training on ESTs within mental health settings is an important component of EBP, supervision of EST implementation, in addition to treatment fidelity, are critical for therapists to develop and maintain a strong EBP skill set (22, 30–32). Evaluation of therapists’ training and supervision histories is an essential first step in the improvement of patient outcomes because it helps mental health centers identify the types of training and supervision models needed to support effective center-wide implementation of ESTs and ultimately improve the quality of patient care.

In a sample of predominantly master’s-level therapists, we found that although a majority reported completing some form of CBT coursework during their graduate school training, only 33% reported receiving supervision of CBT cases. After graduate school training, only 31% received supervision of CBT cases. Overall, only 49% reported receiving any supervision of CBT cases to date. A similar and more striking pattern was found for DBT. Of the therapists who reported completing any DBT coursework during or after graduate school training, only 24% reported receiving any DBT supervision throughout their careers. This statistic is particularly salient given that DBT training explicitly emphasizes the importance of ongoing supervision for maintaining treatment integrity, especially when working with high-risk patients with complex problems (33).

Taken together, our findings support previous research highlighting the need for increased supervision of therapists who implement specific ESTs across a variety of mental health settings (34). Furthermore, increased supervision efforts in workforces that predominantly hire psychotherapy providers with 2-year master’s-level training backgrounds (e.g., vs. 5- to ≥7-year doctoral-level training backgrounds) may be especially beneficial, because shorter training programs may limit therapists’ opportunities for structured EST supervision experiences. Therefore, future research is needed to evaluate graduate school training models and their applicability to different training programs (e.g., social work vs. psychology) of varying lengths (e.g., 2-year vs. 5- to ≥7-year programs) to help minimize training gaps in EBP across graduate programs.

Although adapting educational programming will help provide long-term solutions, in the immediate future, providing effective and efficient training will be key to improving the quality of current psychotherapy interventions. However, given the time constraints of practicing therapists, the feasibility of increased EBP education and supervision efforts will remain low without systematic changes to organizational practices. A majority of providers in this study reported being interested in receiving EST training and supervision in the future; however, barriers to receiving training and supervision were noted in our sample via therapists’ self-reports. For example, one provider wrote, “I cannot express the need for formalized supervision in EBP once trained. This is a huge missing component, and it is not affordable to seek outside formal supervision.” Another provider wrote, “Training would be greatly appreciated, but it is not a realistic item at this time” because of financial and time constraints. Our findings highlight that well-documented barriers to training and supervision continue to exist. Thus, evaluation of past and current EST training and supervision experiences of staff, current training needs, and associated training targets (e.g., education, supervision) is encouraged within routine care centers to improve quality of care. Beyond improving quality of care, increasing self-efficacy within therapeutic practice via increased EST training and supervision may also help to alleviate work-related stress that often contributes to provider burnout (35).

Multiple models are used to train psychotherapy providers in clinics and health systems, such as training for the entire staff, “train-the-trainer” approaches, and online training without supervision. Recent studies suggest that the train-the-trainer approach may be a particularly sustainable and cost-effective model of training, because therapists can be continuously trained and supervised over a prolonged period, with qualified trainers and supervisors embedded within a mental health center (10, 36). However, sufficient time must be allocated to activities that are commonly part of supervision in EST research, such as ongoing skill building through practice, observation, and feedback (24, 37). Given the organizational challenges associated with implementing ESTs, future research that explicitly explores the financial costs and cost-benefit analysis of different training and supervision models is warranted to determine whether these models are worth the cost of implementation in terms of treatment fidelity and patient outcomes.

This study was intended as an initial needs assessment to guide future implementation of training and supervision programs in community mental health clinics, outpatient clinics, and acute inpatient settings within an academic medical center. It is worth noting the paucity of doctoral-level clinicians in our sample. The aim of this project was to serve as a needs assessment before implementation of a train-the-trainer program for therapists to be trained in ESTs and, in turn, to train others within their service centers. Therefore, the focus of the survey was on the therapists in the department, a majority of whom were licensed social workers or licensed clinical counselors. Because the sample was predominantly composed of master’s-level therapists, our findings may not generalize to other clinical settings with a more diverse group of providers. However, it is worth noting that far more clinical social workers than psychiatrists and doctoral-level psychologists make up the current mental health workforce; thus, clinical social workers represent the largest group of mental health service providers (38–41). In addition, the amount of exposure to ESTs in the context of EBP among the therapists in our sample may differ from that among therapists in different care systems. Important factors that were not examined in the current study warrant further examination in future research. In particular, knowing the specific types of training models providers have engaged in would aid in assessing the adequacy of providers’ previous training and supervision and their current training needs. In addition, direct observation or self-report tools (with specific questions related to the therapeutic techniques used during a session) to assess therapists’ use of and fidelity to ESTs are strongly recommended because providers’ self-labels of orientation (e.g., CBT) may not be congruent with the actual skills utilized in therapy (42). Observational methods are the current gold standard for determining therapists’ use of evidence-based therapy techniques (43), but feasibility challenges make the use of such methods nearly impossible (35). Therefore, future research is warranted on implementing service models that increase the number of mental health specialists (i.e., clinical psychologists) serving as consultants and supervisors within mental health centers in order to help provide cost-effective internal support for EBP supervision.

It is important to note that although this study focused on the implementation of training and supervision on ESTs in naturalistic settings, other forms of therapy may also be worth exploring. Although initial lists of ESTs included mostly CBTs, over the past 20 years, the number of efficacy trials has increased for psychodynamic therapy, family-based therapy, and interpersonal therapy, among other treatments (44–46). In addition, research in recent years has highlighted the growing awareness of and problems with the replication crisis (47), which has led to a greater emphasis on study quality, better study designs, and improved reporting of findings. Although the evidence base for therapies is still evolving, it is critical that psychotherapy providers utilize the best available research to help inform treatment efforts (48). Thus, high-quality training and supervision related to ESTs in the broader context of EBP can teach psychotherapy providers how to be informed consumers of intervention trial research and administrators of evidence-based assessment tools in order to enhance clinical practice (49).

Taken together, our findings highlight that although research from the past decade has supported the need for improvements in EST training—especially supervision—the problem of limited exposure to training and to supervision related to ESTs still exists. Our findings have implications for how mental health centers can evaluate staff members’ EST training and supervision experiences, training needs, and associated training targets to improve quality of routine care. In addition, this study highlights potential options for how mental health centers can work toward improving quality of care through increased training efforts. Finally, quality improvement efforts to understand how organizations and supervisors currently use supervision are important. Modification to supervisory practices within mental health settings may improve the quality of care provided by therapists, especially in centers where staff have previous EST training but minimal supervision experience.