Fidelity of an Outreach Treatment Program for Chronic Crack Abusers in the Netherlands to the ACT Model

This study used the existing data of the randomized controlled trial (1). Fidelity assessment took place two years after the closure of the outreach treatment program. All analyses were based on well-documented data collected during the study period, from February 2000 to June 2001. During this period 63 patients entered the outreach treatment program and followed the program for a maximum of eight months.

The fidelity assessment was done by the first author according to the DACTS manual (2). The DACTS is a validated 28-item scale that measures model fidelity across a wide range of observable criteria (3). In this scale three dimensions are distinguished: staffing patterns, organization structure, and service delivery features. The degree to which critical items of assertive community treatment were implemented in the outreach treatment program was rated with a scale, based on the mean score of all items. Possible DACTS scores range from 1 to 5, with higher scores indicating more complete implementation.

In this study 25 of the 28 criteria for adherence to the assertive community treatment model were derived from four sources: an interview with the former team leader and case manager of the outreach treatment program, computerized registration data of contacts, randomly selected clinical records, and management information, including a treatment manual. In accordance with international studies, two of the DACTS items—program size and role of consumers on the team—were not included in the analysis, because these items were added after the psychometric tests were conducted. The item time-unlimited service was excluded because of the fixed time associated with our randomized controlled trial.

Analyses were conducted by using SPSS for Windows 11.0, standard version. Descriptive statistics were generated to evaluate adherence to assertive community treatment on each of the examined items. Implementation scores were rated by means or medians.

Table 1 presents data on the outpatient treatment program's adherence to each of the dimensions of the DACTS. Overall, the program's DACTS score revealed a moderate implementation of the assertive community treatment model (mean score of 3.3). Adherence to staffing patterns was highest (mean score of 3.5), followed by adherence to organization structure (mean score of 3.2), and service delivery features (mean score of 3.1).

The items of highest fidelity (score of 5) included a small caseload, staff capacity, a nurse on staff, a substance abuse specialist on staff, explicit admission criteria, a low intake rate, and intensity of service. Data from the digital information system showed a mean caseload ratio of 5:1 during the 16-month period. A calculation based on management information led to a staff capacity of 96.3 percent. The outpatient treatment program had a ratio of 2.4 full-time nurses for every 100 patients. Except for one individual, all staff members (excluding administrative workers) had at least one year of clinical experience with substance abuse treatment. Because the program originally formed the experimental condition of a randomized controlled trial, explicit admission criteria were formulated to include the target group. In the treatment protocol a phased enrollment of patients was proposed to control the admission process and to ensure a stable treatment environment. Contact registrations showed an average enrollment of 3.7 new patients per month. The selected clinical records revealed that the median amount of time that a staff member spent per week on face-to-face contacts was 126 minutes.

The items of lowest fidelity (score of 1) included a psychiatrist on staff, a vocational specialist on staff, responsibility for crisis services, responsibility for hospital discharge, and dual disorder treatment groups. Management data revealed that neither a psychiatrist nor a vocational specialist was represented on the outreach treatment program team. Staff members were not authorized to initiate crisis services and hospital discharges. Finally, the program lacked specific dual disorder treatment groups.

This study compared an effective outreach treatment program for chronic, high-risk crack abusers with an evidence-based community care model—that is, assertive community treatment. Adherence to assertive community treatment was measured by the DACTS. The study examined similarities and differences between the outreach treatment program and assertive community treatment according to criteria defined in the DACTS.

In agreement with assertive community treatment, the outreach treatment program used explicit inclusion criteria and created a stable treatment environment by means of a low intake rate. Given the high levels of symptoms and deterioration among patients in the outreach treatment program, a small caseload and a high intensity of service were provided. Furthermore, continuity of staffing was guaranteed, and nurses and substance abuse professionals were part of the team. Because both the outreach treatment program and assertive community treatment attached great importance to the above-mentioned treatment characteristics, we recommend that they be included in future program planning for chronic, high-risk crack abusers. According to assertive community treatment standards, a vocational specialist needs to be included as well, because studies have clearly demonstrated the efficacy of supported employment (4).

In the outreach treatment program the absence of a psychiatrist and dual disorder treatment groups was problematic, considering that dual diagnosis was a common feature among the patients. Although the management of the outreach treatment program acknowledged the importance of a psychiatrist on the staff, financial cutbacks did not permit the inclusion of one. However, the lack of a dual disorder treatment group was a well-considered choice: in our pilot study, group therapy was associated with high levels of dropout, and we therefore assumed that this treatment modality was not feasible for chronic, high-risk crack abusers.

Although high fidelity to the assertive community treatment model is recommended to achieve good outcomes, it has been argued that models cannot simply be transferred to other sites or patient groups without adaptation (5). Instead of falling prey to the "single model trap" (6), it is important to address cultural and other local circumstances (7,8). Therefore, we hypothesize that in the case of chronic, high-risk crack abusers, the special arrangements described below are necessary to engage and retain this difficult-to-reach population in treatment.

First, our study indicated that forming a trusting relationship is of great importance. We strongly believe that assertive community treatment's goal of ensuring that patients have contact with multiple team members at the same time is counterproductive in our target population. In our opinion, the individualized client-therapist relationship is very important, because this particular patient group of seriously impaired addicts has difficulties forming a trusting relationship. Conventional counseling techniques based on confrontation and abstinence should be replaced by stagewise substance abuse treatment geared to education, harm reduction, and increasing motivation (9,10).

Second, we consider the intensity of at least four face-to-face contacts per week, as proposed in assertive community treatment, to be too much for chronic, high-risk crack abusers. It is possible that this so-called "high pampering" has a reverse effect on their treatment compliance.

Third, on-the-spot incentives—that is, services that patients consider to be important, such as free meals and acupuncture treatments—should be directly available in the program. The choice of these incentives depends a great deal on local circumstances and patients' service needs and must serve no goal other than to keep the target group involved in treatment.

Evidence-based practice for chronic crack addiction has been lacking; therefore, this study is of great practical relevance. There is a need to develop outreach treatment programs based on the elements that were found to be effective in this study, as well as a fidelity scale for this type of program. Further research is needed to study the effects of modified high-fidelity programs.

This research was supported in part by ZonMw, the Dutch Organization for Health Care Research and Development in the Hague, the Netherlands.

Dr. Henskens is affiliated with the Municipal Health Service of Rotterdam in the Netherlands. Dr. Mulder is with the mental health group Europoort and with Erasmus MC, both in Rotterdam. Dr. Garretsen and Dr. Bongers are affiliated with the Tranzo Research Centre at the University of Tilburg and with the Addiction Research Institutes at the Universities of Rotterdam, Maastricht, Tilburg, and Nijmegen in the Netherlands. Dr. Kroon is with the reintegration research unit at the Trimbos Institute of Utrecht in the Netherlands. Send correspondence to Dr. Henskens at the Municipal Health Service, Department of Individual-Bound Care, P.O. Box 70032, 3000 LP Rotterdam, the Netherlands (e-mail, [email protected]).