Fidelity to Recovery-Oriented ACT Practices and Consumer Outcomes
Abstract
Objective
A previous study of a recovery-oriented assertive community treatment initiative (PACT) in Washington State found reductions in state psychiatric hospital use and related costs for PACT participants, especially in the first six months after enrollment and for consumers who were high users of the state psychiatric hospital before ACT enrollment. This study examined whether these outcomes varied by team fidelity to recovery-oriented ACT practices.
Methods
Generalized estimating equations (GEE) were used to examine the relationship between scores on the Tool for Measurement of Assertive Community Treatment (TMACT), a recently developed tool for assessing fidelity to recovery-oriented ACT, and the use of state hospitals, local hospitals, emergency departments, local crisis stabilization units, and arrests for 631 PACT consumers. These relationships were also examined for PACT consumers with any state hospital use (N=450) and those considered high users of the state hospital (≥96 days in two years before PACT enrollment).
Results
TMACT scores were associated (p<.01) with a decrease in the amount of use but not the probability of using state psychiatric hospitals, local hospital psychiatric inpatient units, and local crisis stabilization units. The marginal effects of higher TMACT scores on the probability and use of emergency departments or arrests were not statistically significant.
Conclusions
This study provides preliminary evidence for the predictive validity of the TMACT. Future research should examine the subscale structure of the TMACT as well as the association between TMACT fidelity and consumer well-being, quality of life, and other important person-centered outcomes.
Since its inception in the 1970s, assertive community treatment (ACT) has grown from a pilot project at a state psychiatric hospital in Wisconsin (1) to one of the most studied and widely disseminated evidence-based practices for persons with severe mental illness (2,3). Among its core features, ACT is characterized by a multidisciplinary team-based approach with a small (1:10) staff-to-consumer ratio, 24/7 staff availability, and assertive outreach (4).
ACT has been adapted to serve urban and rural populations (5–8), homeless persons (9), and persons with severe mental illness who are involved with the criminal justice system (10,11). Evidence-based practices, such as integrated dual-disorders treatment (12,13), illness self-management (14), and supported employment (15) have successfully been added to ACT. These adaptations have led some observers to conclude that ACT is best viewed as a platform for service delivery and integration of other evidence-based practices (16).
The ethos and best practices of community mental health care have changed dramatically over the last 30 years, from a time when clinical staff essentially defined goals and created a high degree of daily structure for consumers with severe mental illness to today’s more person-centered and recovery-oriented approaches (17,18). In brief, recovery-oriented services support the fundamental components of recovery, which include self-direction, individualized and person-centered approaches, empowerment, holistic views, nonlinearity of service provision, a strengths-based approach, peer support, respect, responsibility, and hope (19,20). Some observers have long considered ACT to be inherently coercive and paternalistic (21–25). However, ACT can be adapted to align with recovery principles and practices (26). There is a new generation of ACT studies under way that focuses on the processes and outcomes of recovery-oriented ACT teams (27,28).
Over the past decade, the Dartmouth Assertive Community Treatment Scale (DACTS) (29) has become the gold standard for assessing the fidelity of ACT teams to the original clinical model. The research rationale underlying fidelity assessments is that in establishing high fidelity there is a high likelihood that the ACT team will produce results similar to those found in randomized clinical trials of ACT. Fidelity assessment also serves as a quality improvement mechanism to assist teams in improving performance over time. Although early efforts to establish a connection between fidelity and improved outcomes led to mixed results (25,30,31), recent meta-analyses that use aggregated data across dozens of clinical trials have confirmed that high fidelity, especially in regard to the organizational components of ACT, is associated with reduced psychiatric hospitalizations (32,33).
However, the DACTS has been criticized for focusing too much on the structure of ACT and not enough on care processes, especially those embracing recovery-oriented principles (34,35). Recently, the Tool for Measurement of Assertive Community Treatment (TMACT) has been developed as a recovery-informed update of the DACTS (35). The TMACT was created to monitor the implementation of Washington State’s recovery-oriented ACT initiative (PACT), which deployed ten recovery-oriented ACT teams statewide in 2007 (36). The PACT teams were developed to reduce the utilization of Washington’s two state psychiatric hospitals, along with other inpatient and costly services. Each team received in-depth training about the core elements of ACT, as well as training on integrating ACT with recovery-oriented principles (35,36). Training on recovery approaches was provided by national experts and was focused on strengths-based assessment, person-centered planning processes, and promotion of a culture of recovery within each PACT team.
Our earlier research in Washington State found that PACT participation led to reductions in the use and costs of state psychiatric hospitals (37), especially in the first six months after PACT enrollment and for consumers who were high users of hospitals before PACT enrollment (38). As part of that research, we had the opportunity to examine the relationship between fidelity as measured by the TMACT and consumer service use outcomes. We addressed the following specific research question in the study reported here: Did participation in a higher-fidelity PACT team lead to lower use of state psychiatric hospitals, local hospital psychiatric units, and local crisis stabilization units and to fewer arrests?
Methods
Design
We used a longitudinal study design and statewide administrative data to examine the relationship between fidelity to recovery-oriented ACT as measured by the TMACT and outcomes among 631 PACT consumers over a three-year study period (2007–2010). The study sample included PACT participants with no history of state hospitalization (N=181) and those with prior state hospital use (N=450). The latter group was a sample in our previous studies (37,38).
The research was conducted with the approval of the Institutional Review Board at the Washington State Department of Social and Health Services and at the University of North Carolina, Chapel Hill.
Data
We accessed administrative data from an information system maintained by Washington State’s Research and Data Analysis Division, Department of Social and Health Services, which links consumer demographic, diagnostic, and service utilization records from Medicaid, behavioral health, criminal justice, and other state data systems in a longitudinal, person-specific file (39). Data were collapsed to the person-month level, with each observation reflecting the use of services during that month (37). TMACT fidelity data were obtained from the Washington Institute for Mental Health Research and Training at the University of Washington, the organization responsible for initial training and continuing consultation to the PACT teams (35).
Measures
Fidelity.
The TMACT, an enhanced fidelity tool, was developed and pilot-tested to better assess critical ACT structures and processes (35). It consists of a 47-item inventory measuring team organization and infrastructure, staffing and roles, core practices, person-centered assessments, and recovery orientation. Each item is scored on a 5-point behaviorally anchored scale from 1, low, to 5, high; an overall team score is obtained by averaging the scores on each item. Two trained, independent reviewers conducted TMACT fidelity assessments for each PACT team during a site visit. Data sources for the fidelity review included team self-report data; observations of daily team meetings, treatment planning meetings, and staff provision of services; reviews of randomly selected charts; and interviews with staff and consumers. TMACT fidelity scores were available for each of the ten teams at baseline (within four to six months after start-up) and at six, 12, and 18 months later.
Outcomes.
Outcome measures included use of state psychiatric hospitals, local hospital psychiatric units, emergency departments, and local crisis stabilization units that functioned as evaluation and treatment alternatives to state hospitals, as well as arrests for gross misdemeanor and felony crimes (37). Costs of state hospital use are reported in 2010 dollars, having been adjusted by the Gross Domestic Product deflator.
Data analysis
All data were pooled across the ten PACT teams and collapsed to the person-month level, with each observation reflecting the use of services during that month. Our previous analyses (37) indicated that although there was some evidence of clustering at the team level, the explained variance based on the large sample of person-months was extremely small and essentially ignorable for these analyses. Specifically, we computed the intraclass correlation coefficient (ICC=.01121, 95% confidence interval=.00003–.02239) to assess clustering at the team level. Although statistically significant at p<.05, the ICC accounted for a miniscule portion of explained variance (R2=.01) on the basis of a very large sample (N=13,343 person months). These results indicated that clustering at the individual level was the appropriate model for these analyses and that clustering at the team level was so negligible it could be ignored in these analyses. The generalized estimating equation (GEE) models that we used, as described below, account for clustering at the individual level.
We used GEE models of the person-month data to examine the relationship between TMACT scores and service use outcomes. In our analyses, TMACT scores were interpolated monthly between assessment points. For the months before the baseline TMACT assessment, the baseline values were carried backwards, and for the months after the last assessment TMACT values were carried forward through the end of the study period. TMACT scores were appended to monthly ACT participant data by team and calendar month of assessment.
Continuous variables were analyzed with GEE models with a log link and a gamma distribution, binary variables were analyzed with GEE models with a logit link and a binomial distribution, and count variables were analyzed with GEE models with a log link and a Poisson distribution. Models controlled for race, ethnicity, gender, age (by using a quadratic term), and diagnosis. We used indicators of monthly time trends to allow for nonlinear effects when possible, but some of the models with less frequent outcomes used a linear time trend to facilitate model convergence. Most models were run with an autoregressive correlation structure, but exchangeable structures were required to achieve convergence in some of the models. Average marginal effects of the TMACT were estimated from GEE output.
Because our earlier research demonstrated that PACT effects differed by participants’ level of state psychiatric hospital use before PACT enrollment (37), we examined the difference in the marginal effect of fidelity scores for persons with any history of state psychiatric hospitalization from January 2001 through PACT enrollment (N=450). We did the same for PACT participants with high levels of state hospital use before PACT enrollment (defined as ≥96 days of hospital use in the two years before enrollment; N=263). This criterion for high use was adopted from a recent Cochrane Review of intensive case management for people with severe mental illness (32,33). We created indicators of whether study participants had each of these two characteristics (any use and high use). We reran the GEE models described above with these binary indicators included in separate models and report the marginal effects from these models for the defined subpopulations.
Results
Baseline TMACT scores ranged from 3.3 to 4.5 with an average of 3.9 on a 5-point scale, with higher scores indicating greater fidelity to recovery-oriented ACT (Table 1). Generally, teams showed increases in TMACT scores over the six-, 12-, and 18-month intervals; however, these increases were not statistically significant. There was an .18-point increase in the average score across the ten teams from baseline to six months, an .08-point increase from six to 12 months, and a .05-point increase in the average score across the ten teams from 12 to 18 months. TMACT scores at 18 months ranged from 3.52 to 4.57 with an average of 4.2.
| Time | M | SD | Range |
|---|---|---|---|
| Baseline | 3.9 | .34 | 3.3–4.5 |
| 6 months | 4.1 | .24 | 3.6–4.3 |
| 12 months | 4.1 | .37 | 3.4–4.5 |
| 18 months | 4.2 | .36 | 3.5–4.6 |
a
TMACT, Tool for Measurement of Assertive Community Treatment; PACT, recovery-oriented assertive community treatment. TMACT scores range from 1.0 to 5.0, with higher scores indicating greater fidelity to recovery-oriented ACT.
The three comparison samples were fairly homogeneous with regard to demographic and diagnostic characteristics (Table 2). That is, the three samples were fairly homogenous because they consisted of one sample and two subsamples that were not independent. Participants were predominantly white and male, with an average age of 40, and many had multiple comorbidities. Nearly all had a diagnosis of schizophrenia, more than half also had a diagnosis of affective disorder, and about half also had a substance use disorder. By definition, members of the sample who were high users of the state hospital at baseline all had at least 96 days of state hospitalization in the two years before PACT enrollment, as did about half of the state hospital users and less than half of the PACT full sample.
| Characteristic | Full sample (N=631) | State psychiatric hospital | ||||
|---|---|---|---|---|---|---|
| Any use (lifetime) (N=450) | High use (N=263)b | |||||
| N | % | N | % | N | % | |
| Female | 240 | 38 | 171 | 38 | 95 | 36 |
| Race-ethnicity | ||||||
| White | 517 | 82 | 356 | 79 | 205 | 78 |
| African American | 76 | 12 | 59 | 13 | 42 | 16 |
| Latino | 19 | 3 | 9 | 2 | 53 | 2 |
| Age (M±SD) | 40.3±12.1 | 40.8±11.8 | 40.8±11.5 | |||
| Diagnosis | ||||||
| Schizophrenia | 574 | 91 | 432 | 96 | 255 | 97 |
| Affective disorder | 341 | 57 | 333 | 74 | 189 | 72 |
| Substance use disorder | 309 | 49 | 252 | 56 | 142 | 54 |
| High useb | 265 | 42 | 234 | 52 | 263 | 100 |
a
PACT, recovery-oriented assertive community treatment
b
Defined as ≥96 state hospital days in the 2 years before PACT enrollment
The results from the GEE models are shown in Table 3. For the most part, the overall pattern of results suggests that higher TMACT scores were associated with reduced days of use of state hospitals, local inpatient services, and crisis stabilization units but not with the probability of use of any of these institutional settings. For state hospital days, we found that higher TMACT scores were associated with fewer hospital days per month (p<.01). These results were consistent across samples, although the marginal effect of higher TMACT scores on hospital days was somewhat smaller and not significant among high users of the state hospital at baseline. In contrast, the marginal effect of higher TMACT scores on reductions in local inpatient days achieved statistical significance only in the high user sample (p<.01). Also, higher TMACT scores were consistently associated with fewer crisis stabilization unit days across the three samples (p<.01). None of the results for the probability and use of emergency departments or for arrests were statistically significant.
| Service use | Full sample (N=631)b | State psychiatric hospital | |
|---|---|---|---|
| Any use before PACT enrollment (N=450) | High baseline use (N=263)c | ||
| State psychiatric hospital | |||
| Any admission | –.03 | –.05 | –.05 |
| Number of days | –.62* | –1.48* | –1.00 |
| Local inpatient unit | |||
| Any admission | –.01 | –.01 | –.01 |
| Number of days | –.03 | –.04 | –.10* |
| Crisis stabilization unitd | |||
| Any admission | –.01 | –.01 | –.01 |
| Number of days | –.19* | –.31* | –.27* |
| Emergency departmentd,e | |||
| Any visit | –.02 | .02 | .05 |
| Number of visits | –.11 | –.04 | .10 |
| Arrestsd,e | |||
| Any arrest | –.01 | –.01 | –.02 |
| Number of arrests | –.01 | –.02 | –.04 |
a
Average marginal effect of one-unit increase in score. TMACT, Tool for Measurement of Assertive Community Treatment. PACT, recovery-oriented assertive community treatment. 13,332 person-month observations unless otherwise noted. Generalized estimating equation models controlled for demographic characteristics, clinical diagnoses, and monthly intercepts and used AR1 correlations, unless otherwise noted
b
10,482 person-month observations
c
Defined as ≥96 state hospital days in the 2 years before PACT enrollment
d
Model used a linear time trend instead of monthly intercepts.
e
Exchangeable correlation structure. Samples for emergency department visits and arrests were smaller because of a shorter time frame of data availability. Emergency department visits, N=241 (1,122 person-month observations); arrests, N=565 (4,849 person-month observations)
* p<.01
Discussion
How well did TMACT scores predict consumer service use outcomes? There was an inverse relationship between TMACT scores and days in state hospitals and local crisis stabilization units. That is, higher TMACT scores were associated with reduced state hospital stays and reduced days in acute crisis units. However, TMACT scores were not associated with a lower probability of admission to state or local hospitals or emergency departments. There also was no association between higher TMACT scores and arrests. Accordingly, the overall pattern of results is consistent with our earlier findings (37) that the PACT initiative in Washington State affected the intensity of use (days of use) of state psychiatric hospitals but not the probability of use.
The results of this exploratory study are promising, but this study is only a first step toward assessing the psychometric properties of the TMACT. The results presented here are encouraging in that higher scores on the TMACT were associated with reductions in state hospital utilization, and these findings mirror results from previous studies of the DACTS. However, TMACT scores were not related to state or local hospital admissions. A likely explanation is that TMACT fidelity scores varied little among teams. That is, all teams appeared to begin with high fidelity to the ACT model and to recovery-oriented principles at baseline, which was most likely attributable to the intensive training each team received on these issues. Also, there was little variation in TMACT scores over time. With two exceptions, fidelity scores for teams started high and remained high. Thus, with little variation in TMACT scores between and within teams, it is not unexpected that we found few relationships between TMACT scores and consumer outcomes.
Further research is needed to establish the reliability and validity of the TMACT, and this study is only part of a broader research agenda focused on the development and fidelity measurement of recovery-oriented ACT and assessment of outcomes. Here, we capitalized on an opportunity provided by the creation of ten recovery-oriented ACT teams in Washington State and the availability of administrative data to answer questions about the relationships between TMACT scores and a number of important outcomes. Studies that compare outcomes among teams that score high on the TMACT and teams that score low are needed to further the evidence for the TMACT as a viable fidelity measure of recovery-oriented ACT.
Nevertheless, this study adds to the growing literature on recovery-oriented ACT. More information is needed about recovery-oriented ACT, and a number of fundamental questions have yet to be answered. What are the critical ingredients of recovery-oriented ACT? What are the outcomes of recovery-oriented ACT? How is fidelity to recovery-oriented ACT measured? What is the relationship between fidelity to recovery-oriented ACT and outcomes for persons with severe mental illnesses? These questions must be answered to establish recovery-oriented ACT as an evidence-based adaptation of ACT, and the development and testing of a reliable and valid fidelity measure is critical to answering these questions.
The strengths of this study include the large sample of consumers who received recovery-oriented ACT, the breadth of outcomes available in the statewide administrative data, and the fact that this is the first study of its kind to assess the relationship between fidelity to recovery-oriented ACT and consumer outcomes. The limitations of the study include the lack of personal recovery outcomes, the use of administrative data, and unknown generalizability of results from one state in the Pacific Northwest. Person-centered outcomes such as personal recovery, self-direction, and independence that were not recorded in the administrative data used for this study need to be examined in future assessments of the TMACT.
Conclusions
The TMACT predicted a range of consumer service use outcomes for recovery-oriented ACT teams. Future research should examine teams with a wider range of scores and explore the extent to which fidelity as measured by the TMACT also predicts personal recovery and other person-centered consumer outcomes.
Acknowledgments and disclosures
This research was supported in part by the Substance Abuse and Mental Health Services Administration (SAMHSA), through a Mental Health Services Transformation Grant to Washington State. Assistance from staff of the Washington State Mental Health Transformation Project (in particular, Ron Jemelka, Ph.D.) and the Research and Data Analysis Division of the Washington State Department of Social and Health Services (in particular, David Mancuso, Ph.D.) is gratefully acknowledged. Shirley Richards, B.S., provided excellent programming support. The findings and interpretations reported above are those of the authors and do not imply endorsement by SAMHSA, the Washington State Department of Social and Health Services, or the collaborating universities.
Dr. Domino has received research funding for an unrelated project from Eli Lilly and Company. The other authors report no competing interests.
References
1.
Stein LI, Test MA: Alternative to mental hospital treatment: I. conceptual model, treatment program, and clinical evaluation. Archives of General Psychiatry 37:392–397, 1980
2.
Dixon L: Assertive community treatment: twenty-five years of gold. Psychiatric Services 51:759–765, 2000
3.
Phillips SD, Burns BJ, Edgar ER, et al.: Moving assertive community treatment into standard practice. Psychiatric Services 52:771–779, 2001
4.
Bond GR, Drake RE, Mueser KT, et al.: Assertive community treatment: critical ingredients and impact on patients. Disease Management and Health Outcomes 9:141–159, 2001
5.
Becker RE, Meisler N, Stormer G, et al.: Employment outcomes for clients with severe mental illness in a PACT model replication. Program for Assertive Community Treatment. Psychiatric Services 50:104–106, 1999
6.
Calsyn RJ, Morse GA, Klinkenberg WD, et al.: The impact of assertive community treatment on the social relationships of people who are homeless and mentally ill. Community Mental Health Journal 34:579–593, 1998
7.
Lehman AF, Dixon LB, Kernan E, et al.: A randomized trial of assertive community treatment for homeless persons with severe mental illness. Archives of General Psychiatry 54:1038–1043, 1997
8.
Dixon LB, Krauss N, Kernan E, et al.: Modifying the PACT model to serve homeless persons with severe mental illness. Psychiatric Services 46:684–688, 1995
9.
Dixon LB, Friedman N, Lehman AF: Compliance of homeless mentally ill persons with assertive community treatment. Hospital and Community Psychiatry 44:581–583, 1993
10.
Lamberti JS, Weisman R, Faden DI: Forensic assertive community treatment: preventing incarceration of adults with severe mental illness. Psychiatric Services 55:1285–1293, 2004
11.
Cusack KJ, Morrissey JP, Cuddeback GS, et al.: Criminal justice involvement, behavioral health service use, and costs of forensic assertive community treatment: a randomized trial. Community Mental Health Journal 46:356–363, 2010
12.
Drake RE, McHugo GJ, Clark RE, et al.: Assertive community treatment for patients with co-occurring severe mental illness and substance use disorder: a clinical trial. American Journal of Orthopsychiatry 68:201–215, 1998
13.
Teague GB, Drake RE, Ackerson TH: Evaluating use of continuous treatment teams for persons with mental illness and substance abuse. Psychiatric Services 46:689–695, 1995
14.
Mueser KT, Clark RE, Haines M, et al.: The Hartford study of supported employment for persons with severe mental illness. Journal of Consulting and Clinical Psychology 72:479–490, 2004
15.
Gold PB, Meisler N, Santos AB, et al.: Randomized trial of supported employment integrated with assertive community treatment for rural adults with severe mental illness. Schizophrenia Bulletin 32:378–395, 2006
16.
Burns BJ, Santos AB: Assertive community treatment: an update of randomized trials. Psychiatric Services 46:669–675, 1995
17.
Davidson L: Living Outside Mental Illness: Qualitative Studies of Recovery in Schizophrenia. New York, New York University Press, 2003
18.
Anthony W: Recovery from mental illness: the guiding vision of the mental health service system in the 1990s. Psychosocial Rehabilitation Journal 16:11–23, 1993
19.
National Consensus Statement on Mental Health Recovery. Rockville, Md, Substance Abuse and Mental Health Services Administration, 2005. Available at store.samhsa.gov/shin/content//SMA05-4129/SMA05-4129.pdf
20.
Salyers MP, Tsemberis S: ACT and recovery: integrating evidence-based practice and recovery orientation on assertive community treatment teams. Community Mental Health Journal 43:619–641, 2007
21.
Dennis DL, Monahan J (eds): Coercion and Aggressive Community Treatment: A New Frontier in Mental Health Law. New York, Plenum, 1996
22.
Anthony W, Rogers ES, Farkas M: Research on evidence-based practices: future directions in an era of recovery. Community Mental Health Journal 39:101–114, 2003
23.
Gomory T: A critique of the effectiveness of assertive community treatment. Psychiatric Services 52:1394–1395, 2001
24.
Williamson T: Ethics of assertive outreach (assertive community treatment teams). Current Opinion in Psychiatry 15:543–547, 2002
25.
Bond GR, Salyers MP: Prediction of outcome from the Dartmouth Assertive Community Treatment Fidelity Scale. CNS Spectrums 9:937–942, 2004
26.
Salyers MP, Tsemberis S: ACT and recovery: integrating evidence-based practice and recovery orientation on assertive community treatment teams. Community Mental Health Journal 43:619–641, 2007
27.
Kidd SA, George L, O’Connell M, et al.: Fidelity and recovery-orientation in assertive community treatment. Community Mental Health Journal 46:342–350, 2010
28.
Kidd SA, George L, O’Connell M, et al.: Recovery-oriented service provision and clinical outcomes in assertive community treatment. Psychiatric Rehabilitation Journal 34:194–201, 2011
29.
Teague GB, Bond GR, Drake RE: Program fidelity in assertive community treatment: development and use of a measure. American Journal of Orthopsychiatry 68:216–232, 1998
30.
McGrew JH, Bond GR, Dietzen L, et al.: Measuring the fidelity of implementation of a mental health program model. Journal of Consulting and Clinical Psychology 62:670–678, 1994
31.
McHugo GJ, Drake RE, Teague GB, et al.: Fidelity to assertive community treatment and client outcomes in the New Hampshire dual disorders study. Psychiatric Services 50:818–824, 1999
32.
Dieterich M, Irving CB, Park B, et al.: Intensive case management for severe mental illness. Cochrane Database of Systematic Reviews 10:CD007906, 2010
33.
Burns T, Catty J, Dash M., et al.: Use of intensive case management to reduce time in hospital in people with severe mental illness: systematic review and meta-regression. British Medical Journal 18:335–336, 2007
34.
Mowbray CT, Holder M, Teague GB, et al.: Fidelity criteria: development, measurement, and validation. American Journal of Evaluation 24:315–340, 2003
35.
Monroe-DeVita M, Teague GB, Moser LL: The TMACT: a new tool for measuring fidelity to assertive community treatment. Journal of the American Psychiatric Nurses Association 17:17–29, 2011
36.
Bjorklund RW, Monroe-Devita M, Reed D, et al.: Washington State’s initiative to disseminate and implement high-fidelity ACT teams. Psychiatric Services 60:24–27, 2009
37.
Morrissey JP, Domino ME, Cuddeback GS: Assessing the effectiveness of recovery-oriented ACT in reducing state psychiatric hospital use. Psychiatric Services 64:303–311, 2013
38.
Domino ME, Morrissey JP, Cuddeback GS: The effectiveness of recovery-oriented ACT in reducing hospital use: do effects vary over time? Psychiatric Services 64:312–317, 2013
39.
Client Counts and Service Costs. Olympia, Washington State Department of Social and Health Services, Research and Data Analysis Division. Available at clientdata.rda.dshs.wa.gov
Information & Authors
Information
Published In
Cover: Geraldine Lee #2, by George Wesley Bellows, 1914. Oil on panel, 38 × 30 inches. The Butler Institute of American Art, Youngstown, Ohio.
History
Published in print: April 2013
Published online: 15 October 2014
Authors
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBGet Access
Login options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).