Personal Recovery Among Service Users Compared With Siblings and a Control Group: A Critical Note on Recovery Assessment
Abstract
Objective:
One way to boost the implementation of a recovery-oriented practice in psychiatric care may be by including outcome measures assessing recovery. However, the five core processes of personal recovery—connectedness, hope and optimism about the future, identity, meaning in life, and empowerment (collectively known as CHIME)—are not service user–specific and can be relevant to nonservice users as well. It is unknown whether recovery processes are measurably different among users and nonusers of mental health services. This study aimed to compare scores on the 24-item Recovery Assessment Scale (RAS) among service users with psychosis (in remission and not in remission), their siblings, and a control group, after the validation of the RAS Dutch version.
Methods:
Psychometric evaluation and comparative analyses (analysis of variance and tests of clinical significance) were performed on data from service users (N=581), their siblings (N=632), and control group members (N=372) in the longitudinal Genetic Risk and Outcome in Psychosis study in the Netherlands.
Results:
Results showed that the psychometric validity of the RAS Dutch version was adequate. A significant, moderate effect was found for the RAS total score (F=31.73, df=3 and 1,559, p<0.001; Cohen’s f=0.25). However, clinical significance analysis showed that a substantial number of service users had recovered, including those in remission and those not in remission, and that substantial numbers of siblings and control group members had not recovered.
Conclusions:
The findings call into question the usefulness of the RAS in outcome assessment, given that the differences detected in recovery between service users, siblings, and control group members had limited clinical relevance.
HIGHLIGHTS
•
The number of service users in this study who had recovered, including both those in remission and not in remission, was substantial.
•
The number of siblings and control group members who had not recovered was equally substantial.
•
Study findings call into question the usefulness of the Recovery Assessment Scale in outcome assessment, given that the differences in recovery between service users, siblings, and people in a control group had limited clinical relevance.
A recovery-oriented approach has become increasingly prominent in mental health care services throughout the world (1–5). One way to boost the implementation of a recovery-oriented practice is by including routine outcome measures assessing recovery (6–8). “Personal recovery,” as opposed to “clinical recovery” (9), has often been defined as living a meaningful and contributing life beyond the catastrophic effects of the illness (10–12). In this definition, recovery clearly applies to people with a psychiatric disability.
However, the five core processes of recovery, as identified in the empirically based CHIME framework (13), are not service user–specific. These core processes—connectedness, hope and optimism about the future, identity, meaning in life, and empowerment (13)—can also be considered relevant to nonusers of services. Any individual, whether they experience psychiatric symptoms or not, can feel variation in hope, optimism, empowerment, strength of identity, and sense of meaning in life. Nevertheless, the extent to which these core processes of recovery are rated differently by service users with a mental illness and persons without a mental illness has never been investigated. The primary aim of this study was to investigate whether recovery among service users with a psychotic disorder, both those in remission and not in remission, differs from that of their siblings and members of a control group and, if so, to describe how the groups differed. Recovery was measured with the Recovery Assessment Scale (RAS) (14, 15), and all participants were part of a large Dutch sample. Because the Dutch version of the RAS had not yet been validated, we first examined the psychometric qualities of the Dutch RAS.
Methods
Participants
Data derive from the second follow-up measurements of the 2004–2013 longitudinal Genetic Risk and Outcome in Psychosis (GROUP) study (16). At baseline, the full sample consisted of 1,119 service users with nonaffective psychotic disorder, 1,057 siblings, and 589 persons serving as a control group. Inclusion criteria for service users were ages 16 to 50 years, diagnosis of nonaffective psychotic disorder, and good command of the Dutch language. Inclusion criteria for siblings and the control group were ages 16 to 50 years, no lifetime psychotic disorder, and good command of the Dutch language. For the control group, an additional inclusion criterion was having no first-degree family member with a lifetime psychotic disorder, as established by the Family Interview for Genetic Studies (17). DSM-IV diagnoses were assessed in all three groups with the Comprehensive Assessment of Symptoms and History interview (18) or the Schedules for Clinical Assessment for Neuropsychiatry (19). The diagnoses for service users were schizophrenia and related disorders (N=945, 84%), other psychotic disorders (N=149, 13%), and psychotic illness in the context of substance abuse or somatic illness (N=25, 3%). At the second follow-up, 6 years after baseline, the GROUP sample consisted of 660 service users with nonaffective psychotic disorder, 710 siblings (unaffected by a psychotic disorder), and 394 persons in the control group (white, N=1,560, 89%; black, N=26, 2%; Asian, N=2, <1%; and mixed race-ethnicity, N=176, 10%).
Ethical Statement
The study protocol was approved centrally by the Ethical Review Board of the University Medical Centre Utrecht and subsequently by local review boards of each participating institute and was conducted in accordance with the Helsinki Declaration of 1975, as revised in 2008. All study participants provided written informed consent.
Measures
We used the 24-item RAS (15) with the factors of personal confidence and hope, willingness to ask for help, goal and success orientation, reliance on others, and no domination by symptoms. The RAS has a 5-point agreement scale, with higher scores indicating more recovery. We added the response option of “not applicable” to the items that loaded on the last factor (items 15 [”Coping with mental illness is no longer the main focus of my life”], 16 [“My symptoms interfere less and less with my life”], and 17 [“My symptoms seem to be a problem for shorter periods of time each time they occur”])—given that this factor could have been irrelevant to the siblings and members of the control group. The English RAS-24 was translated to Dutch by two researchers (LvdK, SS) and back-translated by a qualified translator.
The World Health Organization Quality of Life–Bref (WHOQoL-Bref) (20), a 26-item self-report questionnaire, assesses four domains of subjective quality of life over the past 2 weeks—the physical, the psychological, the social, and the environmental. Higher scores on the WHOQoL-Bref indicate higher levels of subjective quality of life.
The Positive and Negative Syndrome Scale (PANSS) (21), including the positive, negative, and general psychopathology subscales, assesses symptom severity. PANSS scores were also used to distinguish between service users in remission and those not in remission, given that for some service users, symptoms were of such low intensity that they no longer interfered significantly with daily functioning (22). Remission was operationalized as a PANSS score of 3 or less on the PANSS items for delusions, unusual thought content, hallucinatory behavior, conceptual disorganization, mannerism/posturing, blunted affect, passive/apathetic social withdrawal, and lack of spontaneity and flow of conversation for a minimum of 6 months (23).
The Social Functioning Scale (SFS) (24) is a 76-item, self-report instrument measuring withdrawal, interpersonal behavior, prosocial activities, recreation, independence-performance, independence-competence, and employment/occupation. Higher scores on the SFS indicate higher levels of social functioning.
The Camberwell Assessment of Need (CAN) (25, 26) was used to assess the need for care on a 3-point scale (no need, met need, and unmet need). In the GROUP study, the original 22 CAN items were extended by two additional items for paid work and undesired effects of medication. In this study, we focused on the number of unmet needs.
The Recovery Style Questionnaire (RSQ) (27) consists of 39 dichotomous items used to distinguish between individuals with an integration recovery style, characterized by active attempts to manage the illness, and those with a sealing-over recovery style, characterized by cognitive and behavioral avoidance of the illness. Higher scores on the RSQ indicate a sealing-over recovery style.
Analysis
GROUP database version 5.0 was used for all analyses. All statistical analyses were performed by using SPSS software for Windows, version 24.0, and MPlus, version 6.12 (for factor analysis only).
Psychometric evaluation.
Internal consistency of the RAS was investigated by using the Cronbach’s alpha coefficient (α≥0.9=excellent, 0.9>α≥0.8=good, 0.8>α≥0.7=acceptable, 0.7>α≥0.6=questionable; 0.6>α≥0.5=poor; and α<0.5=unacceptable (28). To measure the correlation between RAS items and the total scale, we used the criterion that corrected item-total correlation should not be below 0.3 (29). Internal consistency was calculated for service users, siblings, and members of the control group separately (30, 31).
Concurrent validity of the RAS was investigated by relating recovery to quality of life, a concept that is closely related to recovery (14). A positive association between the RAS and the WHOQoL-Bref was expected. Divergent validity of the RAS was examined by relating recovery to severity of psychotic symptoms measured with the PANSS. The RAS is said to measure ”personal” recovery, whereas the PANSS assesses symptom alleviation and can be considered a measure of “clinical” recovery. A trivial to small association between the RAS and the PANSS was expected. For the service user sample only, Pearson’s correlation coefficients were calculated for the correlation between total score on the RAS on the one hand and the subscale scores of the WHOQoL-Bref and the PANSS on the other hand. Correlations were interpreted according to Cohen (32): a coefficient of 0.10 is considered small; 0.30, moderate; and 0.50, large.
In addition, we explored associations between the RAS and the SFS, CAN unmet needs, and the RSQ for the service user sample. We expected a positive association between the RAS and the SFS and trivial to small associations between the RAS and CAN unmet needs and the RSQ, given that the RSQ measures recovery style and the RAS measures the degree of recovery.
A confirmatory factor analysis (CFA) was performed on the 24 RAS items for service users only (15), using Mplus 6.0. Model fit was assessed by using the root mean square error of approximation (RMSEA) and the Tucker-Lewis Index (TLI). An RMSEA below .06 and a TLI close to .95 can be considered good (33).
Comparisons.
The RAS total score and the other factor scores were compared between service users not in remission, service users in remission, siblings, and control group members in terms of statistical significance, effect size, and clinical significance. To determine statistical significance we used analysis of variance. Cohen’s f, defined by the ratio of population standard deviations (32), was calculated as an effect size measure of mean difference. According to Cohen, values of 0.10, 0.25, and 0.40 represent small, moderate and large effect sizes, respectively (32). Clinical significance was calculated by comparing the ratio of recovered versus not recovered persons between the four subgroups, using the three criteria provided by Jacobson and Truax (34). With criterion A, an individual moves above two standard deviations (SDs) from the mean of the reference population (or “dysfunctional” population, the term used by the original authors). In this study, recovery was indicated by whether the RAS score was greater than the mean score among services users not in remission +2 SDs. With criterion B, an individual moves below two SDs of the mean of the “functional population” (original authors’ term). In this study, recovery was indicated by whether the RAS score was lower than the mean score of the control group members –2 SDs. With criterion C, an individual is closer to the mean of the “functional population” than to the mean of the reference population ([criterion A + criterion B]/2).
Which criterion is best depends on one’s standards (34). We chose to use all three criteria and compare the results to get a comprehensive view on the data. For the reference population, the subgroup of service users not in remission was used. In all comparison analyses, the factor “no domination by symptoms” was left out because the items in this factor were considered potentially inapplicable to the siblings of service users and the members of the control group.
Results
A total of 581 service users, 630 siblings, and 372 control group members completed the RAS. This was 88%, 89%, and 94%, respectively, of the GROUP sample at the second follow-up measurement. Of the 561 (97%) service users for whom PANSS remission items were available, 336 (60%) were in remission and 225 (40%) were not in remission.
Psychometric Evaluation
Internal consistency.
Cronbach’s alpha coefficient for the total score of the RAS was 0.90 for service users, 0.90 for siblings, and 0.92 for persons in the control group, which can be considered excellent. For the service users and siblings, one item (“I have a desire to succeed”) had a corrected item-total correlation of 0.28, which is below the criterion (α=0.30). However, dropping the item would hardly increase the overall reliability of the factor (if item deleted, α=0.90 and 0.91, respectively). Internal consistency scores of the other RAS factors were good to acceptable (see online supplement ).
Concurrent and divergent validity.
Among service users, the RAS total score showed a large positive correlation with the WHOQoL-Bref psychological subscale and a moderate positive correlation with the WHOQoL-Bref physical, social, and environmental subscales. A small negative correlation was found between the RAS total score and the PANSS subscales. (The correlation coefficients are available in an online supplement .)
Exploratory associations.
Among service users, the RAS total score showed small to moderate positive correlations with the SFS subscales and total scale and small negative correlations with the CAN unmet needs and with the RSQ (see online supplement ).
Factor structure.
Results of the CFA for service users showed a RMSEA of 0.047 (90% confidence interval=0.041–0.052), indicating a good model fit. The TLI was 0.910, which can be considered a reasonable model fit (see online supplement for details about the CFA).
Comparisons
Statistical significance and effect sizes.
A one-way, between-subjects analysis of variance was conducted to compare the RAS scores between service users not in remission, service users in remission, siblings of service users, and persons in the control group. A significant and moderate difference was found between the four groups for RAS total score (F=31.73, df=3 and 1,559, p<0.001; Cohen’s f=0.25) and personal confidence and hope (F=44.91, df=3 and 1,559, p<0.001; Cohen’s f=0.29). A significant and small difference was found between the four groups for goal and success orientation (F=10.77, df=3 and 1,561, p<0.001; Cohen’s f=0.14) and reliance on others (F=28.67, df=3 and 1,560, p<0.001; Cohen’s f=0.23). A significant but trivial difference was found between the four groups for willingness to ask for help (F=4.27, df=3 and 1,557, p=0.005; Cohen’s f=0.09). Post hoc comparisons, using the Tukey honestly significant difference test, indicated that for all RAS factors, except willingness to ask for help, the mean score for both service user groups was lower than the mean score for siblings and control group members, whereas the scores for the latter two groups did not differ from each other. Moreover, for all factors, the mean score for service users not in remission was lower than the mean score for service users in remission (Table 1).
| Service users | ||||||||
|---|---|---|---|---|---|---|---|---|
| Not in remission (N=225) | In remission (N=336) | Siblings (N=630) | Control group (N=372) | |||||
| Factor | M | SD | M | SD | M | SD | M | SD |
| Total (all factors excluding factor 5 (no domination by symptoms) | 3.67 | .50 | 3.83 | .51 | 3.98 | .46 | 4.00 | .47 |
| Total (all factors including factor 5) | 3.63 | .49 | 3.83 | .52 | na | na | na | na |
| Factor 1: personal confidence and hope | 3.47 | .62 | 3.61 | .60 | 3.89 | .54 | 3.88 | .52 |
| Factor 2: willingness to ask for help | 3.79 | .70 | 4.00 | .77 | 3.87 | .70 | 3.90 | .66 |
| Factor 3: goal and success orientation | 3.77 | .69 | 3.88 | .68 | 4.00 | .58 | 4.02 | .62 |
| Factor 4: reliance on others | 3.90 | .61 | 4.15 | .59 | 4.25 | .54 | 4.31 | .54 |
a
Possible scores range from 1 to 5, with higher scores indicating more recovered.
Clinical significance.
The clinical significance of the group differences in RAS total score (excluding the factor for no domination by symptoms) and in personal confidence and hope, the most discriminating factor, is presented in Tables 2 and 3. For the RAS total factor and the personal confidence and hope factor, the proportion of persons who had recovered was significantly lower among service users not in remission, the reference group, than among siblings and control group members, according to criteria B and C, but not criterion A. However, the proportions of persons in the four groups who had or had not recovered was rather remarkable. According to criterion A, almost none of the participants, regardless of group status, had recovered. According to criterion B, almost all participants, regardless of group status, had recovered. According to criterion C, 50% to 70% of the service users had not recovered, but almost 40% of siblings and control group members also had not recovered. For the remaining factors of the RAS, the application of criteria A, B, and C to the other subscales showed even more extreme differences between the four groups in the proportion of persons who had recovered (see online supplement ).
| Service users | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Not in remission (N=225) | In remission (N=336) | Siblings (N=630) | Control group (N=372) | |||||||||||||
| Recovered | Not recovered | Recovered | Not recovered | Recovered | Not recovered | Recovered | Not recovered | |||||||||
| Criterion | N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % |
| A | 4b | 2 | 221b | 98 | 15b | 5 | 321b | 96 | 37b | 6 | 593b | 94 | 23b | 6 | 349b | 94 |
| B | 197b | 88 | 28b | 12 | 313b,c | 93 | 23b,c | 7 | 613d | 97 | 17d | 3 | 361c,d | 97 | 11c,d | 3 |
| C | 82b | 36 | 143b | 64 | 161c | 48 | 175c | 52 | 395d | 63 | 235d | 37 | 238d | 64 | 134d | 36 |
a
The RAS score did not include the subscale for no domination by symptoms. Clinically significant differences in rates of recovery between subgroups are indicated by subscripts with different letters (p<.05). Differences that are not clinically significant are indicated by identical subscripts.
| Service users | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Not in remission (N=225) | In remission (N=336) | Siblings (N=630) | Control group (N=372) | |||||||||||||
| Recovered | Not recovered | Recovered | Not recovered | Recovered | Not recovered | Recovered | Not recovered | |||||||||
| Criterion | N | % | N | % | N | % | N | % | N | % | N | % | N | % | N | % |
| A | 6b | 3 | 219b | 97 | 9b | 3 | 327b | 97 | 33b | 5 | 597b | 95 | 20b | 5 | 352b | 95 |
| B | 190b | 84 | 35b | 16 | 305b | 91 | 31b | 9 | 604c | 96 | 26c | 4 | 361c | 97 | 11c | 3 |
| C | 55ab | 24 | 170b | 76 | 123c | 37 | 213c | 63 | 378d | 60 | 252d | 40 | 219d | 59 | 153d | 41 |
a
Clinically significant differences in rates of recovery between subgroups are indicated by subscripts with different letters (p=.05). Differences that are not clinically significant are indicated by identical subscripts.
Discussion and Conclusions
Psychometric Quality
The Dutch version of the RAS showed high overall internal consistency and satisfactory concurrent and divergent validity. Higher recovery levels coincided with higher quality of life and were associated, although not strongly, with lower levels of psychiatric symptoms. This is in line with previous research (14, 35, 36). In addition, higher recovery levels were associated with better social functioning, with less unmet care needs, and with an “integration” recovery style, although the latter two effects were very small. The original factor structure of the RAS is a reasonable to good fit with our data. These psychometric findings demonstrate that the Dutch translation of the RAS assesses personal recovery as adequately as other RAS translations (35, 36). Yet, that is not to say that the RAS is a meaningful instrument for routine outcome monitoring.
Key Findings
Our comparison between RAS scores of service users not in remission, service users in remission, siblings, and members of a control group shines a new light on this frequently used measure of recovery. To find out whether the RAS discriminates between service users, siblings, and control group members, we compared the groups in terms of statistical and clinical differences. The differences in recovery scores between service users versus siblings and control group members were mostly statistically significant with trivial to moderate effects. However, going beyond the analysis of variance and zooming in on the clinical significance of differences on the RAS between service users, siblings, and control group members, we found that the differences between the four groups, for the factors evaluated, were less clear.
Criterion C, the least arbitrary criterion according to Jacobson and Truax (34), distinguished most clearly between service users and siblings and control group members. Looking at the RAS total score, we found that 36% of service users who were not in remission and 48% of service users who were in remission had recovered, according to this criterion, compared with 63% of siblings and 64% of control group members. In other words, 64% of service users who were not in remission, 52% of service users who were in remission had not recovered, but this was also true of 37% of siblings, and 36% of control group members. These findings indicate that the RAS total factor discriminates between service users and nonservice users if, and only if, the service users score at the lower extreme of the RAS.
Implications
On the one hand, the fact that we did not find large differences in recovery scores between service users, siblings, and control group members may be considered encouraging. For instance, the finding that service users did not differ from their siblings and control group members on the factor for willingness to ask for help suggests that service users with symptoms of a mental disorder can be just as assertive in asking for help as other people, although the kind of help they are looking for or the resources involved are probably different. On the other hand, the similarity in the proportion of recovered persons among service users, siblings, and control group members raises questions about the usability of the recovery construct as measured with the RAS. If service users report a recovery level similar to that of siblings and control group members, what is the meaning of recovery? It does not make sense to expect recovery scores to rise more among service users than among control group members. For service users who score very low on personal recovery, the RAS, especially the factor for personal confidence and hope, may be useful for measuring progress on personal recovery throughout the clinical care trajectory. Its sensitivity to change should be investigated in a future study.
Nonetheless, for most service users, the RAS will probably not detect changes in personal recovery. Therefore, if we want to include recovery measures in routine outcome assessment, as has been suggested (6–8), the results of this study indicate that including the24-item RAS would be of questionable usefulness. An alternative method may be to use more personalized assessment procedures, which measure change in terms of subjective experiences relevant to the person involved, such as the Discan approach (37).
Strengths and Limitations
This is the first study that compares recovery ratings among service users and nonusers. Moreover, the study was conducted in a large national sample. A limitation was that we could not evaluate the sensitivity to change of the RAS and test-retest reliability. Furthermore, in the comparison between service users, siblings, and control group members, we had to exclude the RAS factor for domination by symptoms, given that the items of this factor were less relevant to siblings and control group members. In fact, this factor may be more service user–specific and, therefore, discriminate better between groups. Finally, it may be argued that the service users included in this study form a relatively healthy group, given that they managed to participate in the second follow-up of the GROUP study, 6 years after baseline. Service users with a poorer condition may have dropped out. However, we accounted for this potential limitation by distinguishing between service users in remission and those not in remission.
Acknowledgments
The authors are grateful for the generosity of time and effort by the patients, their families, and healthy subjects. Furthermore, they thank all research personnel involved in the Genetic Risk and Outcome in Psychosis (GROUP) project, particularly Joyce van Baaren, Erwin Veermans, Ger Driessen, Truda Driesen, Karin Pos, Erna van ’t Hag, Jessica de Nijs, Atiqul Islam, Wendy Beuken, and Debora Op ’t Eijnde. The GROUP investigators are Therese van Amelsvoort, Dr. Bartels-Velthuis, Richard Bruggeman, Wiepke Cahn, Lieuwe de Haan, Frederike Schirmbeck, Claudia J.P. Simons, and Jim van Os.
Supplementary Material
File (appi.ps.201900049.ds001.pdf)
- View/Download
- 31.63 KB
References
1.
Bradstreet S, McBrierty R: Recovery in Scotland: beyond service development. Int Rev Psychiatry 2012; 24:64–69
2.
Chiba R, Miyamoto Y, Kawakami N, et al: Effectiveness of a program to facilitate recovery for people with long-term mental illness in Japan. Nurs Health Sci 2014; 16:277–283
3.
Davidson L, Tondora J, O’Connell MJ, et al: Creating a recovery-oriented system of behavioral health care: moving from concept to reality. Psychiatr Rehabil J 2007; 31:23–31
4.
Tse S, Ran MS, Huang Y, et al: Mental health care reforms in Asia: the urgency of now: building a recovery-oriented, community mental health service in China. Psychiatr Serv 2013; 64:613–616
5.
Turner-Crowson J, Wallcraft J: The recovery vision for mental health services and research: a British perspective. Psychiatr Rehabil J 2002; 25:245–254
6.
Burgess P, Pirkis J, Coombs T, et al: Assessing the value of existing recovery measures for routine use in Australian mental health services. Aust N Z J Psychiatry 2011; 45:267–280
7.
Andresen R, Caputi P, Oades LG: Do clinical outcome measures assess consumer-defined recovery? Psychiatry Res 2010; 177:309–317
8.
Thornicroft G, Slade M: New trends in assessing the outcomes of mental health interventions. World Psychiatry 2014; 13:118–124
9.
Macpherson R, Pesola F, Leamy M, et al: The relationship between clinical and recovery dimensions of outcome in mental health. Schizophr Res 2016; 175(1–3):142–147
10.
Anthony WA: Recovery from mental illness: the guiding vision of the mental health service system in the 1990s. Psychosocial Rehabilitation Journal 1993; 16:11–23
11.
Deegan PE: Recovery and empowerment for people with psychiatric disabilities. Soc Work Health Care 1997; 25:11–24
12.
Leete E: How I perceive and manage my illness. Schizophr Bull 1989; 15:197–200
13.
Leamy M, Bird V, Le Boutillier C, et al: Conceptual framework for personal recovery in mental health: systematic review and narrative synthesis. Br J Psychiatry 2011; 199:445–452
14.
Corrigan PW, Giffort D, Rashid F, et al: Recovery as a psychological construct. Community Ment Health J 1999; 35:231–239
15.
Corrigan PW, Salzer M, Ralph RO, et al: Examining the factor structure of the Recovery Assessment Scale. Schizophr Bull 2004; 30:1035–1041
16.
Korver N, Quee PJ, Boos HB, et al: Genetic Risk and Outcome of Psychosis (GROUP), a multi-site longitudinal cohort study focused on gene-environment interaction: objectives, sample characteristics, recruitment and assessment methods. Int J Methods Psychiatr Res 2012; 21:205–221
17.
NIMH Genetics Initiative: Family Interview for Genetic Studies (FIGS). Rockville, MD, National Institute of Mental Health, 1992
18.
Andreasen NC, Flaum M, Arndt S: The Comprehensive Assessment of Symptoms and History (CASH). An instrument for assessing diagnosis and psychopathology. Arch Gen Psychiatry 1992; 49:615–623
19.
Wing JK, Babor T, Brugha T, et al: Schedules for Clinical Assessment in Neuropsychiatry: SCAN. Arch Gen Psychiatry 1990; 47:589–593
20.
The World Health Organization Quality of Life assessment (WHOQOL): position paper from the World Health Organization. Soc Sci Med 1995; 41:1403–1409
21.
Kay SR, Fiszbein A, Opler LA: The Positive and Negative Syndrome Scale (PANSS) for schizophrenia. Schizophr Bull 1987; 13:261–276
22.
Andreasen NC, Carpenter WT Jr, Kane JM, et al: Remission in schizophrenia: proposed criteria and rationale for consensus. Am J Psychiatry 2005; 162:441–449
23.
van Os J, Drukker M, à Campo J, et al: Validation of remission criteria for schizophrenia. Am J Psychiatry 2006; 163:2000–2002
24.
Birchwood M, Smith J, Cochrane R, et al: The Social Functioning Scale. The development and validation of a new scale of social adjustment for use in family intervention programmes with schizophrenic patients. Br J Psychiatry 1990; 157:853–859
25.
McCrone P, Leese M, Thornicroft G, et al: Reliability of the Camberwell Assessment of Need–European Version. EPSILON Study 6. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs. Br J Psychiatry Suppl 2000; 39:s34–s40
26.
Phelan M, Slade M, Thornicroft G, et al: The Camberwell Assessment of Need: the validity and reliability of an instrument to assess the needs of people with severe mental illness. Br J Psychiatry 1995; 167:589–595
27.
Drayton M, Birchwood M, Trower P: Early attachment experience and recovery from psychosis. Br J Clin Psychol 1998; 37:269–284
28.
George D, Mallery P: SPSS for Windows Step by Step: A Simple Guide and Reference. 11.0 Update, 4th ed. Boston, Allyn & Bacon, 2003
29.
Nunnally J, Bernstein I: Psychometric Theory. New York, McGraw-Hill, 1994
30.
Streiner DL: Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess 2003; 80:99–103
31.
Tavakol M, Dennick R: Making sense of Cronbach’s alpha. Int J Med Educ 2011; 2:53–55
32.
Cohen J: Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ, Erlbaum, 1988
33.
Hu L, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling 1999; 6:1–55
34.
Jacobson NS, Truax P: Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991; 59:12–19
35.
Chiba R, Miyamoto Y, Kawakami N: Reliability and validity of the Japanese version of the Recovery Assessment Scale (RAS) for people with chronic mental illness: scale development. Int J Nurs Stud 2010; 47:314–322
36.
McNaught M, Caputi P, Oades LG, et al: Testing the validity of the Recovery Assessment Scale using an Australian sample. Aust N Z J Psychiatry 2007; 41:450–457
37.
Bilsbury CD, Richman A: A staging approach to measuring patient-centred subjective outcomes. Acta Psychiatr Scand Suppl 2002; 414:5–40
Information & Authors
Information
Published In
History
Received: 25 January 2019
Revision received: 22 March 2019
Accepted: 13 June 2019
Published online: 27 August 2019
Published in print: December 01, 2019
Keywords
Authors
Competing Interests
The authors report no financial relationships with commercial interests.
Funding Information
Multiple funders.: This work was supported by the Geestkracht program
This work was supported by the Geestkracht program of the Dutch Health Research Council (Zon-Mw, grant number 10-000-1001) and matching funds from participating pharmaceutical companies (Lundbeck, AstraZeneca, Eli Lilly, Janssen Cilag) and universities and mental health care organizations in Amsterdam (Academic Psychiatric Centre of the Academic Medical Center, GGZ Ingeest, Arkin, Dijk en Duin, GGZ Rivierduinen, Erasmus Medical Centre, and GGZ Noord Holland Noord), Groningen (University Medical Center Groningen, Lentis, GGZ Friesland, GGZ Drenthe, Dimence, Mediant, GGNet Warnsveld, Yulius Dordrecht, and Parnassia psycho-medical center The Hague), Maastricht (Maastricht University Medical Centre, GGZ Eindhoven en De Kempen, GGZ Breburg, GGZ Oost-Brabant, Vincent van Gogh voor Geestelijke Gezondheid, Mondriaan, Virenze riagg, Zuyderland GGZ, MET GGZ, Universitair Centrum Sint-Jozef Kortenberg, CAPRI University of Antwerp, PC Ziekeren Sint-Truiden, PZ Sancta Maria Sint-Truiden, GGZ Overpelt, and OPZ Rekem), and Utrecht (University Medical Center Utrecht, Altrecht, GGZ Centraal, and Delta). Data used in this study can be requested from the authors via Joyce van Baaren ([email protected]).Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).