Controlled research on coordinated specialty care for people experiencing a first episode of psychosis has demonstrated improvements in both clinical and functional outcomes (
1), including employment (
2,
3). The recent Recovery After an Initial Schizophrenia Episode–Early Treatment Program (RAISE-ETP) study, a 34-site cluster-randomized trial funded by the National Institute of Mental Health (NIMH), found that a comprehensive program of pharmacologic and psychotherapeutic treatments provided in real-world settings could improve quality of life, reduce symptoms (
4), and increase school and work involvement (
5) as compared with usual community care.
While receipt of Social Security Administration (SSA) disability benefits is not itself a reliable indicator of disablement, these benefits are a major feature of the lives of many people living with schizophrenia, providing essential income support and conferring eligibility for health insurance. The RAISE-ETP study provides a unique opportunity to examine the impact of coordinated specialty care on the entry of first-episode psychosis patients into the two major SSA disability programs: Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI). SSDI is an early retirement program for workers who have paid a portion of their earnings to Social Security. SSI, in contrast, is a program for people with low incomes who have not worked sufficiently to qualify for SSDI. They are referred to here, together, as SSA disability programs. SSDI confers eligibility for Medicare after a 2-year wait, and SSI generally confers eligibility for Medicaid.
In 2014, some 713,000 U.S. adults received SSDI or SSI for schizophrenia (
6). A 1998 survey of adults in treatment for schizophrenia in Ohio and Georgia found that 51% reported income from SSDI and 44% from SSI (
7), and 57.8% of patients entering the 2005 Clinical Antipsychotic Trials of Intervention Effectiveness study reported receipt of either SSDI or SSI (
8). Reliance on these programs is thus widespread among people with schizophrenia.
Although programs for first-episode psychosis have been studied in many countries in recent years, their impact on entry into disability income replacement programs has not been studied. In the 1990s, a longitudinal study of 169 patients at an “early stage of psychiatric disorder” reported that 35% later received disability benefits and that recipients had more severe symptoms, had more social isolation, and were more dependent on their families than applicants who did not receive benefits (
9).
A recent study of almost 1 million 18- to 39-year-olds who were awarded SSDI between 1996 and 2007 found dramatic growth in the proportion of young awardees with psychiatric disorders, suggesting rapid early entry (
10). Furthermore, the Mental Health Treatment Study, a major demonstration program of supported employment for SSDI recipients, found that only 0.2% left the program over 2 years (
11). A second study showed that over a 13-year follow-up period, only 13.1% of disability recipients who were receiving supported employment for a diagnosis of schizophrenia left the disability rolls, even temporarily (
12).
A recent policy commentary (
11) concluded from these and other data that supported employment is not effective in facilitating exit from SSDI or SSI and that future rehabilitation efforts should focus on the goal of
preventing the need for first-episode psychosis clients to enroll in disability programs. The RAISE-ETP study provides a unique opportunity to evaluate the feasibility of achieving this objective and offers a hitherto unavailable opportunity to examine rates and predictors of entry into SSA disability programs and their short-term clinical impact early in the course of psychotic illness.
Method
Detailed descriptions of the RAISE-ETP study design, including a CONSORT diagram of recruitment and disposition (
4), the clinical interventions (
13), and the 2-year clinical outcomes (
4), have been published previously.
Study Participants and Sites
A total of 404 individuals 15–40 years of age who presented for treatment for a first episode of psychosis and had taken antipsychotic medication for at least 6 months were enrolled between July 2010 and July 2012; of these, 399 for whom baseline information regarding disability status is available were included in the present analysis. Written informed consent was obtained from adult participants and from legal guardians of participants under age 18. The institutional review boards of the coordinating center and of each site approved the study. An NIMH data and safety monitoring board provided oversight. Thirty-four community mental health treatment centers were chosen after a national invitation and selection process and were equally randomized to provide either specialized coordinated care—the NAVIGATE intervention—or usual community care.
Intervention
NAVIGATE clinical teams provided four treatment components: 1) personalized medication management (assisted by a web-based decision support system), 2) family psychoeducation, 3) individual, resilience-focused training in illness self-management, and 4) supported employment and education grounded in many of the principles of the individual placement and support model and outlined in a detailed training manual (
13). Robust differences have been demonstrated showing far more extensive client-reported receipt of each of these interventions at NAVIGATE sites compared with community care sites (
4). Study participants were not required to express initial interest in work or school at admission, but they received continuing encouragement to participate in supported employment and education. Specific training, monitoring, and fidelity assessments (
5) showed that employment and education specialists had at least twice monthly contacts with clients at 13 of the 17 NAVIGATE sites, with a mean caseload of 10.7 clients at these sites. Using the average score across nine fidelity items, four sites were in the upper range of basic to good, 11 were in the lower range of basic to good, and two showed limited to basic fidelity. Unlike many other supported employment studies (
5), RAISE-ETP included patients who were not explicitly interested in working or attending school, it relied on remote training and consultation, and most specialists worked less than half-time on the NAVIGATE team.
Assessments
Remote evaluators who were blind to treatment condition and study design conducted assessments of quality of life and symptoms every 6 months for 2 years, using secure videoconferencing.
Self-report data on sociodemographic characteristics and sources of income, including disability payments, were obtained through patient interviews every 3 months. Data on employment were gathered through monthly interviews. Additional self-report rating scale assessments were obtained every 6 months for the 2 years of the study.
Measures
Participants’ sociodemographic characteristics were documented at baseline. Overall quality of life was assessed with the Quality of Life Scale (
14), which includes four subscales reflecting interpersonal relationships, instrumental role functioning, intrapsychic foundations, and common objects and activities used in daily life. A recent confirmatory factor analysis of the scale (
15) proposed reconceptualizing the intrapsychic foundations subscale as “motivation,” as the motivation item loaded highest on this factor. Psychiatric symptom severity was measured with the Positive and Negative Syndrome Scale (PANSS) (
16) (using five subscales [
17]) and the Calgary Depression Scale for Schizophrenia (
18).
Additional self-report social and well-being measures included reduced versions of the Perceived Well-Being Scale (
19), the Mental Health Recovery Measure (
20), the Autonomy Support Scale–Short Form (
21), the Brief Evaluation of Medication Influences and Beliefs (
22), the Stigma Scale (
23), the global assessment item in the Quality of Life Interview (a 1–7 rating, from “delighted” to “terrible”) (
24), and the “feeling thermometer” as used in the EuroQol EQ-5D, in which health is self-rated on a scale from 0 (worst possible health) to 100 (perfect health) (
25).
Statistical Methods
Since some participants were receiving benefits at the time of study entry, logistic regression with random effects for site was first conducted to compare the characteristics, including treatment assignment, of clients who received benefits at entry and those who did not, with clustering of clients within sites.
Subsequent analyses involved only participants who were not receiving disability benefits at study entry. The analyses evaluated the association of treatment assignment and baseline characteristics with time to first receipt of SSA disability benefits in a survival analysis using proportional hazard models with a random effect for site. Multivariate analyses that included measures that were significantly associated with receipt of SSA disability benefits on bivariate analysis were used to identify characteristics that were independently associated with receipt of SSA benefits.
Finally, piecewise regression analysis was used to compare the trajectory of change in outcome measures from before to after receipt of disability benefits between beneficiaries and nonbeneficiaries (
26). The median time to receipt of disability income during the study was 9 months, so trajectory changes among participants who did not receive benefits were compared before and after 9 months of program involvement. These comparisons were repeated in a set of sensitivity analyses that used 6 months and 12 months as the temporal break for pre-post trajectory comparisons with participants who did not receive disability benefits during the study. Data from the analysis of baseline predictors of receipt of disability were used to construct a propensity score (
27) representing the likelihood of receiving benefits at any time during the study, based on baseline differences. Piecewise analyses included this propensity score as a covariate to adjust for baseline differences between participants who received disability benefits and those who did not. In a sensitivity analysis, we also examined the piecewise regression with a time-dependent propensity score.
Results
The mean age of the sample was 23.1 years (SD=5.1). Most participants lived with their families (70.7%); 20.5% attended school, and 15.0% were employed. The median duration of untreated psychosis was 74 weeks.
Of 399 participants with complete baseline disability data, 36 (9.0%) were receiving SSA disability benefits (evenly divided between SSI and SSDI). SSA beneficiaries were older and had lower levels of education, more hospitalizations, more severe negative symptoms, and higher total incomes than others (
Table 1). Multivariate analysis showed that beneficiaries were older on average (p=0.004) and had more severe negative symptoms (p=0.02).
Among those not receiving benefits at baseline, 124/363 (34.1%) obtained benefits during the next 2 years, after a median of 9 months, resulting in a total of 160/399 (40.1%) SSA beneficiaries after 2 years.
There were no significant differences between NAVIGATE and usual community care in the proportion receiving SSA disability benefits at baseline or at any time during follow-up assessments over the 2-year study.
Significant baseline predictors of newly receiving benefits included less education, not being employed or going to school, less likelihood of receiving of private health insurance, longer duration of untreated psychosis, older age, lower score on the objects and activities subscale of the Quality of Life Scale, and higher positive symptom ratings on the PANSS (
Table 2). Multivariate analysis of time to receipt of SSA disability benefits identified significant independent baseline predictors, including taking antipsychotic medication, longer than median duration of untreated psychosis (i.e., >74 weeks), less than high school education, not being employed or attending school, less likelihood of receiving of private health insurance, and higher positive symptom scores (
Table 3).
Piecewise regression analysis among the 363 patients not receiving benefits at baseline addressed the impact of receiving new disability benefits on outcome trajectories (as compared with nonrecipients) and showed highly significant effects indicating increased total income, fewer days of employment, and fewer days of use of alcohol to intoxication (
Table 4). Although there was no significant effect on the Quality of Life Scale total score, a significant negative effect was observed on the motivation subscale (p=0.046), and a negative effect just short of significance was observed on the instrumental role functioning subscale (p=0.053). Examination of individual items within the motivation subscale showed significantly reduced sense of purpose and motivation, greater anhedonia, and poorer time utilization (
Table 4).
In contrast, there were no significant effects of receiving benefits on symptom measures on the PANSS or the Calgary Depression Scale for Schizophrenia or on self-report measures of autonomy, attitudes toward medications, recovery, stigma, subjective well-being, or quality of life.
To determine whether the relative decline in motivation was mediated by reduced employment, piecewise regression was repeated, controlling for the number of self-reported days of employment during the month before assessment. With this covariate in the model, neither instrumental function nor motivation was significantly reduced after receipt of disability benefits, nor were items concerning degree of motivation and poorer time utilization. However, greater anhedonia (p<0.03) and reduced sense of purpose (p<0.02) remained significant.
A sensitivity analysis using a time-dependent propensity score produced roughly the same results but with larger p values on the Quality of Life Scale subscales and some of the individual items.
Discussion
To our knowledge, this study is the first to examine the impact of coordinated specialty care on receipt of SSA disability benefits following entry into community care for first-episode psychosis. A total of 40.1% of all participants were receiving SSA disability benefits by the end of the 2-year follow-up period. Although NAVIGATE improved psychosocial functioning and symptoms (
4), it did not significantly reduce entry into SSA disability. Consistent with SSA disability policy, new beneficiaries had worse employment histories, lower levels of education, and more severe positive symptoms than other participants. But with average total earnings of less than $200/month among those without benefits at the time of program entry (
5) and 51% lacking any health insurance, SSA benefits addressed critical needs for income support and eligibility for health insurance. The urgency of these economic needs may thus have superseded the effect of modestly greater improvements in clinical outcomes, leading to high rates of entry into the SSA disability program and no significant treatment group differences.
In view of recent policy interest in preventing the need for entry into SSA disability programs (
11), it is notable that although NAVIGATE led to improved Quality of Life Scale scores, reduced symptoms, and greater increases in employment compared with usual care (
4,
5), the magnitude of these effects was evidently not sufficient to obviate the need for entry into SSA disability programs. Most NAVIGATE patients were not working after 2 years (
5), and those who were earned an average of only $900 per month, about half the average income of typical SSA beneficiaries 29–40 years of age (
10). Thus, most patients, regardless of treatment assignment, still needed income supports and health insurance coverage after 2 years of treatment. As noted previously (
5), employment outcomes may have been less robust in RAISE-ETP than in some other studies of supported employment, possibly because interest in working or going to school was not an entry requirement; because training and implementation of supported employment and education in this real-world study were conducted remotely; or because most employment specialists worked less than half-time on the NAVIGATE team. The highly successful Mental Health Treatment Study of supported employment for SSDI recipients, which, unlike RAISE-ETP, included desire for work as an entry criterion, and which achieved very high levels of fidelity to the individual placement and support model, did show increases in employment earnings, from $791 per month to $1,131 per month, although participants were still well below the poverty level (
28) and only 0.2% were able to earn their way out of their reliance on SSA disability (
11,
29). Recent studies have shown that low income in the general population is associated with greater mortality and poorer health (
30), and the modest income supplements and health benefits provided by SSA disability programs may be important contributors to survival for young people with first-episode psychosis. Even though programs with a specialized focus on rehabilitation clearly generate significant improvements in employment (
31,
32), economic self-sufficiency is rarely attained (
33).
In addition to the evaluation of the impact of NAVIGATE on receipt of SSA benefits, the longitudinal nature of this study allowed additional analysis of changes in outcome trajectory among SSA disability beneficiaries from both treatment groups in comparison with clients who did not receive SSA benefits. Among the 34.1% of participants who were newly awarded SSA disability benefits over the treatment period, receipt of benefits was followed by increased total income. But these participants had fewer days of employment and poorer motivation (e.g., reduced sense of purpose and curiosity), unintended consequences of the disability program. However, there were also fewer days of using alcohol to intoxication and there were no significant effects on symptoms or self-report measures of well-being or subjective quality of life. Receipt of SSA disability income thus appears to provide needed income and health insurance, but is also associated with some evidence of unintended adverse psychological and functional consequences.
The negative association of disability benefits and employment has been well documented in previous studies and is likely to reflect four processes: 1) an income effect (receipt of public support income reduces the economic incentive or need for employment), 2) the effect of a disabling impairment (patients who receive disability are less capable of working because of poor health), 3) the SSA eligibility rules requiring that beneficiaries not earn more than a minimal level, and 4) apprehension about working, for fear of losing needed income and insurance benefits (
34,
35).
The Quality of Life Scale subscale ratings available on patients in this study are the first to evaluate psychological processes that parallel lower employment after receiving SSA disability benefits and suggest reduced overall motivation, as reflected by decreases in sense of purpose and degree of motivation and increases in anhedonia and poor time utilization. Our statistical analysis found support for the notion that reduced days of working partially mediated the relationship between disability and reduced intrapsychic functioning rather than the reverse. Thus, it seems that not working because of economic disincentives contributes to demoralization.
It is notable that symptom severity and self-report measures of incentives and motivation, particularly the Stigma Scale, were not affected by receipt of disability income.
It was unexpected that new SSA beneficiaries showed a tendency toward
fewer days of alcohol intoxication after being awarded benefits, since several previous studies have found receipt of a disability benefit check at the beginning of each month to be associated with increased substance use (
36,
37). While treatment studies have failed to confirm a relationship between public support benefits and substance use (
38), none to our knowledge have found a reduction in substance use. One study of homeless veterans, however, found reduced substance use after receipt of a housing subsidy coupled with case management (
39). It is possible that SSA disability payments reduce economic stress and that with less economic stress and more social support, recipients had less impulse or need to drink.
A final issue raised by the findings presented here is whether changes in SSA disability policies can enhance employment opportunities while preserving access to income and health insurance supports. Many programs have been initiated by the SSA to provide incentives for disability beneficiaries to return to work, most recently the Ticket to Work program, but evidence of their effectiveness is weak (
40). Recent efforts at rehabilitation have also shown limited success in assisting beneficiaries to return to work to a degree that would allow them to discontinue SSA disability benefits (
11,
41).
Several methodological limitations require comment. Since receipt of SSA disability is not a simple indicator of disablement and is potentially influenced by many clinical and economic factors, understanding why there was no difference between treatment groups and why award rates increased 34% in 2 years would require additional information on the process and motivation for disability applications. Unfortunately, no information is available on why applications for SSA disability were initiated and whether they were initiated by patients themselves, by their families, or by clinical programs seeking reimbursement for health services. In states that have adopted the Medicaid provisions of the Affordable Care Act (ACA), it is now possible for low-income adults to receive health insurance without applying for SSDI or SSI, although RAISE-ETP was conducted before the ACA was implemented. Understanding the process of obtaining SSA disability is an important objective for future research.
Second, the sample was based on sites that were especially interested in implementing a program for first-episode psychosis and thus may not be representative of community services nationally, which may attenuate the apparent effectiveness of NAVIGATE. In addition, as noted previously, the RAISE-ETP target population included patients who did not express initial interest in working or going to school, and implementation of supported employment may have been less robust than in some other studies.
Third, data presented here on the changes in outcome trajectory after receiving SSA benefits are not based on random assignment to receive benefits, and therefore causal inferences from these quasi-experimental analyses are not conclusive. In addition, multiple outcomes were examined without downward adjustment of p values. These analyses are descriptive and should not be regarded as hypothesis testing.
In summary, in this study we found that an effective coordinated specialty care intervention did not significantly reduce the 40% proportion of first-episode psychosis patients who had obtained SSA disability benefits by the end of the first 2 years of treatment, and that receipt of benefits increased income but unintentionally may be an obstacle to gainful employment and other aspects of recovery. There is a substantial need for new approaches to income supports that ensure access to needed health care insurance while minimizing possible adverse effects on the motivation for employment and recovery.
Acknowledgments
The authors thank their core collaborators and consultants for their invaluable contributions; the many clinicians, research assistants, and administrators at the participating sites for their enthusiasm and fine work on the project; and the patients and families for their time, trust, and commitment.
RAISE-ETP Executive Committee: John M. Kane, M.D., Delbert G. Robinson, M.D., Nina R. Schooler, Ph.D., Kim T. Mueser, Ph.D., David L. Penn, Ph.D., Robert A. Rosenheck, M.D., Jean Addington, Ph.D., Mary F. Brunette, M.D., Christoph U. Correll, M.D., Sue E. Estroff, Ph.D., Patricia Marcy, B.S.N., James Robinson, M.Ed.
NIMH collaborators: Robert K. Heinssen, Ph.D., A.B.P.P., Joanne B. Severe, M.S., Susan T. Azrin, Ph.D., Amy B. Goldstein, Ph.D.
Additional contributors to the design and implementation of NAVIGATE: Susan Gingerich, M.S.W., Shirley M. Glynn, Ph.D., Jennifer D. Gottlieb, Ph.D., Benji T. Kurian, M.D., M.P.H., David W. Lynde, M.S.W., Piper S. Meyer-Kalos, Ph.D., L.P., Alexander L. Miller, M.D., Ronny Pipes, M.A., L.P.C.-S.
Additional collaborators included MedAvante for the conduct of the centralized, masked diagnostic interviews and assessments, and the team at the Nathan Kline Institute for data management. Thomas Ten Have and Andrew Leon played key roles in the design of the study, particularly for the statistical analysis plan; the authors mourn the untimely deaths of both. The authors gratefully acknowledge the contributions of Haiqun Lin and Kyaw (Joe) Sint to the planning and conduct of statistical analysis.
The participating sites are as follows: Burrell Behavioral Health (Columbia), Burrell Behavioral Health (Springfield), Catholic Social Services of Washtenaw County, Center for Rural and Community Behavior Health New Mexico, Cherry Street Health Services, Clinton-Eaton-Ingham Community Mental Health Authority, Cobb County Community Services Board, Community Alternatives, Community Mental Health Center of Lancaster County, Community Mental Health Center, Inc., Eyerly Ball Iowa, Grady Health Systems, Henderson Mental Health Center, Howard Center, Human Development Center, Lehigh Valley Hospital, Life Management Center of Northwest Florida, Mental Health Center of Denver, Mental Health Center of Greater Manchester, Nashua Mental Health, North Point Health and Wellness, Park Center, PeaceHealth Oregon/Lane County Behavioral Health Services, Pine Belt Mental HC, River Parish Mental Health Center, Providence Center, San Fernando Mental Health Center, Santa Clarita Mental Health Center, South Shore Mental Health Center, St. Clare’s Hospital, Staten Island University Hospital, Terrebonne Mental Health Center, United Services, and University of Missouri–Kansas City School of Pharmacy.