Skip to main content
To the Editor: We appreciate Dr. Amos’s comments on our study on the Recovery After an Initial Schizophrenia Episode Early Treatment Program (RAISE-ETP) (1), but we do not believe that our conclusions were the result of methodological flaws. Dr. Amos specifically contends that the reason that participants in NAVIGATE, the comprehensive approach to first-episode psychosis care, did better across the 2-year observation period was that participants in usual, community care had a worse prognosis at entry.
As presented in our prespecified data analysis plan (http://raiseetp.org/studymanuals/RAISE_Statistical_Plan.pdf), our assessment was that a cluster randomized design offered substantial advantages for our study. The rationale is presented in the article (1). Our approach considered the possibility that there would be differences in participants at the NAVIGATE and community care sites. We specified the baseline demographic and clinical variables that would be compared between groups, and in the event of baseline differences, we specified criteria for including variables as covariates in the outcome analyses (briefly, variables needed to differ significantly and be correlated with outcome). Of the prespecified variables, NAVIGATE participants differed significantly from community care participants on four measures. NAVIGATE had significantly more males (77.6% compared with 66.2%; p=0.05); NAVIGATE had a smaller proportion of participants with prior hospitalization (76.3% compared with 81.6%; p<0.05); NAVIGATE participants had worse total scores on the Positive and Negative Syndrome Scale (p<0.02); and NAVIGATE had fewer participants attending school at baseline (16.0% compared with 26.0%; p<0.02). Three out of the four differences would suggest a worse prognosis in the experimental NAVIGATE group, contrary to Dr. Amos’s contention of a worse prognosis among community care participants. Table 2 of the article shows which variables met the statistical analysis plan criteria for inclusion as a covariate in each analysis.
Furthermore, we do not agree with the additional suggestion that differences in the number of potential participants screened at NAVIGATE sites and at community care sites resulted in selection bias. Screening results can vary between community sites for any number of reasons, including different referral patterns or the personalities of the screeners. However, consistent and systematic application of inclusion and exclusion criteria is key. RAISE-ETP utilized a cadre of well-trained clinical professionals who were blinded to site and cluster assignment in order to select participants on the basis of standardized diagnostic and assessment interviews. As noted above, this strategy minimized potentially confounding differences between treatment and control groups. In addition, for clustered randomization at site level, we used site-level random effects to account for any potentially unmeasured differences between the two treatments.
Regarding the duration of untreated psychosis, as Dr. Amos suggests, our study sample size was chosen based upon power to detect differences across conditions in quality of life and not in duration of untreated psychosis.
As Dr. Amos noted, the difference in mean duration of untreated psychosis between conditions was small in comparison with the standard deviations in this measure. Unlike Dr. Amos, we believe that the selection of statistical tests was appropriate. These analyses showed no significant difference with two tests of duration of untreated psychosis (the p value of the comparison of the mean duration of untreated psychosis was 0.35 unadjusted and was 0.33 adjusted, and the p value for the median duration of untreated psychosis was 0.35). These results did not meet the statistical plan criteria for the inclusion of duration of untreated psychosis as a covariate, and thus we believe that our exclusion of duration of untreated psychosis from the variables included as covariates was warranted.
Although the duration of untreated psychosis was not significantly different between groups at baseline, it did emerge as a significant moderator of several outcomes. We did not comment on the Treatment and Intervention in Psychosis study because a discussion of whether reducing the duration of untreated psychosis would change outcomes was beyond the scope of our article. We found that stratifying comparisons by duration of untreated psychosis was associated with significant differences in outcomes. We did not seek to explain the mechanism behind this difference.
The statement in our earlier article (2) that none of the sites withdrew after randomization referred to the potential risk that sites would initiate withdrawal because of disappointment in their cluster-randomized assignment. We did discontinue two sites due to poor enrollment.
We appreciate the opportunity to address Dr. Amos’s concerns, but we believe that given the nature of this study, we have done everything appropriate to demonstrate that our conclusions are valid and follow the data as closely as possible.

References

1.
Kane JM, Robinson DG, Schooler NR, et al: Comprehensive versus usual community care for first-episode psychosis: 2-year outcomes from the NIMH RAISE Early Treatment Program. Am J Psychiatry 2016; 173:362–372
2.
Kane JM, Schooler NR, Marcy P, et al: The RAISE early treatment program for first-episode psychosis: background, rationale, and study design. J Clin Psychiatry 2015; 76:240–246

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 535 - 536
PubMed: 27133408

History

Accepted: February 2016
Published online: 1 May 2016
Published in print: May 01, 2016

Authors

Details

John M. Kane, M.D.
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.
Delbert G. Robinson, M.D.
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.
Nina R. Schooler, Ph.D.
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.
Haiqun Lin, M.D., Ph.D.
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.
Robert A. Rosenheck, M.D.
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.
Robert K. Heinssen, Ph.D., A.B.P.P.
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.
For the RAISE-ETP Study Group
From the Division of Psychiatry Research, Zucker Hillside Hospital, Northwell Health, Glen Oaks, N.Y.; the Feinstein Institute for Medical Research, Manhasset, N.Y.; the Department of Psychiatry, SUNY Downstate Medical Center, Brooklyn, N.Y.; the Department of Psychiatry, Yale Medical School, and Yale School of Public Health, New Haven, Conn.; and the Division of Services and Intervention Research, NIMH, Rockville, Md.

Competing Interests

The authors’ disclosures accompany the original article.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share