Studies of such samples provide important information on predictors of psychosis and schizophrenia. Significant predictors of nonaffective psychotic disorder found in those settings include genetic risk with recent deterioration in functioning, unusual thought content, suspicion/paranoia, social impairment, history of substance abuse, disorganized symptoms (
1,
7,
8), positive symptoms, bizarre thinking, sleep disturbances, schizotypal disorder, and lower level of education (
4). If such findings could be generalized to primary psychiatric care, this would have substantial implications for early detection and early intervention in psychotic disorders.
The aim of this study was to present a population-based context to concepts developed in specialized prodromal clinics. Young men and women examined in military mental health outpatient clinics were followed for psychiatric hospitalizations, and the association between symptoms present at the index examination and risk for later hospitalization for nonaffective psychotic disorders was examined.
This study has two important methodological advantages. First, the 18- to 21-year-olds examined and followed for up to 9 years are representative of the entire population. Second, since mental health care, including hospitalization, is free and easily accessible both in the military and in civilian settings in Israel, biases caused by limited access to mental health care are minimal.
Method
The study was approved by the ethics committees of the Israeli Defense Forces (IDF) Medical Corps and the Chaim Sheba Medical Center.
Service in the IDF is mandatory for all Jewish Israelis between the ages of 18 and 21 for males and 18 and 20 for females. The association between signs and symptoms present in a mental health examination and subsequent psychiatric hospitalization was examined by merging data from the IDF’s Mental Health Examination Archive with data from the national Psychiatric Hospitalization Case Registry. These databases were linked using the Israeli national identification number (analogous to the U.S. Social Security number) assigned to all newborns and legal citizens. For service members 18 to 21 years old examined in military mental health outpatient clinics who later appeared in the hospitalization registry, dates of hospitalizations and discharge diagnoses were added to the file. To preserve confidentiality, the national identification number was removed before the linked file was transferred to the investigators.
Databases
IDF Mental Health Examination Archive.
The IDF mental health examination archive contains information obtained from military mental health outpatient clinics, including examinations of all young adults serving in the IDF from 2000 to 2006 referred by others or self-referred to mental health examination. These examinations are performed by postgraduate-level licensed social workers, clinical psychologists, or psychiatrists in military mental health outpatient clinics. To achieve the greatest standardization possible, all mental health professionals go through special courses and receive ongoing supervision by senior psychiatrists, psychologists, and social workers, focusing on the administration and documentation of the mental health examination. Referrals to military mental health outpatient clinics are made by military general practitioners, mental health professionals, or commanding officers. The mental health examination consists of a semistructured interview and a structured rating scale documenting the presence or absence of psychiatric signs and symptoms.
Psychiatric Hospitalization Case Registry.
The national Psychiatric Hospitalization Case Registry is a complete listing of all psychiatric hospitalizations in Israel, including in psychiatric hospitals, day hospitals, and psychiatric units in general hospitals, using ICD discharge diagnoses assigned by a board-certified psychiatrist. Reporting is regularly monitored to ensure precision.
A study comparing Research Diagnostic Criteria diagnoses with registry diagnoses (
9) found that registry diagnoses of nonaffective psychotic disorders (ICD-10 codes F20.0–29.9) had a sensitivity of 0.87, and 93% of patients with schizophrenia in the population are eventually hospitalized and appear in the registry (
10).
Study Population
During the years 2000–2006, a total of 114,983 service members 18–21 years old were examined at least once by a mental health professional. Of these, 2,450 (2.1%) were later hospitalized in a psychiatric ward, up to 9 years after the index mental health examination (see Figure S1 in the
data supplement that accompanies the online edition of this article). Of those hospitalized, 1,092 received a diagnosis of a nonaffective psychotic disorder (ICD-10 codes F20.0–29.9). These rates of hospitalization for nonaffective psychotic disorder are in agreement with a 2011 report of the Israeli Ministry of Health (
25) finding that 58.4% of psychiatric hospitalizations were for the treatment of schizophrenia or other psychotic disorders.
A total of 1,358 service members from the sample were later hospitalized for other psychiatric disorders (2.9% for organic mental disorders [ICD-10 codes F00–F09], 8.1% for substance-related disorders [codes F10–F19], 18.8% for affective disorders [codes F30–F39], 29.7% for anxiety and somatoform disorders [codes F40–F49], 8.0% for eating disorders [code F50], 15.1% for personality disorders [codes F60–F69], 0.2% for intellectual disabilities [codes F70-F79], 0.4% for developmental disorders [codes F80–F89], 4.1% for childhood-onset disorders [codes F90–F98], and 12.7% for unspecified mental disorder [code F99]). The comparison group included 112,533 individuals examined by mental health professionals between 2000 and 2006 who were not later hospitalized in a psychiatric ward.
The nonaffective psychotic disorder group (N=1,092) was classified into five groups according to time from the index mental health examination to hospitalization. The first group comprised those who were hospitalized 0–14 days after the index examination (N=43), an interval suggesting that these individuals may already have been suffering from a psychotic disorder and possibly had been masking their symptoms. Because many prodromal studies have assessed risk for hospitalization within 1 year, we divided those hospitalized between 15 and 365 days according to the median time elapsed between the index examination and later hospitalization, resulting in groups hospitalized between 15 and 111 days (N=143) and between 112 and 365 days (N=138) after the index examination. Individuals who were hospitalized more than 1 year after the examination were also divided according to the median time elapsed between the index examination and later hospitalization, resulting in group hospitalized between 1 and 3.5 years (N=385) and between 3.5 and 9 years after the index examination (N=383).
Statistical Analysis
Cox proportional hazards regression models were used to compare the prevalence of individual symptoms identified in the first mental health examination between individuals who were later hospitalized for a nonaffective psychotic disorder, those later hospitalized for other psychiatric disorders, and those who were not later hospitalized for a psychiatric disorder. Hazard ratios with 95% confidence intervals were computed.
In an attempt to classify clinically recognizable symptom clusters, we clustered the 24 symptoms recorded during the index mental health examination into clusters using categorical principal components analysis with variable principal normalization. These clusters were then dichotomized, such that individuals with at least one of the symptoms in a given cluster were included in that cluster and compared with those not having any of the symptoms in the cluster. The dichotomized cluster scores were then included in a Cox proportional hazards regression analysis to assess which cluster of symptoms best predicted later hospitalization, followed by analyses stratified by time from examination. We then performed a “high-risk group” analysis, examining the potential additive effects of the presence of other symptom clusters in addition to symptoms from the psychotic symptom cluster. Hazard ratios with 95% confidence intervals were computed. The sensitivity, specificity, and positive predictive values were calculated for each category of symptoms.
Analyses were performed using SPSS, version 17.0 (SPSS, Inc., Chicago).
Discussion
In this study of a population-based sample of 18- to 21-year-olds, the strongest predictor of hospitalization for a nonaffective psychotic disorder was the presence of a cluster of symptoms including thought disorder, perceptual abnormalities, poor orientation, and suicidality at the time of the index mental health examination. These results confirm previous findings, from studies conducted both in specialized prodromal clinics (
4,
7) and in the general population (
12,
13), that subthreshold psychotic symptoms are associated with an elevated risk for later developing a psychotic disorder. The results further support the focus of prodromal clinics on individuals with attenuated psychotic symptoms, as this study shows that even within primary mental health care settings, this group had the greatest risk for later hospitalization for nonaffective psychotic disorders. We also found that risk behavior and impulse control problems were associated with later hospitalization for nonaffective psychotic disorders. This is in agreement with previous reports of behavioral and emotional instability, impulsivity, and problems with aggression control before the clinical onset of psychotic disorders (
14–
16).
Depressive symptoms were associated with lower risk for hospitalization for nonaffective psychotic disorder. Some studies have reported that depression is highly prevalent in the prodromal phase of psychotic illness (
2), and it has been found to be predictive of psychotic disorder in prodromal individuals (
5) and in individuals in the general population presenting with hallucinations (
17), while other studies did not find dysphoric mood to contribute uniquely to psychosis prediction (
7) or suggested that depression before the onset of the first psychotic episode was more strongly associated with a later diagnosis of an affective psychosis than with a later diagnosis of schizophrenia (
18).
The North American Prodrome Longitudinal Study (
7) reported a positive predictive value of 52% for prodromal patients with higher levels of unusual thought content and suspicion/paranoia, and positive predictive values between 68% and 80% for prediction algorithms combining two or three of the following: genetic risk for schizophrenia, deterioration in functioning, unusual thought content, suspicion/paranoia, social impairment, and a history of substance abuse. The prospective European Prediction of Psychosis Study (
4) predicted transition to psychosis using positive symptoms, bizarre thinking, sleep disturbances, a schizotypal disorder, past-year level of functioning, and years of education; that model had a positive predictive value of 83.3%. A meta-analysis of the prediction ability of prodromal clinical interview instruments for later active psychosis showed very good predictive power in help-seeking individuals but not in the general population, with a reported positive predictive value of 5.7% (
19). Our population-based study yielded positive predictive values that are at the lower range of the latter estimate, in particular within the first 111 days after first examination. Those hospitalized within 2 weeks of the index mental health examination had a hazard ratio of 45 for psychotic symptoms, suggesting that these adolescents were probably already acutely psychotic, hence were hospitalized within days, and probably should have been diagnosed as suffering from a psychotic disorder at their examination. As time to hospitalization increased, the predictive ability of psychotic symptoms decreased gradually, as is expected. In psychotic illness, psychotic symptoms usually appear at low intensity and gradually increase over time until reaching a threshold enabling diagnosis (
7).
The lower positive predictive value in population-based settings compared with prodromal clinics is likely due to the fact that patients often arrive at prodromal clinics after consecutive stages of screening, e.g., first being examined by a school psychologist or a family physician, then being referred to a general psychiatrist, and only then being referred to a specialized prodromal clinic. The psychopathology in patients assessed in prodromal clinics is substantial (
20), and these patients are very different from 18- to 21-year-olds presenting at a military mental health outpatient clinic. As military service in Israel is mandatory, soldiers represent the general population in Israel in the 18- to 21-year age range and hence are, we believe, comparable to individuals seeking treatment at a college mental health clinic. The nature of our study population, representative of the general population, may be a possible explanation for the clusters including symptoms that do not seem to fit together. For example, “psychotic symptoms” include poor orientation and suicide attempts, and the cluster “other symptoms” includes a mixture of clinical features that appear unrelated to each other (sexual orientation, self-esteem, substance abuse, obsessive-compulsive behavior). These results reflect the empirical clustering of symptoms in this general population cohort, and they probably reflect the heterogeneity of this sample, as opposed to the more homogeneous population of high-risk prodromal patients.
We found a significant association between the presence of psychotic symptoms and hospitalization for other psychiatric disorders, although to a lesser magnitude than for hospitalization for nonaffective psychotic disorders. This is in agreement with previous work reporting that two-thirds of individuals classified as high risk will not convert to full psychotic disorder, with the majority of these individuals experiencing nonpsychotic disorders (
21).
To our knowledge, this is the first study on symptoms associated with the psychosis prodrome that is population-based and uses a prospective, albeit historical, design. We know of only one other population-based study on the topic, the seminal ABC Schizophrenia Study (
2,
22). That study, however, collected data retrospectively and compared case subjects with healthy comparison subjects. The overwhelming majority of previous prospective studies on the prodrome have focused on highly selected patients with diagnostic uncertainty or persons already manifesting mild psychotic symptoms at the time of referral (
23).
This study has several important strengths. First, the military has little tolerance for odd behaviors, which leads to a low threshold for referral to a mental health examination. Our sample therefore may include case subjects who would not necessarily seek medical attention or might not be referred for psychiatric consultation in a community setting. Second, the national Psychiatric Hospitalization Case Registry lists all psychiatric hospitalizations in Israel. Therefore, this study has little loss to follow-up, in contrast to studies from prodromal clinics, which are prone to loss to follow-up. In addition, we were able to follow these individuals for a prolonged period, up to 9 years, to verify hospitalization for psychotic disorder.
Nevertheless, limitations of the study should be acknowledged. Our sample did not include individuals with very poor functioning in adolescence, as they are not drafted into the IDF. Also, the military mental health examination is a standard clinical examination without a formal assessment for prodromal symptoms. Nevertheless, many of the symptoms that appear in prodrome questionnaires, such as the Structured Interview for Prodromal Symptoms and the Scale of Prodromal Symptoms (
24), are included in the interviews conducted by military mental health professionals, including unusual thought content, subthreshold perceptual abnormalities, social isolation, and sleep disturbance. It is possible that if an instrument specifically aimed at identifying prodromal symptoms had been administered to all 18- to 21-year-olds, more of the future patients would have been identified. In addition, some individuals might have been treated successfully as outpatients and hence avoided hospitalization.
In summary, among 18- to 21-year-olds in a general population setting, the presence of psychotic symptoms was associated with later hospitalization for a nonaffective psychotic disorder. However, the positive predictive value of these symptoms was very low. The clinical setting of this study, characterized by a low threshold and high sensitivity to odd and unusual behaviors, and use of a population-based sample performing mandatory military service, coupled with free access to health care, point to the challenges of applying prediction algorithms or risk calculators (
20) outside the context of the specialized prodromal clinics in which they were developed.