Self-Reported Suicidal Ideation as a Predictor of Suicidal Behavior Among Outpatients With Diagnoses of Psychotic Disorders
Abstract
Objective:
Individuals with psychotic disorders are at high risk of suicidal behavior. The study examined whether response to item 9 of the Patient Health Questionnaire (PHQ-9), which asks about thoughts of death or self-harm, predicts suicidal behavior among outpatients with diagnoses of psychotic disorders.
Methods:
Electronic health records (EHRs) from seven large integrated health systems were used to identify all outpatient visits by adults with a diagnosis of schizophrenia spectrum psychosis or unspecified psychosis from January 1, 2009, to June 30, 2015, during which a PHQ-9 was completed (N=32,982 visits by 5,947 patients). Suicide attempts over the 90 days following each visit were ascertained from EHRs and insurance claims. Suicide deaths were ascertained from state death certificate files.
Results:
Risk of suicide attempt within 90 days of an outpatient visit was .8% among patients reporting no thoughts of death or self-harm and 3.5% among those reporting such thoughts “nearly every day.” Over 90 days of follow-up, 47% of suicide attempts occurred among those who reported any recent thoughts of death or self-harm at the sampled visit. Also, 59% of attempts occurred among those reporting thoughts of death or self-harm at the index visit or any visit in the prior year. The number of suicide deaths within 90 days (N=10) was too small to accurately assess the relationship between PHQ-9 item 9 response and subsequent suicide death.
Conclusions:
Among outpatients with psychotic disorders, response to item 9 of the PHQ-9 accurately identified those at increased short-term risk of a suicide attempt.
HIGHLIGHTS
•
Over 10% of outpatients with diagnoses of a psychotic disorder report frequent thoughts of death or self-harm on the PHQ-9 questionnaire.
•
Among outpatients with diagnoses of psychotic disorder, response to item 9 of the PHQ-9 was a strong predictor of a suicide attempt over the following 90 days.
•
Considering responses to item 9 over the prior year—not just the current response—improved detection of risk without sacrificing positive predictive value.
Suicidal behavior is especially common among individuals with psychotic disorders (1); approximately 5% die by suicide, and over 25% attempt suicide at some point (2–4). Risk is especially high after the first onset of symptoms (3, 5, 6) and soon after psychiatric hospitalization (7, 8). Many risk factors for suicidal behavior among individuals with psychotic disorders are similar to those in the general population: depressive symptoms, substance use disorder, and a history of suicidal behavior (2, 4, 8–11). A meta-analysis by Chapman and colleagues (12) found a stronger association between suicidal ideation and subsequent suicide death among persons with psychotic disorders than among those with mood disorders. Some risk factors, however, are specific to psychosis, such as higher educational attainment or premorbid intelligence (4, 8) and lower levels of negative symptoms (13). Consequently, assessing suicide risk among persons with psychotic disorders may be more challenging (14, 15).
Standard questionnaires administered at outpatient mental health visits can accurately identify increased risk of a subsequent suicide attempt and suicide death (16–19). Considering this evidence, both the Joint Commission (20) and the National Action Alliance for Suicide Prevention (21) have recommended systematic assessment of suicide risk. None of this evidence (16–19), however, has examined accuracy of questionnaires or other risk prediction tools among individuals with psychotic disorders.
In this study, we used data from seven large integrated health systems to examine the relationship between self-reported suicidal ideation and subsequent suicidal behavior among adult outpatients with diagnoses of schizophrenia spectrum psychosis or unspecified psychotic disorder. We address three related questions: What are the prevalence and correlates of self-reported suicidal ideation as assessed by item 9 of the Patient Health Questionnaire (PHQ-9)? How well does response to PHQ-9 item 9 at an outpatient visit predict suicide attempt and suicide death over the following 90 days? Does including responses to PHQ-9 item 9 at previous visits improve identification of risk?
Methods
The seven health systems participating in this research (HealthPartners; Henry Ford Health System; and the Colorado, Hawaii, Northwest, Southern California, and Washington regions of Kaiser Permanente) serve a combined population of approximately eight million members in nine states. Each system provides insurance coverage and comprehensive health care (including general medical and specialty mental health care) to a defined population. Members are enrolled through employer-sponsored insurance, individual insurance plans, capitated Medicaid or Medicare plans, and subsidized programs for low-income residents. Each health system’s members are generally representative of the service area in terms of age, race-ethnicity, and socioeconomic status (22, 23). Participating systems recommend use of the PHQ-9 at all mental health specialty visits and primary care visits for depression, but implementation was still in progress during the study period (24).
As members of the Mental Health Research Network, each health system maintains a research data warehouse organized according to the Health Care Systems Research Network Virtual Data Warehouse model (25). This resource combines data from insurance enrollment records, electronic health records (EHRs), insurance claims, pharmacy dispensing, state mortality records, and census-derived neighborhood characteristics. Responsible institutional review boards for each health system approved use of these deidentified data for this research.
The study sample included outpatient visits by members ages 18 or older during which a billing or encounter diagnosis of a psychotic disorder was recorded and a response to item 9 of the PHQ-9 was entered in the EHR (item 9: “Over the past 2 weeks, how often have you been bothered by thoughts that you would be better off dead or of hurting yourself in some way?”) Eligible psychotic disorder diagnoses included schizophrenia spectrum psychosis (ICD-9-CM codes 295.0, 295.1–295.3, 295.6, 295.8, and 295.9), schizoaffective disorder (ICD-9-CM code 295.7), and unspecified psychosis (ICD-9-CM code 298.9). All visits meeting these criteria from January 1, 2009, through June 30, 2015, were included, except at Henry Ford where only visits after implementation of a new EHR system on December 1, 2012 were included. Each patient could contribute multiple visits, and study outcomes (suicide attempt and suicide death) were observed for 30- and 90-day windows following each visit. Consequently, each suicide attempt or suicide death could be linked to more than one prior visit. This approach avoids informative censoring by using only information available at the time of the selected visit. Because recording of diagnoses may vary from visit to visit, sensitivity analyses included a broader sample of visits by individuals with a psychotic disorder diagnosis recorded at any time in the past 5 years.
For each visit, probable suicide attempts over the following 90 days were ascertained from all injury or poisoning diagnoses recorded in EHRs and insurance claims accompanied by an ICD-9-CM cause-of-injury code indicating intentional self-harm (E950–E958) or undetermined intent (E980–E988). Data from these health systems (17, 26–28) support both the sensitivity and positive predictive value of this definition (including both definite self-harm and “undetermined intent” diagnoses) for identification of probable suicide attempts. [A table in an online supplement to this article presents data supporting use of ICD-9 coding for identifying probable suicide attempts.] Visits were excluded from analyses regarding suicide attempts if the patient disenrolled from the participating health plan during the 90-day follow-up period, because suicide attempts after disenrollment would not be captured by health system records.
Suicide deaths were ascertained from state mortality records. On the basis of common recommendations (29–32), all deaths with any ICD-10 cause-of-death diagnosis of definite self-inflicted injury (X6–X84) or injury-poisoning with undetermined intent (Y10–Y34) were classified as probable suicide deaths.
Other potential correlates of suicidal behavior extracted from health system EHRs and insurance claims data included age, sex, race, ethnicity, responses to the PHQ-9 at prior visits, recent use of emergency department or inpatient mental health care, and recent diagnosis of self-inflicted injury or poisoning.
Initial descriptive analyses examined characteristics of patient visits according to response to PHQ-9 item 9. Primary analyses examined rates of suicide attempt and suicide death over 90 days following each visit according to response to PHQ-9 item 9 at the selected visit and according to response to item 9 at any time during the prior year. Secondary analyses examined rates of suicide attempt and suicide death during a 30-day risk period. Heterogeneity of suicide attempt or death rates across item 9 response categories was first evaluated by using chi-square statistics. Logistic regression models were used to compare odds of suicide attempt and suicide death across item 9 response categories, with and without adjustment for other potential predictors (recent suicide attempt or recent acute care mental health treatment). To account for possible correlation among multiple visits by a single patient, logistic models were estimated by using generalized estimating equations with the robust sandwich estimator (working independence covariance matrix).
Results
The criteria described above identified 32,982 eligible visits by 5,947 patients; 30,091 visits (91%) in mental health specialty clinics and 2,891 (9%) in primary care clinics. A total of 89 visits (.3%) were excluded because of fewer than 90 days of health system enrollment after the eligible visit. Of the 5,947 patients contributing to the sample, 2,239 (38%) contributed one visit, 912 (16%) two visits, 498 (8%) three visits, 345 (6%) four visits, 865 (15%) five to nine visits, and 833 (15%) 10 or more visits. Response to item 9 of the PHQ-9 regarding thoughts of death or self-harm was “not at all” in 24,654 visits (75%), “several days” in 4,635 (14%), “more than half the days” in 1,926 (6%), and “nearly every day” in 1,767 (5%). Duration of health system enrollment prior to the visit (so that complete data were available) was greater than 1 year for 28,035 visits (85%) and greater than 5 years for 20,119 (61%).
Table 1 displays characteristics of eligible visits according to response to PHQ-9 item 9. Patients reporting more frequent suicidal thoughts were younger. A greater proportion of those reporting more frequent suicidal thoughts were female, compared with male; black, Native American, or Native Hawaiian, compared with non-Hispanic whites; and more likely to have had recent mental health emergency department or inpatient care. Compared with non-Hispanic whites, the proportion of Asians reporting more frequent suicidal thoughts was smaller. However, all of these associations were modest in magnitude. Reporting more frequent suicidal thoughts was strongly associated with a diagnosis of self-harm in the past year and with a higher total PHQ-9 score.
| Not at all (N=24,654) | Several days (N=4,635) | More than half the days (N=1,926) | Nearly every day (N=1,767) | All visits (N=32,982) | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Characteristic | N | % | N | % | N | % | N | % | N | % |
| Age at visit | ||||||||||
| 18–29 | 4,875 | 20 | 1,035 | 22 | 400 | 21 | 405 | 23 | 6,715 | 20 |
| 30–44 | 6,493 | 26 | 1,282 | 28 | 567 | 29 | 602 | 34 | 8,944 | 27 |
| 45–64 | 10,474 | 42 | 1,918 | 41 | 809 | 42 | 620 | 35 | 13,821 | 42 |
| ≥65 | 2,812 | 11 | 400 | 9 | 150 | 8 | 140 | 8 | 3,502 | 11 |
| Sex | ||||||||||
| Female | 12,284 | 50 | 2,201 | 48 | 1,072 | 56 | 1,029 | 58 | 16,586 | 50 |
| Male | 12,370 | 50 | 2,434 | 52 | 854 | 44 | 738 | 42 | 16,396 | 50 |
| Race | ||||||||||
| White | 17,612 | 71 | 3,338 | 72 | 1,327 | 69 | 1,224 | 69 | 23,501 | 71 |
| Black | 2,476 | 10 | 388 | 8 | 250 | 13 | 252 | 14 | 3,366 | 10 |
| Asian | 1,605 | 6 | 237 | 5 | 91 | 5 | 52 | 3 | 1,985 | 6 |
| Native American/Alaska Native | 388 | 2 | 98 | 2 | 53 | 3 | 55 | 3 | 594 | 2 |
| Native Hawaiian/Pacific Islander | 455 | 2 | 136 | 3 | 60 | 3 | 76 | 4 | 727 | 2 |
| Other or unknown | 2,118 | 9 | 438 | 9 | 145 | 8 | 108 | 6 | 2,809 | 9 |
| Hispanic ethnicity | ||||||||||
| Hispanic | 5,130 | 21 | 997 | 21 | 427 | 22 | 432 | 24 | 6,986 | 21 |
| Not Hispanic | 19,524 | 79 | 3,638 | 79 | 1,499 | 78 | 1,335 | 76 | 25,996 | 79 |
| Mental health hospitalization in past year | ||||||||||
| Yes | 6,084 | 25 | 1,190 | 26 | 489 | 25 | 572 | 32 | 8,335 | 25 |
| No | 18,570 | 75 | 3,445 | 74 | 1,437 | 75 | 1,195 | 68 | 24,647 | 75 |
| Mental health emergency department visit in past year | ||||||||||
| Yes | 7,948 | 32 | 1,620 | 35 | 649 | 34 | 676 | 38 | 10,893 | 33 |
| No | 16,706 | 68 | 3,015 | 65 | 1,277 | 66 | 1,091 | 62 | 22,089 | 67 |
| Diagnosis of self-harm in past year | ||||||||||
| Yes | 827 | 3 | 186 | 4 | 117 | 6 | 134 | 8 | 1,264 | 4 |
| No | 23,827 | 97 | 4,449 | 96 | 1,809 | 94 | 1,633 | 92 | 31,718 | 96 |
| Total PHQ-9 score at visitb | ||||||||||
| 0–9 | 18,678 | 76 | 1,571 | 34 | 224 | 12 | 155 | 9 | 20,628 | 62 |
| 10–14 | 3,490 | 14 | 1,279 | 28 | 297 | 15 | 81 | 5 | 5,147 | 16 |
| 15–19 | 1,707 | 7 | 1,187 | 26 | 693 | 36 | 325 | 18 | 3,912 | 12 |
| ≥20 | 779 | 3 | 598 | 13 | 712 | 37 | 1,206 | 68 | 3,295 | 10 |
| Maximum item 9 response in past yearc | ||||||||||
| Not at all | 20,266 | 82 | 0 | — | 0 | — | 0 | — | 20,266 | 61 |
| Several days | 3,083 | 13 | 3,436 | 74 | 0 | — | 0 | — | 6,519 | 20 |
| More than half the days | 703 | 3 | 749 | 16 | 1,417 | 74 | 0 | — | 2,869 | 9 |
| Nearly every day | 602 | 2 | 450 | 10 | 509 | 26 | 1,767 | 100 | 3,328 | 10 |
a
PHQ-9, nine-item Patient Health Questionnaire. Item 9: “Over the past 2 weeks, how often have you been bothered by thoughts that you would be better off dead or of hurting yourself in some way?” p<.001 for all comparisons, by chi-square test for heterogeneity across item 9 response groups
b
Possible scores range from 0 to 27, with higher scores indicating more severe depression.
c
Includes response at index visit.
Health system records identified 145 unique suicide attempts within 90 days of any visit, and 386 visits were followed by one of these events within 90 days. State mortality records identified 10 unique suicide deaths within 90 days of an eligible visit, and 19 visits were followed by one of these deaths within 90 days.
Rates of probable suicide attempt and suicide death over 30 and 90 days according to response to PHQ-9 item 9 are shown in the top portion of Table 2. Likelihood of suicide attempt within 90 days was strongly associated with response to item 9, increasing from .8% for those responding “not at all” to 3.5% for those responding “nearly every day.” A similar pattern of consistently increasing risk was seen for suicide attempts within 30 days. Likelihood of suicide death within 90 days did not vary significantly according to item 9 response. Although likelihood of suicide death within 30 days varied significantly across item 9 response categories (that is, significant chi-square test for heterogeneity), the pattern was neither consistently increasing nor decreasing.
| Total visits (N=32,982) | Not at all (N=24,654) | Several days (N=4,635) | More than half the days (N=1,926) | Nearly every day (N=1,767) | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Any suicide attempt | N | % | N | % | N | % | N | % | N | % | χ2b | p |
| Index visit | ||||||||||||
| Within 90 days | 386 | 1.17 | 206 | .84 | 72 | 1.56 | 47 | 2.44 | 61 | 3.46 | 136 | <.001 |
| Within 30 days | 187 | .57 | 91 | .37 | 40 | .86 | 26 | 1.35 | 30 | 1.70 | 85.3 | <.001 |
| Total visits | Not at all | Several days | More than half the days | Nearly every day | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Any suicide death | (N=30,300) | (N=22,699) | (N=4,218) | (N=1,775) | (N=1,608) | |||||||
| Within 90 days | 19 | .07 | 12 | .05 | 3 | .07 | 3 | .17 | 1 | .12 | 3.64 | .304 |
| Within 30 days | 11 | .04 | 5 | .02 | 2 | .05 | 3 | .17 | 1 | .06 | 10.3 | .016 |
| Visit with maximum item 9 response in past yearc | ||||||||||||
| Total | Not at all | Several days | More than half the days | Nearly every day | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Any suicide attempt | (N=32,982) | (N=20,243) | (N=6,515) | (N=2,869) | (N=3,327) | |||||||
| Within 90 days | 386 | 1.17 | 158 | .78 | 66 | 1.01 | 63 | 2.19 | 99 | 2.98 | 148 | <.001 |
| Within 30 days | 187 | .57 | 64 | .32 | 43 | .66 | 35 | 1.22 | 45 | 1.35 | 81.6 | <.001 |
| Total visits | Not at all | Several days | More than half the days | Nearly every day | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Any suicide death | (N=30,300) | (N=18,653) | (N=6,032) | (N=2,596) | (N=3,019) | |||||||
| Within 90 days | 19 | .07 | 9 | .05 | 5 | .08 | 1 | .04 | 4 | .14 | 3.64 | .303 |
| Within 30 days | 11 | .04 | 3 | .02 | 4 | .07 | 0 | .00 | 4 | .13 | 12.2 | .007 |
a
PHQ-9, nine-item Patient Health Questionnaire. Item 9: “Over the past 2 weeks, how often have you been bothered by thoughts that you would be better off dead or of hurting yourself in some way?”
b
df=3.
c
Includes index visit.
A total of 28,728 visits (87%) visits were preceded by at least one prior PHQ-9 item 9 response. In the bottom portion of Table 2, rates of suicide attempt are compared according to maximum response to item 9 in the prior year (including the index visit). The pattern is similar to that seen with item 9 response at the sampled visit: a strong and consistent association with likelihood of suicide attempt and no clear relationship to likelihood of suicide death.
Comparison across rows in Table 2 also illustrates the performance of PHQ-9 item 9 in identifying risk of suicide attempt following visits with psychotic disorder diagnoses. For example, any response other than “not at all” to item 9 during a specific visit would have a sensitivity of 47% (180/386) to identify probable suicide attempt in the following 90 days. Positive predictive value or the probability that patients with a positive screen (a response other than “not at all”) would have a suicide attempt would increase from 1.6% for a response of “several days” to 3.5% for a response of “nearly every day.” When maximum response to item 9 in the past year was considered, any response other than “not at all” would have a sensitivity of 59% (228/386) to identify probable suicide attempt in the following 90 days. Positive predictive value would increase from 1.0% for a response of “several days” to 3.0% for a response of “nearly every day.”
Results of logistic regression models are shown in Table 3. Unadjusted odds of a suicide attempt within 90 days were approximately four times as great following a visit in which a patient responded “nearly every day,” compared with a visit with a response of “not at all” (model 1). This association was slightly reduced after adjustment for history of psychiatric hospitalization, psychiatric emergency department visit, or suicide attempt in the prior year (model 2). Analyses regarding maximum response to item 9 in the prior year (models 3 and 4) showed the same pattern. Parallel logistic models predicting risk of suicide attempt within 30 days yielded similar results, but confidence limits were wider, reflecting the smaller number of events.
| Model 1: item 9 response at index visit | Model 2: item 9 response at index visit and recent service useb | Model 3: maximum item 9 response in past year | Model 4: maximum item 9 response in past year and recent service useb | |||||
|---|---|---|---|---|---|---|---|---|
| Variable | OR | 95% CI | OR | 95% CI | OR | 95% CI | OR | 95% CI |
| Item 9 response (reference: not at all) | ||||||||
| Several days | 1.87 | 1.43–2.45 | 1.75 | 1.33–2.31 | 1.30 | .86–1.97 | 1.22 | .82–1.82 |
| More than half the days | 2.97 | 2.16–4.09 | 2.55 | 1.84–3.55 | 2.85 | 1.54–5.29 | 2.59 | 1.40–4.80 |
| Nearly every day | 4.24 | 3.18–5.67 | 3.18 | 2.35–4.29 | 3.90 | 2.35–6.45 | 3.68 | 2.71–5.24 |
| Service use in past year (reference: none) | ||||||||
| Mental health hospitalization | 1.94 | 1.51–2.49 | 1.91 | 1.12–3.26 | ||||
| Mental health emergency department visit | 1.56 | 1.22–1.99 | 1.53 | .90–2.60 | ||||
| Diagnosis of self-harm in past year | 6.32 | 4.90–8.15 | 6.25 | 3.18–12.30 | ||||
a
Item 9 of the nine-item Patient Health Questionnaire: “Over the past 2 weeks, how often have you been bothered by thoughts that you would be better off dead or of hurting yourself in some way?” Logistic models were estimated with generalized estimating equations and used the robust sandwich estimator to account for multiple visits within patients.
b
Recent service use indicates a psychiatric hospitalization or a psychiatric emergency department visit in the past year.
Because recorded diagnoses may vary from visit to visit, sensitivity analyses included a broader sample of visits (N=97,106) by individual patients (N=17,778) with a recorded diagnosis of psychotic disorder at the index visit or at any encounter (outpatient, emergency department, or inpatient) up to 5 years previously. The results were not meaningfully different from those of the primary analyses. [Tables presenting these results are included in the online supplement .]
Discussion and Conclusions
In a sample of nearly 33,000 outpatient visits by almost 6,000 individual patients from seven large health systems, we found that response to item 9 of the PHQ-9 was a strong predictor of suicide attempt over the following 90 days among individuals who received diagnoses of psychotic disorders. Likelihood of a suicide attempt was strongly associated with both response to item 9 at the index visit and with the maximum response at visits during the prior year.
Among visits with diagnoses of psychotic disorder, the epidemiology of suicidal ideation (Table 1) was generally similar to that among mental health visits overall (16). Prevalence of self-reported suicidal ideation was moderately higher at visits with psychotic disorder diagnoses, compared with all mental health visits (16). As expected, reporting frequent thoughts of death or self-harm was strongly associated with more severe symptoms of depression and with a history of suicide attempt.
Limitations
Given the small number of suicide deaths in this sample, our data could not accurately assess the relationship between item 9 response and suicide mortality. Larger samples are needed to address this question.
Our identification of individuals with psychotic disorders relied on diagnoses assigned by treating mental health and primary care providers. Our previous research in these health plans regarding first-appearing diagnoses of psychotic disorders suggested that over 80% of these diagnoses would be confirmed by review of full-text medical records (33). Nevertheless, these findings should apply to patients receiving “usual care” diagnoses rather than to those undergoing research assessments.
Interpretation of these findings should consider false-positive and false-negative errors in ascertainment of probable suicide attempts and deaths. Previous research has indicated that attribution of death to suicide by medical examiners (32) has false-positive rates near zero and that documentation of definite or possible self-inflicted injury in records from these health systems (26, 27, 34) has false-positive rates of 10%−20% [see table in online supplement ]. False negatives, however, may be more common. Up to one quarter of suicide deaths may not be identified by medical examiners (35, 36). Random misclassification of suicidal behavior (either false positives or false negatives) would introduce a conservative bias. Health system records may not capture suicide attempts, either because people do not seek care or because providers do not recognize or document self-harm. Our findings might not apply to suicidal behavior unrecognized by medical examiners or health care providers.
Treating providers were aware of PHQ-9 responses and may have changed or intensified treatment for patients reporting thoughts of death or self-harm. The elevated risk of a suicide attempt that we observed occurred despite any such treatment changes.
Our data did not allow us to examine mental state or severity of psychotic symptoms at the time of the outpatient visit. Self-reported thoughts of death or self-harm could be a less accurate indicator of risk among patients who are experiencing significant disorganization, as might occur in emergency department or inpatient settings.
Data from health system records apply only to patients engaged in care. Although more than half of persons attempting suicide or dying by suicide have had some outpatient health care contact in the preceding 90 days (37, 38), the remainder would be missed by visit-based screening with the PHQ-9 or any other assessment.
Context
The PHQ-9 was not designed as a measure of suicidal ideation or as a screening tool to identify suicide risk. We have previously reported that response to item 9 is a more accurate predictor of suicidal behavior than are responses to other PHQ-9 items assessing overall depression severity (17). Nevertheless, use of more detailed measures specifically designed to assess suicidal ideation or predict suicide risk (19, 39, 40) could yield improvements in both sensitivity and positive predictive value. Given that the PHQ-9 is widely used in outpatient mental health care settings, these findings should have practical utility.
Identification of suicide risk should not be limited to self-report questionnaires and information typically recorded in EHRs. Providers must also consider important social risk factors for suicidal behavior, such as job loss, bereavement, or relationship disruption. Because those risk factors are not systematically assessed or recorded in standardized fashion, we could not consider them in our analyses.
Comparison of these findings with previously reported findings in the broader population reveals important similarities and differences. Among individuals with psychotic disorders, thoughts of death or self-harm were strongly associated with severity of depressive symptoms as measured by overall PHQ-9 score. Similar to findings at visits for general outpatient mental health care and at primary care visits for depression (16), response to item 9 was a strong predictor of subsequent suicide attempt in this study. The relative increases in risk of suicide attempt associated with item 9 response in this sample, however, were smaller than those seen in broader outpatient samples. For example, the fourfold increase in likelihood associated with a response of “nearly every day” following a visit with a psychotic disorder diagnosis (Table 3) compares to an eightfold increase following a general outpatient mental health care visit or primary care visit for depression with the same item 9 response (16). Absolute risk differences associated with item 9 response, however, were larger in this sample. For example, we observed an absolute risk difference of 2.7% over 90 days between highest and lowest responses to item 9 in this sample, compared with the absolute difference of approximately 1% previously seen among all outpatient visits (16). These two findings regarding response to item 9 (smaller relative risk difference and larger absolute risk difference) are not in conflict; they both result from the higher baseline risk of suicide attempt among patients with psychotic disorders. We also observed that almost half of suicide attempts following completion of the PHQ-9 at visits with a psychotic disorder diagnosis occurred among patients responding “not at all” to item 9. This proportion is similar to that previously reported in general samples of mental health and primary care outpatients (16, 17).
Our data suggest that providers should consider responses to item 9 during past visits, rather than focusing only on the current response. Considering item 9 response only during the current visit (top portion of Table 2) would fail to identify more than half of the patients attempting suicide in the following 90 days. Expanding consideration to all item 9 responses in the prior year (bottom portion of Table 2) would increase sensitivity to approximately 60% while only modestly decreasing positive predictive value. These findings are consistent with the observation in broader outpatient samples that response to item 9 indicates elevated risk of a suicide attempt lasting for at least 12 to 18 months (16).
Implications
We believe that these findings should apply to outpatient mental health and primary care practices across the United States. The study included approximately 33,000 visits made by nearly 6,000 adults receiving outpatient treatment for a psychotic disorder in seven health systems across nine states. Participating health systems serve diverse populations, including large numbers from minority racial and ethnic groups and large numbers enrolled via Medicare, Medicaid, and other subsidized insurance programs for low-income individuals.
These findings have important implications for clinicians caring for people diagnosed as having psychotic disorders. First, our findings indicate that individuals with psychotic disorders provide clinically useful responses to simple self-report questions about thoughts of death or self-harm. Second, these results provide practical guidance to clinicians regarding the implications of response to PHQ-9 item 9. A response of “not at all” certainly does not imply absence of risk; over 40% of suicide attempts in this sample occurred among patients who did not endorse suicidal thoughts during the prior year. But endorsement of frequent thoughts of death or self-harm certainly indicates an increased risk of self-harm and a need for more detailed assessment and appropriate care planning. Of patients reporting thoughts of death or self-harm nearly every day, approximately one in 30 received care for self-harm or probable suicide attempt during the following 90 days. Our findings demonstrate that simple self-report measures such as the PHQ-9 can be useful in addressing the high risk of suicidal behavior among individuals with psychotic disorders.
Footnote
NIMH had no role in the design, analysis, interpretation, or publication of this study.
Supplementary Material
File (appi.ps.201800381.ds001.pdf)
- View/Download
- 137.89 KB
References
1.
Bromet EJ, Nock MK, Saha S, et al: Association between psychotic experiences and subsequent suicidal thoughts and behaviors: a cross-national analysis from the World Health Organization World Mental Health Surveys. JAMA Psychiatry 2017; 74:1136–1144
2.
Cassidy RM, Yang F, Kapczinski F, et al: Risk factors for suicidality in patients with schizophrenia: a systematic review, meta-analysis, and meta-regression of 96 studies. Schizophr Bull 2018; 44:787–797
3.
Palmer BA, Pankratz VS, Bostwick JM: The lifetime risk of suicide in schizophrenia: a reexamination. Arch Gen Psychiatry 2005; 62:247–253
4.
Hor K, Taylor M: Suicide and schizophrenia: a systematic review of rates and risk factors. J Psychopharmacol 2010; 24(suppl):81–90
5.
Robinson J, Harris M, Cotton S, et al: Sudden death among young people with first-episode psychosis: an 8–10 year follow-up study. Psychiatry Res 2010; 177:305–308
6.
Simon GE, Stewart C, Yarborough BJ, et al: Mortality rates after the first diagnosis of psychotic disorder in adolescents and young adults. JAMA Psychiatry 2018; 75:254–260
7.
Mortensen PB, Juel K: Mortality and causes of death in first admitted schizophrenic patients. Br J Psychiatry 1993; 163:183–189
8.
Weiser M, Kapra O, Werbeloff N, et al: A population-based longitudinal study of suicide risk in male schizophrenia patients: proximity to hospital discharge and the moderating effect of premorbid IQ. Schizophr Res 2015; 169:159–164
9.
Jovanović N, Podlesek A, Medved V, et al: Association between psychopathology and suicidal behavior in schizophrenia: a cross-sectional study of 509 participants. Crisis 2013; 34:374–381
10.
Østergaard MLD, Nordentoft M, Hjorthøj C: Associations between substance use disorders and suicide or suicide attempts in people with mental illness: a Danish nation-wide, prospective, register-based study of patients diagnosed with schizophrenia, bipolar disorder, unipolar depression or personality disorder. Addiction 2017; 112:1250–1259
11.
McGinty J, Sayeed Haque M, Upthegrove R: Depression during first episode psychosis and subsequent suicide risk: a systematic review and meta-analysis of longitudinal studies. Schizophr Res 2018; 195:58–66
12.
Chapman CL, Mullin K, Ryan CJ, et al: Meta-analysis of the association between suicidal ideation and later suicide among patients with either a schizophrenia spectrum psychosis or a mood disorder. Acta Psychiatr Scand 2015; 131:162–173
13.
Fenton WS, McGlashan TH, Victor BJ, et al: Symptoms, subtype, and suicidality in patients with schizophrenia spectrum disorders. Am J Psychiatry 1997; 154:199–204
14.
Lopez-Morinigo JD, Fernandes AC, Chang CK, et al: Suicide completion in secondary mental healthcare: a comparison study between schizophrenia spectrum disorders and all other diagnoses. BMC Psychiatry 2014; 14:213
15.
Lopez-Morinigo JD, Ayesa-Arriola R, Torres-Romano B, et al: Risk assessment and suicide by patients with schizophrenia in secondary mental healthcare: a case-control study. BMJ Open 2016; 6:e011929
16.
Simon GE, Coleman KJ, Rossom RC, et al: Risk of suicide attempt and suicide death following completion of the Patient Health Questionnaire depression module in community practice. J Clin Psychiatry 2016; 77:221–227
17.
Simon GE, Rutter CM, Peterson D, et al: Does response on the PHQ-9 depression questionnaire predict subsequent suicide attempt or suicide death? Psychiatr Serv 2013; 64:1195–1202
18.
Louzon SA, Bossarte R, McCarthy JF, et al: Does suicidal ideation as measured by the PHQ-9 predict suicide among VA patients? Psychiatr Serv 2016; 67:517–522
19.
Mundt JC, Greist JH, Jefferson JW, et al: Prediction of suicidal behavior in clinical research by lifetime suicidal ideation and behavior ascertained by the electronic Columbia-Suicide Severity Rating Scale. J Clin Psychiatry 2013; 74:887–893
20.
Detecting and Treating Suicidal Ideation in All Settings. Sentinel Alert Event no 56. Oakbrook Terrace, IL, Joint Commission, Patient Safety Advisory Group, 2016
21.
Hogan MF, Grumet JG: Suicide prevention: an emerging priority for health care. Health Aff 2016; 35:1084–1090
22.
Simon GE, Coleman KJ, Waitzfelder BE, et al: Adjusting antidepressant quality measures for race and ethnicity. JAMA Psychiatry 2015; 72:1055–1056
23.
Arterburn DE, Alexander GL, Calvi J, et al: Body mass index measurement and obesity prevalence in ten US health plans. Clin Med Res 2010; 8:126–130
24.
Rossom RC, Simon GE, Beck A, et al: Facilitating action for suicide prevention by learning health care systems. Psychiatr Serv 2016; 67:830–832
25.
Ross TR, Ng D, Brown JS, et al: The HMO Research Network Virtual Data Warehouse: a public data model to support collaboration. EGEMS 2014; 2:1049
26.
Simon GE, Savarino J, Operskalski B, et al: Suicide risk during antidepressant treatment. Am J Psychiatry 2006; 163:41–47
27.
Simon GE, Savarino J: Suicide attempts among patients starting depression treatment with medications or psychotherapy. Am J Psychiatry 2007; 164:1029–1034
28.
Lu CY, Stewart C, Ahmed AT, et al: How complete are E-codes in commercial plan claims databases? Pharmacoepidemiol Drug Saf 2014; 23:218–220
29.
Ohberg A, Lonnqvist J: Suicides hidden among undetermined deaths. Acta Psychiatr Scand 1998; 98:214–218
30.
Cooper PN, Milroy CM: The coroner’s system and under-reporting of suicide. Med Sci Law 1995; 35:319–326
31.
Bakst SS, Braun T, Zucker I, et al: The accuracy of suicide statistics: are true suicide deaths misclassified? Soc Psychiatry Psychiatr Epidemiol 2016; 51:115–123
32.
Cox KL, Nock MK, Biggs QM, et al: An examination of potential misclassification of army suicides: results from the Army Study to Assess Risk and Resilience in Servicemembers. Suicide Life Threat Behav 2017; 47:257–265
33.
Simon GE, Coleman KJ, Yarborough BJ, et al: First presentation with psychotic symptoms in a population-based sample. Psychiatr Ser 2017; 68:456–461
34.
Simon GE, Johnson E, Lawrence JM, et al: Predicting suicide attempts and suicide deaths following outpatient visits using electronic health records. Am J Psychiatry 2018; 175:951–960
35.
Mościcki EK: Epidemiology of suicidal behavior. Suicide Life Threat Behav 1995; 25:22–35
36.
O’Carroll PW: A consideration of the validity and reliability of suicide mortality data. Suicide Life Threat Behav 1989; 19:1–16
37.
Ahmedani BK, Simon GE, Stewart C, et al: Health care contacts in the year before suicide death. J Gen Intern Med 2014; 29:870–877
38.
Ahmedani BK, Stewart C, Simon GE, et al: Racial/ethnic differences in health care visits made before suicide attempt across the United States. Med Care 2015; 53:430–435
39.
Posner K, Brown GK, Stanley B, et al: The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry 2011; 168:1266–1277
40.
Beck AT, Brown GK, Steer RA, et al: Suicide ideation at its worst point: a predictor of eventual suicide in psychiatric outpatients. Suicide Life Threat Behav 1999; 29:1–9
Information & Authors
Information
Published In
Cover: XXXX
History
Received: 13 August 2018
Revision received: 18 September 2018
Accepted: 19 October 2018
Published online: 10 December 2018
Published in print: March 01, 2019
Keywords
Authors
Competing Interests
Dr. Simon reports receipt of research funding from Novartis Pharmaceuticals. Dr. Lynch reports receipt of a grant from Janssen Pharmaceuticals. Dr. Shortreed reports work on grants awarded to Kaiser Permanente Washington Health Research Institute by Bristol-Meyers Squibb, Pfizer, and Syneos Health. The other authors report no financial relationships with commercial interests.
Funding Information
National Institute of Mental Health10.13039/100000025: U19 MH092201
This work was supported by cooperative agreement U19 MH092201 with the National Institute of Mental Health (NIMH).Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBLogin options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).