Skip to main content
Full access
Brief Report
Published Online: 1 May 2007

Assessment of Self-Injurious Thoughts Using a Behavioral Test

Publication: American Journal of Psychiatry

Abstract

Objective: The assessment of self-injurious thoughts has been limited by a reliance on what individuals are willing or able to report explicitly. The authors examined a new method that measures self-injurious thoughts by using individuals’ reaction times to self-injury-related stimuli on a computerized test. Method: Eighty-nine adolescents who were not self-injurious (N=36) or had recently engaged in nonsuicidal self-injury (N=53) completed two versions of the Self-Injury Implicit Association Test, which measure the automatic association of self-injury with oneself and with favorableness. Results The tests revealed significant behavioral differences between the self-injurers and noninjurers. Moreover, test scores significantly improved the statistical prediction of nonsuicidal self-injury beyond that achieved with demographic and psychiatric factors. Conclusions: These initial results support the validity of the Self-Injury Implicit Association Test as a performance-based measure of self-injurious thoughts. Future research should further examine the usefulness of incorporating implicit measures in risk assessment and decision-making procedures for self-injury and other sensitive clinical behaviors.
Nonsuicidal self-injury, which refers to the direct, deliberate destruction of one’s own body tissue without suicidal intent, is a pervasive problem (1) . A long-standing limitation in the assessment of self-injurious thoughts is the reliance on an individual’s self-report of such thoughts, as such measures can introduce problems in risk assessment and clinical decision making because they are prone to concealment in order to avoid unwanted treatment, such as involuntary hospitalization. Moreover, research suggests that self-report measures are insensitive to implicit thoughts, or those occurring outside of conscious awareness (2) .
To address these problems with self-reports, researchers have developed performance-based methods for assessing sensitive and stigmatized behaviors. One such method is the Implicit Association Test (3, 4), a reaction-time test that measures individuals’ less controllable, automatic associations with a concept of interest (5) . Briefly, the Implicit Association Test uses the fact that people classify related concepts (e.g., “flowers” and “pleasant”) together more quickly than less related concepts (e.g., “insects” and “pleasant”) to measure the mental associations they hold about different constructs of interest (for demonstration tests, see https://implicit.harvard.edu/implicit/). The Implicit Association Test may be a useful clinical tool, as it is predictive of future behavior (6), sensitive to clinical change (7), and resistant to attempts to feign desirable qualities (8) . This final feature makes the test especially valuable for the assessment of behaviors for which there is motivation to conceal one’s true thoughts or intentions, such as self-injury.
The current research was aimed at developing and examining a performance-based measure of the associations individuals hold about self-injurious thoughts, the Self-Injury Implicit Association Test. We examined whether people with a recent history of nonsuicidal self-injury perform differently from noninjurious people on this test. If so, this would be, to our knowledge, the first evidence of a behavioral test that can distinguish between self-injurers and noninjurers. Next, as a test of the potential clinical utility of the instrument, we examined whether it improves the prediction of nonsuicidal self-injury beyond that achieved with known demographic and psychiatric risk factors.

Method

The participants were 89 (68 female) adolescents with a mean age of 17.10 years (SD=1.92, range=12–19) who identified themselves as European American (73.0%), African American (3.4%), Hispanic (6.7%), Asian American (11.2%), or having mixed or other ethnicity (5.6%). The participants included those with a recent (past year) history of nonsuicidal self-injury (N=53) and a noninjurious comparison group (N=36). This group size provided strong statistical power (0.96) to detect the large between-group differences (d=0.80, alpha=0.05, two-tailed) required for the Self-Injury Implicit Association Test to be a useful clinical tool. Participants were recruited through announcements posted in psychiatric clinics, newspapers, community bulletin boards, and the Internet. All procedures were approved by Harvard University’s institutional review board. Written informed consent was obtained for all participants, with parental consent for those less than 18 years old.
All of the assessments were completed during one session in a behavioral research laboratory. We examined two versions of the Self-Injury Implicit Association Test: one that measures how strongly individuals associate self-injury with themselves (the identity version) and one that measures the automatic association of self-injury with evaluative positivity (the attitude version). The two versions were developed, administered, and scored according to standard procedures for the Implicit Association Test (3) . Briefly, each participant was seated alone at a desktop computer and instructed to classify stimuli that appeared in the center of the computer screen as quickly as possible by pressing two keys: “e” for stimuli to be classified on the left of the screen and “i” for stimuli classified on the right.
The identity version of the Self-Injury Implicit Association Test tested the strength of the association an individual holds between self-injury and him- or herself. The participants were presented with a series of images that were either related to self-injury (i.e., pictures of skin that had been cut) or neutral (i.e., pictures of noninjured skin) and were asked to classify these as quickly as possible as representing the concept “Cutting” or “No Cutting.” We intentionally focused only on cutting to limit variability in the experimental procedures and because prior work indicates that cutting is the primary method of nonsuicidal self-injury (9) . Of the current 53 self-injurers, 51 (96.2%) reported using cutting, among other methods, for self-injury. In the identity version of the test, participants also were presented with words that were either self-relevant (e.g., “I,” “Mine”) or other-relevant (e.g., “They,” “Them”) and were asked to classify these as quickly as possible as representing the attributes “Me” or “Not Me.” Correct classifications were followed by presentation of the next stimulus, and incorrect classifications were followed by presentation of a red “X,” which remained until the correct key press was made.
For the first critical test block (presented in random order) the participants were instructed to press the same computer key in response to both “Cutting” and “Me” stimuli (thus pairing stimuli related to self-injury and oneself) and the other computer key for “No Cutting” and “Not Me” stimuli ( Figure 1 ). For the second critical test block, the opposite sorting was performed (i.e., pairing stimuli related to noninjuring and oneself). Response latencies in these two blocks were recorded and analyzed by using a standard Implicit Association Test scoring algorithm (3) . The relative strength of the association between self-injury and oneself was indexed by calculating a standardized D score for each participant by subtracting the mean response latency for the Cutting/Me test block from the mean response latency of the Cutting/Not Me test block and dividing by the standard deviation of the response latency for all trials. Thus, positive D scores reflect faster responding (i.e., stronger associations) when self-injury and oneself are paired, whereas negative D scores reflect slower responding (i.e., weaker associations) when self-injury and oneself are paired.
Figure 1. Sample Stimulus From the Self-Injury Implicit Association Test a
a For each test block, the concept and attribute labels remain in the top corners of the screen and participants must classify each stimulus appearing in the center of the screen accordingly. In this example, the left key is the correct response because the image is of cut skin and the wording “Cutting” appears on the left side of the screen. Individuals who identify with self-injury (i.e., associate self-injury with the self) should perform more quickly on this test block because self-injury (i.e., “Cutting”) is paired with the self (i.e., “Me”). In contrast, noninjurers should perform more quickly on the test block in which “Cutting” is paired with “Not Me.” See https://implicit.harvard.edu/implicit/ for actual demonstration tests.
Our second form of the test, the attitude version, followed the same procedures but used the categories of “Good” (e.g., “Pleasure,” “Relief”) and “Bad” (e.g., “Painful,” “Ineffective”) instead of the categories of “Me” and “Not Me.”
Demographic factors including age, sex, and race/ethnicity were assessed in face-to-face interviews. To ensure that between-group differences on the Self-Injury Implicit Association Test were not due to differences in IQ, all participants also were assessed with the Wechsler Abbreviated Scale of Intelligence (10) . Psychiatric disorders are associated with nonsuicidal self-injury (11, 12), and therefore they were assessed by using the Schedule for Affective Disorders and Schizophrenia for School-Age Children—Present and Lifetime Version (K-SADS-PL) (13) . Given their associations with self-injury, we focused specifically on disorders of mood (major depression, bipolar disorder), anxiety (panic, separation anxiety, phobias, generalized anxiety, and obsessive-compulsive disorder), impulse control (oppositional defiant, conduct, and attention deficit hyperactivity disorder), eating (bulimia nervosa, anorexia nervosa), and substance use (alcohol, drugs). Level of clinical severity was measured by using the Children’s Global Assessment Scale (14) . The presence of nonsuicidal self-injury in the past year was assessed by using the Self-Injurious Thoughts and Behaviors Interview, a structured interview with strong interrater reliability, test-retest reliability, and construct validity (Nock et al., unpublished manuscript, 2006).
Performance results on the two versions of the Self-Injury Implicit Association Test (i.e., D scores) for the two groups were compared by using t tests. The ability of the instruments to add incrementally to the prediction of nonsuicidal self-injury was tested by using two separate hierarchical logistic regression analyses (one for each test version) in which demographic factors (age, gender, race/ethnicity) were entered in the first step, psychiatric factors (full-scale IQ, presence of each class of disorder, total number of disorders, and score on the Children’s Global Assessment Scale) were entered in the second step, and D scores were entered in the third step.

Results

Analyses revealed large and statistically significant differences between the self-injurers and noninjurers on the identity version of the Self-Injury Implicit Association Test ( Figure 2 ). As presented on the left side of the figure, those engaging in nonsuicidal self-injury showed a positive association (D score) between “Cutting” and “Me” (mean=0.18, SD=0.45), while the noninjurers showed a negative association (mean=–0.31, SD=0.34). Analyses also revealed a large and statistically significant difference on the attitude version of the test. As presented on the right side of Figure 2, both groups showed a positive association between “Cutting” and “Bad,” but the association was significantly stronger for the noninjurers (mean=–0.53, SD=0.29) than for those engaging in self-injury (mean=–0.16, SD=0.41).
Figure 2. Performance of Participants With Nonsuicidal Self-Injury and Comparison Subjects on Two Versions of the Self-Injury Implicit Association Test
a Positive scores reflect faster responding (i.e., stronger associations) when self-injury and oneself are paired, whereas negative scores reflect slower responding (i.e., weaker associations) when self-injury and oneself are paired.
b This version measures how strongly individuals associate self-injury with themselves. The difference between groups was significant (t=–5.60, df=87, d=1.20, p<0.001).
c This version measures the automatic association of self-injury with evaluative positivity. The difference between groups was significant (t=–4.66, df=87, d=1.00, p<0.001).
In terms of incremental predictive validity, after accounting for the variance explained by the demographic (χ 2 =6.00, df=3, R 2 =0.09, p=0.12) and psychiatric (χ 2 =38.66, df=8, ΔR 2 =0.44, p<0.001) factors, we found that performance on both the identity version (χ 2 =10.38, df=1, ΔR 2 =0.18, p=0.001) and attitude version (χ 2 =4.74, df=1, ΔR 2 =0.14, p=0.03) of the Self-Injury Implicit Association Test independently and significantly improved the statistical prediction of nonsuicidal self-injury. Notably, scores on the two versions were correlated (r=0.50, N=89, p<0.001), and when entered simultaneously in the third step of the regression equation, the identity version continued to significantly predict self-injury (odds ratio=11.32, p=0.02), whereas the attitude form of the test did not (odds ratio=2.87, p=0.31).

Discussion

The Self-Injury Implicit Association Test uses individuals’ response times to measure the implicit associations they hold about self-injury. Our results revealed remarkable group differences between self-injurers and noninjurers, supporting the criterion validity of this measure. Moreover, performance on two versions of this test significantly improved the statistical prediction of nonsuicidal self-injury beyond the use of demographic and psychiatric factors, suggesting that the test holds promise for improving the detection and prediction of self-injurious behaviors. This initial study introduces a novel method of assessing the nature of self-injurious thoughts that does not rely on self-report, which represents a major advance in risk assessment. Future research must demonstrate the prospective, predictive validity of the test before it can be recommended for use in clinical settings. Demonstrating that the Self-Injury Implicit Association Test improves prospective prediction beyond self-report would further highlight the utility of this measure. Future research also should test the usefulness of implicit measures for assessing other sensitive and/or stigmatized clinical behaviors, as well as the use of such measures for examining mechanisms of change during treatment (15) .

Footnotes

Received Sept. 14, 2006; revision received Oct. 17, 2006; accepted Nov. 17, 2006. From the Department of Psychology, Harvard University. Address correspondence and reprint requests to Dr. Nock, Department of Psychology, Harvard University, 33 Kirkland St., Cambridge, MA 02138; [email protected] (e-mail).
Both authors report no competing interests.
Supported by NIMH grants MH-076047 (Dr. Nock) and MH-57672 (Dr. Banaji) and by grants from the Milton Fund and Talley Fund of Harvard University (Dr. Nock).
The authors thank members of the Laboratory for Clinical and Developmental Research and Roy Ruhling for their assistance with this work.

References

1.
Klonsky ED, Oltmanns TF, Turkheimer E: Deliberate self-harm in a nonclinical population: prevalence and psychological correlates. Am J Psychiatry 2003; 160:1501–1508
2.
Greenwald AG, Banaji MR: Implicit social cognition: attitudes, self-esteem, and stereotypes. Psychol Rev 1995; 102:4–27
3.
Greenwald AG, Nosek BA, Banaji MR: Understanding and using the Implicit Association Test, I: an improved scoring algorithm. J Pers Soc Psychol 2003; 85:197–216
4.
Greenwald AG, McGhee DE, Schwartz JL: Measuring individual differences in implicit cognition: the implicit association test. J Pers Soc Psychol 1998; 74:1464–1480
5.
Fazio RH, Olson MA: Implicit measures in social cognition research: their meaning and use. Annu Rev Psychol 2003; 54:297–327
6.
Rudman LA, Lee MR: Implicit and explicit consequences of exposure to violent and misogynous rap music. Group Processes and Intergroup Relations 2001; 5:133–150
7.
Teachman BA, Woody SR: Automatic processing in spider phobia: implicit fear associations over the course of treatment. J Abnorm Psychol 2003; 112:100–109
8.
Banse R, Seise J, Zerbes N: Implicit attitudes towards homosexuality: reliability, validity, and controllability of the IAT. Z Exp Psychol 2001; 48:145–160
9.
Nock MK, Prinstein MJ: A functional approach to the assessment of self-mutilative behavior. J Consult Clin Psychol 2004; 72:885–890
10.
Wechsler D: Wechsler Abbreviated Scale of Intelligence. San Antonio, Tex, Psychological Corp, 1999
11.
Nock MK, Joiner TE Jr, Gordon KH, Lloyd-Richardson E, Prinstein MJ: Non-suicidal self-injury among adolescents: diagnostic correlates and relation to suicide attempts. Psychiatry Res 2006; 144:65–72; Epub 2006 Aug 2
12.
Nock MK, Prinstein MJ: Clinical features and behavioral functions of adolescent self-mutilation. J Abnorm Psychol 2005; 114:140–146
13.
Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P, Williamson D, Ryan N: Schedule for Affective Disorders and Schizophrenia for School-Age Children—Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry 1997; 36:980–988
14.
Shaffer D, Gould MS, Brasic J, Ambrosini P, Fisher P, Bird H, Aluwahlia S: A children’s global assessment scale (CGAS). Arch Gen Psychiatry 1983; 40:1228–1231
15.
Nock MK: Conceptual and design essentials for evaluating mechanisms of clinical change. Alcohol Clin Exp Res (in press)

Information & Authors

Information

Published In

Go to American Journal of Psychiatry
Go to American Journal of Psychiatry
American Journal of Psychiatry
Pages: 820 - 823
PubMed: 17475742

History

Published online: 1 May 2007
Published in print: May, 2007

Authors

Details

Matthew K. Nock, Ph.D.
Mahzarin R. Banaji, Ph.D.

Metrics & Citations

Metrics

Citations

Export Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format
Citation style
Style
Copy to clipboard

View Options

View options

PDF/EPUB

View PDF/EPUB

Get Access

Login options

Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.

Personal login Institutional Login Open Athens login
Purchase Options

Purchase this article to access the full text.

PPV Articles - American Journal of Psychiatry

PPV Articles - American Journal of Psychiatry

Not a subscriber?

Subscribe Now / Learn More

PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.

Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).

Media

Figures

Other

Tables

Share

Share

Share article link

Share