Abnormal Modulation of Amygdala Activity in Schizophrenia in Response to Direct- and Averted-Gaze Threat-Related Facial Expressions
Publication: American Journal of Psychiatry
Abstract
Objective:
Reduced amygdala activation in individuals with schizophrenia is thought to contribute to impairments in emotion recognition and social functioning. Recent work, however, suggests that amygdala abnormalities in schizophrenia are more nuanced than generalized hypoactivation and that modulation of amygdala responses across different stimulus types may be more closely related to social functioning than to overall levels of amygdala activation during a task. The authors investigated amygdala modulation during emotion recognition in patients by manipulating the gaze direction of threat-related expressions.
Method:
Blood-oxygen-level-dependent functional MRI was used to measure neural activation in 37 healthy volunteers and 35 schizophrenia patients while participants identified the emotion (anger or fear) displayed on facial stimuli that appeared with either direct or averted gaze.
Results:
Analysis of percent signal change in the amygdala bilaterally revealed a three-way interaction of emotion, gaze, and group, demonstrating significantly reduced amygdala responses to direct-gaze anger expressions in the patient group but comparable levels of activation across groups in all other conditions. Within the patient group, amygdala responses to direct-gaze anger expressions were positively correlated with level of functioning.
Conclusions:
These findings extend previous reports of amygdala hypoactivation in schizophrenia by identifying abnormal amygdala modulation in response to varying emotional stimuli. Additionally, the strong relationship between amygdala activation and social and occupational functioning underscores the need for investigations of amygdala modulation in schizophrenia that further specify the nature of these impairments and that examine a potential causal link between amygdala activation and functioning.
Impaired emotion recognition is a core domain of social cognitive dysfunction in schizophrenia and is strongly linked to functional outcome (1). One possible mechanism for this impairment is abnormal activation of a neural network centered on the amygdala (2–4). Studies examining amygdala functioning in schizophrenia largely report hypoactivation, and a recent meta-analysis supports findings of overall reduced amygdala activation in response to facial emotion processing 5). More nuanced investigations, however, have begun to expose complex patterns of functioning such that in some conditions (e.g., incorrectly labeling fear) schizophrenia patients show hyperactivation relative to healthy comparison subjects, and in others (e.g., correctly labeling anger) they show hypoactivation (6). Such findings confirm that amygdala responses in schizophrenia can be modulated by threat-related expressions, and it appears that these modulated relationships show the greatest associations with disease variables such as flat affect (6) and level of social functioning (7). These links to functional outcome provide a compelling argument for the identification of additional factors that could potentially modulate amygdala functioning in schizophrenia.
The gaze direction of threat-related facial expressions has been found to modulate both emotion recognition accuracy and amygdala response in healthy individuals. Behaviorally, and perhaps because of differing levels of self-relevance (8), emotion recognition accuracy is greater for direct-gaze anger and averted-gaze fear expressions than for averted-gaze anger and direct-gaze fear expressions (9–11; see reference 12 for an exception). Angry faces with a direct gaze are also rated as more intense than angry faces with an averted gaze, and the opposite is true for fear expressions (8, 13). Finally, detection of gaze direction is faster and more accurate when direct gaze is paired with angry expression and averted gaze is paired with fearful expression (14).
With regard to amygdala activation, the earliest report (15) noted that direct-gaze fear and averted-gaze anger expressions produced greater amygdala responses than did their opposite-gaze counterparts. These initial results were interpreted to suggest that the amygdala is particularly sensitive to the ambiguous levels of threat presented by an angry face that is looking away and a fearful face that is making direct eye contact. While subsequent work has raised questions about the true direction of this effect, differential amygdala responses depending on emotion and gaze direction continue to be reported, thus highlighting an important interaction between gaze direction and emotion perception (16–18).
To our knowledge, only one study has examined neural correlates of gaze detection in schizophrenia, and no studies have examined the combined effects of threat-related emotion and gaze direction. Kohler and colleagues (19) manipulated gaze direction of faces expressing neutral emotional states and asked healthy volunteers and patients with schizophrenia to determine whether the face was looking at them or looking away. Despite similar behavioral performances, patterns of amygdala activation varied between groups. Whereas healthy individuals did not show an effect of gaze direction in the amygdala, patients with schizophrenia showed greater left amygdala activation to direct gaze relative to averted gaze.
We sought to further these investigations by examining whether gaze direction of threat-related faces would evoke differential amygdala response in individuals with schizophrenia. Healthy volunteers and schizophrenia patients completed an emotion recognition task of fear and anger expressions with direct and averted gazes while undergoing functional neuroimaging. We hypothesized, first, that across the task as a whole, patients would show reduced amygdala activation relative to healthy comparison subjects. Second, based on the results of Kohler et al. (19), we tentatively hypothesized that patients would show greater amygdala activation to both anger and fear in direct-gaze expressions and therefore show less amygdala modulation as compared to healthy volunteers. Finally, while amygdala activation was the primary focus of this investigation, we also conducted exploratory analyses to identify other brain regions showing sensitivity to gaze manipulations of threat-related faces.
Method
Participants
The original sample included 40 healthy comparison subjects and 46 patients diagnosed with schizophrenia or schizoaffective disorder. Twelve individuals (three comparison subjects and nine patients) were excluded from further analysis because of poor image quality and excessive motion artifact (motion >4 mm). Two other patients were excluded for inadequate coverage of the imaging area and poor task performance (nonresponses >70%). The final sample included 37 healthy comparison subjects and 35 schizophrenia patients (31 with schizophrenia and four with schizoaffective disorder). The sample characteristics are summarized in Table 1. The groups did not differ significantly in gender, handedness, ethnicity, age, or maternal or paternal education level. As expected, the groups differed in education level (t=3.05, df=69, p=0.003), with comparison subjects achieving higher levels than patients. All participants were volunteers at the Schizophrenia Research Center of the University of Pennsylvania Medical Center, and all provided written informed consent after receiving a full description of the study procedures. The University of Pennsylvania ethics review board approved the study.
| Characteristic | Healthy Comparison Subjects (N=37) | Schizophrenia Patients (N=35) | ||
|---|---|---|---|---|
| N | % | N | % | |
| Male | 18 | 48.6 | 17 | 48.6 |
| Ethnicity | ||||
| Caucasian | 18 | 48.6 | 16 | 45.7 |
| African American | 16 | 43.2 | 18 | 51.4 |
| Asian | 3 | 8.1 | 1 | 2.9 |
| Right-handed | 34 | 91.9 | 30 | 85.7 |
| Ambidextrous | 0 | 0.0 | 1 | 2.9 |
| Mean | SD | Mean | SD | |
| Age (years) | 35.59 | 9.93 | 36.46 | 10.71 |
| Education (years) | 14.97 | 2.24 | 13.21 | 2.52 |
| Maternal educationa (years) | 13.65 | 2.90 | 13.61 | 2.93 |
| Paternal educationb (years) | 14.03 | 3.71 | 13.91 | 3.29 |
| Strauss-Carpenter Outcome Scale scorec | 29.90 | 2.78 | 21.76 | 5.45 |
| Duration of illness (years) | 15.21 | 11.06 | ||
| Antipsychotic dosage (chlorpromazine equivalents/day) | 378.19 | 296.47 | ||
| Scale for the Assessment of Negative Symptoms, subscale score | ||||
| Affective flattening or blunting | 6.40 | 5.10 | ||
| Alogia | 2.26 | 2.38 | ||
| Avolition-apathy | 2.86 | 2.30 | ||
| Anhedonia-asociality | 4.77 | 4.67 | ||
| Scale for the Assessment of Positive Symptoms, subscale score | ||||
| Hallucinations | 3.66 | 4.79 | ||
| Delusions | 3.69 | 6.20 | ||
| Bizarre behavior | 0.86 | 1.73 | ||
| Positive formal thought disorder | 2.83 | 4.62 | ||
a
Data missing for two patients.
b
Data missing for three patients.
c
Data missing for seven comparison subjects and two patients.
Diagnoses were confirmed with the Diagnostic Interview for Genetic Studies (20) and self-reported demographic and medical history information. To be eligible for the study, patients had to have a diagnosis of schizophrenia or schizoaffective disorder, depressed type, and no other current axis I or II diagnoses. Comparison subjects also completed all assessment procedures to ensure that they did not currently meet criteria for any axis I or II disorders, never met criteria for a psychotic disorder, and did not have any first-degree family members with a psychotic illness. For both groups, exclusion criteria were current substance use, abuse, or dependence (except nicotine); history of head injury; and any medical conditions known to affect brain function (e.g., uncontrolled hypertension, diabetes mellitus, history of seizures).
Assessments of symptom severity in the patient group using the Scale for the Assessment of Negative Symptoms (SANS; 21) and the Scale for the Assessment of Positive Symptoms (SAPS; 22) identified relatively mild symptom levels. Global ratings on these instruments averaged 1.42 (SD=0.72, range=0–3.0) and 1.04 (SD=1.04, range=0–3.5), respectively. Level of social and occupational functioning was assessed with the Strauss-Carpenter Outcome Scale (23). As expected, patients showed significantly lower levels of functioning than did comparison subjects (t=7.36, df=61, p<0.001). Six patients were receiving stable dosages of first-generation antipsychotics (chlorpromazine equivalents, mean=300.0 mg/day [SD=181.55]); 26 patients were on stable dosages of second-generation antipsychotics (chlorpromazine equivalents, mean=405.0 mg/day [SD=318.77]) (24). Information on medication was unavailable for three patients.
Imaging Stimuli and Task
During scanning, participants were presented with 72 faces individually and asked to identify the emotion expressed by each face. Faces displayed anger, fear, or no emotion, with 24 in each expression category; of these 24 faces, 12 were presented with a direct gaze so that they appeared to be looking directly at the participant, and 12 were presented with a gaze averted by 8 degrees (six to the right and six to the left) so that they appeared to be looking away from the participant.
The task used an event-related design, with each face displayed for 5.5 seconds. Faces were followed by a variable interstimulus interval of 0.5–18.5 seconds in which participants fixed on a complex crosshair comprising a scrambled face image with a crosshair fixation point centered in the display. Total task duration was 12.55 minutes. (Additional information about the task is presented in the data supplement that accompanies the online edition of this article.)
Imaging Procedures
Earplugs were used to muffle scanner noise, and head fixation was aided by foam-rubber restraints mounted on the head coil. Stimuli were rear-projected to the center of the visual field using a PowerLite 7300 video projector (Epson America, Long Beach, Calif.) and viewed through a mirror mounted on the head coil. Stimulus presentation was synchronized with image acquisition using the Presentation software program (Neurobehavioral Systems, Albany, Calif.).
Image Acquisition
Blood-oxygen-level-dependent (BOLD) functional MRI (fMRI) was acquired with a Siemens Trio 3-T (Erlangen, Germany) system with an eight-channel head coil and the following parameters: repetition time=3,000 msec, echo time=32 msec, field of view=240 mm, matrix=128×128, slice thickness=2 mm, gap=0 mm, 30 slices, voxel size=1.875×1.875×2 mm. To reduce partial volume effects in orbitofrontal regions, echo planar images were acquired obliquely (axial/coronal). The slices provided coverage of the temporal lobe and inferior frontal lobes, with good coverage of the ventral regions through the orbitofrontal lobes, midbrain, and fusiform gyrus. This slab acquisition allowed for excellent resolution through our a priori region of interest in the amygdala. A 5-minute magnetization-prepared, rapid acquisition gradient-echo T1-weighted image (repetition time=1,630 msec, echo time=3.87 msec, field of view=180×240 mm, matrix 192×256×160, voxel size 0.94×0.94×1 mm) was collected for spatial normalization and overlays of functional data.
Statistical Analysis
In order to remain consistent with previous work and to focus our analyses on the threat-related emotions of anger and fear, behavioral and neural responses to neutral faces were included as a covariate of no interest in their respective analyses. Previous work suggests that neutral faces may contain unintended, and variable, emotional significance, and indeed, several studies have demonstrated that neutral faces are commonly perceived as containing some emotional content (25–27).
Behavioral Performance
Response accuracy was assessed with a repeated-measures analysis of variance (ANOVA). Stimulus emotion (anger or fear) and gaze (direct or averted) were entered as within-subject factors, and group (comparison group or patient group) was entered as the between-subjects factor. Analysis of response time is provided in the online data supplement.
Image Analysis
Preprocessing and analyses of fMRI data were performed with FEAT (fMRI Expert Analysis Tool), version 5.98 (from FMRIB's Software Library [FSL], www.fmrib.ox.ac.uk/fsl). Images were slice-time corrected, motion-corrected to the median image using a trilinear interpolation with six degrees of freedom (28), high-pass filtered (100 seconds), spatially smoothed (4-mm full width at half maximum, isotropic), and grand-mean scaled using mean-based intensity normalization. FMRIB's Brain Extraction Tool was used to remove non-brain areas (29). The median functional and anatomical volumes were coregistered and then transformed into the standard anatomical space (T1 Montreal Neurological Institute template, voxel dimensions of 2×2×2 mm) using trilinear interpolation.
Subject-level time-series statistical analysis was carried out using FMRIB's Improved General Linear Model with local autocorrelation correction (30). The four condition events (direct-gaze anger, averted-gaze anger, direct-gaze fear, and averted-gaze fear) were modeled in the general linear model after convolution with a canonical hemodynamic response function and its temporal derivative. Six rigid body movement parameters were also modeled as nuisance covariates along with two other regressors (direct-gaze neutral and averted-gaze neutral). The resulting contrast images revealing task-dependent activation relative to fixation baseline were then used in group-level analyses.
To examine activation in our a priori region of interest, the right and left amygdala were first anatomically defined using the WFU (Wake Forest University) PickAtlas utility (31). Mean percent signal change in both regions of interest was then estimated using the model described above, and these values were entered into a repeated-measures ANOVA with hemisphere (right versus left), emotion (anger versus fear), and gaze (direct versus averted) as within-subject factors and group (comparison subjects versus patients) as the between-subject factor. The threshold for statistical significance was set at p<0.05 (two-tailed), and significant interactions were probed with follow-up t tests.
To address our exploratory aim of examining additional brain regions showing sensitivity to the interaction of emotion and gaze across groups, a mixed-effects analysis using FMRIB's local analysis of mixed effects was performed to conduct a 2×2×2 (group by emotion by gaze) voxel-wise ANOVA on subject-level contrasts across the entire slab acquisition. Cluster-level correction of p<0.01 was used for all main effects and two-way interactions. The main effect of group produced robust effects; thus, for clarity, results for this contrast are presented at a more conservative threshold of p<0.05 (family-wise error corrected, cluster >50). For the three-way interaction of emotion, gaze, and group, a less stringent cluster-level correction of p<0.05 was applied. For these analyses, findings pertaining to the main effect of group or interactions with group are presented below. All other within-subject findings are presented in the online data supplement.
Results
Behavioral Performance
For response accuracy, both the main effect of group (F=7.96, df=1, 68, p=0.006) and the emotion-by-gaze interaction (F=5.44, df=1, 68, p=0.023) were significant. As expected, on the task as a whole, accuracy was greater in the comparison group (mean=82.6%, SD=11.85) than in the schizophrenia group (mean=73.8%, SD=13.25). There was also an interaction between emotion and gaze, such that direct-gaze anger (mean=82.3%, SD=16.08) and averted-gaze fear (mean=81.3%, SD=17.99) were better recognized than averted-gaze anger (mean=72.7%, SD=20.08) and direct-gaze fear (mean=76.7%, SD=14.73). This interaction did not differ by group (Figure 1).
FIGURE 1. Performance by Schizophrenia Patients and Healthy Comparison Subjects on an Emotion Recognition Task Using Direct- and Averted-Gaze Threat-Related Facial Expressionsa
The right-hand panel shows a significant emotion-by-gaze-by-group interaction in anatomically defined amygdala. Mean percent signal change estimates are collapsed across both right and left amygdala.
Analyses of BOLD Signal Change in Amygdala
The repeated-measures ANOVA on mean percent signal change revealed a statistically significant main effect for hemisphere (F=8.41, df=1, 70, p=0.005), indicating greater left amygdala responsivity (mean=0.856, SD=0.331) as compared to the right amygdala (mean=0.775, SD=0.283). A significant main effect was also evident for emotion (F=9.57, SD=1, 70, p=0.003), such that fear expressions (mean=0.859, SD=0.318) evoked greater amygdala responses than did anger expressions (mean=0.773, SD=0.297). Greater amygdala activity was also seen in response to averted-gaze relative to direct-gaze expressions, but this main effect fell short of statistical significance (F=3.11, df=1, 70, p=0.082). Notably, the main effect of group across both regions of interest combined was not significant (F=2.381, df=1, 70, p=0.13). More importantly, however, the three-way interaction between emotion, gaze, and group was significant (F=5.19, df=1, 70, p=0.026 (see Figure 1). Follow-up t tests revealed that this interaction was largely driven by significantly reduced amygdala responses to direct-gaze anger expressions in the patient group. Indeed, patients showed significantly lower signal change for direct-gaze anger expressions than for all other conditions (p<0.01 for all comparisons), and within conditions, they significantly differed from comparison subjects only for direct-gaze anger expressions (t=2.81, df=1, 70, p=0.006), although it should be noted that the between-group comparison for averted-gaze fear expressions approached significance (t=1.72, df=1, 70, p=0.090). Somewhat surprisingly, despite a pattern of differences in comparison subjects that was partially consistent with previous reports, no direct comparisons of amygdala response across conditions reached statistical significance. No other interactions were significant.
Voxel-wise Comparisons Across the Acquisition Slab
Voxel-wise analyses of neural activation revealed a main effect of group, indicating that comparison subjects showed greater activation than patients in several regions typically associated with facial emotion processing, including the fusiform gyrus bilaterally, the right thalamus, the right inferior frontal gyrus, and the cerebellum. In contrast, patients showed greater activation than comparison subjects in the right middle temporal gyrus (Table 2; see also Figure S2 in the online data supplement).
| Effect and Region | Cluster Sizeb | Coordinates | |||
|---|---|---|---|---|---|
| x | y | z | Peak z | ||
| Main effect of group (comparison subjects > patients) | |||||
| Left fusiform gyrus (Brodmann's area 37) | 396 | −44 | −58 | −24 | 8.21 |
| Right fusiform gyrus (Brodmann's area 37) | 309 | 42 | −52 | −24 | 8.08 |
| Right thalamus | 257 | 10 | −6 | 6 | 7.3 |
| Left cerebellum, declive | 235 | −24 | −78 | −22 | 8.21 |
| Right cerebellum, declive | 199 | 44 | −80 | −22 | 8.21 |
| Right inferior frontal gyrus (Brodmann's area 46) | 92 | 46 | 30 | 8 | 7.89 |
| Right lateral globus pallidus | 70 | 30 | −18 | −2 | 6.54 |
| Right lingual gyrus | 89 | 20 | −92 | −4 | 6.77 |
| Left lingual gyrus | 88 | −6 | −92 | −6 | 6.31 |
| Main effect of group (patients > comparison subjects) | |||||
| Right middle temporal gyrus (Brodmann's area 37) | 80 | 44 | −66 | −2 | 7.25 |
| Gaze-by-group interaction (comparison subjects: averted > direct gaze, and patients: direct > averted gaze) | |||||
| Right medial frontal gyrus (Brodmann's area 10) | 350 | 8 | 56 | 2 | 3.46 |
| Left precentral gyrus (Brodmann's area 44) | 330 | −58 | 18 | 4 | 4.12 |
| Left lingual gyrus (Brodmann's area 18) | 183 | −2 | −84 | 2 | 3.57 |
| Left putamen | 110 | −20 | 6 | −6 | 3.41 |
| Left inferior frontal gyrus (Brodmann's area 10) | 110 | −50 | 42 | −4 | 3.33 |
| Emotion-by-gaze-by-group interaction | |||||
| Left caudate | 292 | −12 | 4 | 4 | 3.59 |
| Left caudate head | −10 | 10 | 0 | 3.27 | |
| Left thalamus | −10 | −6 | 2 | 2.30 | |
| Left putamen | −22 | 8 | −6 | 1.75 | |
| Right thalamus | 238 | 14 | −4 | 10 | 3.16 |
| Right caudate body | 12 | 8 | 6 | 3.08 | |
| Right caudate head | 14 | 14 | 0 | 2.65 | |
a
Anatomical labels and Brodmann's areas, where appropriate, were assigned according to Talairach and Tournoux (40). Main effect clusters significant at p<0.05 (family-wise error corrected, cluster >50). Two-way interaction clusters significant at p<0.01, corrected. Three-way interaction clusters significant at p<0.05, corrected, and coordinates for a maximum of three local maxima at least 6 mm apart are reported for each cluster.
b
In 2-mm3 voxels.
Likewise, multiple regions showed a significant interaction between gaze and group such that comparison subjects showed greater activation to averted-gaze relative to direct-gaze expressions and patients showed an opposite pattern (a contrast of −1, 1, −1, 1 for comparison subjects and 1, −1, 1, −1 for patients for direct-gaze anger, averted-gaze anger, direct-gaze fear, and averted-gaze fear, respectively). These regions included the medial prefrontal cortex, including Brodmann's area 10; the left precentral gyrus; the left lingual gyrus; the left putamen; and the left inferior frontal gyrus (Figure 2). Finally, two clusters demonstrated a significant three-way interaction between emotion, gaze, and group (Figure 2). These clusters included the thalamus and caudate bilaterally and revealed opposite patterns of neural responses in comparison subjects relative to patients, such that comparison subjects showed greater activation to averted-gaze anger and direct-gaze fear relative to direct-gaze anger and averted-gaze fear, and patients showed greater activation to direct-gaze anger and averted-gaze fear relative to averted-gaze anger and direct-gaze fear. Coordinates are provided in Table 2.
FIGURE 2. Regions Showing Stimulus Characteristic-by-Group Interactions in Schizophrenia Patients and Healthy Comparison Subjects on an Emotion Recognition Task Using Direct- and Averted-Gaze Threat-Related Facial Expressionsa
a In panel A, mean percent signal change is extracted from the peak voxel in the left inferior frontal gyrus cluster to demonstrate the direction of the interaction. Images are cluster-level-corrected at p<0.01. In panel B, mean percent signal change is extracted from the peak voxel in the left caudate cluster to demonstrate the direction of the interaction. Image is cluster-level-corrected at p<0.05.
Post Hoc Analyses
Given that amygdala responses in patients differed from those in comparison subjects only in response to direct-gaze anger expressions, we conducted post hoc correlational analyses to examine associations between amygdala activation to direct-gaze anger, symptom ratings, and level of functioning in the patient group. We averaged mean percent signal change estimates in response to direct-gaze anger expressions across hemisphere and then calculated bivariate correlations between these measures and the sum of the symptom subscale scores on the SANS and the SAPS and total score on the Strauss-Carpenter Outcome Scale. These relationships were generally weak (r values <0.25) except for a robust negative correlation between amygdala response and anhedonia (r=−0.564, p<0.001) and a robust positive correlation between amygdala response and level of functioning (r=0.587, p<0.001) (Figure 3). These correlations were unchanged when the potential effects of medication were controlled for.
FIGURE 3. Association Between Clinical Measures and Amygdala Activity in Schizophrenia Patients on an Emotion Recognition Task Using Direct- and Averted-Gaze Threat-Related Facial Expressionsa
a On the left, a scatterplot of the association between percent signal change in the amygdala bilaterally in response to direct-gaze anger expressions and Scale for the Assessment of Negative Symptoms anhedonia ratings. On the right, a scatterplot of the association between percent signal change in the amygdala bilaterally in response to direct-gaze anger expressions and level of social and occupational functioning. Both correlations are significant at a Bonferroni-corrected level of p<0.006.
Discussion
We investigated amygdala modulation during emotion recognition in patients with schizophrenia by manipulating gaze direction in threat-related expressions. Across the task as a whole, reductions in neural activation in patients were seen throughout a facial emotion processing network that includes the limbic and thalamic regions, the frontal regions, and the cerebellum. Results demonstrated a three-way interaction between emotion, gaze, and group in amygdala that was driven by significantly decreased activation in patients only to direct-gaze anger expressions. Contrary to previous reports demonstrating generalized amygdala hypoactivation during emotion processing (5), patients and healthy comparison subjects showed comparable levels of amygdala activation to all other stimulus categories. Given that directed anger expressions likely present the clearest indication of self-relevant threat, our findings highlight a specific deficit in facial emotion processing in patients with schizophrenia that may also be related to accurately assessing threat and determining self-relevance (8, 10, 17, 32). These findings are also supportive of previous work demonstrating abnormal amygdala modulation in schizophrenia and are consistent with our previous finding that paranoid patients fail to show greater amygdala activation in response to increasing levels of threat (7). In our previous work, degree of amygdala modulation showed a relationship with social functioning, and in the present study, the degree of amygdala activation to direct-gaze anger expressions was significantly correlated with level of functioning. This finding identifies a robust link between amygdala activation and measurements of social and occupational functioning that may indicate a potential neural basis for impaired functioning in schizophrenia.
In addition to the amygdala, several other regions previously implicated in emotion processing and social cognition showed significant interactions between stimulus characteristics and group. Most notably, both the medial prefrontal cortex and the inferior frontal gyrus demonstrated greater activation to averted-gaze relative to direct-gaze expressions in healthy comparison subjects and an opposite pattern in schizophrenia patients. The medial prefrontal cortex has been consistently linked to theory of mind (the ability to infer the thoughts or intentions of others) (33, 34), and this pattern in healthy subjects may reflect a greater effort to interpret the intentions of an individual who is looking away. Patients, however, show impairments in theory of mind (35, 36), which may be related to the abnormal pattern of activation seen here. Likewise, greater activation in the inferior frontal gyrus for healthy individuals in response to averted-gaze expressions may indicate the greater cognitive demand of processing more ambiguous stimuli. Finally, activations in the caudate and thalamus bilaterally showed a three-way interaction between emotion, gaze, and group. Both the caudate and the thalamus are implicated in processing fear-related stimuli (37, 38), and the caudate has been linked to emotional arousal (39). While tentative, these results may reflect abnormal early arousal responses to potential threat in individuals with schizophrenia and therefore require replication.
Reported neural interactions between stimulus characteristics and group were evident despite the lack of any group interactions in recognition accuracy. Both patients and healthy comparison subjects followed a pattern of behavioral response that is consistent with previous work (9–11). This finding may suggest some preserved ability in schizophrenia to integrate gaze cues and emotional signals. A recent study examining this effect in patients with unilateral amygdala damage reported that only right lobectomy patients showed an abnormal behavioral pattern, suggesting that the effect may be dependent on the right amygdala (10). While our patient group generally showed reduced activity relative to our comparison group, they did show right amygdala activity in response to all stimuli, which may have contributed to an intact normative pattern in emotion recognition accuracy, albeit with reduced accuracy overall.
This study has several limitations. First, while the pattern of neural activation to averted- and direct-gaze fear expressions in our healthy comparison subjects was consistent with previous findings (16, 17), we did not find a significant interaction of gaze and emotion in the amygdala. As N'Diaye and colleagues (17) have pointed out, this may be due to our use of high-intensity emotional expressions. N'Diaye et al. used both mild and high-intensity expressions and found a significant interaction between emotion and gaze in amygdala only for mild expressions. They concluded that the interactive effect of gaze on emotion recognition may be maximized only in conditions where emotional signals are relatively weak and can be enhanced with congruent shifts in gaze (i.e., averted gaze in a fearful expression resulting in a greater portion of exposed eye whites). Alternatively, in the present study we assessed explicit emotion recognition. It is possible that amygdala modulation differs during implicit processing and that modulation to fear is greater when emotion is not directly assessed (15, 16). Second, manipulation of our stimuli to create shifted gaze can be most accurately characterized as horizontal head tilt with concomitant averted gaze rather than a directed expression with averted gaze. While the majority of previous work on this topic has used the latter, work by Hess and colleagues (11) suggests that there may not be a meaningful distinction between the two presentations. Finally, the correlation between amygdala activation and functioning does not imply causality. Additional work will be needed to determine whether other factors (e.g., premorbid functioning, activation of additional brain regions) may account for this finding.
Notwithstanding these limitations, this study provides novel support for abnormal amygdala modulation in patients with schizophrenia that goes beyond generalized reduced activation. More importantly, amygdala activation showed a strong and positive correlation with social and occupational functioning, reinforcing the need for continued research investigating modulators of amygdala responses in schizophrenia.
Footnote
Received June 12, 2010; revision received Sept. 15, 2010; accepted Oct. 15, 2010
Supplementary Material
File (ajp_168_03_293_01.pdf)
- View/Download
- 244.59 KB
References
1.
Couture SM, Penn DL, Roberts DL: The functional significance of social cognition in schizophrenia: a review. Schizophr Bull 2006; 32(suppl 1):S44–S63
2.
Marwick K, Hall J: Social cognition in schizophrenia: a review of face processing. Br Med Bull 2008; 88:43–58
3.
Morris RW, Weickert CS, Loughland CM: Emotional face processing in schizophrenia. Curr Opin Psychiatry 2009; 22:140–146
4.
Pinkham AE, Gur RE, Gur RC: Affect recognition deficits in schizophrenia: neural substrates and psychopharmacological implications. Expert Rev Neurother 2007; 7:807–816
5.
Li H, Chan RC, McAlonan GM, Gong QY: Facial emotion processing in schizophrenia: a meta-analysis of functional neuroimaging data. Schizophr Bull 2010; 36:1029–1039
6.
Gur RE, Loughead J, Kohler CG, Elliott MA, Lesko K, Ruparel K, Wolf DH, Bilker WB, Gur RC: Limbic activation associated with misidentification of fearful faces and flat affect in schizophrenia. Arch Gen Psychiatry 2007; 64:1356–1366
7.
Pinkham AE, Hopfinger JB, Ruparel K, Penn DL: An investigation of the relationship between activation of a social cognitive neural network and social functioning. Schizophr Bull 2008; 34:688–697
8.
Sander D, Grandjean D, Kaiser S, Wehrle T, Scherer K: Interaction effects of perceived gaze direction and dynamic facial expression: evidence for appraisal theories of emotion. Eur J Cogn Psychol 2007; 19:470–480
9.
Adams RB, Kleck RE: Perceived gaze direction and the processing of facial displays of emotion. Psychol Sci 2003; 14:644–647
10.
Cristinzio C, N'Diaye K, Seeck M, Vuilleumier P, Sander D: Integration of gaze direction and facial expression in patients with unilateral amygdala damage. Brain 2010; 133:248–261
11.
Hess U, Adams RB, Kleck RE: Looking at you or looking elsewhere: the influence of head orientation on the signal value of emotional facial expressions. Motiv Emot 2007; 31:137–144
12.
Bindemann M, Burton AM, Langton SRH: How do eye gaze and facial expression interact? Vis Cogn 2008; 16:708–733
13.
Adams RB, Kleck RE: Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion 2005; 5:3–11
14.
Adams RB, Franklin RG: Influence of emotional expression on the processing of gaze direction. Motiv Emot 2009; 33:106–112
15.
Adams RB, Gordon HL, Baird AA, Ambady N, Kleck RE: Effects of gaze on amygdala sensitivity to anger and fear faces. Science 2003; 300:1536
16.
Hadjikhani N, Hoge R, Snyder J, de Gelder B: Pointing with the eyes: the role of gaze in communicating danger. Brain Cogn 2008; 68:1–8
17.
N'Diaye K, Sander D, Vuilleumier P: Self-relevance processing in the human amygdala: gaze direction, facial expression, and emotion intensity. Emotion 2009; 9:798–806
18.
Sato W, Yoshikawa S, Kochiyama T, Matsumura M: The amygdala processes the emotional significance of facial expressions: an fMRI investigation using the interaction between expression and face direction. Neuroimage 2004; 22:1006–1013
19.
Kohler CG, Loughead J, Ruparel K, Indersmitten T, Barrett FS, Gur RE, Gur RC: Brain activation during eye gaze discrimination in stable schizophrenia. Schizophr Res 2008; 99:286–293
20.
Nurnberger JI, Blehar MC, Kaufmann CA, York-Cooler C, Simpson SG, Harkavy-Friedman J, Severe JB, Malaspina D, Reich T: Diagnostic Interview for Genetic Studies: rationale, unique features, and training. NIMH Genetics Initiative. Arch Gen Psychiatry 1994; 51:849–859
21.
Andreasen NC: Scale for the Assessment of Negative Symptoms (SANS). Iowa City, University of Iowa, 1984
22.
Andreasen NC: Scale for the Assessment of Positive Symptoms (SAPS). Iowa City, University of Iowa, 1984
23.
Strauss JS, Carpenter WT: The prediction of outcome in schizophrenia, I: characteristics of outcome. Arch Gen Psychiatry 1972; 27:739–746
24.
Woods SW: Chlorpromazine equivalent doses for the newer atypical antipsychotics. J Clin Psychiatry 2003; 64:663–667
25.
Kline JS, Smith JE, Ellis HC: Paranoid and nonparanoid schizophrenic processing of facially displayed affect. J Psychiatr Res 1992; 26:169–182
26.
Kohler CG, Turner TH, Bilker WB, Brensinger CM, Siegel SJ, Kanes SJ, Gur RE, Gur RC: Facial emotion recognition in schizophrenia: intensity effects and error pattern. Am J Psychiatry 2003; 160:1768–1774
27.
Sasson NJ, Pinkham AE, Richard J, Hughett P, Gur RE, Gur RC: Controlling for response biases clarifies sex and age differences in facial affect recognition. J Nonverbal Behav (in press)
28.
Jenkinson M, Bannister P, Brady M, Smith S: Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 2002; 17:825–841
29.
Smith SM: Fast robust automated brain extraction. Hum Brain Mapp 2002; 17:143–155
30.
Woolrich MW, Ripley BD, Brady M, Smith SM: Temporal autocorrelation in univariate linear modeling of fMRI data. Neuroimage 2001; 14:1370–1386
31.
Maldjian JA, Laurienti PJ, Kraft RA, Burdette JH: An automated method for neuroanatomic and cytoarchitectonic atlas-based interrogation of fMRI data sets. Neuroimage 2003; 19:1233–1239
32.
Sander D, Grafman J, Zalla T: The human amygdala: an evolved system for relevance detection. Rev Neurosci 2003; 14:303–316
33.
Amodio DM, Frith CD: Meeting of minds: the medial frontal cortex and social cognition. Nat Rev Neurosci 2006; 7:268–277
34.
Calder AJ, Lawrence AD, Keane J, Scott SK, Owen AM, Christoffels I, Young AW: Reading the mind from eye gaze. Neuropsychologia 2002; 40:1129–1138
35.
Bora E, Yucel M, Pantelis C: Theory of mind impairment in schizophrenia: meta-analysis. Schizophr Res 2009; 109:1–9
36.
Sprong M, Schothorst P, Vos E, Hox J, van Engeland H: Theory of mind in schizophrenia: meta-analysis. Br J Psychiatry 2007; 191:5–13
37.
Sewards TV, Sewards MA: Fear and power-dominance drive motivation: neural representations and pathways mediating sensory and mnemonic inputs, and outputs to premotor structures. Neurosci Biobehav Rev 2002; 26:553–579
38.
Liddell BJ, Brown KJ, Kemp AH, Barton MJ, Das P, Peduto A, Gordon E, Williams LM: A direct brainstem-amygdala-cortical “alarm” system for subliminal signals of fear. Neuroimage 2005; 24:235–243
39.
Colibazzi T, Posner J, Wang Z, Gorman D, Gerber A, Yu S, Zhu H, Kangarlu A, Duan Y, Russell J, Peterson BS: Neural systems subserving valence and arousal during the experience of induced emotions. Emotion 2010; 10:377–389
40.
Talairach J, Tournoux P: Co-Planar Stereotaxic Atlas of the Human Brain. New York, Thieme Medical, 1988
Information & Authors
Information
Published In
History
Received: 12 June 2010
Revision received: 15 September 2010
Accepted: 15 October 2010
Published online: 1 March 2011
Published in print: March 2011
Authors
Funding Information
All authors report no financial relationships with commercial interests.Supported by NIMH grants T32-MH019112 and R01-MH060722.
Metrics & Citations
Metrics
Citations
Export Citations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
View Options
View options
PDF/EPUB
View PDF/EPUBGet Access
Login options
Already a subscriber? Access your subscription through your login credentials or your institution for full access to this article.
Personal login Institutional Login Open Athens loginNot a subscriber?
PsychiatryOnline subscription options offer access to the DSM-5-TR® library, books, journals, CME, and patient resources. This all-in-one virtual library provides psychiatrists and mental health professionals with key resources for diagnosis, treatment, research, and professional development.
Need more help? PsychiatryOnline Customer Service may be reached by emailing [email protected] or by calling 800-368-5777 (in the U.S.) or 703-907-7322 (outside the U.S.).