Social and Nonsocial Content Differentially Modulates Visual Attention and Autonomic Arousal in Rhesus Macaques

Christopher J. Machado; Eliza Bliss-Moreau; Michael L. Platt; David G. Amaral

doi:10.1371/journal.pone.0026598

Abstract

The sophisticated analysis of gestures and vocalizations, including assessment of their emotional valence, helps group-living primates efficiently navigate their social environment. Deficits in social information processing and emotion regulation are important components of many human psychiatric illnesses, such as autism, schizophrenia and social anxiety disorder. Analyzing the neurobiology of social information processing and emotion regulation requires a multidisciplinary approach that benefits from comparative studies of humans and animal models. However, many questions remain regarding the relationship between visual attention and arousal while processing social stimuli. Using noninvasive infrared eye-tracking methods, we measured the visual social attention and physiological arousal (pupil diameter) of adult male rhesus monkeys (Macaca mulatta) as they watched social and nonsocial videos. We found that social videos, as compared to nonsocial videos, captured more visual attention, especially if the social signals depicted in the videos were directed towards the subject. Subject-directed social cues and nonsocial nature documentary footage, compared to videos showing conspecifics engaging in naturalistic social interactions, generated larger pupil diameters (indicating heightened sympathetic arousal). These findings indicate that rhesus monkeys will actively engage in watching videos of various kinds. Moreover, infrared eye tracking technology provides a mechanism for sensitively gauging the social interest of presented stimuli. Adult male rhesus monkeys' visual attention and physiological arousal do not always trend in the same direction, and are likely influenced by the content and novelty of a particular visual stimulus. This experiment creates a strong foundation for future experiments that will examine the neural network responsible for social information processing in nonhuman primates. Such studies may provide valuable information relevant to interpreting the neural deficits underlying human psychiatric illnesses such as autism, schizophrenia and social anxiety disorder.

Citation: Machado CJ, Bliss-Moreau E, Platt ML, Amaral DG (2011) Social and Nonsocial Content Differentially Modulates Visual Attention and Autonomic Arousal in Rhesus Macaques. PLoS ONE 6(10): e26598. https://doi.org/10.1371/journal.pone.0026598

Editor: Jan Lauwereyns, Kyushu University, Japan

Received: May 6, 2011; Accepted: September 29, 2011; Published: October 26, 2011

Copyright: © 2011 Machado et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding: This work was supported by funding from the National Institute of Mental Health (K99-MH083883) to C.J. Machado and (R37-MH57502) to D.G. Amaral. All work was carried out at the California National Primate Research Center (RR00069). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that not competing interests exist.

Introduction

Social cognition describes a collection of perceptual, cognitive and regulatory processes that coordinate one's interactions with others [1]–[5]. This brief definition does not capture the complexity of a process that humans, and even many nonhuman primate species [6], engage in effortlessly throughout each day. Research into how the primate brain normally processes social information, regulates emotional arousal and guides appropriate social behavior has flourished over the past three decades. Although much of this research has involved clinical and nonclinical human populations, studies using animal models, such as rhesus monkeys, have also provided many key insights including a list of brain regions that are putative components of the “social brain” [3]. Nonhuman primate studies using selective neurotoxic lesions ([7]–[12]), transient inactivation [13], functional neuroimaging [14]–[18] and electrophysiological recording techniques [19]–[32] have implicated the superior temporal cortex, amygdala, orbitofrontal cortex and anterior cingulate cortex in collectively decoding the meaning of social stimuli, orchestrating appropriate social and emotional responses and evaluating outcomes relative to predictions. These findings have largely corroborated data from human functional neuroimaging and lesion studies [33]–[35].

Despite the advances brought about through research on rhesus monkeys, this work comes with several caveats. First, most neurotoxic lesion and transient inactivation studies have measured social behavior deficits in operated and control animals while freely interacting in groups [7]–[9], [13]. While this affords the opportunity to record rich behavioral interactions, such studies allow for very little experimental control. Analyses of specific social information processing abilities in more controlled settings with such experimental groups could greatly aid the interpretation of observational data. Second, although electrophysiological recording and functional neuroimaging studies are conducted under highly-controlled conditions, these studies typically use static images of facial expressions or body postures as social stimuli. This is problematic because primate social communication using facial expressions and body postures involves motion and a sequential exchange between individuals, neither of which are adequately captured in a still image. High-quality video stimuli provide greater contextual and sequential information, and allow for behavioral responses to be measured away from extraneous physical, social or olfactory distractions [36], [37]. To date, video stimuli have only been used sparingly to study aspects of social information processing [38]–[42]. Macaques attend to videos depicting social stimuli for extended periods of time and viewing time is comparable for videos depicting aggression, affiliation and environmental exploration [38], [42]. Macaques also respond in a socially appropriate manner to videos. Male rhesus monkeys will, for example, produce appeasement gestures, avoid and gaze avert in response to videos of threatening males and will approach video clips of female conspecifics [38], [39], [42], [43]. Finally, while many scholars believe that emotional state and personality heavily influence how humans decode the meaning of social signals [44], few studies in nonhuman primates have measured peripheral physiological arousal in conjunction with social information processing.

In the current experiment, we measured visual social attention and sympathetic nervous system arousal in adult, male, rhesus monkeys as they watched a large library of social and nonsocial video clips. We measured visual attention using an infrared eye-tracking system and a noninvasive method of head restraint [45]. Dark-adapted pupil diameter was the index of sympathetic nervous system activity [46]–[48]. We hypothesized that animals would attend more to videos depicting species-typical social interactions or facial expressions than to nature documentary video footage showing non-primate animals or landscapes. We also predicted that videos with social content would result in larger pupil diameters indicating heightened automatic nervous system arousal relative to nonsocial nature documentary videos.

Materials and Methods

Ethics statement

All experimental procedures were noninvasive and developed in collaboration with the veterinary, animal husbandry and environmental enrichment staff at the California National Primate Research Center (CNPRC). All data presented here were collected at the CNPRC under a protocol (13483) approved by the University of California, Davis, Institutional Animal Care and Use Committee. All attempts were made (in terms of social housing, enriched diet, use of positive reinforcement strategies and minimizing the duration of daily training/testing sessions) to promote the psychological well-being of the animals in accordance with recommendations made by the Weatherall report, “The use of non-human primates in research.”

Subjects and living conditions

Six adult male rhesus monkeys participated in this study. Each was born at the CNPRC and lived in 1 of 24, half-acre outdoor enclosures for at least 2 years before being relocated to indoor housing. Each of these outdoor enclosures contained approximately 70 animals of various ages and sexes. Once relocated indoors, each animal was housed in a standard adult macaque laboratory cage (66 cm width×61 cm length×81 cm height) with a minimum of 6 hours of socialization permitted with a neighboring animal each weekday. Depending on the relationship, daily socialization was either full, unrestrained interactions in either of the 2 adjoining cages or restricted to mostly visual interaction through a metal grate (moderate tactile access was also possible). The housing room was maintained on a 12-hour light/dark cycle. All animals were maintained on a diet of fresh fruit, vegetables and monkey chow (Lab Diet #5047, PMI Nutrition International Inc., Brentwood, MO), with water available ad libitum. The current study did not begin until the animals were 5.8–8.7 years old and weighed 10–14 kg.

Training

Training methods and noninvasive head restraint strategies have been described in detail elsewhere [45]. Briefly, all training and subsequent data collection occurred while the animals sat in a modified primate chair with a slanted top (Crist Instrument Co., Inc., Damascus, MD). Head restraint was accomplished noninvasively using individualized thermoplastic helmets that could be affixed to the primate chair. Each animal was habituated to sitting in the primate chair with its helmet on for successively longer periods of time up to 90 minutes. Next, the animal's chair was rolled into a sound-attenuating testing chamber (Acoustic Systems, Austin, TX; 2.1 m wide×2.4 m tall×1.1 m deep) for habituation to this testing context and the video eye-tracker (Applied Science Laboratories, Bedford, MA; model R-HS-S6). A wide-screen, color video monitor (60.96 cm diagonal; Gateway Inc., Irvine, CA; model LP2424) was positioned at the monkey's eye level. The video monitor was positioned 127 cm from the animals' eyes, while the eye-tracking camera was positioned on a tripod 53.34 cm from the animals' eyes. A curved mouthpiece (Crist Instrument Co., Inc.; model # 5-RLD-00A) was attached to the top-left of the chair and connected to an automatic juice dispenser (Crist Instrument Co., Inc.; model # 5-RLD-E3) so that fluid reward could be dispensed throughout the testing session. A white noise generator (60 dB) inside of the chamber was used to mask outside auditory distractions.

Visual stimuli were presented to each monkey using a PC running the Eprime 2.0 Professional software package (Psychology Software Tools, Pittsburgh, PA). All gaze data were collected using the Eye-Trac 6 .NET User Interface program (Applied Science Laboratories) on a separate PC. Infrared luminance level, pupil threshold and corneal reflection threshold were set individually for each animal at the start of each session. Sampling rate for the infrared eye-tracking camera was set to 120 Hz. A standard nine-point calibration (3×3 matrix of calibration stimuli) was conducted prior to testing with each animal to ensure accuracy of gaze data collection. Calibration stimuli were videos presented in small portions of the screen (8.89×5.72 cm on screen, 4° visual angle) of rhesus monkeys from the outdoor housing enclosures at the CNPRC. The goal here was to attract the animal's gaze to different portions of the screen to calibrate the data acquisition software.

Once reliably calibrated, each monkey was trained to fixate color animated GIF images at random spatial positions on the computer screen for juice rewards that were manually dispensed by the experimenter. Animals completed this phase of training once they fixated the GIF images consistently for 2 consecutive days. During the second phase of fixation training, animals viewed either photographs (color or black and white; 5-second duration) on a 50% gray background or color video clips (taken from commercial movies and nature documentary DVDs; 30-second duration) on a black background. Each photograph or movie was separated by four 50% gray screens: 1) blank, 10-second duration, 2) black square target (3.4° visual angle) at center, 3) same black square target positioned randomly at 1 of 8 points around the screen periphery, and 4) blank, 10-second duration. Animals were required to fixate each black square target for at least 250 ms to obtain a small juice reward and move on to the next picture or movie trial, thus ensuring accuracy of the point-of-gaze data throughout a prolonged testing session. The animals completed the final phase of training once they finished 100 picture or 50 movie trials in less than 90 minutes on 3 consecutive days.

Video catalog

A library of 600, 30-second color videos was created for this study. Half of these videos (300) were created from raw video footage of rhesus monkeys collected at the CNPRC. A majority of these “social” videos showed rhesus macaques from the CNPRC field cages engaging in social behaviors, such as aggression (25 videos), grooming (50 videos), play (50 videos), mounting (15 videos), foraging (50 videos) or sitting in groups without overt social behavior (nonspecific social behavior; 50 videos). These stimuli will be collectively referred to as Naturalistic Social videos. In addition, a series of videos was created that depicted camera- or subject-directed facial expressions of aggression or subordination (20 videos each), as well as videos of monkeys simply looking towards the camera but not producing any social signals (neutral subject directed; 20 videos). These stimuli will be collectively referred to as Subject Directed Social videos. The remaining 300 videos were gathered from commercial nature documentaries such as “Planet Earth” (BBC Warner, 2007) and “Life in the Undergrowth” (BBC Warner, 2006). These Nature videos depicted birds (53 videos), insects/invertebrates (43 videos), land mammals (62 videos), marine mammals/fish (57 videos) and landscapes/flowers (85 videos). None of the Nature, Naturalistic Social or Subject Directed Social videos showed humans, other nonhuman primate species, snakes or other natural predators of macaques (i.e., predatory cats or large reptiles).

Raw video footage was edited using the PowerDirector Express version 5.0 software (CyberLink Corp., Fremont, CA) on a PC. Each video clip only included footage depicting social behavior from a single category (e.g., grooming, aggressive subject directed, foraging, etc.) or animals from only one Nature category (e.g., land mammals, birds, insects, etc.). Given that the frequency of scene changes within a video may influence visual attention in rhesus monkeys [40], we created videos that included 1–7 equal segments or 0–6 scene changes (mode = 4 segments or 3 scene changes). Compiled clips were produced by the software in MPEG2 format. Two versions were made of each video in the catalog; 1 with a resolution of 720×480 (480p) and a second with 1280×720 (720p) resolution. The current study used the 720×480 resolution versions to maximize PC processing speed. All videos spanned 12.6° visual angle in the vertical direction and 23.2° visual angle in the horizontal plane. Examples of the Nature, Naturalistic Social and Subject Directed Social videos are provided online as supplementary material (see Videos S1, S2, S3, respectively).

Video passive viewing task

Data described here were gathered over 12 days. On each test day, the animal was transported to the eye-tracking room, placed into the testing chair and its head was restrained with a thermoplastic helmet [45]. The animal's chair was then moved into the testing chamber, the mouthpiece for juice delivery was attached to the chair and the eye-tracker was calibrated as described above.

The first phase of a daily testing session required the animal to watch 10, 30-second “Baseline” videos that were made up of typical PC or Macintosh screen savers (e.g., Starfield, 3D FlowerBox, or 3D Pipes in Windows XP). These same 10 Baseline videos were shown in widescreen format (16∶9) and in random sequence each test day. Requiring the animals to watch these basic video stimuli served to verify eye-tracker calibration and the animal's willingness to participate in the testing session before the animal viewed the Naturalistic Social, Subject Directed Social and Nature videos of main interest. As shown at the top of Figure 1, each trial during the Baseline video session included the following sequence: 1) Blank gray screen that matched the average luminance of the subsequent video (10-second duration), 2) Baseline video (30-second duration), 3) Blank gray screen that matched the average luminance of preceding video (10-second duration), 4) Black square target (3.4° visual angle) at center of a 50% gray screen, 5) Same black square target positioned randomly at one of eight points around the 50% gray screen periphery. The animal was required to fixate the 2 black square targets for at least 500 ms to advance to the next trial and receive juice rewards (180 ms juice pulse for center target, 360 ms juice pulse for peripheral target).

Download:

Figure 1. Schematic of a typical testing trial.

A 10-second gray screen preceded and followed each 30-second video. During the first daily phase (Baseline; top panel), videos depicted simple, inanimate objects. During the second daily phase (bottom panel), animals viewed a pseudorandom mixture of Nature and Social (Naturalistic and Subject Directed) videos. After each video, animals were required to fixate a center and peripheral target for >500 ms to receive a juice reward and proceed to the next trial.

https://doi.org/10.1371/journal.pone.0026598.g001

In the second testing phase, the animal viewed a pseudorandom mixture of 25 Social and 25 Nature videos (Figure 1, bottom), also shown in widescreen format (16∶9). The Social videos included both Naturalistic Social and Subject Directed Social videos. The following 4 constraints were put on the daily sequence of videos: 1) Half of the test days began with a Social video and the remaining half began with a Nature video, 2) Five Social and 5 Nature videos occurred in each block of 10 videos, 3) No more than 2 Social or Nature videos could occur on consecutive trials, and 4) If 2 consecutive Social or Nature videos did occur, the 2 videos were from different categories (i.e., 2 grooming or land mammal videos were never presented consecutively). Each Social and Nature video was viewed only once by each animal during this study and all animals saw the videos in the same sequence each day. The Social and Nature videos were presented within the same trial structure as shown in Figure 1, with the same square target fixation requirements.

Data analysis

Each animal's total fixation duration, total frequency of fixations, average fixation duration, average gaze dwell duration and average pupil diameter was measured for each video using the ASL Results software package (Applied Science Laboratories). Eye tracking parameters were computed for a single rectangular area of interest (AOI) that encompassed the entire video frame. Default parameters were used to define fixations (Applied Science Laboratories). A fixation was recorded if gaze coordinates remained within 1°×1° visual angle for at least 100 ms. The duration of a given fixation ended when gaze coordinates deviated by more than 1°×1° visual angle for more than 360 ms. Total fixation frequency represented the cumulative number of discrete fixations that fell within the video AOI during each 30-second trial. Total fixation duration was the cumulative time (maximum = 30 seconds) that the animal spent fixating the video AOI. The average fixation duration was derived by dividing the total fixation duration by the total fixation frequency. Finally, the average dwell duration measures the average amount of time that gaze remained within the video AOI without leaving.

We opted to normalize data within each animal to control for individual differences across test days. For each video, the animal's total fixation duration, total fixation frequency, average fixation duration or average dwell duration was divided by the average of that same variable across all 50 Social and Nature videos viewed that day. The resulting quotients were multiplied by 100 to give a metric that can be interpreted as a percent of the animal's typical total fixation duration, total fixation frequency, average fixation duration or average dwell duration on a given test day. As an example, if an animal fixated on a given video for 23 seconds, but their average fixation duration across all Social and Nature videos on that day was 18 seconds, then their normalized total fixation duration for the video in question was (23/18)×100 = 128 or 28% longer than the daily average fixation duration.

For each of these 4 dependent variables, we examined values for the entire 30-second video, as well as values for each 10-second block. Data were compared across broad categories of video stimuli (Nature, Subject Directed Social and Naturalistic Social), as well as within each category (i.e., Grooming vs. Play vs. Aggression, etc. in the Naturalistic Social category) using ANOVAs with Category (3–6) and Block (3) as within-subjects factors with repeated measures. A Huynh-Feldt correction was used to adjust the degrees of freedom if the group variance did not remain equal across the three 10-second blocks. Post-hoc t-tests of significant main effects and interactions were Bonferroni corrected for multiple comparisons. Alpha was set at p<.05, but significance levels up to p = .07 are also presented as marginally significant due to the small sample size and conservative approach to correction for multiple comparisons.

As an index of cognitive processing load [49], [50] and physiological arousal [51], [52] (especially reflecting sympathetic nervous system activation [46]–[48]) for each video, we also measured the animals' dark-adapted pupil diameter at 120 Hz. To remove data reflecting the pupillary light reflex, the first 2 seconds of each video trial were omitted from the analysis. Initial inspection of the video catalog revealed that the average luminance of the Nature videos was significantly lower than the average luminance of the Social videos (Naturalistic Social and Subject Directed Social combined; F(1,598) = 4.144; p<.05). Such a difference necessitated a normalization procedure to remove the influence of differences in luminance across video categories, as well as individual differences. We identified 2 normalization strategies. The gray screen that proceeded and followed each video had the same average luminance as that video. The raw average pupil diameter data from each video was therefore divided by the average pupil diameter during the gray screens flanking each video and multiplied by 100 to provide pupil diameters in terms of a percent of the gray screen value. An alternative approach was to use the same within-subject strategy as described for the gaze data above. The raw average pupil diameter for each video was divided by that animal's average pupil diameter across the entire testing session on that day and multiplied by 100 to provide pupil diameters in terms of a percent of the daily average. Analysis of the pupil diameter data was conducted using both normalization strategies and nearly identical results were found for both strategies. Therefore, for the sake of consistency with the gaze data, we will display results for the pupil diameter dataset using the within-subject normalization strategy. The results generated using the gray screen normalization strategy are included as Tables S1, S2, S3 online.

Results

Examples of 1 Nature, Naturalistic Social and Subject Directed Social video are shown online with the pattern of visual attention (or point-of-gaze) from 1 animal mapped onto the video with black cross-hairs (Videos S4, S5, S6, respectively). The noninvasive thermoplastic helmets used for head restraint produced reliable gaze and pupil diameter data for all animals. Only 1.3% of the total trials (47 out of 3600) were discarded due to excessive head movement or other technical problems with the eye-tracker. The animals readily attended to the 600 videos. The 6 adult male rhesus monkeys spent an average of 21.19 seconds±1.81 SEM fixating on these videos, regardless of content. This average fixation duration was significantly higher than that of the Baseline videos (showing moving shapes) that were used during the session to verify eye-tracker calibration accuracy [F(1,5) = 14.74, p = .01, η_p² = .747].

Based on the frequency of fixations, the monkeys' discriminated between the Nature, Naturalistic Social and Subject Directed Social video categories. As shown in Figure 2A, the animals fixated more frequently during for the Naturalistic Social videos than the Subject Directed Social or Nature videos [Category main effect; F(2,10) = 10.45, p<.01, η_p² = .676; post-hoc: Naturalistic Social>Subject Directed Social p = .066, Naturalistic Social>Nature p = .015]. We also found that sub-categories within the Naturalistic Social videos differed in the total frequency of fixations [Category main effect; F(5,25) = 6.15, p = .001, η_p² = .552]. In particular, the animals fixated more frequently when watching videos showing conspecifics engaged in mounting behavior relative to those showing foraging [post-hoc: Mounting>Foraging p = .021]. No other sub-categories within the Naturalistic Social videos differed significantly.

Download:

Figure 2. Rhesus monkeys discriminate social and nonsocial videos.

Graphs show the total number of fixations (A), total fixation duration (B), average fixation duration (C) and average dwell duration (D) for the Subject Directed Social, Naturalistic Social and Nature video categories. Main effects of video category: † p = .07, * p<.05, ** p<.01. Vertical bars represent the standard error of the mean (SEM).

https://doi.org/10.1371/journal.pone.0026598.g002

In contrast to the total number of fixations, Subject Directed Social videos commanded the greatest total fixation duration (Figure 2B), but the difference relative to the other 2 categories was not significant [Category main effect; F(2,10) = 4.685, p = .037, η_p² = .484; post-hoc: Subject Directed Social = Naturalistic Social = Nature, all p>.11]. However, discrete fixations were significantly longer when animals watched Subject Directed Social videos [Figure 2C; Category main effect; F(2,10) = 31.406, p<.001, η_p² = .863; post-hoc: Subject Directed Social>Naturalistic Social p = .002, Subject Directed Social>Nature p = .01]. More focused analysis of the 3 sub-categories within Subject Directed Social videos did not indicate any significant differences in average fixation duration based on type of content (i.e., aggressive, affiliative or neutral).

In addition to measures of gaze frequency and duration, we also measured the average time that the animals' gaze remained or “dwelled” within the video frame area of interest without leaving (Figure 2D). This measure showed that the Subject Directed Social and Naturalistic Social videos both captured the animals' attention for longer periods of time than the Nature videos [Category main effect; F(2,10) = 9.108, p = .006, η_p² = .646; post-hoc: Subject Directed Social>Nature p = .036, Naturalistic Social>Nature p = .065]. There was no significant difference in average dwell duration between the sub-categories of Subject Directed Social videos. However, within the Naturalistic Social category, aggression and mounting videos captured the animals' attention for longer periods of time than foraging videos [Category main effect; F(5,25) = 15.674, p<.001, η_p² = .758; post-hoc: Aggression>Foraging p = .016, Mounting>Foraging p = .005]. Finally, the measures of total fixation frequency, total fixation duration, average fixation duration and average dwell duration were all consistent throughout the entire video (i.e., there were not significant main effects of Block), indicating that these measures of visual attention were not consistently driven by 1 particular segment of the videos.

Average pupil diameter during each video was also collected to provide a measure of sympathetic nervous system activity [46]–[48]. As shown in Figure 3A, mean pupil diameter was significantly larger when the animals watched the Subject Directed Social and Nature videos relative to the Naturalistic Social videos [Category main effect; F(2,10) = 101.53, p<.001, η_p² = .953; post-hoc: Subject Directed Social and Nature>Naturalistic Social, both p<.001]. Pupil diameter was also largest during the first 10 seconds of a given video (Block 1 of 3), regardless of content [Block main effect; F(2,10) = 14.364, p = .01, η_p² = .742; post-hoc: Block 1>Block 2 p<.05, Block 1>Block 3 p = .05; Figure 3B]. Finally, there was a significant Category×Block interaction. For Subject Directed Social and Naturalistic Social videos, pupil diameter decreased significantly between Blocks 1 and 2 [t(5) = 4.8 and 5.1, respectively, both p<.05], but remained static between Blocks 2 and 3. By contrast, when animals watched Nature videos, their pupil diameters decreased slightly across the 30-second video, but did not change significantly. We also examined the sub-categories within the Subject Directed Social and Nature videos to determine if 1 or more specific type of content could be driving the larger pupil diameters observed for the more general category. There were no significant differences in pupil diameter between the 3 sub-categories of Subject Directed Social videos (Figure 3C). However, within the Nature video category, pupil diameter was significantly greater when the animals watched videos showing marine mammals and fish relative to all other sub-categories (all p<.05). Pupil diameter was intermediate and did not differ between videos showing birds, insects/invertebrates and landscapes/flowers, but each of these 3 sub-categories still produced pupil diameters greater than land mammals (all p<.05 relative to land mammal sub-category).

Download:

Figure 3. Sympathetic arousal, as indexed by pupil diameter, varies with video content.

Within-subject normalized pupil diameter data shown for the entire 30-second video (A) or when videos were analyzed in 10-second blocks (B). Pupil diameters are also shown for specific sub-categories within the Subject Directed Social and Nature categories (C). Main effects of video category: § p<.05 relative to all other Nature subcategories, * p<.05 relative to Land Mammals only, ** p<.01. Main effects of time block: # p<.05. Change between Block 1 and Block 2: Δ p<.05. Vertical bars represent the standard error of the mean (SEM).

https://doi.org/10.1371/journal.pone.0026598.g003

Discussion

The present study assessed how visual attention and autonomic nervous system arousal are differentially modulated by social and nonsocial information. This was assessed using noninvasive video eye-tracking and pupillometry to simultaneously measure differences in visual attention and sympathetic nervous system arousal when adult male rhesus monkeys watched high-quality videos. Overall, adult male rhesus monkeys fixated more frequently and for longer durations when watching videos with social content relative to nonsocial, nature documentary footage. Relative to nature documentary footage, videos showing macaque social signals directed towards the viewer commanded the longest average fixation duration, total fixation duration and average duration of continuous fixation or “dwell” within the video frame. Videos showing conspecifics engaged in naturalistic social interactions resulted in the highest total number of fixations, but videos in this category typically fell between those showing subject-directed social signals or nature documentary footage in fixation duration measures of attention (i.e., average dwell duration).

These results confirmed our expectations that were based on previous eye-tracking studies with humans, apes and monkeys indicating a strong preference for attending to social stimuli, especially faces [41], [42], [53]–[62]. In particular, the 2 kinds of social videos (Naturalistic and Subject Directed) produced similar values for total fixation duration and average dwell duration, and these values were greater than those measured for the Nature videos. It is therefore unlikely that differences in raw motion (i.e., activity of the stimuli in the video) could account for this pattern of results, since the amount of overall motion was typically high for the Naturalistic Social and Nature videos, and significantly less for the Subject Directed Social videos. For these 2 measures, the pattern of results seems to be more driven by species-typical social content than overall motion. By contrast, average fixation duration was greater for the Subject Directed Social videos, relative to the Naturalistic Social and Nature videos. This pattern of results does suggest that overall motion may have contributed to average fixation duration, with higher levels of motion resulting in fixations that, on average, last for shorter periods of time. This pattern of results has also been observed in humans [63], [64]. The elevated number of fixations for naturalistic social videos relative to the subject-directed social or nature documentary footage was an unexpected finding. This may have been due to the fact that the naturalistic social behavior videos had more background stimuli overall (other monkeys moving around in the large housing enclosures at the CNPRC) than either the Subject Directed Social videos (plain blue or white background) or the Nature videos (naturalistic backgrounds, but a heavy focus on animals featured in the clip). As such, there were simply more discrete stimuli of interest on which to fixate during the naturalistic social videos than in the other video categories.

As is common for most infrared eye-tracking systems currently available, we were also able to measure 1 index of autonomic nervous system arousal in our animals – pupil diameter. The diameter of the human and nonhuman primate pupil is controlled by muscles in the iris that contract and relax [65], [66]. Parasympathetic nervous system fibers innervate the sphincter pupillae of the iris, and their activity results in pupillary constriction. By contrast, increased activity of sympathetic nervous system innervation to the dilator pupillae of the iris results in pupillary dilation [65], [66]. When a visual stimulus is presented, a rapid (1–2 second) constriction of the pupil occurs. This phenomenon is called the pupillary light reflex and its magnitude and latency varies depending on the overall brightness of the stimulus [67]–[70]. To decrease the effect of stimulus brightness on our results, we omitted the first 2 seconds of pupil diameter data from each video trial. Throughout the presentation of a particular visual stimulus, pupil diameter fluctuates depending on many factors, including cognitive processing load [49], [50] and physiological arousal [51], [52]. Pupil diameter also typically diminishes over time during the presentation of a stimulus, as the subject habituates, or with fatigue across a testing session [65], [66].

In contrast to the clear visual preference for videos with conspecific social content, we showed here that both subject-directed social signals and nature documentary footage, relative to those with naturalistic social interaction content, resulted in larger pupil diameters indicating elevated sympathetic nervous system arousal. The elevated autonomic response in the subject-directed videos was expected. Although the subject-directed social videos varied in the type of social signals displayed (agonistic, submissive or neutral expressions), all consisted of close-up footage of unfamiliar monkeys displaying direct eye contact toward the camera/viewer. In rhesus monkey society, direct eye-contact is a highly threatening gesture and readily elicits behavioral expressions of fear, passive avoidance and/or generalized tension [71], [72]. Acute fear or generalized anxiety have been linked for some time to physiological changes in general, and to sympathetic nervous system activation in particular (see for review [73]). Therefore, it is likely that the direct eye contact seen in this video category contributed to the increased pupil diameters measured for these videos relative to the naturalistic social videos which showed less provocative general social behavior.

The increased pupillary response to the Nature category of videos was not expected. One possible explanation for the elevated pupil diameters could be the novelty of the content in those videos. The monkeys used in this study were raised in semi-naturalistic outdoor enclosures. As a result, they had limited exposure to non-primate animals (such as birds, other small mammals and insects) during development. The rural landscape in which the housing enclosures are embedded is very consistent. Thus, the marine mammals or fish, as well as the oceanic, forest, desert and polar landscapes shown in the nature documentary footage were highly novel to our subjects. There was evidence of habituation in the temporal characteristics of pupil diameters (significantly lower pupil diameters after the first 10 seconds) for the Subject Directed and Naturalistic social videos, but not for the Nature videos (no change in pupil diameter across the 30-second video; Figure 3B) which further suggests they were highly novel. Consistent with the idea that increased arousal observed during the Nature clips resulted from novelty is the finding that videos that included marine mammals and fish resulted in the highest average pupil diameter (Figure 3B). The landscapes and flowers subcategory produced the second-largest average pupil diameters. In fact, videos showing birds, insects or landscapes all produced pupil diameters that were significantly larger than videos showing land mammals (i.e., animals most similar in body structure and locomotion to our subjects). Similar to acute fear or anxiety discussed above, novelty has also been shown to result in elevated peripheral sympathetic arousal in the rat [74], [75], monkey [76] and human [77], [78]. Therefore, it is plausible to conclude that the sustained elevations in pupil diameter observed for the nature documentary videos was driven by the overall novelty of the animals and locations displayed in these stimuli.

An alternative explanation for this pattern of results could be that the Nature videos, and particularly the ones showing marine mammals and fish, were darker than other video categories and it was that factor that drove the heightened pupil diameters. This is a plausible explanation, but unlikely given how the pupil diameter data were normalized. One strategy computed each animal's pupil diameters as a percentage of the average pupil diameter measured across the 25 social and 25 nonsocial videos shown on that particular day (within-subject normalization strategy; see Methods and Results sections). These data were also analyzed after expressing each animal's pupil diameter as a percentage of the diameter recorded during a gray screen that preceded and followed each video and had the same average luminance as that video (gray screen normalization strategy; see Tables S1, S2, S3 online). A very consistent pattern of results emerged regardless of which method was used to correct pupil diameters for differences in luminance across videos. Nature and Subject Directed Social videos result in greater pupil diameters relative to Naturalistic Social videos, and videos showing marine mammals and fish tend to produce the largest pupil diameters within the Nature category. This finding does not entirely exclude the possibility that brightness is playing a role in modulating pupil diameter, but it is unlikely to be the major driving factor.

Beyond the novel results produced by this study, we also have introduced a valuable library of videos that can now be used to study various aspects of social cognition in rhesus monkeys. A total of 600, 30-second color videos were made, half of which showed rhesus macaques engaged in various forms of social behavior or displaying social gestures indicative of aggression or subordination. The remaining half of the stimulus pool showed landscapes and fauna, or other, non-primate animals. The number of scenes or camera position transitions varied consistently according to a normal distribution within each category of Social or Nature video. For all videos created from raw footage collected at the CNPRC, measures were taken to eliminate any opaque barriers (fencing or cage bars) between the animals and the video camera. Such an extensive stimulus set does not currently exist in the fields of social neuroscience or primatology, and therefore may be of value to other investigators. For example, the normative point-of-gaze and pupil diameter data already generated in the current study could be used to select specific stimuli for future studies. These stimuli could also be used during functional neuroimaging or electrophysiological recording studies, alone or in conjunction with static images, to ask questions about how the primate brain represents social context or sequential information during social interactions. These video stimuli will be made available to other investigators and should be requested from the corresponding author.

In summary, the study of social neuroscience, like other areas of neuroscience, can benefit greatly from comparative studies in humans and animal models. This is especially true if studies utilize stimuli that closely reflect naturalistic conditions and use similar methods (such as eye-tracking and pupillometry) across species. Understanding how different kinds of experimental manipulations (e.g., brain lesions, transient deactivation or hyper-activation of a given brain structure, atypical prenatal or post-natal environment, etc.) perturb specific aspects of social cognition (perception, evaluation, motivation and behavioral/physiological regulation) will greatly facilitate the development of new insights into the underlying neurobiology of human psychiatric illnesses.

Supporting Information

Table S1.

Pupil diameter analysis using the gray screen normalization method and comparing the three main video categories.

https://doi.org/10.1371/journal.pone.0026598.s001

(DOCX)

Table S2.

Pupil diameter analysis using the gray screen normalization method and comparing the Subject Directed Social video sub-categories.

https://doi.org/10.1371/journal.pone.0026598.s002

(DOCX)

Table S3.

Pupil diameter analysis using the gray screen normalization method and comparing the Nature video sub-categories.

https://doi.org/10.1371/journal.pone.0026598.s003

(DOCX)

Video S1.

A sample video from the Nature video category.

https://doi.org/10.1371/journal.pone.0026598.s004

(MOV)

Video S2.

A sample video from the Naturalistic Social video category.

https://doi.org/10.1371/journal.pone.0026598.s005

(MOV)

Video S3.

A sample video from the Subject Directed Social video category.

https://doi.org/10.1371/journal.pone.0026598.s006

(MOV)

Video S4.

A sample video from the Nature video category with black cross-hairs superimposed to indicate one animal's point-of-gaze.

https://doi.org/10.1371/journal.pone.0026598.s007

(MOV)

Video S5.

A sample video from the Naturalistic Social video category with black cross-hairs superimposed to indicate one animal's point-of-gaze.

https://doi.org/10.1371/journal.pone.0026598.s008

(MOV)

Video S6.

A sample video from the Subject Directed Social video category with black cross-hairs superimposed to indicate one animal's point-of-gaze.

https://doi.org/10.1371/journal.pone.0026598.s009

(MOV)

Acknowledgments

We thank the veterinary and animal services staff of the California National Primate Research Center for helping to refine the animal handling procedures described in this article. We would also like to thank K. Henning and G. Moadab for assistance with collecting the data as well as R. Murillo for helping to create the video stimuli.

Author Contributions

Conceived and designed the experiments: CJM EBM MLP DGA. Performed the experiments: CJM EBM. Analyzed the data: CJM. Wrote the paper: CJM EBM MLP DGA.

References

1. Adolphs R (2010) Conceptual challenges and directions for social neuroscience. Neuron 65: 752–767.
- View Article
- Google Scholar
2. Baron-Cohen S, Ring HA, Wheelwright S, Bullmore ET, Brammer MJ, et al. (1999) Social intelligence in the normal and autistic brain: an fMRI study. European Journal of Neuroscience 11: 1891–1898.
- View Article
- Google Scholar
3. Brothers L (2002) The social brain: A project for integrating primate behavior and neuropsysiology in a new domain. In: Cacioppo JT, Berntson GG, Adolphs R, Carter CS, Davidson RJ, et al., editors. Foundations in Social Neuroscience. Cambridge: The MIT Press. pp. 367–386.
4. Bauman MD, Amaral DG (2007) Neurodevelopment of social cognition. In: Nelson CA, Luciana M, editors. Handbook of Developmental Cognitive Neuroscience. Cambridge: MIT Press. pp. 161–186.
5. Schumann CM, Bauman MD, Machado CJ, Amaral DG (2006) The social brain, amygdala, and autism. In: Moldin SO, Rubenstein JL, editors. Understanding autism: From basic neuroscience to treatement. Boca Raton: CRC Press. pp. 227–253.
6. Byrne RW, Bates LA (2010) Primate social cognition: uniquely primate, uniquely social, or just unique? Neuron 65: 815–830.
- View Article
- Google Scholar
7. Emery NJ, Capitanio JP, Mason WA, Machado CJ, Mendoza SP, et al. (2001) The effects of bilateral lesions of the amygdala on dyadic social interactions in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience 115: 515–544.
- View Article
- Google Scholar
8. Machado CJ, Emery NJ, Capitanio JP, Mason WA, Mendoza SP, et al. (2008) Bilateral neurotoxic amygdala lesions in rhesus monkeys (Macaca mulatta): Consistent pattern of behavior across different social contexts. Behavioral Neuroscience 122: 251–266.
- View Article
- Google Scholar
9. Machado CJ, Bachevalier J (2006) The impact of selective amygdala, orbital frontal cortex or hippocampal formation lesions on established social relationships in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience 120: 761–786.
- View Article
- Google Scholar
10. Bauman MD, Lavenex P, Mason WA, Capitanio JP, Amaral DG (2004) The development of social behavior following neonatal amygdala lesions in rhesus monkeys. Journal of Cognitive Neuroscience 16: 1388–1411.
- View Article
- Google Scholar
11. Bauman MD, Toscano JE, Mason WA, Lavenex P, Amaral DG (2006) The expression of social dominance following neonatal lesions of the amygdala or hippocampus in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience 120: 749–760.
- View Article
- Google Scholar
12. Prather MD, Lavenex P, Mauldin-Jourdain ML, Mason WA, Capitanio JP, et al. (2001) Increased social fear and decreased fear of objects in monkeys with neonatal amygdala lesions. Neuroscience 106: 653–658.
- View Article
- Google Scholar
13. Malkova L, Barrow KV, Lower LL, Gale K (2003) Decreased social interactions in monkeys after unilateral blockade of GABA-A receptors in the basolateral amygdala Annals of the New York. Academy of Sciences 985: 540–541.
- View Article
- Google Scholar
14. Hoffman KL, Gothard KM, Schmid MC, Logothetis NK (2007) Facial-Expression and Gaze-Selective Responses in the Monkey Amygdala. Current Biology 17: 766–772.
- View Article
- Google Scholar
15. Logothetis NK, Guggenberger H, Peled S, Pauls J (1999) Functional imaging of the monkey brain. Nature Neuroscience 2: 555–562.
- View Article
- Google Scholar
16. de Gelder B, Partan S (2009) The neural basis of perceiving emotional bodily expressions in monkeys. Neuroreport 20: 642–646.
- View Article
- Google Scholar
17. Tsao DY, Freiwald WA, Tootell RB, Livingstone MS (2006) A cortical region consisting entirely of face-selective cells. Science 311: 670–674.
- View Article
- Google Scholar
18. Moeller S, Freiwald WA, Tsao DY (2008) Patches with links: a unified system for processing faces in the macaque temporal lobe. Science 320: 1355–1359.
- View Article
- Google Scholar
19. Gothard KM, Battaglia FP, Erickson CA, Spitler KM, Amaral DG (2007) Neural responses to facial expression and face identity in the monkey amygdala. Journal of Neurophysiology 97: 1671–1683.
- View Article
- Google Scholar
20. O'Scalaidhe SP, Wilson FA, Goldman-Rakic PS (1997) Areal segregation of face-processing neurons in prefrontal cortex. Science 278: 1135–1138.
- View Article
- Google Scholar
21. O'Scalaidhe SP, Wilson FA, Goldman-Rakic PS (1999) Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: evidence for intrinsic specialization of neuronal coding. Cerebral Cortex 9: 459–475.
- View Article
- Google Scholar
22. Brothers L, Ring B (1993) Mesial temporal neurons in the macaque monkey with responses selective for aspects of social stimuli. Behavioural Brain Research 57: 53–61.
- View Article
- Google Scholar
23. Brothers L, Ring B, Kling A (1990) Response of neurons in the macaque amygdala to complex social stimuli. Behavioural Brain Research 41: 199–213.
- View Article
- Google Scholar
24. Kling A, Steklis HD, Deutsch S (1979) Radiotelemetered activity from the amygdala during social interactions in the monkey. Experimental Neurology 66: 88–96.
- View Article
- Google Scholar
25. Leonard CM, Rolls ET, Wilson FA, Baylis GC (1985) Neurons in the amygdala of the monkey with responses selective for faces. Behavioural Brain Research 15: 159–176.
- View Article
- Google Scholar
26. Rolls ET (1984) Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. Human Neurobiology 3: 209–222.
- View Article
- Google Scholar
27. Bruce C, Desimone R, Gross CG (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal of Neurophysiology 46: 369–384.
- View Article
- Google Scholar
28. Perrett DI, Rolls ET, Caan W (1982) Visual neurones responsive to faces in the monkey temporal cortex. Experimental Brain Research 47: 329–342.
- View Article
- Google Scholar
29. Hasselmo ME, Rolls ET, Baylis GC (1989) The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural Brain Research 32: 203–218.
- View Article
- Google Scholar
30. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, et al. (1984) Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. Human Neurobiology 3: 197–208.
- View Article
- Google Scholar
31. Perrett DI, Smith PA, Mistlin AJ, Chitty AJ, Head AS, et al. (1985) Visual analysis of body movements by neurones in the temporal cortex of the macaque monkey: a preliminary report. Behavioural Brain Research 16: 153–170.
- View Article
- Google Scholar
32. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, et al. (1985) Visual cells in the temporal cortex sensitive to face view and gaze direction. Proceedings of the Royal Society London Biological Sciences 223: 293–317.
- View Article
- Google Scholar
33. Bechara A, Bar-On R (2006) Neurological substrates of emotional and social intelligence: Evidence from patients with focal brain lesions. In: Cacioppo JT, Visser PS, Pickett CL, editors. Social Neuroscience: People thinking about thinking people. Cambridge: The MIT Press. pp. 13–40.
34. Adolphs R (2009) The social brain: neural basis of social knowledge. Annual Review of Psychology 60: 693–716.
- View Article
- Google Scholar
35. Mitchell JP (2009) Inferences about mental states. Philosophial Transactions of the Royal Society London Biological Sciences 364: 1309–1316.
- View Article
- Google Scholar
36. Fleishman LJ, Mc CW, D'Eath RB, Brainard DH, Endler JA (1998) Colour perception and the use of video playback experiments in animal behaviour. Animal Behaviour 56: 1035–1040.
- View Article
- Google Scholar
37. D'Eath RB (1998) Can video images imitate real stimuli in animal behaviour experiments. Biological Reviews 73: 267–292.
- View Article
- Google Scholar
38. Capitanio JP (2002) Sociability and responses to video playbacks in adult male rhesus monkeys (Macaca mulatta). Primates 43: 169–177.
- View Article
- Google Scholar
39. Plimpton EH, Swartz KB, Rosenblum LA (1981) Responses of juvenile bonnet macaques to social stimuli presented through color videotapes. Developmental Psychobiology 14: 109–115.
- View Article
- Google Scholar
40. Platt DM, Novak MA (1997) Videostimulation as enrichment for captive rhesus monkeys (Macaca mulatta). Applied Animal Behavior Science 52: 139–155.
- View Article
- Google Scholar
41. Nahm FKD, Perret A, Amaral DG, Albright TD (1997) How do monkeys look at faces? Journal of Cognitive Neuroscience 9: 611–623.
- View Article
- Google Scholar
42. Mosher CP, Zimmerman PE, Gothard KM (2011) Videos of conspecifics elicit interactive looking patterns and facial expressions in monkeys. Behavioral Neuroscience 125: 639–652.
- View Article
- Google Scholar
43. Rudebeck PH, Buckley MJ, Walton ME, Rushworth MF (2006) A role for the macaque anterior cingulate gyrus in social valuation. Science 313: 1310–1312.
- View Article
- Google Scholar
44. Olsson A, Ochsner KN (2008) The role of social cognition in emotion. Trends in Cognitive Science 12: 65–71.
- View Article
- Google Scholar
45. Machado CJ, Nelson EE (2011) Eye-tracking with nonhuman primates is now more accessible than ever before. American Journal of Primatology 73: 562–569.
- View Article
- Google Scholar
46. Steinhauer SR, Siegle GJ, Condray R, Pless M (2004) Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. International Journal of Psychophysiology 52: 77–86.
- View Article
- Google Scholar
47. Steinhauer SR, Hakerem G (1992) The pupillary response in cognitive psychophysiology and schizophrenia. Annals of the New York Academy of Sciences 658: 182–204.
- View Article
- Google Scholar
48. Friedman D, Hakerem G, Sutton S, Fleiss JL (1973) Effect of stimulus uncertainty on the pupillary dilation response and the vertex evoked potential. Electroencephalography and Clinical Neurophysiology 34: 475–484.
- View Article
- Google Scholar
49. Siegle GJ, Granholm E, Ingram RE, Matt GE (2001) Pupillary and reaction time measures of sustained processing of negative information in depression. Biological Psychiatry 49: 624–636.
- View Article
- Google Scholar
50. Siegle GJ, Steinhauer SR, Thase ME (2004) Pupillary assessment and computational modeling of the Stroop task in depression. International Journal of Psychophysiology 52: 63–76.
- View Article
- Google Scholar
51. Franzen PL, Buysse DJ, Dahl RE, Thompson W, Siegle GJ (2009) Sleep deprivation alters pupillary reactivity to emotional stimuli in healthy young adults. Biological Psychology 80: 300–305.
- View Article
- Google Scholar
52. Silk JS, Dahl RE, Ryan ND, Forbes EE, Axelson DA, et al. (2007) Pupillary reactivity to emotional information in child and adolescent depression: links to clinical and ecological measures. American Journal of Psychiatry 164: 1873–1880.
- View Article
- Google Scholar
53. Keating CF, Keating EG (1982) Visual scan patterns of rhesus monkeys viewing faces. Perception 11: 211–219.
- View Article
- Google Scholar
54. Keating CF, Keating EG (1993) Monkeys and mug shots: cues used by rhesus monkeys (Macaca mulatta) to recognize a human face. Journal of Comparative Psychology 107: 131–139.
- View Article
- Google Scholar
55. Gothard KM, Erickson CA, Amaral DG (2004) How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task? Animal Cognition 7: 25–36.
- View Article
- Google Scholar
56. Hirata S, Fuwa K, Sugama K, Kusunoki K, Fujita S (2010) Facial perception of conspecifics: chimpanzees (Pan troglodytes) preferentially attend to proper orientation and open eyes. Animal Cognition 13: 679–688.
- View Article
- Google Scholar
57. Kano F, Tomonaga M (2009) How chimpanzees look at pictures: a comparative eye-tracking study. Proceedings of the Royal Society London Biological Sciences 276: 1949–1955.
- View Article
- Google Scholar
58. Kano F, Tomonaga M (2010) Face scanning in chimpanzees and humans: Continuity and discontinuity. Animal Behaviour 79: 227–235.
- View Article
- Google Scholar
59. Ekman P, Friesen WV (1975) Unmasking the face: A guide to recognizing emotions from facial cues. Oxford, England: Prentice-Hall. 212 p.
60. Walker-Smith GJ, Gale AG, Findlay JM (1977) Eye movement strategies involved in face perception. Perception 6: 313–326.
- View Article
- Google Scholar
61. Wilson FA, Goldman-Rakic PS (1994) Viewing preferences of rhesus monkeys related to memory for complex pictures, colours and faces. Behavioural Brain Research 60: 79–89.
- View Article
- Google Scholar
62. Watson KK, Ghodasra JH, Platt ML (2009) Serotonin transporter genotype modulates social reward and punishment in rhesus macaques. PLoS One 4: e4156.
- View Article
- Google Scholar
63. Dorr M, Martinetz T, Gegenfurtner KR, Barth E (2010) Variability of eye movements when viewing dynamic natural scenes. Journal of Vision 10: 1–17.
- View Article
- Google Scholar
64. Itti L (2005) Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition 12: 1093–1123.
- View Article
- Google Scholar
65. Andreassi JL (2000) Pupillary response and behavior. In: Andreassi JL, editor. Psychophysiology: Human behavior and physiological response. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 218–233.
66. Stern RM, Ray WJ, Quigley KS (2001) Eyes: Pupillography and electrooculography. In: Stern RM, Ray WJ, Quigley KS, editors. Psychophysiological Recording. New York, NY: Oxford University Press. pp. 125–141.
67. Clarke RJ, Zhang H, Gamlin PDR (2003) Characteristics of the pupillary light reflex in the alert rhesus monkey. Journal of Neurophysiology 89: 3179–3189.
- View Article
- Google Scholar
68. Johnson LN, Hill RA, Bartholomew MJ (1988) Correlation of afferent pupillary defects with visual field loss on automated perimetry. Opthalmology 95: 1649–1655.
- View Article
- Google Scholar
69. Kardon RH (1995) Pupil perimetry. In: Tusa RJ, Newman SA, editors. Neuro-ophthalmological Disorders: Diagnostic Work-up and Management. New York: Dekker. pp. 421–436.
70. Thompson HS, Montague P, Cox TA, Corbett JJ (1982) The relationship between visual acuity, pupillary defect and visual field loss. American Journal of Ophthalmology 93: 681–688.
- View Article
- Google Scholar
71. Chevalier-Skolnikoff S (1973) Facial expression of emotion in nonhuman primates. In: Ekman P, editor. Darwin and Facial Expression. New York: Academic Press. pp. 11–89.
72. Van Hooff JA (1967) The facial displays of the catarrhine monkeys and apes. In: Morris D, editor. Primate Ethology. Chicago: Aldine Publishing Company. pp. 7–68.
73. Hoehn-Saric R, McLeod DR (1988) The peripheral sympathetic nervous system. Its role in normal and pathologic anxiety. Psychiatric Clinics of North America 11: 375–386.
- View Article
- Google Scholar
74. van den Buuse M, Van Acker SA, Fluttert M, De Kloet ER (2001) Blood pressure, heart rate, and behavioral responses to psychological “novelty” stress in freely moving rats. Psychophysiology 38: 490–499.
- View Article
- Google Scholar
75. Nijsen MJ, Croiset G, Diamant M, Broekhoven MH, De Wied D, et al. (1998) Vagal activation in novelty-induced tachycardia during the light phase in the rat. Physiology & Behavior 63: 233–239.
- View Article
- Google Scholar
76. Mendoza SP, Mason WA (1997) Autonomic balance in Saimiri sciureus and Calicebus moloch: Relation to life-style. Folia Primatologica 68: 307–318.
- View Article
- Google Scholar
77. Weisz J, Czigler I (2006) Age and novelty: Event-related brain potentials and autonomic activity. Psychophysiology 43: 261–271.
- View Article
- Google Scholar
78. Barry RJ, Sokolov EN (1993) Habituation of phasis and tonic components of the orienting reflex. International Journal of Psychophysiology 15: 39–42.
- View Article
- Google Scholar

[ref1] 1. Adolphs R (2010) Conceptual challenges and directions for social neuroscience. Neuron 65: 752–767.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Baron-Cohen S, Ring HA, Wheelwright S, Bullmore ET, Brammer MJ, et al. (1999) Social intelligence in the normal and autistic brain: an fMRI study. European Journal of Neuroscience 11: 1891–1898.
View Article
Google Scholar

[5] View Article

[6] Google Scholar

[ref3] 3. Brothers L (2002) The social brain: A project for integrating primate behavior and neuropsysiology in a new domain. In: Cacioppo JT, Berntson GG, Adolphs R, Carter CS, Davidson RJ, et al., editors. Foundations in Social Neuroscience. Cambridge: The MIT Press. pp. 367–386.

[ref4] 4. Bauman MD, Amaral DG (2007) Neurodevelopment of social cognition. In: Nelson CA, Luciana M, editors. Handbook of Developmental Cognitive Neuroscience. Cambridge: MIT Press. pp. 161–186.

[ref5] 5. Schumann CM, Bauman MD, Machado CJ, Amaral DG (2006) The social brain, amygdala, and autism. In: Moldin SO, Rubenstein JL, editors. Understanding autism: From basic neuroscience to treatement. Boca Raton: CRC Press. pp. 227–253.

[ref6] 6. Byrne RW, Bates LA (2010) Primate social cognition: uniquely primate, uniquely social, or just unique? Neuron 65: 815–830.
View Article
Google Scholar

[11] View Article

[12] Google Scholar

[ref7] 7. Emery NJ, Capitanio JP, Mason WA, Machado CJ, Mendoza SP, et al. (2001) The effects of bilateral lesions of the amygdala on dyadic social interactions in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience 115: 515–544.
View Article
Google Scholar

[14] View Article

[15] Google Scholar

[ref8] 8. Machado CJ, Emery NJ, Capitanio JP, Mason WA, Mendoza SP, et al. (2008) Bilateral neurotoxic amygdala lesions in rhesus monkeys (Macaca mulatta): Consistent pattern of behavior across different social contexts. Behavioral Neuroscience 122: 251–266.
View Article
Google Scholar

[17] View Article

[18] Google Scholar

[ref9] 9. Machado CJ, Bachevalier J (2006) The impact of selective amygdala, orbital frontal cortex or hippocampal formation lesions on established social relationships in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience 120: 761–786.
View Article
Google Scholar

[20] View Article

[21] Google Scholar

[ref10] 10. Bauman MD, Lavenex P, Mason WA, Capitanio JP, Amaral DG (2004) The development of social behavior following neonatal amygdala lesions in rhesus monkeys. Journal of Cognitive Neuroscience 16: 1388–1411.
View Article
Google Scholar

[23] View Article

[24] Google Scholar

[ref11] 11. Bauman MD, Toscano JE, Mason WA, Lavenex P, Amaral DG (2006) The expression of social dominance following neonatal lesions of the amygdala or hippocampus in rhesus monkeys (Macaca mulatta). Behavioral Neuroscience 120: 749–760.
View Article
Google Scholar

[26] View Article

[27] Google Scholar

[ref12] 12. Prather MD, Lavenex P, Mauldin-Jourdain ML, Mason WA, Capitanio JP, et al. (2001) Increased social fear and decreased fear of objects in monkeys with neonatal amygdala lesions. Neuroscience 106: 653–658.
View Article
Google Scholar

[29] View Article

[30] Google Scholar

[ref13] 13. Malkova L, Barrow KV, Lower LL, Gale K (2003) Decreased social interactions in monkeys after unilateral blockade of GABA-A receptors in the basolateral amygdala Annals of the New York. Academy of Sciences 985: 540–541.
View Article
Google Scholar

[32] View Article

[33] Google Scholar

[ref14] 14. Hoffman KL, Gothard KM, Schmid MC, Logothetis NK (2007) Facial-Expression and Gaze-Selective Responses in the Monkey Amygdala. Current Biology 17: 766–772.
View Article
Google Scholar

[35] View Article

[36] Google Scholar

[ref15] 15. Logothetis NK, Guggenberger H, Peled S, Pauls J (1999) Functional imaging of the monkey brain. Nature Neuroscience 2: 555–562.
View Article
Google Scholar

[38] View Article

[39] Google Scholar

[ref16] 16. de Gelder B, Partan S (2009) The neural basis of perceiving emotional bodily expressions in monkeys. Neuroreport 20: 642–646.
View Article
Google Scholar

[41] View Article

[42] Google Scholar

[ref17] 17. Tsao DY, Freiwald WA, Tootell RB, Livingstone MS (2006) A cortical region consisting entirely of face-selective cells. Science 311: 670–674.
View Article
Google Scholar

[44] View Article

[45] Google Scholar

[ref18] 18. Moeller S, Freiwald WA, Tsao DY (2008) Patches with links: a unified system for processing faces in the macaque temporal lobe. Science 320: 1355–1359.
View Article
Google Scholar

[47] View Article

[48] Google Scholar

[ref19] 19. Gothard KM, Battaglia FP, Erickson CA, Spitler KM, Amaral DG (2007) Neural responses to facial expression and face identity in the monkey amygdala. Journal of Neurophysiology 97: 1671–1683.
View Article
Google Scholar

[50] View Article

[51] Google Scholar

[ref20] 20. O'Scalaidhe SP, Wilson FA, Goldman-Rakic PS (1997) Areal segregation of face-processing neurons in prefrontal cortex. Science 278: 1135–1138.
View Article
Google Scholar

[53] View Article

[54] Google Scholar

[ref21] 21. O'Scalaidhe SP, Wilson FA, Goldman-Rakic PS (1999) Face-selective neurons during passive viewing and working memory performance of rhesus monkeys: evidence for intrinsic specialization of neuronal coding. Cerebral Cortex 9: 459–475.
View Article
Google Scholar

[56] View Article

[57] Google Scholar

[ref22] 22. Brothers L, Ring B (1993) Mesial temporal neurons in the macaque monkey with responses selective for aspects of social stimuli. Behavioural Brain Research 57: 53–61.
View Article
Google Scholar

[59] View Article

[60] Google Scholar

[ref23] 23. Brothers L, Ring B, Kling A (1990) Response of neurons in the macaque amygdala to complex social stimuli. Behavioural Brain Research 41: 199–213.
View Article
Google Scholar

[62] View Article

[63] Google Scholar

[ref24] 24. Kling A, Steklis HD, Deutsch S (1979) Radiotelemetered activity from the amygdala during social interactions in the monkey. Experimental Neurology 66: 88–96.
View Article
Google Scholar

[65] View Article

[66] Google Scholar

[ref25] 25. Leonard CM, Rolls ET, Wilson FA, Baylis GC (1985) Neurons in the amygdala of the monkey with responses selective for faces. Behavioural Brain Research 15: 159–176.
View Article
Google Scholar

[68] View Article

[69] Google Scholar

[ref26] 26. Rolls ET (1984) Neurons in the cortex of the temporal lobe and in the amygdala of the monkey with responses selective for faces. Human Neurobiology 3: 209–222.
View Article
Google Scholar

[71] View Article

[72] Google Scholar

[ref27] 27. Bruce C, Desimone R, Gross CG (1981) Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. Journal of Neurophysiology 46: 369–384.
View Article
Google Scholar

[74] View Article

[75] Google Scholar

[ref28] 28. Perrett DI, Rolls ET, Caan W (1982) Visual neurones responsive to faces in the monkey temporal cortex. Experimental Brain Research 47: 329–342.
View Article
Google Scholar

[77] View Article

[78] Google Scholar

[ref29] 29. Hasselmo ME, Rolls ET, Baylis GC (1989) The role of expression and identity in the face-selective responses of neurons in the temporal visual cortex of the monkey. Behavioural Brain Research 32: 203–218.
View Article
Google Scholar

[80] View Article

[81] Google Scholar

[ref30] 30. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, et al. (1984) Neurones responsive to faces in the temporal cortex: studies of functional organization, sensitivity to identity and relation to perception. Human Neurobiology 3: 197–208.
View Article
Google Scholar

[83] View Article

[84] Google Scholar

[ref31] 31. Perrett DI, Smith PA, Mistlin AJ, Chitty AJ, Head AS, et al. (1985) Visual analysis of body movements by neurones in the temporal cortex of the macaque monkey: a preliminary report. Behavioural Brain Research 16: 153–170.
View Article
Google Scholar

[86] View Article

[87] Google Scholar

[ref32] 32. Perrett DI, Smith PA, Potter DD, Mistlin AJ, Head AS, et al. (1985) Visual cells in the temporal cortex sensitive to face view and gaze direction. Proceedings of the Royal Society London Biological Sciences 223: 293–317.
View Article
Google Scholar

[89] View Article

[90] Google Scholar

[ref33] 33. Bechara A, Bar-On R (2006) Neurological substrates of emotional and social intelligence: Evidence from patients with focal brain lesions. In: Cacioppo JT, Visser PS, Pickett CL, editors. Social Neuroscience: People thinking about thinking people. Cambridge: The MIT Press. pp. 13–40.

[ref34] 34. Adolphs R (2009) The social brain: neural basis of social knowledge. Annual Review of Psychology 60: 693–716.
View Article
Google Scholar

[93] View Article

[94] Google Scholar

[ref35] 35. Mitchell JP (2009) Inferences about mental states. Philosophial Transactions of the Royal Society London Biological Sciences 364: 1309–1316.
View Article
Google Scholar

[96] View Article

[97] Google Scholar

[ref36] 36. Fleishman LJ, Mc CW, D'Eath RB, Brainard DH, Endler JA (1998) Colour perception and the use of video playback experiments in animal behaviour. Animal Behaviour 56: 1035–1040.
View Article
Google Scholar

[99] View Article

[100] Google Scholar

[ref37] 37. D'Eath RB (1998) Can video images imitate real stimuli in animal behaviour experiments. Biological Reviews 73: 267–292.
View Article
Google Scholar

[102] View Article

[103] Google Scholar

[ref38] 38. Capitanio JP (2002) Sociability and responses to video playbacks in adult male rhesus monkeys (Macaca mulatta). Primates 43: 169–177.
View Article
Google Scholar

[105] View Article

[106] Google Scholar

[ref39] 39. Plimpton EH, Swartz KB, Rosenblum LA (1981) Responses of juvenile bonnet macaques to social stimuli presented through color videotapes. Developmental Psychobiology 14: 109–115.
View Article
Google Scholar

[108] View Article

[109] Google Scholar

[ref40] 40. Platt DM, Novak MA (1997) Videostimulation as enrichment for captive rhesus monkeys (Macaca mulatta). Applied Animal Behavior Science 52: 139–155.
View Article
Google Scholar

[111] View Article

[112] Google Scholar

[ref41] 41. Nahm FKD, Perret A, Amaral DG, Albright TD (1997) How do monkeys look at faces? Journal of Cognitive Neuroscience 9: 611–623.
View Article
Google Scholar

[114] View Article

[115] Google Scholar

[ref42] 42. Mosher CP, Zimmerman PE, Gothard KM (2011) Videos of conspecifics elicit interactive looking patterns and facial expressions in monkeys. Behavioral Neuroscience 125: 639–652.
View Article
Google Scholar

[117] View Article

[118] Google Scholar

[ref43] 43. Rudebeck PH, Buckley MJ, Walton ME, Rushworth MF (2006) A role for the macaque anterior cingulate gyrus in social valuation. Science 313: 1310–1312.
View Article
Google Scholar

[120] View Article

[121] Google Scholar

[ref44] 44. Olsson A, Ochsner KN (2008) The role of social cognition in emotion. Trends in Cognitive Science 12: 65–71.
View Article
Google Scholar

[123] View Article

[124] Google Scholar

[ref45] 45. Machado CJ, Nelson EE (2011) Eye-tracking with nonhuman primates is now more accessible than ever before. American Journal of Primatology 73: 562–569.
View Article
Google Scholar

[126] View Article

[127] Google Scholar

[ref46] 46. Steinhauer SR, Siegle GJ, Condray R, Pless M (2004) Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. International Journal of Psychophysiology 52: 77–86.
View Article
Google Scholar

[129] View Article

[130] Google Scholar

[ref47] 47. Steinhauer SR, Hakerem G (1992) The pupillary response in cognitive psychophysiology and schizophrenia. Annals of the New York Academy of Sciences 658: 182–204.
View Article
Google Scholar

[132] View Article

[133] Google Scholar

[ref48] 48. Friedman D, Hakerem G, Sutton S, Fleiss JL (1973) Effect of stimulus uncertainty on the pupillary dilation response and the vertex evoked potential. Electroencephalography and Clinical Neurophysiology 34: 475–484.
View Article
Google Scholar

[135] View Article

[136] Google Scholar

[ref49] 49. Siegle GJ, Granholm E, Ingram RE, Matt GE (2001) Pupillary and reaction time measures of sustained processing of negative information in depression. Biological Psychiatry 49: 624–636.
View Article
Google Scholar

[138] View Article

[139] Google Scholar

[ref50] 50. Siegle GJ, Steinhauer SR, Thase ME (2004) Pupillary assessment and computational modeling of the Stroop task in depression. International Journal of Psychophysiology 52: 63–76.
View Article
Google Scholar

[141] View Article

[142] Google Scholar

[ref51] 51. Franzen PL, Buysse DJ, Dahl RE, Thompson W, Siegle GJ (2009) Sleep deprivation alters pupillary reactivity to emotional stimuli in healthy young adults. Biological Psychology 80: 300–305.
View Article
Google Scholar

[144] View Article

[145] Google Scholar

[ref52] 52. Silk JS, Dahl RE, Ryan ND, Forbes EE, Axelson DA, et al. (2007) Pupillary reactivity to emotional information in child and adolescent depression: links to clinical and ecological measures. American Journal of Psychiatry 164: 1873–1880.
View Article
Google Scholar

[147] View Article

[148] Google Scholar

[ref53] 53. Keating CF, Keating EG (1982) Visual scan patterns of rhesus monkeys viewing faces. Perception 11: 211–219.
View Article
Google Scholar

[150] View Article

[151] Google Scholar

[ref54] 54. Keating CF, Keating EG (1993) Monkeys and mug shots: cues used by rhesus monkeys (Macaca mulatta) to recognize a human face. Journal of Comparative Psychology 107: 131–139.
View Article
Google Scholar

[153] View Article

[154] Google Scholar

[ref55] 55. Gothard KM, Erickson CA, Amaral DG (2004) How do rhesus monkeys (Macaca mulatta) scan faces in a visual paired comparison task? Animal Cognition 7: 25–36.
View Article
Google Scholar

[156] View Article

[157] Google Scholar

[ref56] 56. Hirata S, Fuwa K, Sugama K, Kusunoki K, Fujita S (2010) Facial perception of conspecifics: chimpanzees (Pan troglodytes) preferentially attend to proper orientation and open eyes. Animal Cognition 13: 679–688.
View Article
Google Scholar

[159] View Article

[160] Google Scholar

[ref57] 57. Kano F, Tomonaga M (2009) How chimpanzees look at pictures: a comparative eye-tracking study. Proceedings of the Royal Society London Biological Sciences 276: 1949–1955.
View Article
Google Scholar

[162] View Article

[163] Google Scholar

[ref58] 58. Kano F, Tomonaga M (2010) Face scanning in chimpanzees and humans: Continuity and discontinuity. Animal Behaviour 79: 227–235.
View Article
Google Scholar

[165] View Article

[166] Google Scholar

[ref59] 59. Ekman P, Friesen WV (1975) Unmasking the face: A guide to recognizing emotions from facial cues. Oxford, England: Prentice-Hall. 212 p.

[ref60] 60. Walker-Smith GJ, Gale AG, Findlay JM (1977) Eye movement strategies involved in face perception. Perception 6: 313–326.
View Article
Google Scholar

[169] View Article

[170] Google Scholar

[ref61] 61. Wilson FA, Goldman-Rakic PS (1994) Viewing preferences of rhesus monkeys related to memory for complex pictures, colours and faces. Behavioural Brain Research 60: 79–89.
View Article
Google Scholar

[172] View Article

[173] Google Scholar

[ref62] 62. Watson KK, Ghodasra JH, Platt ML (2009) Serotonin transporter genotype modulates social reward and punishment in rhesus macaques. PLoS One 4: e4156.
View Article
Google Scholar

[175] View Article

[176] Google Scholar

[ref63] 63. Dorr M, Martinetz T, Gegenfurtner KR, Barth E (2010) Variability of eye movements when viewing dynamic natural scenes. Journal of Vision 10: 1–17.
View Article
Google Scholar

[178] View Article

[179] Google Scholar

[ref64] 64. Itti L (2005) Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition 12: 1093–1123.
View Article
Google Scholar

[181] View Article

[182] Google Scholar

[ref65] 65. Andreassi JL (2000) Pupillary response and behavior. In: Andreassi JL, editor. Psychophysiology: Human behavior and physiological response. Mahwah, NJ: Lawrence Erlbaum Associates. pp. 218–233.

[ref66] 66. Stern RM, Ray WJ, Quigley KS (2001) Eyes: Pupillography and electrooculography. In: Stern RM, Ray WJ, Quigley KS, editors. Psychophysiological Recording. New York, NY: Oxford University Press. pp. 125–141.

[ref67] 67. Clarke RJ, Zhang H, Gamlin PDR (2003) Characteristics of the pupillary light reflex in the alert rhesus monkey. Journal of Neurophysiology 89: 3179–3189.
View Article
Google Scholar

[186] View Article

[187] Google Scholar

[ref68] 68. Johnson LN, Hill RA, Bartholomew MJ (1988) Correlation of afferent pupillary defects with visual field loss on automated perimetry. Opthalmology 95: 1649–1655.
View Article
Google Scholar

[189] View Article

[190] Google Scholar

[ref69] 69. Kardon RH (1995) Pupil perimetry. In: Tusa RJ, Newman SA, editors. Neuro-ophthalmological Disorders: Diagnostic Work-up and Management. New York: Dekker. pp. 421–436.

[ref70] 70. Thompson HS, Montague P, Cox TA, Corbett JJ (1982) The relationship between visual acuity, pupillary defect and visual field loss. American Journal of Ophthalmology 93: 681–688.
View Article
Google Scholar

[193] View Article

[194] Google Scholar

[ref71] 71. Chevalier-Skolnikoff S (1973) Facial expression of emotion in nonhuman primates. In: Ekman P, editor. Darwin and Facial Expression. New York: Academic Press. pp. 11–89.

[ref72] 72. Van Hooff JA (1967) The facial displays of the catarrhine monkeys and apes. In: Morris D, editor. Primate Ethology. Chicago: Aldine Publishing Company. pp. 7–68.

[ref73] 73. Hoehn-Saric R, McLeod DR (1988) The peripheral sympathetic nervous system. Its role in normal and pathologic anxiety. Psychiatric Clinics of North America 11: 375–386.
View Article
Google Scholar

[198] View Article

[199] Google Scholar

[ref74] 74. van den Buuse M, Van Acker SA, Fluttert M, De Kloet ER (2001) Blood pressure, heart rate, and behavioral responses to psychological “novelty” stress in freely moving rats. Psychophysiology 38: 490–499.
View Article
Google Scholar

[201] View Article

[202] Google Scholar

[ref75] 75. Nijsen MJ, Croiset G, Diamant M, Broekhoven MH, De Wied D, et al. (1998) Vagal activation in novelty-induced tachycardia during the light phase in the rat. Physiology & Behavior 63: 233–239.
View Article
Google Scholar

[204] View Article

[205] Google Scholar

[ref76] 76. Mendoza SP, Mason WA (1997) Autonomic balance in Saimiri sciureus and Calicebus moloch: Relation to life-style. Folia Primatologica 68: 307–318.
View Article
Google Scholar

[207] View Article

[208] Google Scholar

[ref77] 77. Weisz J, Czigler I (2006) Age and novelty: Event-related brain potentials and autonomic activity. Psychophysiology 43: 261–271.
View Article
Google Scholar

[210] View Article

[211] Google Scholar

[ref78] 78. Barry RJ, Sokolov EN (1993) Habituation of phasis and tonic components of the orienting reflex. International Journal of Psychophysiology 15: 39–42.
View Article
Google Scholar

[213] View Article

[214] Google Scholar

Social and Nonsocial Content Differentially Modulates Visual Attention and Autonomic Arousal in Rhesus Macaques

Social and Nonsocial Content Differentially Modulates Visual Attention and Autonomic Arousal in Rhesus Macaques

Correction

Figures

Abstract

Introduction

Materials and Methods

Ethics statement

Subjects and living conditions

Training

Video catalog

Video passive viewing task

Data analysis

Results

Discussion

Supporting Information

Table S1.

Table S2.

Table S3.

Video S1.

Video S2.

Video S3.

Video S4.

Video S5.

Video S6.

Acknowledgments

Author Contributions

References