We read conspecifics' social cues effortlessly, but little is known about our abilities to understand social gestures of other species. To investigate the neural underpinnings of such skills, we used functional magnetic resonance imaging to study the brain activity of experts and non-experts of dog behavior while they observed humans or dogs either interacting with, or facing away from a conspecific. The posterior superior temporal sulcus (pSTS) of both subject groups dissociated humans facing toward each other from humans facing away, and in dog experts, a distinction also occurred for dogs facing toward vs. away in a bilateral area extending from the pSTS to the inferior temporo-occipital cortex: the dissociation of dog behavior was significantly stronger in expert than control group. Furthermore, the control group had stronger pSTS responses to humans than dogs facing toward a conspecific, whereas in dog experts, the responses were of similar magnitude. These findings suggest that dog experts' brains distinguish socially relevant body postures similarly in dogs and humans.
Citation: Kujala MV, Kujala J, Carlson S, Hari R (2012) Dog Experts' Brains Distinguish Socially Relevant Body Postures Similarly in Dogs and Humans. PLoS ONE 7(6): e39145. doi:10.1371/journal.pone.0039145
Editor: Giuseppe di Pellegrino, University of Bologna, Italy
Received: October 24, 2011; Accepted: May 19, 2012; Published: June 13, 2012
Copyright: © 2012 Kujala et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by the Academy of Finland (National Centers of Excellence Program 2006–2011, and NEURO program), ERC Advanced Grant #232946, Sigrid Jusélius Foundation, Signe and Ane Gyllenberg Foundation, Foundations' Post Doc Pool (Kone Foundation), UI-ART MIDE Program and the aivoAALTO project of the Aalto University, and the Finnish Graduate School of Neuroscience. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Inspecting social interaction between two people from a third-person viewpoint engages brain areas supporting the analysis of human bodies, facial expressions, biological motion, and theory of mind , . However, humans are not limited to understanding the behavior of other humans but can become expert interpreters of the gestural communication of other species, especially social mammals, such as domestic dogs. Even persons who have never owned a dog may recognize a dog's emotional state .
Earlier results propose that the brain mechanisms underlying human social cognition are utilized in the perception of non-human animals. For example, humans distinguish the direction of apparent movement from point-light walkers, irrespective of whether the walker represents a human or a non-human animal . Moreover, the electrophysiological 140–170-ms face-sensitive brain responses, that are most prominent for human faces, are stronger to animal faces than to objects, such as tools or furniture . Furthermore, when humans see a dog biting a piece of food, their motor mirroring network is activated in a similar manner as during viewing a comparable action of a human being . Although the perception of non-human animals thus seems to be supported by similar neural mechanisms as the perception of conspecific human beings, the common and distinct aspects of processing social behavior of humans and non-human animals remain largely unknown.
Here, we investigated brain processes involved during observation of social interaction between two humans or two dogs. Since dog enthusiasts have a vast experience of observing dog behavior, we specifically tested whether such expertise would affect the observer's brain activity during observation of interaction of dogs. For this purpose, we measured functional magnetic resonance imaging (fMRI) signals from subjects observing photos of two humans or two dogs either interacting (facing towards each other) or not interacting (facing away); crystallized photos served as control stimuli (Figure 1).
Figure 1. Examples of stimuli and eye gaze patterns.
Left column: Examples of stimuli where dogs and humans were either engaged in face-to-face interaction (toward) or facing away from each other (away); the pixelated and crystallized versions of the human and dog photos (pixel) served as controls. Middle and right columns: The average eye gaze maps for experts and control subjects, respective to the stimuli on the left. The average fixation durations are color-coded (minimum of 5 ms indicated by light blue and the maximum of 200 ms or over by bright red).doi:10.1371/journal.pone.0039145.g001
Two subject groups participated in the study: (i) experts in dog behavior who were extensively involved in dog training and activities such as agility, obedience training, and game hunting, and (ii) a group of control subjects with no particular expertise with dogs. We expected that brain regions processing social interaction of humans would also process social interaction of dogs, at least in experts, and distinguish between the two interactive conditions (facing toward and facing away) for dogs as they do for humans .
Expertise, empathy and mental state attribution
The background questionnaire quantified the group differences in expertise of dog behavior (Ownership, Experience, Attachment and Knowledge). As expected, experts scored higher than the control group in all measures. The Ownership questionnaire confirmed that none of the control subjects owned a dog (only 4/18 control subjects had had a dog in the family earlier when they were children) whereas 17/19 dog experts owned at least one dog (difference statistically significant with Z = 2.7, P<0.001, two-sample Kolmogorov-Smirnov test). According to the Experience questionnaire, 8/19 experts and 0/18 control subjects had over 15 years of experience on dog behavior; 17/18 control subjects had zero experience (Z = 2.7, P<0.001). According to the Attachment questionnaire, 16/19 experts and 0/18 control subjects liked dogs extremely much (Z = 2.6, P<0.001), and the Knowledge questionnaire revealed that 14/19 experts but 0/18 control subjects had very much or extremely much knowledge of dog behavior (Z = 2.4, P<0.001).
The empathy scale (IRI) scores did not differ between expert and control groups in any subcategory (mean ± SD scores on perspective taking 17±4 and 17±5 for experts and controls, respectively, P = 0.7, multivariate GLM; fantasy scale 17±6 and 16±6, P = 0.7; emotional concern 18±5 and 17±5, P = 0.8; personal distress 10±4 and 9±3, P = 0.4).
The free written commentaries in the background questionnaire were answered by 89% of the dog experts and 67% of the control subjects. Dog experts made more inferences of dogs' mental states than did control subjects (18 and 5 inferences, respectively, Z = 3.1, P = 0.002, independent-samples Mann-Whitney U-test), whereas the number of mental state inferences of humans were equal (10 by experts and 8 by controls). No statistically significant differences were found in either group between mental state inferences of dogs and humans (18 dog and 10 human mental inferences by experts, T = 1.8, P = 0.072; 5 dog and 8 human inferences by control subjects, T = 1.0, P = 0.317, Wilcoxon signed ranks tests).
In general, the experts commented the dog photos in more detail, e.g. “the poodle was a bit reserved”, “all dogs were female”, and “young, friendly, and playful dogs”, whereas the control subjects commented them more generally by “I couldn't always separate the poodle's head from the tail”, “dogs were often interested of one another”, and “dogs seemed to be in their natural surroundings”. Both groups also declared having imagined figurines in the Pixel condition (5/19 dog experts; 6/18 control subjects).
Figure 1 shows examples of the eye gaze patterns. Depending on the condition, the subjects spent on average 977–1465 ms out of the total 2500-ms stimulus presentation time in viewing the dog and human ROIs (see Table 1). Due to technical artifacts (e.g. eye blinking), the sum of all fixation times per stimulus (including the background scenery) was 1672±41 ms (mean ± SEM across conditions and subjects).
Table 1. Mean ± SEM fixation durations (in ms) to dog and human stimulus ROIs and the background, averaged across subjects.doi:10.1371/journal.pone.0039145.t001
The total fixation durations to the heads and bodies of the creatures (both humans and dogs) did not differ between experts and control subjects (between-subjects factor group, F1,21 = 0.2, P = 0.7, repeated-measures ANOVA). Instead, a main effect of behavior was found (F1,21 = 67.8, P<0.001), as well as interaction effects between species×body part (F1,21 = 12.4, P = 0.002), behavior×body part (F1,21 = 40.7, P<0.001), and species×behavior×body part (F1,21 = 10.9, P = 0.003). The planned comparisons clarifying the ANOVA results showed that both human and dog heads received longer fixations in toward than away conditions (mean ± SEM fixation durations to dog heads were 462±56 ms longer in toward than away condition across groups, t22 = 8.3, P<0.001 and fixations to human heads were 329±54 ms longer in toward than away condition, t22 = 6.1; P<0.001; paired-samples t-tests), whereas the dog bodies received 168±38 ms longer fixations in away than toward condition (t22 = 4.5, P<0.001); fixations to human bodies did not differ between stimulus conditions. Furthermore, dog heads received 262±50 ms longer fixations than human heads in toward condition (t22 = 5.5, P<0.001) and 142±51 ms longer fixations in away condition (t22 = 2.7, P = 0.01), whereas the human bodies received 170±61 ms longer fixations than dog bodies in toward condition (t22 = 3.0, P = 0.007); fixation durations between human and dog bodies did not differ in the away condition.
The fixation durations to dog tails did not differ between groups nor conditions. However, the head/body ratios of fixation durations were smaller in experts than control subjects in both Dog_toward and Dog_away conditions (head/body ratio of experts 2.2±0.4 and controls 4.2±0.7 during Dog_toward: F21 = 5.3, P = 0.03, and head/body ratio of experts 0.7±0.1 and controls 1.2±0.2 during Dog_away: F21 = 4.8, P = 0.04, one-way ANOVA), whereas no statistical difference was reached for human stimuli (Human_toward: F21 = 2.4, P = 0.1; Human_away: F21 = 1.4, P = 0.3).
Brain activations related to perception of dogs
The overall brain activations were very similar in both groups: dogs (“Dogs vs. Rest”; Figure 2 top panels) activated e.g. the occipital cortex, the temporal poles, amygdala, posterior superior temporal sulcus (pSTS), inferior frontal gyrus (IFG) and dorsomedial frontal cortex bilaterally. The activation map was very similar to the one acquired with the human stimuli in the contrast “Humans vs. Rest” in control subjects (see our previous report from the same subjects ). Pixel images activated other parts of this circuitry except the pSTS and amygdala.
Figure 2. Brain activation of dog experts and control subjects in two-way statistical maps.
Top panel: Dogs (Dog_toward+Dog_away). Middle panel: Activation to Dogs vs. Pixels. Bottom panel: Activation to Dogs vs. Humans. The FDR-corrected statistical maps (q<0.05) are overlaid on the anatomical MR image averaged across all subjects. Red-yellow: stronger activation in [first] vs. [second] stimulus category, blue-green: stronger activation in [second] vs. [first] category. Temp pole = temporal pole, pSTS = posterior superior temporal sulcus, IFG = inferior frontal gyrus, FG = fusiform gyrus, Post Cing = posterior cingulate, ITG = inferior temporal gyrus, IPS = intraparietal sulcus. Exp = experts, Con = controls.doi:10.1371/journal.pone.0039145.g002
The contrast “Dogs vs. Pixel” assessed physical differences between the stimuli and revealed stronger responses to dog than pixel images e.g. in the temporal poles, left fusiform gyrus (FG), bilateral pSTS conjoined with the temporoparietal junction, and posterior cingulate in both experts and control subjects (Figure 2, middle panels).
Both groups exhibited stronger activation to human than dog stimuli in the amygdala and the right pSTS, and control subjects also in the left pSTS and inferior temporal gyrus (ITG); the difference was most prominent in the right pSTS of the control subjects (see the blue-green color in the bottom section of Figure 2). In both groups, activation was stronger to dog than human stimuli in the intraparietal sulcus (IPS) bilaterally and in the early visual areas of the occipital cortex (Figure 2, bottom panels; orange-yellow).
Activation of posterior temporal lobe linked to expertise on dog behavior
Brain processing influenced by the social interaction within the observed snapshot photos was inspected by contrasting conditions in which humans and dogs were facing toward a conspecific with the conditions in which they were facing away from a conspecific (Human_toward vs. Human_away and Dog_toward vs. Dog_away); see Figure 3 (top panel for experts and bottom panel for control subjects).
Figure 3. Distinction of interaction in experts and control subjects.
Brain activation in pSTS in the contrasts Dog_toward>Dog_away (red) and Human_toward>Human_away (blue) and their overlap (yellow) in experts and control subjects. The location of the axial plane is indicated in the coronal image. All contrasts are shown at q (FDR)<0.05.doi:10.1371/journal.pone.0039145.g003
In both groups, the pSTS was activated more strongly in the Human_toward than Human_away condition (blue color in Figure 3). Stronger activity to Human_toward vs. Human_away condition was also seen in bilateral amygdala of both groups; for detailed discussion about the results of control subjects, see . No statistically significant difference was detected in control subjects between Dog_toward and Dog_away conditions whereas in experts, several brain regions (frontal, parietal, insular and temporal regions) showed stronger activation to Dog_toward than Dog_away stimuli (see Table 2). In pSTS, the activation revealed by the Dog_toward>Dog_away contrast overlapped in both hemispheres with activation seen in the Human_toward>Human_away contrast (Figure 3 top).
Table 2. Brain activations of both groups for dogs facing toward each other vs. control conditions.doi:10.1371/journal.pone.0039145.t002
Additionally, the the scores of the expertise questionnaires were positively correlated with the magnitudes of brain activity within the pSTS during the “Dog_toward>Dog_away” contrast: all measures correlated statistically significantly with the right pSTS (Ownership R = 0.39, P<0.05; Experience R = 0.41, P<0.05; Attachment R = 0.41, P<0.01 and Knowledge R = 0.41, P<0.05) and Experience and Attachment measures correlated with the left pSTS (Experience R = 0.35, P<0.05; Attachment R = 0.39, P<0.05).
Furthermore, the difference between Dog_toward vs. Dog_away conditions was stronger in experts than in the control group throughout the left hemisphere, as well as within the two most ventral ROIs of the right hemisphere [Figure 4; z coordinate = 4: F1, 35 = 9.749, P = 0.004 (left hemisphere); z = −1: F1, 35 = 5.994, P = 0.02 (left) and F1, 35 = 15.163, P<0.001 (right), z = −6: F1, 35 = 8.233, P = 0.007 (left) and F1, 35 = 7.048, P = 0.01 (right), one-way ANOVA].
Figure 4. Difference between experts and control subjects in distinguishing body postures of dogs.
Left: The locations of the three ROIs vertically adjacent to each other overlaid on the cortical surface. Right: Experts had stronger differences between Dog_toward – Dog_away conditions than control subjects at the two most ventral ROIs of right hemisphere (z = −1 and z = −6). There were no group differences in the signal change between Human_toward – Human_away conditions. ** p = 0.01, *** p<0.001.doi:10.1371/journal.pone.0039145.g004
Instead, the groups had equal response differences between Human_toward vs. Human_away conditions throughout vertically adjacent ROIs in both hemispheres (rightmost histogram in Figure 4).
Sensitivity for conspecifics in amygdala?
In the Dog_toward vs. Human_toward contrast (Figure 5), the amygdala was activated less to Dog_toward than Human_toward in both experts and control subjects (depicted in blue in the leftmost slices of Figure 5), whereas the early visual areas were activated more strongly to Dog_toward than Human_toward (depicted in red–yellow in Figure 5). In dog experts, also the bilateral inferior temporo-occipital cortex (left upper corner in Figure 5), and right IFG, right IPS, right dorsal hippocampus, and right superior parietal gyrus were activated more strongly to Dog_toward than Human_toward stimuli (Table 2). Control subjects, but not experts, had weaker activation to Dog_toward than Human_toward stimuli also in the bilateral pSTS (depicted in blue in Figure 5).
Figure 5. Brain activation to dogs vs. humans facing a conspecific.
Differences in brain activation between Dog_toward and Human_toward at q (FDR)<0.05. Activation was stronger to Human_toward than Dog_toward in the amygdala of both groups (left panel), and in the pSTS of control subjects only (bottom right). Activation to Dog_toward was stronger than to Human_toward in the inferior temporo-occipital cortex of dog experts (top left). Smaller cluster size of k = 3 is used here to visualize the bilaterality of amygdala activation. Stronger activation to Dog_toward than Human_toward is depicted in blue color, and stronger activation to Human_toward than Dog_toward is depicted in red-yellow color.doi:10.1371/journal.pone.0039145.g005
Observation of dogs in natural settings: the roles of mentalizing, visual perception and perspective-taking
In agreement with our expectations, the brain regions involved in processing of social interaction between humans also seemed to support observation of social interaction of dogs. The overall activation during observation of dogs (“Dogs vs. Rest”) was very similar in dog experts and control subjects, comprising areas that have been previously associated with socio-emotional processing, such as analysis of human bodies –, biological motion –, faces –, gestures or expressions – and mentalizing –. The results suggest that generally, the social interaction of dogs is processed in the regions that also process human social cues, in both experts and non-experts of dog behavior.
Both dog experts and control subjects had stronger activation to dog than pixel images (“Dogs vs. Pixels”) in the temporal poles, pSTS, and posterior cingulate cortex, i.e. in brain areas that have been associated with various aspects of social cognition and mentalizing –. Although the subjects reported having made mental inferences, the dorsomedial prefrontal cortex (dmPFC), a part of the mentalizing circuitry (for review, see , ), showed no differential activity in the contrast “Dogs vs. Pixels” or “Dogs vs. Humans” in either group.
Previously, dmPFC activation has been often observed during tasks that require the subjects to make mental state inferences of persons whose gestures they do not see (e.g. , , ). However, visual perspective tasks, where subjects evaluated what other persons would see, have lacked dmPFC activation (e.g. , ), similarly as happened in the current study where the subjects had to interpret the observed bodily gestures in order to deduce the social interaction.
In one of the rare studies where subjects were observing two-person interactions, dmPFC activation differentiated “communicative intentions” from “private intentions” . Furthermore, the dmPFC activation is found to be strengthened with the feeling of “personal presence” of the viewer to the social interaction . We would like to emphasize that our basic contrasts “Dogs vs. Humans” and “Dogs vs. Pixels” did not differentiate between the interaction levels. However, the contrast Human_toward>Human_away revealed dmPFC activation in the control group, as reported earlier , and in the current study, the dog expert group (but not the control group), showed dmPFC activation in the “Dog_toward>Dog_away” contrast. These results agree with Walter and colleagues , since our “toward” conditions showed more communicative intention than ”away” conditions, suggesting that the dog communicative intentions were only detected by the dog expert group.
According to the IRI scores, the general empathy and perspective-taking abilities of our dog expert and control groups did not differ. Although the IRI samples empathy and perspective-taking toward humans instead of animals, one could have assumed that dog experts have over-developed perspective-taking abilities. Our results do not support this view, as the perspective-taking scores were not different between the groups. Altogether, our data thus suggest that expertise in dog behavior is not explained by differences in the mentalizing abilities between dog experts and control subjects. Instead, dog expertise seems to be more related to improved visual reading of the dogs' body postures. This interpretation is supported by the eye-tracking data that showed that the experts, compared with the control group, gazed relatively more the dog bodies than dog heads.
Expertise affects the processing of dog interaction in pSTS and inferior temporo-occipital regions
The main aim of the present study was to investigate how the experience-derived expertise in dog behavior affects brain activation related to inspection of body postures reflecting social interaction between dogs. During observation of dog photos, activity in the frontal, temporal and parietal areas in the expert group, but not in the control subjects, differed between dogs facing toward and dogs facing away from each other. Furthermore, the lateral temporo-occipital cortex (pSTS region) was activated similarly in both groups to human photos but differently to dog photos. The dog experts' pSTS activation overlapped in the Human_toward>Human_away and in the Dog_toward>Dog_away contrasts, whereas in control subjects, the pSTS was activated only in the Human_toward>Human_away contrast.
The voxel cluster that showed a significant signal change in dog experts in the Dog_toward vs. Dog_away contrast continued from the pSTS (associated with biological motion – and social cues derived from eyes and bodies (for review, see )) ventrally to the inferior temporo-occipital regions associated with object processing (e.g. , , , ).
Recently, the pSTS has been shown to differentiate human motion from dog motion , but its activation is also modified by the level of human social interaction detected from visual cues , , . Our data agree with these findings showing that the pSTS activation is modulated by the observed species (dog or human), the level of social interaction and, in addition, by the expertise of the subjects regarding the other species (dogs). In control subjects, the pSTS reacted stronger to interacting humans than to interacting dogs, without differences between dogs interacting and facing away. In the dog experts, on the other hand, activity in the pSTS did not differ between interacting humans and interacting dogs, but it differentiated between dogs interacting and facing away.
Additionally, the positive correlation between the pSTS activation of both hemispheres with the involvement of the subjects in dog behavior (the questionnaire factor Experience) and with their attachment to dogs (factor Attachment) suggest that the subjects' pSTS activation reflects the behavioral relevance of the social cues, even when they are seen from non-conspecifics.
Furthermore, the group comparison of signal changes within the ROIs in the temporo-occipital cortex showed that the signal difference between the Dog_toward and Dog_away conditions was stronger in experts than in control subjects in all ROIs of the left hemisphere and in the two most ventral ROIs of the right hemisphere. Thus also the lateral occipital cortex that is sensitive to object processing seems to be involved in the expertise of other species, especially in the right hemisphere. In fact, the common stimuli used in functional localization of the object-selective cortex include pictures of living creatures such as cats , dogs, or other animals , implying that besides inanimate objects, the area contributes to visual perception of animals. Furthermore, acquiring expertise in identifying objects increases response strength in the right lateral occipital gyrus and modifies the spatial distribution of activity . Our results agree with the previous finding.
Earlier, expertise-related modulation of brain activity has been demonstrated in the fusiform gyrus in e.g. bird and car experts . Although the focus of this study was not in this area, we did not find any differential FG processing between groups in the contrast Dogs vs. Humans.
Eye gaze patterns during observation of social interaction
The total fixation durations to ROI regions (heads, bodies or tails) did not differ statistically significantly between experts and control subjects. In general, dog heads were fixated longer than human heads regardless of the condition, which may be due to the relatively bigger area of the stimuli covered by dog than human heads (mean 4704 vs. 2942 pixels, respectively). The total fixation time to both human and dog heads was longer in the toward than away conditions. The differences may be affected by the structure of the photos: in the toward conditions, the heads of both dogs and humans were close to each other–and close to the center of the photo–whereas in the away conditions, the distance between the heads was longer (as was the time between the fixations to the creatures). Alternatively, since gaze following is rather automatic (for a review, see ), gazes of humans/dogs in the toward condition guided the subject's gaze from one head to another, whereas in the away condition, the subjects spent more time following the gazes pointing elsewhere. These explanations also apply to longer fixation durations to dog bodies in the away than toward condition, since dog bodies were closer to each other in the away than toward condition and dog's gazes pointed away from each other.
Independently of the above low-level visual factors, the head/body ratio of fixation durations was smaller for experts than control subjects in both Dog_toward and Dog_away conditions, suggesting that the dog experts' gaze, compared with the control subjects' gaze, landed relatively longer to dog bodies than dog heads. The eye gaze is strongly task-dependent , and the results of the head/body ratio suggest that when the task was to inspect the attitudes of the interacting agents, experts in dog behavior spent a relatively longer time reading body than head postures of dogs compared with control subjects. The result is in line with previous data showing that humans who do not own pets, view dog faces with similar eye gaze patterns than human faces, i.e., by scanning mostly the eyes in both humans and non-human animals .
Importantly, the head/body ratio effect applied both to Dog_toward and Dog_away conditions, suggesting that the differences in brain activation observed in the pSTS and inferior temporo-occipital regions of experts between Dog_toward and Dog_away conditions were not due to differences in the fixation duration. However, the eye gaze data suggest that the experts were able to extract the social bodily gestures in both conditions better than control subjects, enabling them to distinguish the social situation.
Human-sensitive responses in processing social interaction
The present study explored similarities and differences in neural processing of socially relevant body postures of humans and dogs. Both in experts and control subjects, observing photos of two interacting dogs elicited activation in the social brain circuitry in a very similar fashion than was previously shown for observing two interacting humans . The direct contrasts of “Dogs vs. Humans” and “Dog_toward vs. Human_toward” also revealed some processing differences between the human and dog stimuli: visual cortex activation around the calcarine sulcus was, in both groups, stronger to dog than human pictures. This difference probably reflects the effect of slightly different filming conditions between these two types of stimuli: the background texture was more salient and contained more shadows in the dog than human stimuli.
The contrasts “Dogs vs. Humans” and “Dog_toward vs. Human_toward” also show stronger activations to humans than dogs in pSTS and amygdala. The pSTS activity was modified by expertise in dog behavior, but the activity in the amygdala was stronger for humans than dogs in both groups, regardless of the dog expertise. Activation in amygdala was stronger for humans than dogs in general (Dogs vs. Humans), stronger for interacting humans in Human_toward>Human_away contrast, and stronger for interacting humans than interacting dogs (Human_toward>Dog_toward). Our results are in line with the findings that amygdala activation differentiates faces of humans from those of dogs  and motion of humans from that of dogs . The finding that the amygdala was activated only to human face-to-face interaction, but not to dog face-to-face interaction, suggests that the amygdala is sensitive to the human inter-personal distance viewed from the third-person perspective. The results of the current study further suggest that the amygdala is sensitive to inter-personal distance between other humans, but not between dogs.
Materials and Methods
Altogether 42 healthy subjects participated in the measurements: 3 subjects in the pilot recordings, and 20 dog experts and 19 control subjects in the main study that comprised simultaneous fMRI and eye gaze measurements; subsequently, the subjects filled in behavioral questionnaires sampling empathy, exposure to dog behavior and mental state attribution (see details of the participants in Table 3). The study had a prior approval by the ethics committee of the Helsinki and Uusimaa district. All participants gave their written informed consent prior to the experiment, and a similar consent was also obtained from the actors before they were videotaped and photographed for stimulus production.
Table 3. Details of the participants in each of the measurements.doi:10.1371/journal.pone.0039145.t003
Since experience plastically modifies neural function , expertise requirements in the study were based on active behavioral experience and exposure to dogs' behavior. Selection criteria of the dog expert group included long-lasting involvement in hobbies such as agility, dog obedience training, or game hunting, experience of dog behavior in dog-related jobs (veterinarians or dog-training teachers) in addition to currently owning one or more pet dogs. The participants of the control group did not own a dog, nor did they have extensive experience of dogs or a fear of them. Participants in both groups were selected after a short e-mail interview sampling the above requirements.
In the fMRI analysis, data from 2 female subjects were discarded due to excessive head motion, and thus both fMRI data and behavioral questionnaires were fully analyzed from 19 experts (11 females and 8 males, 18–39 years, mean ± SD 30.1±5.3 years) and 18 control subjects (9 females and 9 males, 19–41 years, mean ± SD 28.3±6.8 years). The subject age did not differ statistically significantly between the groups (t36 = 0.9, P = 0.4; two-tailed independent-samples t-test). Seventeen out of 19 experts and 17/18 control subjects were right-handed according to the Edinburgh Handedness Inventory : on the scale from −1 (left) to +1 (right), the mean ± SD score for the expert group was 0.71±0.46 (range −1 to 1) and for the control group 0.77±0.41 (range −0.9 to 1). Subjects were compensated monetarily for the lost working hours and travel expenses.
Successful eye gaze recordings were obtained from 12 dog experts (8 females, 4 males, 18–43 years, mean ± SD 30.1±5.4 years) and 11 control subjects (4 females, 7 males, 19–41 years, mean ± SD 27.0±7.3). The subject ages did not differ between the groups (t21 = 1.9, P = 0.06; independent-samples t-test).
After the fMRI acquisition, the subjects filled in a background questionnaire concerning their expertise of dog behavior, with answers distributed to a five-point scale from 0 (min) to 4 (max), and an empathy questionnaire (Interpersonal Reactivity Index, IRI by ). The background questionnaire for expertise sampled the following features: (i) Ownership: How many dogs the subject currently owns (0 = none, 1 = one dog, 2 = two to three dogs, 3 = four to five dogs, 4 = more than five dogs), (ii) Experience: How many years the subject has been actively involved in dog training or hobby activities, e.g. agility or game hunting (0 = none, 1 = 1–5 yrs, 2 = 6–10 yrs, 3 = 11–15 yrs, 4 = over 15 years), (iii) Attachment: How much the subject likes dogs (0 = not at all, 1 = a little, 2 = some, 3 = very much, 4 = extremely much, (iv) Knowledge: How much the subject knows about dog behavior (0 = nothing, 1 = a little, 2 = some, 3 = very much, 4 = extremely much).
The questionnaire also included free space for elaborating the subject's dog- training expertise or other involvement in dog breeding, agility sports, obedience training, or equivalent. Moreover, the subjects were encouraged to write free commentaries on stimulus photos or the experiment to reveal their attention and reasoning during the scan. To check whether participants inferred the mental states of the individuals, one of the experimenters reviewed the free recall answers for descriptions of mental states or social references (“happy”, “playful”, “acting like they don't notice the other”, “were getting along well”), and tested them with the nonparametric independent-samples Mann-Whitney U-tests and Wilcoxon signed ranks tests.
Multivariate general linear model (GLM) was used to reveal possible statistically significant differences in empathy subscales between experts and control subjects, as well as between males and females, and the statistical significance of differences between experts and control subjects in the questionnaire scores was tested with the nonparametric Kolmogorov-Smirnov test.
For stimulus materials, students from the Theatre Academy of Finland and dogs and their owners from the local dog club (Espoon koirakerho) were recruited as “actors” in two separate filming sessions in the sand fields of nearby recreational parks. Both humans and dogs were filmed and photographed individually while they were inspecting their surroundings, and together with a conspecific while they were either ignoring or interacting with one another. This procedure resulted in 3810 still photos.
Ten photos from 4 actor pairs and 4 dog pairs were selected in both conditions, resulting in 40 photos per category. The pictures fulfilled the following criteria: (i) the photo was technically in focus and clearly presented the event in question (e.g. interaction between actors), (ii) the photos of the same category showed similar body orientations of the actors of the two species, (iii) a variety of different postures were captured for each actor (i.e. the different photos of one actor did not appear identical). Actors in the human stimuli were 2 males and 2 females, and the dogs in the dog stimuli were a French bulldog, a great dane, a cocker spaniel, and a poodle.
Some digital manipulation (e.g. removing human owners and the leash from a few dog photos) was done using Adobe® Photoshop® (version 7.0). The color schemes of the photos were equalized using Adobe® Photoshop® Lightroom® (version 1.3). Finally, a random sample of 40 stimulus photos from all human and dog categories were pixelated and crystallized (25 of them turned upside down to make identification of figures harder) to create a visual control category of pixel photos showing no social communication nor complete objects, yet consisting of separate observable shapes (see Figure 1 for examples). The rationale for the pixel category was to capture visual activation elicited by the gross contours and colors present within the human and dog photos, as well as to reveal task-related attempts to decipher social interaction.
This process resulted in 200 photos, comprising 5 categories of 40 images in each. The images were of 4 different actors per species, each appearing in 20 stimuli per category: 1) two humans facing each other and greeting by shaking hands, hugging, or touching each other on the shoulder (Human_toward), 2) two humans in the same photo but facing away and not noticing each other (Human_away), 3) two dogs facing each other and greeting by sniffing and playing (Dog_toward), 4) two dogs in the same photo but facing away (Dog_away), and 5) crystallized pixel figures (Pixel) as control stimuli.
The images, displayed on a projection screen by a data projector (Christie Vista ×3, Christie Digital Systems Inc., USA), were 640×480 pixels in size (width×height, 20 cm×14 cm on the screen), overlaid on a gray background of 1024×768 pixels and presented with a frame rate of 75 Hz. Stimulus presentation was controlled with Presentation® software (http://nbs.neuro-bs.com/) run on a PC computer.
The stimuli were viewed binocularly at a distance of 34 cm within a block design. Each stimulus was shown for 2.5 s in a continuous 25-s stimulus block, 10 stimuli per block, and the block alternated with 25-s rest blocks with a fixation cross on a grey background. The recording sessions started and ended with rest blocks, so that each session comprised 14 stimulus blocks and 15 rest blocks. The stimulus sequence also included blocks of photos of single humans and dogs in the same surroundings to establish a baseline of visual object perception. However, to emphasize the results between stimulus classes of “toward” and “away” categories, the single human and dog photos were excluded from the present study. The data were gathered in two successive recording sessions (each 12 min 5 s in duration, with 140 different stimuli presented in a pseudorandomized order). The order of the sessions was counterbalanced across subjects.
Prior to the experiment, the subjects were informed that they would see images of people and dogs, as well as abstract pixel compositions. They were instructed to explore the images freely and inspect the attitude of the beings towards one another or towards their surroundings, whenever possible. They were also asked to avoid overt and covert verbalizing and to keep the head still.
The magnetic resonance data were acquired with whole-body General Electric Signa® 3.0T MRI scanner at the Advanced Magnetic Imaging Centre. During the experiment, the subject was resting in the scanner, facing upwards and viewing the stimulus images through a mirror attached to the 8-channel head coil.
Functional MR images were acquired using a gradient-echo planar imaging sequence with field of view = 240×240 mm2, time of repetition = 2500 ms, time to echo = 32 ms, number of excitations = 1, flip angle = 75°, and matrix size = 64×64. Before the presentation of the visual stimuli, six dummy volumes were acquired allowing the MR signal to stabilize. Altogether 42 slices (thickness 3.0 mm) were acquired in an interleaved order. The resulting functional voxels were 3.75×3.75×3 mm3 in size.
Structural T1-weighted images were acquired using a spoiled-gradient echo sequence with a matrix size of 256×256, time of repetition 9.2 ms, field of view 260×260 mm2, flip angle of 15°, and slice thickness of 1 mm, resulting in 1×1.016×1.016 mm3 voxels.
The fMRI data were analyzed with BrainVoyager QX software version 1.10.2/3 (Brain Innovation B.V., The Netherlands). Preprocessing included slice scan time correction and 3D motion correction with first volume as a reference, linear trend removal and high-pass filtering at 0.008 Hz.
Functional and anatomical data were iso-voxelated to 3×3×3 mm3 and 1×1×1 mm3 voxels, respectively, and normalized to the Talairach space . All data were analyzed further at this resolution. Subsequently, all functional data were interpolated to the resolution of anatomical images for visualization purposes of the statistical maps.
Statistical analysis of fMRI
Whole-brain analysis was conducted for identification of the activation differences during different stimulus conditions, separately for expert and control groups. Brain activations were subjected to statistical analysis using random effects general linear model (RFX-GLM), and the individual time courses were normalized using z-transformation. The predictors for RFX-GLM were obtained by convolving the time courses of the stimulus blocks with a canonical hemodynamic response function to reveal blood-oxygenation-level-dependent (BOLD) activations.
Main effects of dog stimuli were inspected with a bi-directional statistical map, showing contrasts in both directions within the whole brain, of “Dogs vs. Rest” (the term “Rest” referring here to the “baseline” level for the signal change; the Rest blocks were not modeled separately). Similarly, the object-related brain activations were inspected with a contrast of “Dogs vs. Pixel” (balanced for the amount of stimuli). The effect of species on brain activations was inspected with the bi-directional contrast “Dogs vs. Humans”. Thereafter, comparisons were made between humans facing toward each other and facing away (“Human_toward vs. Human_away”), dogs facing toward and away (“Dog_toward vs. Dog_away”), and humans and dogs in face-to-face interaction with a conspecific (“Human_toward vs. Dog_toward”). The relationship between the pSTS activation and the results of the expertise questionnaire in the “Dog_toward vs. Dog_away” contrast was further clarified by extracting the beta values from this region and calculating a Pearson correlation with each of the different expertise measures (Ownership, Experience, Attachment and Knowledge) across all subjects.
All statistical maps were corrected for multiple comparisons according to false discovery rate (FDR, ) incorporated in the BVQX software, and using a cluster size of 10 contiguous voxels . The FDR-corrected statistical threshold was q(FDR)<0.005 for Dogs vs. Rest and q(FDR)<0.05 for the contrasts Dogs vs. Pixels, Dogs vs. Humans, Dog_toward vs. Dog_away, Dog_toward vs. Human_toward and Human_toward vs. Human_away. Brain areas showing modulation of activity were identified with common brain atlases , .
Since we were specifically interested in the expertise effects within the temporal-lobe areas responsive for perception of body postures and biological motion –, , , –, we defined anatomically three small ROIs of 8 mm3 in each hemisphere from the across-subjects MR images within the region important for perception of body postures and biological motion (Talairach coordinates of x = −52 and 52; y = −60; and z = 4, −1 and −6). The signal changes were examined for group differences with one-way ANOVAs in both hemispheres.
The subjects' eye gaze was tracked with SMI MEye Track long-range eye tracking system (Sensomotoric Instruments GmbH, Germany) to compare the number and duration of fixations around human and dog bodies in experts and control subjects. The tracking method is based on video-oculography and dark pupil–corneal reflection.
The infrared camera was set at the foot of the bed to monitor the subject's eye via a mirror attached to the head coil, and an infrared light source was placed on the mirror box to illuminate the eye. The camera was shielded properly (in house) and did not affect the signal-to-noise ratio of the fMRI data. The eye tracker was calibrated prior to the experiment using 5 fixation points, and the data were collected at a sampling rate of 60 Hz.
The eye gaze patterns (successful recordings obtained for 11 control subjects and 12 dog experts) were analyzed with Begaze 2.0 (Sensomotoric Instruments GmbH, Germany). Eye blinks were removed from the data and fixations were detected with a dispersion-threshold identification algorithm, using a 2° dispersion window and 120 ms as the minimum fixation duration. Gaze maps were then calculated separately for individual stimuli, by overlying the fixations of all subjects and by smoothing the data with a gaussian kernel of 70 pixels. Thereafter the average fixation duration was computed across subjects at each pixel and was color-coded for average fixation durations from 5 ms to 200 ms or more (Figure 1).
Eye movements between experts and control subjects were compared from all Human_toward, Human_away, Dog_toward and Dog_away stimuli (40 photos per category). For each photo, regions of interest were drawn manually around human heads and bodies as well as dog heads, bodies and tails and the remaining background image area, for which the subjects' total fixation durations were calculated.
The total fixation durations of experts and control subjects in each ROI were compared with a repeated-measures analysis of variance (ANOVA) with a between-subjects factor “group” (experts, controls) and within-subject factors “species” (human, dog), “behavior” (toward, away) and “body part” (head, body). The ANOVA results were clarified with planned contrasts (paired-samples t-tests) between dog and human body parts and interaction levels. Fixations to dog tails were inspected in a separate ANOVA with a between-subjects factor “group” and a within-subjects factor “behavior”. In addition, the ratios in fixation durations between heads and bodies were calculated and compared in one-way ANOVA with a between-subjects factor “group” and head/body ratios of all four stimulus categories.
We thank V.-M. Saarinen for carrying out the eye tracking measurements and the preliminary data analysis, S. Vanni for advice for the control stimuli, M. Kattelus for the help in fMRI measurements, L. Hirvenkari for the assistance with the empathy scales, S. Malinen and M. Seppä for comments on data analysis, and Espoon koirakerho and Theatre Academy Helsinki for the help in producing the stimuli.
Conceived and designed the experiments: MVK RH. Performed the experiments: MVK SC. Analyzed the data: MVK. Contributed reagents/materials/analysis tools: JK. Wrote the paper: MVK JK SC RH.
- 1. Kujala MV, Carlson S, Hari R (2011) Engagement of amygdala in third-person view of face-to-face interaction. Hum Brain Mapp. DOI:10.1002/hbm.21317.
- 2. Sinke CB, Sorger B, Goebel R, de Gelder B (2010) Tease or threat? Judging social interactions from bodily expressions. Neuroimage 49: 1717–1727.
- 3. Pongracz P, Molnar C, Miklosi A, Csanyi V (2005) Human listeners are able to classify dog (Canis familiaris) barks recorded in different situations. J Comp Psychol 119: 136–144.
- 4. Troje NF, Westhoff C (2006) The inversion effect in biological motion perception: evidence for a “life detector”? Curr Biol 16: 821–824.
- 5. Halgren E, Raij T, Marinkovic K, Jousmäki V, Hari R (2000) Cognitive response profile of the human fusiform face area as determined by MEG. Cereb Cortex 10: 69–81.
- 6. Buccino G, Lui F, Canessa N, Patteri I, Lagravinese G, et al. (2004) Neural circuits involved in the recognition of actions performed by nonconspecifics: an FMRI study. J Cogn Neurosci 16: 114–126.
- 7. Peelen MV, Downing PE (2005) Selectivity for the human body in the fusiform gyrus. J Neurophysiol 93: 603–608.
- 8. Peelen MV, Wiggett AJ, Downing PE (2006) Patterns of fMRI activity dissociate overlapping functional brain areas that respond to biological motion. Neuron 49: 815–822.
- 9. Downing PE, Wiggett AJ, Peelen MV (2007) Functional magnetic resonance imaging investigation of overlapping lateral occipitotemporal activations using multi-voxel pattern analysis. J Neurosci 27: 226–233.
- 10. Pourtois G, Peelen MV, Spinelli L, Seeck M, Vuilleumier P (2007) Direct intracranial recording of body-selective responses in human extrastriate visual cortex. Neuropsychologia 45: 2621–2625.
- 11. Taylor JC, Wiggett AJ, Downing PE (2007) Functional MRI analysis of body and body part representations in the extrastriate and fusiform body areas. J Neurophysiol 98: 1626–1633.
- 12. Spiridon M, Fischl B, Kanwisher N (2006) Location and spatial profile of category-specific regions in human extrastriate cortex. Hum Brain Mapp 27: 77–89.
- 13. Grossman ED, Blake R (2002) Brain Areas Active during Visual Perception of Biological Motion. Neuron 35: 1167–1175.
- 14. Pyles JA, Garcia JO, Hoffman DD, Grossman ED (2007) Visual perception and neural correlates of novel ‘biological motion’. Vision Res 47: 2786–2797.
- 15. Santi A, Servos P, Vatikiotis-Bateson E, Kuratate T, Munhall K (2003) Perceiving biological motion: dissociating visible speech from walking. J Cogn Neurosci 15: 800–809.
- 16. Vaina LM, Solomon J, Chowdhury S, Sinha P, Belliveau JW (2001) Functional neuroanatomy of biological motion perception in humans. Proc Natl Acad Sci U S A 98: 11656–11661.
- 17. Kanwisher N, McDermott J, Chun MM (1997) The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci 17: 4302–4311.
- 18. Gauthier I, Skudlarski P, Gore JC, Anderson AW (2000) Expertise for cars and birds recruits brain areas involved in face recognition. Nat Neurosci 3: 191–197.
- 19. Grill-Spector K, Knouf N, Kanwisher N (2004) The fusiform face area subserves face perception, not generic within-category identification. Nat Neurosci 7: 555–562.
- 20. Adams RB Jr, Kleck RE (2003) Perceived gaze direction and the processing of facial displays of emotion. Psychol Sci 14: 644–647.
- 21. Puce A, Syngeniotis A, Thompson JC, Abbott DF, Wheaton KJ, et al. (2003) The human temporal lobe integrates facial form and motion: evidence from fMRI and ERP studies. Neuroimage 19: 861–869.
- 22. Haxby JV, Hoffman EA, Gobbini MI (2000) The distributed human neural system for face perception. Trends Cogn Sci 4: 223–233.
- 23. Frith U, Frith CD (2003) Development and neurophysiology of mentalizing. Philos Trans R Soc Lond B Biol Sci 358: 459–473.
- 24. Saxe R, Powell LJ (2006) It's the thought that counts: specific brain regions for one component of theory of mind. Psychol Sci 17: 692–699.
- 25. Ruby P, Decety J (2004) How would you feel versus how do you think she would feel? A neuroimaging study of perspective-taking with social emotions. J Cogn Neurosci 16: 988–999.
- 26. Frith CD, Frith U (1999) Interacting minds–a biological basis. Science 286: 1692–1695.
- 27. Gallagher HL, Frith CD (2003) Functional imaging of ‘theory of mind’. Trends Cogn Sci 7: 77–83.
- 28. Mitchell JP, Macrae CN, Banaji MR (2006) Dissociable medial prefrontal contributions to judgments of similar and dissimilar others. Neuron 50: 655–663.
- 29. Ruby P, Decety J (2003) What you believe versus what you think they believe: a neuroimaging study of conceptual perspective-taking. Eur J Neurosci 17: 2475–2480.
- 30. Aichhorn M, Perner J, Kronbichler M, Staffen W, Ladurner G (2006) Do visual perspective tasks need theory of mind? Neuroimage 30: 1059–1068.
- 31. Vogeley K, May M, Ritzl A, Falkai P, Zilles K, et al. (2004) Neural correlates of first-person perspective as one constituent of human self-consciousness. J Cogn Neurosci 16: 817–827.
- 32. Walter H, Adenzato M, Ciaramidaro A, Enrici I, Pia L, et al. (2004) Understanding intentions in social interaction: the role of the anterior paracingulate cortex. J Cogn Neurosci 16: 1854–1863.
- 33. Schilbach L, Wohlschlaeger AM, Kraemer NC, Newen A, Shah NJ, et al. (2006) Being with virtual others: Neural correlates of social interaction. Neuropsychologia 44: 718–730.
- 34. Allison T, Puce A, McCarthy G (2000) Social perception from visual cues: role of the STS region. Trends Cogn Sci 4: 267–278.
- 35. Malach R, Reppas JB, Benson RR, Kwong KK, Jiang H, et al. (1995) Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc Natl Acad Sci U S A 92: 8135–8139.
- 36. Grill-Spector K, Kushnir T, Edelman S, Avidan G, Itzchak Y, et al. (1999) Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 24: 187–203.
- 37. Kaiser MD, Shiffrar M, Pelphrey KA (2011) Socially tuned: Brain responses differentiating human and animal motion. Soc Neurosci. DOI:10.1080/17470919.17472011.17614003.
- 38. Centelles L, Assaiante C, Nazarian B, Anton JL, Schmitz C (2011) Recruitment of both the mirror and the mentalizing networks when observing social interactions depicted by point-lights: a neuroimaging study. PLoS One 6: e15749.
- 39. Haxby JV, Gobbini MI, Furey ML, Ishai A, Schouten JL, et al. (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 293: 2425–2430.
- 40. Op de Beeck HP, Baker CI, DiCarlo JJ, Kanwisher NG (2006) Discrimination training alters object representations in human extrastriate cortex. J Neurosci 26: 13025–13036.
- 41. Shepherd SV (2010) Following gaze: gaze-following behavior as a window into social cognition. Front Integr Neurosci 4: 5.
- 42. Itier RJ, Villate C, Ryan JD (2007) Eyes always attract attention but gaze orienting is task-dependent: evidence from eye movement monitoring. Neuropsychologia 45: 1019–1028.
- 43. Guo K, Tunnicliffe D, Roebuck H (2010) Human spontaneous gaze patterns in viewing of faces of different species. Perception 39: 533–542.
- 44. Blonder LX, Smith CD, Davis CE, Kesler-West ML, Garrity TF, et al. (2004) Regional brain response to faces of humans and dogs. Brain Res Cogn Brain Res 20: 384–394.
- 45. Merzenich MM, Jenkins WM (1993) Reorganization of cortical representations of the hand following alterations of skin inputs induced by nerve injury, skin island transfers, and experience. J Hand Ther 6: 89–104.
- 46. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9: 97–113.
- 47. Davis M (1980) A multidimensional approach to differences in empathy. Catalog of Selected Documents in Psychology 10: 85.
- 48. Talairach J, Tournoux P (1988) Co-planar stereotaxic atlas of the human brain: 3-dimensional proportional system: an approach to cerebral imaging. Stuttgart: Thieme Medical Publishers. 122 p.
- 49. Genovese CR, Lazar NA, Nichols T (2002) Thresholding of statistical maps in functional neuroimaging using the false discovery rate. Neuroimage 15: 870–878.
- 50. Forman SD, Cohen JD, Fitzgerald M, Eddy WF, Mintun MA, et al. (1995) Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): use of a cluster-size threshold. Magn Reson Med 33: 636–647.
- 51. Duvernoy HM (1999) The Human Brain: Surface, Three-Dimensional Sectional Anatomy with MRI, and Blood Supply. Wien New York: Springer-Verlag.
- 52. de Gelder B (2006) Towards the neurobiology of emotional body language. Nat Rev Neurosci 7: 242–249.
- 53. Downing PE, Jiang Y, Shuman M, Kanwisher N (2001) A cortical area selective for visual processing of the human body. Science 293: 2470–2473.
- 54. Peelen MV, Downing PE (2007) The neural basis of visual body perception. Nat Rev Neurosci 8: 636–648.