Skip to main content
Download PDF

Social attention to activities in children and adults with autism spectrum disorder: effects of context and age

Molecular Autism volume 11, Article number: 79 (2020) Cite this article

Abstract

Background

Diminished visual monitoring of faces and activities of others is an early feature of autism spectrum disorder (ASD). It is uncertain whether deficits in activity monitoring, identified using a homogeneous set of stimuli, persist throughout the lifespan in ASD, and thus, whether they could serve as a biological indicator (“biomarker”) of ASD. We investigated differences in visual attention during activity monitoring in children and adult participants with autism compared to a control group of participants without autism.

Methods

Eye movements of participants with autism (n = 122; mean age [SD] = 14.5 [8.0] years) and typically developing (TD) controls (n = 40, age = 16.4 [13.3] years) were recorded while they viewed a series of videos depicting two female actors conversing while interacting with their hands over a shared task. Actors either continuously focused their gaze on each other’s face (mutual gaze) or on the shared activity area (shared focus). Mean percentage looking time was computed for the activity area, actors’ heads, and their bodies.

Results

Compared to TD participants, participants with ASD looked longer at the activity area (mean % looking time: 58.5% vs. 53.8%, p < 0.005) but less at the heads (15.2% vs. 23.7%, p < 0.0001). Additionally, within-group differences in looking time were observed between the mutual gaze and shared focus conditions in both participants without ASD (activity: Δ = − 6.4%, p < 0.004; heads: Δ = + 3.5%, p < 0.02) and participants with ASD (bodies: Δ = + 1.6%, p < 0.002).

Limitations

The TD participants were not as well characterized as the participants with ASD. Inclusion criteria regarding the cognitive ability [intelligence quotient (IQ) > 60] limited the ability to include individuals with substantial intellectual disability.

Conclusions

Differences in attention to faces could constitute a feature discriminative between individuals with and without ASD across the lifespan, whereas between-group differences in looking at activities may shift with development. These findings may have applications in the search for underlying biological indicators specific to ASD.

Trial registration ClinicalTrials.gov identifier NCT02668991.

Background

There is a need for quantifiable and objective measures of behavior in autism spectrum disorder (ASD) that can aid diagnosis and stratification and may be useful as biomarkers (i.e., biological indicators of condition) for treatment response [1]. Given the phenotypic heterogeneity in ASD, eye tracking might be an objective way to assess social attention [2] wherein social attention differences have been noted in infant siblings of children with ASD, as well as toddlers, children, and adults with ASD, compared to individuals without ASD [3,4,5,6,7,8]. Current evidence suggests it may be possible to predict social-communicative outcomes and risk for ASD based on early visual attention to social stimuli, highlighting social attention as a potential predictive biomarker for ASD [9,10,11,12,13,14,15,16].

In addition to their use as predictive or diagnostic biomarkers, biosensors, such as eye trackers, have the potential to serve as a potential biomarker of change in ASD for example in clinical trials. Given the variability in when individuals are diagnosed and enrolled in interventions [17,18,19], it is critical to generate biomarkers at early (i.e., ≤ 3 years) and later developmental stages in order to generate developmentally appropriate biomarkers that can capture the changes and success of interventions across the lifespan. For this purpose, eye-tracking paradigms need to be tested for suitability and validity in the populations for which they are intended to be used. For greatest applicability, this means examining feasibility and utility across a range of clinically validated populations and across a wide array of age groups. It is well-known that social attention is abnormal across development for individuals with ASD [20, 21], replication of findings using consistent methodology across the heterogeneity of ASD remains limited [17, 21, 22], which may hamper our ability to establish a biomarker of social attention. Moreover, the extent to which observed differences are driven by use of differing experimental paradigms and methodologies across studies is also unclear. Finally, eye tracking may also be biologically relevant, as visual attention of this type may be related to social neural networks and thus not simply a behavioral phenomenon [23].

Activity monitoring paradigm

One important role of social attention relates to selective attention toward the joint activities of others (i.e., activity monitoring). Toddlers with ASD have been found to monitor the activity of others less than their TD peers when observing a child and adult play interaction in short dynamic scenes [24]. Reduced attention to activity can lead to decreased opportunities for observational learning, which can impact social and cognitive development and have deleterious long-term effects [25, 26]. It also appears that complexity of features in the environment may compete with social stimuli, increasing the likelihood that abnormal patterns of attention are observed in individuals with ASD [21]. For instance, in a recent study of activity monitoring in ASD, toddlers were shown a set of stimuli that differed across three dimensions of interest: gaze direction of the actors, presence of background distractors, and dynamic nature of the stimuli [27, 28]. Consistent with prior work, findings show that toddlers with ASD, when compared to control toddlers, attended less to scenes overall, looked less at the activity and faces, and looked more at the background. Differences in activity monitoring between toddlers with ASD and other groups were most striking when background distractors were included and when stimuli were shown as dynamic videos. In contrast, gaze direction of the actors did not significantly influence between-group differences. Interestingly, unlike toddlers with ASD, older 3-year-old children with ASD did not show limited activity monitoring; however, like the toddlers, they showed decreased looking at heads and increased looking at background. An unanswered question is whether there are continuing developmental transitions by which children with ASD diverge from those without ASD in their viewing patterns toward activity scenes, which would impact the use of eye tracking as a biomarker across the lifespan.

Current study

In the current study, we used an activity monitoring paradigm to investigate allocation of visual attention to stimuli in complex social scenes involving shared activities in older children and adults with ASD, and a typically developing (TD) comparison group. There is no current published literature describing differences between older children and adults with and without ASD on this task, and as such this work provides an upward extension of results in toddlers and at the preschool-age [27, 28]. We focused on the experimental manipulation of gaze direction (i.e., shared gaze focus on the activity versus mutual gaze between actors) and used only dynamic stimuli with background distractors.

Our primary aim was to establish preliminary data to aid in determining the utility of this paradigm as a discriminative biomarker in older individuals with and without ASD. Hypotheses based on previous findings [24] were that there would be less attention to the heads of actors, less attention to activity, and more attention to background distractors in the ASD group compared to the TD group. We also hypothesized, that response to gaze direction would be different between the ASD and TD groups, which in turn would modulate attention patterns both in these older children with ASD [29,30,31] and TD groups. Finally, in an exploratory analysis, we investigated whether differences in allocated attention during activity monitoring were related to individual differences in age, autism severity, and intelligence quotient (IQ).

Methods

Ethical practices

The Institutional Review Board at each of the nine participating study sites approved the study protocol and subsequent amendments. The study was conducted in accordance with the ethical principles of the Declaration of Helsinki, consistent with Good Clinical Practices and applicable regulatory requirements. Participants, their parents (for participants < 18 years old), or legally authorized representatives provided written informed consent before joining the study. Assent was obtained from any participants aged < 18 who were capable of understanding the nature of the study, and this was written assent for those who were able to write.

Participants

Participants in the ASD group were aged ≥ 6 years with a confirmed diagnosis of ASD based on clinical examination, caregiver interview, and use of the Autism Diagnostic Observation Schedule, 2nd Edition (ADOS-2) [32]. Key exclusion criteria were a measured composite score on the Kaufmann Brief Intelligence Test-2 (KBIT-2) [33] of < 60, and history of or current significant medical illness. TD controls were aged ≥ 6 years with a score in the normal range on the Social Communication Questionnaire [34] who did not meet criteria for any major mental health disorder [35] as assessed using the Mini-International Neuropsychiatric Interview [36]. Age 6 was used as the cutoff for this study, since it is the lower regulatory age bound for clinical studies in psychiatry. Note that the KBIT-2 was only collected for individuals with ASD but not for TD controls. Participants were enrolled within the framework of a large, observational, multi-center study that was conducted from July 6, 2015, to October 14, 2016, at nine study sites in the USA (trial registration no. NCT02668991 at https://clinicaltrials.gov) and consisted of multiple passive viewing tests [37,38,39,40,41,42].

In total, 136 individuals with ASD and 41 TD controls completed the study. Out of those, after exclusions due to technical or calibration failures, 122 individuals with ASD and 40 TD controls were included for the activity monitoring test (Table 1, Additional file 8: Table S8).

Table 1 Participant characteristics
Full size table

Activity monitoring task

Participants viewed a series of videos presenting two female actors involved in a shared activity. In each video, the actors were viewed in profile with bodies facing each other and hands interacting over a shared task. The actors were placed in a typical office environment with barren walls and carpet that was enriched by visually salient distractors, including furniture, food, electronic and mechanical devices. Throughout videos, the actors were exclusively and continuously focusing either on each other’s face (Mutual gaze condition) or the shared activity area (Shared focus condition) while performing a simple action (e.g., cutting vegetables) and talking to each other (Fig. 1). The conversation between the actors involved simple language to accommodate participants with limited language.

Fig. 1
figure 1

Stimulus conditions. A Shared focus condition. B Mutual gaze condition. The regions uniformly filled in different colors correspond to different ROIs: red, Heads; green, Bodies; blue, Activity. The remaining part of a visual scene corresponds to the ROI Background. Note that the three color masks were invisible during actual experiments and are presented here for the sake of illustration only. ROI region-of-interest

Full size image

Each participant viewed four videos in total (two each of Shared focus and Mutual gaze conditions). Each video lasted 20 s. The presentation order of the two stimulus conditions was random across participants.

Procedure

Participants sat in a comfortable chair approximately 60 cm from a 23-inch computer screen (1920 × 1080 pixels). The height of the chair and screen were adjusted to ensure that participants’ eyes were level with the center of the screen. Eye-tracking data were collected using a 30 Hz Tobii X2 eye tracker mounted below the screen. iMotions Biometric Research Platform (https://imotions.com/) was used for stimuli presentation, data synchronization, and automatic calibration. Participants could freely observe presented stimuli. Before each experimental period, a five-point calibration procedure consisting of animated cartoon characters paired with an auditory cue was performed.

Behavior rating scales

Parents or caregivers of individuals with ASD reported on the following domains: ASD symptoms (Autism Behavior Inventory [ABI] [43, 44]); problem behaviors (Aberrant Behavior Checklist—Community [ABC] [45, 46]); emotional and behavioral disorders (Child Adolescent Symptom Inventory [CASI] [47]); social impairment (Social Responsiveness Scale 2™ [SRS-2] [48]); and repetitive behaviors (Repetitive Behavior Scale—Revised [RBS-R] [49]). Each of the above scales and ADOS-2 consist of subscales that reflect different clusters of ASD symptoms (see Additional file 1: Table S1).

Data analysis

Standard region-of-interest (ROI) analysis techniques were adapted for the analysis of gaze patterns (Fig. 1). The examined ROIs included the shared Activity area, the Bodies, and Heads of the two actors in a video, and the remaining Background. The videos were designed such that no major movements of ROIs occurred. Time spent by a participant looking at a specific ROI was normalized by the total viewing time for each video separately and averaged across videos per stimulus condition. The average percentage of time spent by a participant looking at stimuli relative to their presentation duration is referred to as the level of visual attention in that condition. Overall level of visual attention was obtained by averaging levels across the two stimulus conditions per participant. A two-sided, two-sample Kolmogorov–Smirnov test was used to compare the level of visual attention between the two groups of participants.

A linear mixed-effects model (widely implemented for multi-level data in clinical trials [50]) was used to compare % looking time between the two groups of participants and stimulus conditions for each individual ROI. Each model included the percentage of time spent looking at a specific ROI as a dependent variable, with stimulus condition, participant group, participant’s age and sex as fixed effects. Each model additionally included an interaction between stimulus condition and participant group. To account for within-participant variability in % looking time, each model included a participant identifier as a random intercept. The R package “nlme” was used to fit the models. Each model was fit by maximizing the restricted log-likelihood function. Significance of fixed effects was assessed using analysis of variance type III sum of squares and the Wald χ2 test (see Additional file 2: Table S2), as implemented in the R package “car.” Post hoc pair-wise comparisons were performed using the Tukey–Kramer correction for multiple comparisons. The least-squares mean estimates, their standard errors (SE), and two-sided 95% confidence intervals for different levels of the modeled categorical factors were obtained with the R package “lsmeans” (see Additional file 3: Table S3). This package was also used to run post hoc pair-wise comparisons (see Additional file 4: Table S4). The goodness of fit of each linear mixed-effects model was assessed by computing marginal and conditional coefficients of determination (R2) according to Nakagawa, Johnson, and Schielzeth (2017) and using the R package “MuMin” (see Additional file 5: Table S5 and Additional file 6: Table S6). For the sake of comparison with other studies, Cohen’s d was additionally computed for different combinations of stimulus condition and participant group for each individual ROI separately (see Additional file 4: Table S4). Alternatively, we also tested a linear mixed-effects model that was similar to that described above but included ROI and all its interactions with stimulus condition and participant group as additional fixed effects. The model was tested using the data of all ROIs, except for the ROI Background, to account for correlations between % looking time for different ROIs that existed due to normalization by the total viewing time (i.e., the sum of % looking time across the four ROIs was equal to 100% for each participant; see above). The same approach for post hoc pair-wise comparisons as described above was applied to this model. The outcomes of this model are reported in detail in Supplementary Material (see Additional file 12: Table S9, Additional file 13: Table S10, Additional file 14: Table S11, and Additional file 15: Figure S4).

A linear mixed-effects model was applied to compare slopes of the linear relationships between participant’s age and % looking time for the ROIs Activity and Heads between the two groups of participants. The model for each of these two ROIs included the percentage of time spent looking at that ROI as a dependent variable and participant’s age, group, and an interaction between age and group as fixed effects. A participant identifier served as the random intercept. The data for each ROI were pooled across the two stimulus conditions. The same approach as that described above was applied to test for statistical significance of the fixed effects (see Additional file 7: Table S7). Alternatively, to account for a potential effect of stimulus condition on the obtained results, we also tested a linear mixed-effects model that was similar to that described above but included stimulus condition and all its interactions with participant’s age and group as additional fixed effects. The model was tested separately for the ROI Activity and Heads. Moreover, to account for a potential effect of ROI, the latter model was further expanded to include ROI and all its interactions with stimulus condition, participant’s age and group as additional fixed effects. The model was tested using the data of both ROIs Activity and Heads. The outcomes of these models are reported in detail in Supplementary Material (see Additional file 16: Table S12 and Additional file 17: Table S13).

All reported correlations (rS) were Spearman partial correlations (given their lower susceptibility to potential outliers compared to Pearson correlations). Participant’s sex and age served as covariates for the computation of correlations between % looking time for different ROIs and the KBIT-2 IQ composite score in the group with ASD (see Additional file 9: Figure S1). The same list of covariates extended by the inclusion of KBIT-2 IQ composite score was used to compute correlations between % looking time for different ROIs and ASD symptoms severity (see Additional file 10: Figure S2 and Additional file 1: Table S1). Spearman partial correlation coefficients and corresponding two-sided p values were computed using the R package “ppcor.” No correction for multiple testing was performed for the computed correlation coefficients. Note that the number of statistical tests and, thus, the exact cutoff for significant p values in each analysis was debatable. For example, correction for multiple testing for the relationships between % looking time for different ROIs and ASD symptoms severity (Table 2) could have been done in multiple ways: for each behavior rating scale separately but across all ROIs and stimulus conditions, for each ROI separately but across all scales and stimulus conditions, or combining all tests regardless of behavior rating scale, ROI and stimulus condition. More options are available when accounting for individual ASD symptoms, as assessed by the behavior rating scales administered in the study (Additional file 1: Table S1). For the reasons outlined above, the p values were reported “as is,” with values < 0.05 considered significant.

Table 2 Correlations between % looking time for different ROIs and total score of behavior rating scales
Full size table

Results

The two groups of participants did not significantly differ in their overall level of visual attention to presented stimuli (ASD vs. TD, mean [SE]: 87.2% [1.18%] vs. 91.5% [1.06%], p > 0.16). Similarly, level of visual attention did not vary between the groups in any of the two stimulus conditions when the latter were analyzed separately (both, p > 0.11) (see Additional file 11: Figure S3).

Figure 2 shows distributions of % looking time for each individual ROI, stimulus condition, and group of participants (see Additional file 20: Table S16 for statistics on individual sites). Linear mixed-effects models revealed a significant effect of participant group on looking time for the ROIs Activity (p < 0.005) and Heads (p < 0.0001) but no effect of stimulus condition (both, p > 0.06) (see Additional file 2: Table S2 and Additional file 4: Table S4). Specifically, individuals with ASD spent more time looking at Activity than TD controls (ASD vs. TD, mean [SE]: 58.5% [1.12%] vs. 53.8% [1.76%]); in contrast, individuals with ASD spent less time looking at Heads (15.2% [0.89%]) than TD controls (23.7% [1.39%]). In addition, both ROIs revealed a significant interaction between stimulus condition and participant group (Activity: p < 0.04; Heads: p < 0.005). The % looking time in individuals with ASD did not differ between the two stimulus conditions for both Activity (Shared focus vs. Mutual gaze, mean [SE]: 59.5% [1.23%] vs. 57.5% [1.27%], p > 0.25) and Heads (15.4% [0.94%] vs. 15.0% [0.96%], p > 0.92) (see Additional file 3: Table S3 and Additional file 4: Table S4). In contrast, stimulus condition significantly modulated % looking time in TD controls for each of these two ROIs. Specifically, TD controls spent significantly more time looking at Activity in the Shared focus than in the Mutual gaze stimulus condition (57.0% [1.97%] vs. 50.6% [1.98%], Cohen’s d = 0.51, p < 0.005), with the opposite observed for Heads (21.9% [1.50%] vs. 25.4% [1.51%], Cohen’s d = 0.33, p < 0.02). Lastly, the linear mixed-effects model showed a significant effect of stimulus condition on % looking time for the ROI Bodies (p < 0.0003). The latter effect was only observed in participants with ASD as a significant difference in % looking time between the two stimulus conditions (Shared focus vs. Mutual gaze, mean [SE]: 7.08% [0.55%] vs. 8.69% [0.56%], Cohen’s d = 0.23, p < 0.002). No significant fixed effects were observed for the ROI Background. All between-group comparisons remained statistically significant (all p’s < 0.05) in the alternative model that combined the data across ROIs and additionally included ROI and all its interactions with stimulus condition and participant group as fixed effects (see Additional file 12: Table S9, Additional file 13: Table S10, Additional file 14: Table S11, and Additional file 15: Figure S4).

Fig. 2
figure 2

Scatter plots between participant’s age and looking time for the ROIs Activity and Heads. The data are presented for each stimulus condition (a, c: Shared focus; b, d: Mutual gaze) and ROI (a, b: Activity; c, d: Heads) separately. Dots denote individual participants. The red and blue colors correspond to the data of individuals with ASD and TD controls, respectively. n indicates the number of participants. The black line in each panel represents the best linear fit of the data pooled across the two groups of participants, with the equation for that fit being presented in the same panel. ASD autism spectrum disorder, ROI region-of-interest, TD typically developing

Full size image

Participant’s age showed a significant effect on % looking time for the ROIs Activity (p < 0.0001) and Heads (p < 0.0001) (see Additional file 2: Table S2). Specifically, % looking time for Activity decreased with participant’s age, whereas the reverse was the case for Heads (Fig. 3). A different set of linear mixed-effects models was used (see Methods Section) to test for differences in slopes of the identified relationships between participant’s age and % looking time between the two groups of participants. As expected, the models again revealed a significant effect of participant’s age on % looking time for both ROIs Activity (p < 0.03) and Heads (p < 0.02) (see Additional file 6: Table S6 and Additional file 7: Table S7). However, no model showed a significant interaction between participant’s age and group (both p’s > 0.40), thus suggesting a similar strength of the identified relationships across the two groups of participants. Similarly, no alternative model that accounted for the effect of stimulus condition and ROI on the obtained results revealed a significant interaction between participant’s age and group (all p’s > 0.10; see Additional file 16: Table S12 and Additional file 17: Table S13), thus further confirming the findings reported above. To test whether a significant effect of participant’s age on % looking time for the ROIs Activity and Heads was driven by older participants (Fig. 3), the models described above were fitted using the data of all participants (1) below 40 years, (2) below 35 years, (3) below 30 years, (4) below 25 years, and (5) below 20 years separately (see Additional file 18: Table S14, Additional file 19: Table S15). No model revealed a significant effect of participant’s age on % looking time for the ROI Activity for any of the five tested data samples (all p’s > 0.09; Additional file 19: Table S15). Yet, participant’s age was significantly associated with % looking time for the ROI Heads for all data samples (all p’s < 0.05), except for that including the participants aged below 30 years (p = 0.0502). Remarkably, when analyzing the data of each stimulus condition separately, relationships between participant’s age and % looking time, as assessed by Spearman correlations, proved to be statistically significant for either ROI across the five tested age groups in the Mutual gaze (all p’s < 0.01; Additional file 18: Table S14) but not in the Shared focus (all p’s > 0.11) condition.

Fig. 3
figure 3

Distributions of % looking time for each individual ROI, stimulus condition, and group of participants. The data of each ROI, stimulus condition and group of participants (with autism—red, without autism—blue) are summarized in a form of boxplots. Black dots denote individual participants. n indicates the number of participants. *p value < 0.05, **p value < 0.005, ***p value < 0.0005 (corrected for multiple comparisons for each individual ROI using the Tukey–Kramer method; see Additional file 3: Table S3 and Additional file 4: Table S4). ASD autism spectrum disorder, ROI region-of-interest, TD typically developing

Full size image

The data on participants’ intelligence, as assessed by KBIT-2, were collected only in participants with ASD. This precluded the use of these data in comparisons of % looking time between the two groups of participants. When relating % looking time for different ROIs to the KBIT-2 IQ composite score in participants with ASD, the KBIT-2 IQ score revealed significant negative correlations with % looking time for Bodies (rS = − 0.189, p < 0.05) and Heads (rS = − 0.208, p < 0.03) in the Shared focus stimulus condition (see Additional file 9: Figure S1). However, the same correlations failed to reach statistical significance (Bodies: rS = − 0.097, p = 0.32; Heads: rS = − 0.166, p = 0.09) in the Mutual gaze condition. No other significant correlations were observed (all p > 0.11).

To test whether overall severity of ASD symptoms manifested in percentage of time spent by individuals with ASD looking at a specific ROI, we correlated % looking time with the total score of behavior rating scales (n = 5). The correlation coefficients were computed for each ROI and stimulus condition separately, and the results of these computations are presented in Table 2. Of the 40 computed correlation coefficients, only three (7.5%) were significant. These included negative correlations in the Mutual gaze condition between the ABI core ASD symptom scale score and Activity (rS = − 0.204, p < 0.04), the ADOS-2 total score and Heads (rS = − 0.212, p < 0.03), as well as a positive correlation between the RBS-R total score and Heads (rS = 0.227, p < 0.02) in the Shared focus condition (see Additional file 10: Figure S2). Additional file 1: Table S1 shows correlations between % looking time for different ROIs and ASD symptoms severity as captured by the collected behavior rating scales.

Discussion

We employed a dynamic activity monitoring paradigm in a sample of children and adults to quantify differences in social attention allocation between those with ASD and TD. We included two conditions in which actors either gazed at each other, or where their focus was on the activity, in order to determine whether these differences modulated visual attention. Individuals with ASD demonstrated different patterns of social attention during activity monitoring. Compared to the TD group, individuals with autism looked less at the actors’ heads, and longer at the shared activity area.

Contrary to expectations, we found that participants with autism looked more at the activity compared to participants without autism, but only in the Mutual gaze condition. There are several reasons why this may have been the case. First, as indicated by Shic et al. [27, 28], older individuals with ASD may not exhibit diminished activity monitoring to the same extent as 2-year-old toddlers with ASD, suggesting developmental changes in the monitoring of joint activities. The current study extends these findings by offering evidence that this upward developmental trajectory in ASD may continue as children grow older, ultimately reversing the pattern of diminished activity monitoring observed in younger children to that of a pattern of increased activity monitoring by school-age. Second, participants with ASD may focus more on activity due to increased preference toward areas of motion (i.e., hands manipulating the activity). Finally, this difference may be explained by how participants modulate their attention in response to differences in gaze behavior of the actors [31]. Participants with ASD did not adjust their attention to the activity based on where the actors were looking. That is, they spent the same amount of time attending to the activity during the Mutual gaze and Shared focus conditions. It is possible that the actor’s gaze direction may not have been salient to them and thus did not influence their looking behavior. In contrast, TD participants modulated attention such that in the Mutual gaze condition (relative to the Shared focus condition), TD participants spent more time looking at the actors’ heads and less time looking at the activity. Decreased responsiveness to gaze cues is in line with early joint attention deficits observed in toddlers with ASD and suggests that this difference persists across the lifespan, consistent with Freeth et al. [51].

The current study has similarities to a recent social attention study in adults, where richness of a social scene increased observable differences between ASD and TD groups in viewing of naturalistic videos [52]. These authors suggested that the ASD group did not pick up on the subtleties of increased social content (i.e., magnitude and quality of social content). Unlike the naturalistic and dynamic gaze shifts in that study, the gaze manipulations inherent within our activity monitoring stimuli intentionally disrupt the normative social modulation of gaze by utilizing fixed rather than dynamic gaze. It is therefore possible that socially savvy TD participants find this unnatural gaze modulation novel and eerily devoid of joint attention, driving their increased attention to the heads of the actors. Future work would benefit from understanding the extent by which group differences within this artificial manipulation of fixed gaze vary from natural interactional gaze patterns.

Effects of age

In our sample of children and adults, age was found to have a significant effect on looking to the shared activity and to the heads of actors in the Mutual gaze condition, with older individuals with and without ASD looking less at the shared activity and more at the heads. Contrary to the studies in toddlers [24, 27, 28], individuals with ASD in our sample spent more time looking at the shared activity than TD controls. This may be consistent with developmental shifts in social interactions. In early childhood, social interaction is dominated by play and shared activities with objects. As children age, language and dyadic interactions become the primary mode of social interaction and learning, and more subtle non-verbal behaviors help to influence contextual interpretation of social behavior. Thus, the trends we see here may map on to typical developmental shifts in social interactions, where the most important information during a social interaction in adolescence and beyond is gleaned from language rather than a shared activity.

Of particular interest, there were no age-related group differences in activity monitoring, suggesting, based on Shic et al. [27, 28], that much of the differential developmental trajectory may be captured at the toddler age. It also suggests that, in terms of observed relationships between looking patterns and age, both TD and ASD groups change in a similar fashion over time. In addition, unlike in the toddler study, we did not find any differences between groups in visual attention to the background. Both groups payed more attention to the actors or the activity and the background “distractors” did not hold additional salience for the ASD group, as may have been predicted. This may be explained by similar developmental trajectories after the toddler age, whereby either biological motion, or motion is more salient than static objects. It could also be that the images used in the background were of less interest to older participants with ASD than the toddler group. In addition, unlike the toddler study, our current study did not include individuals with more severe intellectual impairment. Further study with manipulation of variables in older individuals with ASD, as well as with individuals with greater intellectual impairment, would be needed to determine the specific reasons for reduced attention to the background in an older ASD group.

Understanding aspects of heterogeneity in ASD

Considering the established heterogeneity present in ASD, it is critical to understand how gaze patterns relate to prevalent individual differences, including sex, ASD symptomology, and cognitive abilities. First, unlike age, sex did not significantly contribute to any of the linear mixed-effects models, suggesting that while it may be important to account for this variable as a covariate [53], there is little evidence within the current study to suggest that patterns of social attention are influenced by sex. This finding is consistent with several studies that have not identified sex differences in behavioral features of ASD [54], but is in contrast to one study that identified sex differences in visual attention to dynamic social scenes for children with ASD [55]. Methodological differences between our study and Harrop et al. [55] could reconcile this discrepancy as the study included a younger, more restricted age range of participants between 6 and 10 years. It is possible that sex differences in social attention are developmentally sensitive, and that combining children, adolescents, and adults together may mask some developmental trends, and our sample size of 29 females compared to a larger proportion of males was not sufficient to detect any differences. Still, very few studies have examined sex differences in social attention for individuals with ASD across the lifespan, and our findings warrant further investigation.

We found that children rated as having more social affect challenges exhibited less attention to heads during the mutual gaze condition. In contrast, increased repetitive behaviors (particularly compulsive, ritualistic, sameness, and self-injurious behaviors) were related to increased attention to heads during the shared focus condition. These findings encompass both observations of child’s ASD symptoms (e.g., ADOS-2 total) and parental report (e.g., ABI core, RBS-R total) and are consistent with prior work indicating that looking behaviors correspond to social function and social behaviors in school-age children and adults with ASD [2, 56]. Within the current data, the lack of correspondence between social attention and social behaviors (e.g., SRS-2 or ABI social communication subdomain) is surprising. One possibility is that features of social attention are subtle and thus not well captured by macro-level parental report measures. However, other literature in infant populations has also not found reliable relationships between social attention and ASD symptoms [57,58,59] suggesting that perhaps heterogeneity may dilute the power to detect relationships at an individual level. Given the multiple comparisons that were made between eye-tracking features and behavior rating scales and the fact that the current study was not designed to thoroughly test relationships between severity of ASD symptoms and looking time, the few correlations described above should be treated with a great caution. The correlations can also be used to inform future research about the existence of potential links between behavioral reports and eye-tracking measures. Continuing to explore and replicate these findings with additional cohorts will be valuable in understanding how underlying ASD symptoms relate to implicit social attention patterns.

Our findings indicated that individuals with ASD with a higher IQ appear to look less at heads and bodies specifically in the context in which shared focus was on the activity, suggesting that individuals with higher cognitive ability direct more attention to the focus of the actors’ gaze. This finding suggests caution regarding the specificity of head-looking across the heterogeneity of ASD and is consistent with other recent work demonstrating that children with ASD who are minimally verbal are less likely to follow gaze shifts relative to age-matched verbal children with ASD within a spontaneous looking task [60]. One possibility is that children with a higher IQ are more likely to share focus with other people, unlike children with lower IQ, which may ultimately impact opportunities for implicit social learning. This may be because ASD children with a higher IQ are capable of processing the information quickly and are subsequently focused on the relevant scene content (i.e., direction of the actors’ gaze). Alternatively, it may be the case that monitoring activities is more related to mental age than relative IQ, and as such increased monitoring of activities in school-age children and adults with ASD may reflect cumulative effects of an atypical developmental progression. This is consistent with evidence indicating that toddlers and young children with higher developmental ability show increased monitoring of activities and diminished looking at the background [19, 27, 28].

Limitations

The current work has a number of limitations as we continue to examine possible use of activity monitoring as a biomarker. Firstly, population characteristics will need to be expanded for both groups of participants with and without autism in order to parse heterogeneity in ASD. For instance, while this study focused on a large, well-characterized sample of participants with ASD, similar efforts should be taken to characterize TD individuals to understand basic individual variability in activity monitoring. Further, biomarkers should be established and validated within individuals across development (i.e., longitudinal assessment and test–retest validity), as well as with participants with lower cognitive and/or adaptive functioning. Our sample was restricted by an inclusion criterion regarding cognitive ability (IQ > 60), which precluded our ability to evaluate individuals with more substantive intellectual disability. There remains a gap in the literature regarding how the activity monitoring paradigm, and social attention paradigms, in general, function in older and less cognitively able groups [21]. Associations between social attention and ASD symptomology should also be interpreted with caution due to the number of comparisons that were made and the possibility for spurious significant findings. Lastly, replication of this existing paradigm is required, including consistent methodology and analytics, as well as a better understanding of how activity monitoring gaze patterns respond to change (i.e., related to development or a specific treatment intervention).

Conclusion

A key motivation for this work was to examine the potential of looking patterns during viewing of scenes depicting interactive activities to serve as a biomarker for ASD. Important features of a biomarker include robust differences between the clinical population and control group and persistent discriminative value throughout development, from infancy to adulthood. To this end, together with other current work [27, 28], we show that diminished looking to heads in certain contexts (i.e., mutual gaze) constitutes a potentially robust signature of ASD across the lifespan. By comparison, this same body of work suggests that looking at activities, while being a powerful predictor in very early childhood, may not have a strong discriminative ability later in childhood and adulthood. Identification of endophenotypic constructs may be more achievable in studies of infants, where skills are just emerging, but are likely to become more difficult and complex in older children and adults when interactions between life experiences, treatment effects, and compensatory mechanisms may play a role [2]. Social attention deficits at different ages may also vary along the developmental trajectory of ASD. Finally, there may be a distinction between diagnostic and phenotypic biomarkers, such that some tasks are more sensitive to the potentially binary diagnostic classification of ASD, whereas other tasks are more sensitive to the phenotypic heterogeneity observed within ASD [9].

We currently represent collaborations across multiple institutions [1, 61] that seek to develop biomarkers for ASD. Continued support across research institutions will be necessary to better understand and validate eye tracking and other candidate biomarkers.

Availability of data and materials

All data generated or analyzed during this study are included in this published article [and its supplementary information files].

Abbreviations

ABC:

Aberrant Behavior Checklist—Community

ABI:

Autism Behavior Inventory

ADOS-2:

Autism Diagnostic Observation Schedule, 2nd Edition

ASD:

Autism spectrum disorder

CASI:

Child Adolescent Symptom Inventory

CASI-Anx:

Child Adolescent Symptom Inventory—Anxiety

df :

Degrees of freedom

IQ:

Intelligence quotient

KBIT-2:

Kaufmann Brief Intelligence Test-2

RBS-R:

Repetitive Behavior Scale—Revised

ROI:

Region-of-interest

rs:

Reported correlations

SD:

Standard deviation

SE:

Standard error

SRS-2:

Social Responsiveness Scale 2™

TD:

Typically developing

References

  1. McPartland JC. Developing clinically practicable biomarkers for autism spectrum disorder. J Autism Dev Disord. 2017;47(9):2935–7.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Rice K, Moriuchi JM, Jones W, Klin A. Parsing heterogeneity in autism spectrum disorders: visual scanning of dynamic social scenes in school-aged children. J Am Acad Child Adolesc Psychiatry. 2012;51(3):238–48.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Chawarska K, Macari S, Shic F. Context modulates attention to social scenes in toddlers with autism. J Child Psychol Psychiatry. 2012;53(8):903–13.

    Article  PubMed  Google Scholar 

  4. Chawarska K, Volkmar F, Klin A. Limited attentional bias for faces in toddlers with autism spectrum disorders. Arch Gen Psychiatry. 2010;67(2):178–85.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Jones W, Carr K, Klin A. Absence of preferential looking to the eyes of approaching adults predicts level of social disability in 2-year-old toddlers with autism spectrum disorder. Arch Gen Psychiatry. 2008;65(8):946–54.

    Article  PubMed  Google Scholar 

  6. Pierce K, Conant D, Hazin R, Stoner R, Desmond J. Preference for geometric patterns early in life as a risk factor for autism. Arch Gen Psychiatry. 2011;68(1):101–9.

    Article  PubMed  Google Scholar 

  7. Riby DM, Hancock PJ. Viewing it differently: Social scene perception in Williams syndrome and autism. Neuropsychologia. 2008;46(11):2855–60.

    Article  PubMed  Google Scholar 

  8. Freeth M, Bugembe P. Social partner gaze direction and conversational phase; factors affecting social attention during face-to-face conversations in autistic adults? Autism. 2019;23(2):503–13.

    Article  PubMed  Google Scholar 

  9. Bradshaw J, Klin A, Evans L, Klaiman C, Saulnier C, McCracken C. Development of attention from birth to 5 months in infants at risk for autism spectrum disorder. Dev Psychopathol. 2019. https://0-doi-org.brum.beds.ac.uk/10.1017/S0954579419000233.

    Article  PubMed  Google Scholar 

  10. Dawson G, Bernier R, Ring RH. Social attention: a possible early indicator of efficacy in autism clinical trials. J Neurodev Disord. 2012;4(1):11. https://0-doi-org.brum.beds.ac.uk/10.1186/1866-1955-4-11.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Elsabbagh M, Gliga T, Pickles A, Hudry K, Charman T, Johnson MH. The development of face orienting mechanisms in infants at-risk for autism. Behav Brain Res. 2013;251:147–54.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Frazier TW, Klingemier EW, Parikh S, Speer L, Strauss MS, Eng C, et al. Development and validation of objective and quantitative eye tracking-based measures of autism risk and symptom levels. J Am Acad Child Adolesc Psychiatry. 2018;57(11):858–66.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Jones EJ, Venema K, Earl R, Lowy R, Barnes K, Estes A, et al. Reduced engagement with social stimuli in 6-month-old infants with later autism spectrum disorder: a longitudinal prospective study of infants at high familial risk. J Neurodev Disord. 2016;8:7. https://0-doi-org.brum.beds.ac.uk/10.1186/s11689-016-9139-8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Moore A, Wozniak M, Yousef A, Barnes CC, Cha D, Courchesne E, et al. The geometric preference subtype in ASD: identifying a consistent, early-emerging phenomenon through eye-tracking. Mol Autism. 2018;9:19. https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-018-0202-z.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Pierce K, Marinero S, Hazin R, McKenna B, Barnes CC, Malige A. Eye tracking reveals abnormal visual preference for geometric images as an early biomarker of an autism spectrum disorder subtype associated with increased symptom severity. Biol Psychiatry. 2016;79(8):657–66.

    Article  PubMed  Google Scholar 

  16. Thorup E, Nyström P, Gredebäck G, Bölte S, Falck-Ytter T. Altered gaze following during live interaction in infants at risk for autism: an eye-tracking study. Mol Autism. 2016;7:12. https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-016-0069-9.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Mandell DS, Novak MM, Zubritsky CD. Factors associated with age of diagnosis among children with autism spectrum disorders. Pediatrics. 2005;116(6):1480–6.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Moss J, Howlin P. Autism spectrum disorders in genetic syndromes: implications for diagnosis, intervention and understanding the wider autism spectrum disorder population. J Intellect Disabil Res. 2009;53(10):852–73.

    Article  CAS  PubMed  Google Scholar 

  19. White SW, Keonig K, Scahill L. Social skills development in children with autism spectrum disorders: A review of the intervention research. J Autism Dev Disord. 2007;37(10):1858–68.

    Article  Google Scholar 

  20. Chita-Tegmark M. Social attention in ASD: A review and meta-analysis of eye-tracking studies. Res Dev Disabil. 2016;48:79–93.

    Article  PubMed  Google Scholar 

  21. Frazier TW, Strauss M, Klingemier EW, Zetzer EE, Hardan AY, Eng C, et al. A meta-analysis of gaze differences to social and nonsocial information between individuals with and without autism. J Am Acad Child Adolesc Psychiatry. 2017;56(7):546–55.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Chevallier C, Parish-Morris J, McVey A, Rump KM, Sasson NJ, Herrington JD, et al. Measuring social attention and motivation in autism spectrum disorder using eye-tracking: Stimulus type matters. Autism Res. 2015;8(5):620–8.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Murphy ER, Norr M, Strang JF, Kenworthy L, Gaillard WD, Vaidya CJ. Neural basis of visual attentional orienting in childhood autism spectrum disorders. J Autism Dev Disord. 2017;47(1):58–67.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Shic F, Bradshaw J, Klin A, Scassellati B, Chawarska K. Limited activity monitoring in toddlers with autism spectrum disorder. Brain Res. 2011;1380:246–54.

    Article  CAS  PubMed  Google Scholar 

  25. Johnson MH. Interactive specialization: a domain-general framework for human functional brain development? Dev Cogn Neurosci. 2011;1(1):7–21.

    Article  PubMed  Google Scholar 

  26. Klin A, Jones W, Schultz R, Volkmar F. The enactive mind, or from actions to cognition: lessons from autism. Philos Trans R Soc Lond B Biol Sci. 2003;358(1430):345–60.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Shic F, Chen G, Perlmutter M, Gisin E, Dowd A, Prince E, Flink L, Lansiquot S, Wall C, Kim E, Wang Q, Macari S, Chawarska K. Components of limited activity monitoring in toddlers and children with ASD. In: Presented at the 2014 international meeting for autism research (IMFAR 2014), Atlanta, Georgia, US. May, 2014.

  28. Shic F, Hudac C, Bradshaw J, Macari S, Chawarska K. Components of limited activity monitoring in toddlers with ASD. Manuscript submitted for publication.

  29. Fletcher-Watson S, Leekam SR, Benson V, Frank MC, Findlay JM. Eye movements reveal attention to social information in autism spectrum disorder. Neuropsychologia. 2009;47(1):248–57.

    Article  CAS  PubMed  Google Scholar 

  30. Pantelis PC, Kennedy DP. Deconstructing atypical eye gaze perception in autism spectrum disorder. Sci Rep. 2017;7(1):14990. https://0-doi-org.brum.beds.ac.uk/10.1038/s41598-017-14919-3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Senju A, Kikuchi Y, Hasegawa T, Tojo Y, Osanai H. Is anyone looking at me? Direct gaze detection in children with and without autism. Brain Cogn. 2008;67(2):127–39.

    Article  PubMed  Google Scholar 

  32. Lord C, Luyster R, Gotham K, Guthrie W. Autism Diagnostic Observation Schedule. 2nd ed. Torrence, CA: Western Psychological Services; 2012.

    Google Scholar 

  33. Kaufman AS, Kaufman NL. Kaufman brief intelligence test. 2nd ed. Bloomington, MN: Pearson, Inc; 2004. https://0-doi-org.brum.beds.ac.uk/10.1002/9781118660584.ese1325.

  34. Rutter M, Bailey A, Lord C. Social Communication Questionnaire (SCQ) manual. Los Angeles, CA: Western Psychological Services; 2003.

    Google Scholar 

  35. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 5th ed. Arlington, TX: American Psychiatric Publishing; 2013. https://0-doi-org.brum.beds.ac.uk/10.1176/appi.books.9780890425596.

  36. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59(Suppl 20):22–33.

  37. Jagannatha S, Sargsyan D, Manyakov NV, Skalkin A, Bangerter A, Ness S, et al. A practical application of data mining methods to build predictive models for autism spectrum disorder based on biosensor data from Janssen Autism Knowledge Engine (JAKE®). Stat Biopharm Res. 2019;11(2):111–7.

    Article  Google Scholar 

  38. Manfredonia J, Bangerter A, Manyakov NV, Ness S, Lewin D, Skalkin A, et al. Automatic recognition of posed facial expression of emotion in individuals with autism spectrum disorder. J Autism Dev Disord. 2019;49(1):279–93.

    Article  PubMed  Google Scholar 

  39. Manyakov NV, Bangerter A, Chatterjee M, Mason L, Ness S, Lewin D, et al. Visual exploration in autism spectrum disorder: exploring age differences and dynamic features using recurrence quantification analysis. Autism Res. 2018;11(11):1554–666.

    Article  PubMed  Google Scholar 

  40. Ness SL, Manyakov NV, Bangerter A, Lewin D, Jagannatha S, Boice M, et al. JAKE® multimodal data capture system: insights from an observational study of autism spectrum disorder. Front Neurosci. 2017;11:517. https://0-doi-org.brum.beds.ac.uk/10.3389/fnins.2017.00517.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Ness SL, Bangerter A, Manyakov NV, Lewin D, Boice M, Skalkin A, et al. An observational study with the Janssen Autism Knowledge Engine (JAKE®) in individuals with autism spectrum disorder. Front Neurosci. 2019;13:111. https://0-doi-org.brum.beds.ac.uk/10.3389/fnins.2019.00111.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Sargsyan D, Jagannatha S, Manyakov NV, Skalkin A, Abigail Bangerter A, Seth Ness, et al. Feature selection with weighted importance index in an autism spectrum disorder Study. Stat Biopharm Res. 2019;11(2):118–125.

  43. Bangerter A, Ness S, Aman MG, Esbensen AJ, Goodwin MS, Dawson G, et al. Autism Behavior Inventory: a novel tool for assessing core and associated symptoms of autism spectrum disorder. J Child Adolesc Psychopharmacol. 2017;27(9):814–22.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Bangerter A, Ness S, Lewin D, Aman MG, Esbensen AJ, Goodwin MS, et al. Clinical validation of the Autism Behaviour Inventory: caregiver-rated assessment of core and associated symptoms of autism spectrum disorder. 2019. https://0-doi-org.brum.beds.ac.uk/10.1007/s10803-019-03965-7.

  45. Aman MG, Novotny S, Samango-Sprouse C, Lecavalier L, Leonard E, Gadow KD, et al. Outcome measures for clinical drug trials in autism. CNS Spectr. 2004;9(1):36–47.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Aman MG, Singh NN. Aberrant Behavior Checklist Manual. 2nd ed. East Aurora, NY: Slosson Educational Publications, Inc; 2017.

    Google Scholar 

  47. Gadow KD, Sprafkin J. Adolescent Symptom Inventory 4 screening manual. Stony Brook, NY: Checkmate Plus, LTD; 1997.

    Google Scholar 

  48. Constantino JN, Davis SA, Todd RD, Schindler MK, Gross MM, Brophy SL, et al. Validation of a brief quantitative measure of autistic traits: comparison of the social responsiveness scale with the autism diagnostic interview-revised. J Autism Dev Disord. 2003;33(4):427–33.

    Article  PubMed  Google Scholar 

  49. Bodfish J, Symons F, Lewis MH. The Repetitive Behavior Scale. Human Development Research and Training Center, Morganton, NC: Western Carolina Center; 1999.

    Google Scholar 

  50. Mallinckrod CH, Lane PW, Schnell D, Peng Y, Mancuso JP. Recommendations for the primary analysis of continuous endpoints in longitudinal clinical trials. Drug Inf J. 2008;42(4):303–19.

    Article  Google Scholar 

  51. Freeth M, Chapman P, Ropar D, Mitchell P. Do gaze cues in complex scenes capture and direct the attention of high functioning adolescents with ASD? Evidence from eye-tracking. J Autism Dev Disord. 2010;40(5):534–47.

    Article  CAS  PubMed  Google Scholar 

  52. Parish-Morris J, Pallathra AA, Ferguson E, Maddox BB, Pomykacz A, Perez LS, et al. Adaptation to different communicative contexts: an eye tracking study of autistic adults. J Neurodev Disord. 2019;11(1):5. https://0-doi-org.brum.beds.ac.uk/10.1186/s11689-019-9265-1.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Ketelaars MP, In’t Velt A, Mol A, Swaab H, Bodrij F, van Rijn S. Social attention and autism symptoms in high functioning women with autism spectrum disorders. Res Dev Disabil. 2017;64:78–86.

  54. Van Wijngaarden-Cremers PJM, van Eeten E, Groen WB, Van Deurzen PA, Oosterling IJ, Van der Gaag RJ. Gender and age differences in the core triad of impairments in autism spectrum disorders: a systematic review and meta-analysis. J Autism Dev Disord. 2014;44(3):627–35.

    Article  PubMed  Google Scholar 

  55. Harrop C, Jones D, Zheng S, Nowell S, Schultz R, Parish-Morris J. Visual attention to faces in children with autism spectrum disorder: are there sex differences? Mol Autism. 2019;10:28. https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-019-0276-2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. Klin A, Jones W, Schultz R, Volkmar F, Cohen D. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002;59(9):809–16.

    Article  PubMed  Google Scholar 

  57. Elsabbagh M, Gliga T, Pickles A, Hudry K, Charman T, Johnson MH, BASIS Team. The development of face orienting mechanisms in infants at-risk for autism. Behav Brain Res. 2013;251:147–154.

  58. Jones EJH, Gliga T, Bedford R, Charman T, Johnson MH. Developmental pathways to autism: a review of prospective studies of infants at risk. Neurosci Biobehav Rev. 2014;39(100):1–33.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Gliga T, Jones EJH, Bedford R, Charman T, Johnson MH. (2014). From early markers to neuro-developmental mechanisms of autism. Dev Rev. 2014;34(3):189–207.

  60. Skwerer D, Brukilacchio B, Chu A, Eggleston B, Meyer S, Tager-Flusberg H. Do minimally verbal and verbally fluent individuals with autism spectrum disorder differ in their viewing patterns of dynamic social scenes? Autism. 2019;23(8):2131–44. https://0-doi-org.brum.beds.ac.uk/10.1177/1362361319845563.

    Article  Google Scholar 

  61. Loth E, Charman T, Mason L, Tillmann J, Jones EJH, Wooldridge C, et al. The EU-AIMS Longitudinal European Autism Project (LEAP): design and methodologies to identify and validate stratification biomarkers for autism spectrum disorders. Mol Autism. 2017;8:24. https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-017-0146-8.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Nakagawa S, Johnson PCD, Schielzeth H. The coefficient of determination R2 and intra-class correlation coefficient from generalized linear mixed-effects model revisited and explained. J R Soc Interface. 2017;14(134):20170213. https://0-doi-org.brum.beds.ac.uk/10.1098/rsif.2017.0213.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgments

The authors thank the study participants and the following investigators for their participation in this study: Arizona: Christopher J. Smith, Ph.D.; California: Bennett Leventhal, MD and Robert Hendren, DO; Connecticut (at the time of study conduct): Frederick Shic, Ph.D.; Massachusetts: Jean Frazier, MD; New Jersey: Yvette Janvier, MD; New York: Russell Tobe, MD; North Carolina: Geraldine Dawson, Ph.D.; Pennsylvania: Judith S. Miller, Ph.D.; Washington: Bryan King, MD. Medical writing support was provided by Himabindu Gutha, Ph.D. (SIRO Clinpharm Pvt. Ltd, Thane, India) and additional editorial assistance was provided by Ellen Baum, Ph.D. (Janssen Global Services, LLC). The authors thank the study participants, without whom this study would not have been accomplished, and the investigators for their participation in this study.

Funding

This study was funded by Janssen Research & Development, LLC, USA. The design of the stimuli used in this experiment was funded by NIH R03MH092618. This work was also supported in part by NIH K23MH120476 (PI: Bradshaw). The contents of this manuscript do not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

  1. Janssen Pharmaceutica NV, Turnhoutseweg 30, 2340, Beerse, Belgium

    Dzmitry A. Kaliukhovich & Nikolay V. Manyakov

  2. Janssen Research & Development, LLC, 1125 Trenton-Harbourton Road, Titusville, NJ, 08560, USA

    Abigail Bangerter, Seth Ness & Gahan Pandina

  3. Datagrok, INC, 1800 JFK Blvd Suite 300 PMB 90078, Philadelphia, PA, 19103, USA

    Andrew Skalkin

  4. 312E Robinson Hall, Department of Health Sciences, Bouvé College of Health Sciences, Northeastern University, 360 Huntington Avenue, Boston, MA, 02115, USA

    Matthew S. Goodwin

  5. Duke Center for Autism and Brain Development and Duke Institute for Brain Sciences, Duke University School of Medicine, 2608 Erwin Road, Suite 30, Durham, NC, 27705, USA

    Geraldine Dawson

  6. Benioff Children’s Hospital, University of California, San Francisco, 401 Parnassus Avenue, Langley Porter, San Francisco, CA, 94143-0984, USA

    Robert L. Hendren & Bennett Leventhal

  7. Center for Youth Development and Intervention, University of Alabama, Box 870348, Tuscaloosa, AL, 35487-0348, USA

    Caitlin M. Hudac

  8. Department of Psychology, University of South Carolina, 1512 Pendleton Street, Columbia, SC, 29201, USA

    Jessica Bradshaw

  9. Department of Pediatrics, Seattle Children’s Research Institute, Center for Child Health, Behavior and Development, University of Washington, 6200 NE 74th Street, Ste 110, Seattle, WA, 98115-8160, USA

    Frederick Shic

Authors
  1. Dzmitry A. Kaliukhovich
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nikolay V. Manyakov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Abigail Bangerter
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Seth Ness
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrew Skalkin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Matthew S. Goodwin
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Geraldine Dawson
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Robert L. Hendren
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Bennett Leventhal
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Caitlin M. Hudac
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Jessica Bradshaw
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Frederick Shic
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Gahan Pandina
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors participated in the original design of the study, supervising recruitment, and monitoring of data quality, and contributed to the data interpretation, development, and/or review of this manuscript and confirm that they have read the journal’s position on issues involved in ethical publication and affirm that this report is consistent with those guidelines. All authors meet ICMJE criteria and all those who fulfilled those criteria are listed as authors. All authors had access to the study data, provided direction and comments on the manuscript, made the final decision about where to publish these data, and approved submission to this journal. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Dzmitry A. Kaliukhovich.

Ethics declarations

Ethics approval and consent to participate

The Institutional Review Board at each of the nine participating study sites approved the study protocol and subsequent amendments. The study was conducted in accordance with the ethical principles of the Declaration of Helsinki, consistent with Good Clinical Practices and applicable regulatory requirements. Participants, their parents (for participants < 18 years old), or legally authorized representatives provided written informed consent before joining the study. Participants also provided assent.

Consent for publication

Not applicable.

Competing interests

Dzmitry A. Kaliukhovich, Nikolay V. Manyakov, Abigail Bangerter, Seth Ness, Andrew Skalkin (at the time of study conduct), and Gahan Pandina are employees of Janssen Research & Development, LLC and hold company stocks/stock options. Matthew Goodwin has received research and consulting funding from Janssen Research & Development, LLC. Geraldine Dawson is on the Scientific Advisory Boards of Janssen Research and Development, Akili, Inc., LabCorp, Inc., and Roche Pharmaceutical Company, a consultant for Apple, Inc, Gerson Lehrman Group, Guidepoint, Inc., Teva Pharmaceuticals, Tris Pharma, Inc., and Axial Ventures, has received grant funding from Janssen Research and Development, and is CEO of DASIO, LLC. Dawson has developed technology that has been licensed and Dawson and Duke University have benefited financially. Dawson receives royalties from Guilford Press, Springer, and Oxford University Press. Robert Hendren received reimbursement for consultation from Janssen Research & Development, LLC. Bennett Leventhal has received research grant funding from the NIH, is a consultant to Janssen Research and Development, LLC and the Illinois Children’s Healthcare Foundation, and is a board member of the Brain Research Foundation. Frederick Shic is on the Scientific Advisory Board of and is a consultant to Janssen Research and Development, LLC, and has received grant funding from Janssen Research and Development LLC, and Roche.

Previous presentations

Data from this study were submitted as an abstract and accepted for presentation at the 32nd ECNP Congress, September 8, 2019, Copenhagen, Denmark.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1

Table S1. Correlations between % looking time for different ROIs and symptoms severity in participants with ASD. The data are presented for each of the two stimulus conditions separately. Cells contain Spearman partial correlation coefficients along with the corresponding two-sided p values in parentheses. The correlation coefficients are computed on the data of all participants with ASD, with participant’s age, sex and KBIT-2 intelligence composite score being used as covariates. Cells with p values below 0.05 are highlighted in bold. n indicates the number of participants with the data of the corresponding behavior rating scale available. ASD autism spectrum disorder, KBIT-2 Kaufmann Brief Intelligence Test-2, ROI region-of-interest

Additional file 2

Table S2. Fixed effects in linear mixed-effects models of different ROIs. Significance of the fixed effects is assessed using analysis of variance type III sum of squares and the Wald χ2 test. p values below 0.05 are highlighted in bold. df degrees of freedom, ROI region-of-interest.

Additional file 3

Table S3. Least-squares mean estimates, standard errors and two-sided 95% confidence intervals for different levels of the modelled categorical factors. ASD autism spectrum disorder, df degrees of freedom, ROI region-of-interest, TD typically developing.

Additional file 4

Table S4. Pair-wise comparisons of % looking time between the two groups of participants and stimulus conditions. Post-hoc pair-wise comparisons are performed using the Tukey–Kramer correction for multiple comparisons. p values below 0.05 are highlighted in bold. Cohen’s d is computed using all available data without selecting the same participants across stimulus conditions (see Additional file 8: Table S8). ASD autism spectrum disorder, df degrees of freedom, ROI region-of-interest, SE standard error, TD typically developing

Additional file 5

Table S5. Coefficients of determination R2 in linear mixed-effects models of different ROIs. Marginal R2 corresponds to the proportion of the total variance explained by the fixed effects, whereas conditional R2 is the proportion of the variance explained by both fixed and random effects [62]. The same models as that in Additional file 2: Table S2 are analyzed. ROI region-of-interest.

Additional file 6

Table S6. Coefficients of determination R2 in linear mixed-effects models comparing slopes of the relationships between participant’s age and % looking time across the two groups of participants. Marginal R2 corresponds to the proportion of the total variance explained by the fixed effects, whereas conditional R2 is the proportion of the variance explained by both fixed and random effects [62]. The same models as those in Additional file 7: Table S7 are analyzed. ROI region-of-interest.

Additional file 7

Table S7. Fixed effects in linear mixed-effects models comparing slopes of the relationships between participants’ age and % looking time across the two groups of participants. Significance of the fixed effects is assessed using analysis of variance type III sum of squares and the Wald χ2 test. p values below 0.05 are highlighted in bold. df degrees of freedom, ROI region-of-interest.

Additional file 8

Table S8. Participant characteristics for each stimulus condition separately. n indicates the number of participants. ASD autism spectrum disorder, ADOS-2 Autism Diagnostic Observation Schedule, 2nd Edition, KBIT-2 Kaufmann Brief Intelligence Test-2, TD typically developing.

Additional file 9

Figure S1. Scatter plots between the KBIT-2 IQ composite score and looking time for the ROIs Bodies and Heads. Only the data of individuals with ASD are presented. The data are presented for each stimulus condition (a, c—Shared focus; b, d—Mutual gaze) and ROI (a, b—Bodies; c, d—Heads) separately. Red dots denote individual participants, with n indicating their total number. The red line in each panel represents the best linear fit of the presented data. rS in each panel correspond to a Spearman partial correlation coefficient computed on the data presented in that panel, with the corresponding p value being shown in parentheses. ASD autism spectrum disorder, KBIT-2 Kaufmann Brief Intelligence Test-2.

Additional file 10

Figure S2. Scatter plots of significant relationships between looking time and the total score of behavior rating scales. Information about the significant relationships and their strength is provided in Table 2. The x- and y-axes of each panel correspond to the total score of a behavior rating scale and looking time for a specific ROI, respectively. The panel title reports the ROI and stimulus condition in which statistical significance is obtained. rS in each panel correspond to a Spearman partial correlation coefficient computed on the data presented in that panel, with the corresponding p value being shown in parentheses. Red dots denote individual participants, with n indicating their number. The red line in each panel represents the best linear fit of the presented data. ABI Autism Behavior Inventory, ADOS-2 Autism Diagnostic Observation Schedule, 2nd Edition, RBS-R Repetitive Behavior Scale—Revised, ROI region-of-interest.

Additional file 11

Figure S3. Between-group comparisons of the level of visual attention to presented stimuli. The data are presented for each of the two stimulus conditions separately. The red and blue colors correspond to the data of individuals with ASD and TD controls, respectively. The arrows along the x-axis indicate medians of the corresponding histograms matched by color. n is the number of participants. Bin width is 5%. ASD autism spectrum disorder, TD typically developing.

Additional file 12

Table S9. Fixed effects in the linear mixed-effects model that includes ROI and all its interactions with stimulus condition and participant group. To account for correlations between % looking time for different ROIs, the tested model utilizes the data of all ROIs, except for the ROI Background. Significance of the fixed effects is assessed using analysis of variance type III sum of squares and the Wald χ2 test. p values below 0.05 are highlighted in bold. df degrees of freedom, ROI region-of-interest.

Additional file 13

Table S10. Least-squares mean estimates, standard errors and two-sided 95% confidence intervals for different levels of the categorical factors in the linear mixed-effects model that includes ROI and all its interactions with stimulus condition and participant group. The tested model is the same as that presented in Additional file 12: Table S9. ASD autism spectrum disorder, df degrees of freedom, ROI region-of-interest, TD typically developing

Additional file 14

Table S11. Pair-wise comparisons of % looking time between the two groups of participants and stimulus conditions for each ROI separately in the linear mixed-effects model that includes ROI and all its interactions with stimulus condition and participant group. The tested model is the same as that presented in Additional file 12: Table S9 and Additional file 13: Table S10. Post-hoc pair-wise comparisons are performed using the Tukey–Kramer correction for multiple comparisons. The table presents only the results of comparisons within a single ROI but not between any two different ROIs. p values below 0.05 are highlighted in bold. Cohen’s d is computed using all available data without selecting the same participants across stimulus conditions (see Additional file 8: Table S8). ASD autism spectrum disorder, df degrees of freedom, ROI region-of-interest, SE standard error, TD typically developing

Additional file 15

Figure S4. Distributions of % looking time for each individual ROI, stimulus condition and participant group in the linear mixed-effects model that includes ROI and all its interactions with the latter two factors. The data of each ROI, stimulus condition and group of participants (ASD—red, TD—blue) are summarized in a form of boxplots. Black dots denote individual participants. n indicates the number of participants. * p value < 0.05, ** p value < 0.005, *** p value < 0.0005 (corrected for multiple comparisons for each individual ROI using the Tukey–Kramer method; see Additional file 13: Table S10 and Additional file 14: Table S11). Note that the model does not include data of the ROI Background (see Additional file 12: Table S9). ASD autism spectrum disorder, ROI region-of-interest, TD typically developing.

Additional file 16

Table S12. Fixed effects in the linear mixed-effects models that compare slopes of the relationships between participant’s age and % looking time between the two groups of participants while accounting for the effect of stimulus condition. The tested models are similar to those presented in Additional file 7: Table S7 but include stimulus condition and all its interactions with participant’s age and group as additional fixed effects. Significance of the fixed effects is assessed using analysis of variance type III sum of squares and the Wald χ2 test. p values below 0.05 are highlighted in bold. df degrees of freedom, ROI region-of-interest

Additional file 17

Table S13. Fixed effects in the linear mixed-effect model that compare slopes of the relationships between participant’s age and % looking time between the two groups of participants while accounting for the effects of stimulus condition and region of interest. The tested model is similar to those presented in Additional file 7: Table S7 and Additional file 16: Table S12 but includes stimulus condition and region of interest as well as all interactions between the latter two factors and participant’s age and group as additional fixed effects. Only data of the ROIs Activity and Heads are analyzed. Significance of the fixed effects is assessed using analysis of variance type III sum of squares and the Wald χ2 test. p values below 0.05 are highlighted in bold. df degrees of freedom, ROI region-of-interest.

Additional file 18

Table S14. Relationship between participant’s age and % looking time for the ROIs Activity and Heads tested for the groups of participants below a specified age. Only data of the participants below a specified age are analyzed, with n indicating their total number for each of the two stimulus conditions and groups of participants separately. rS corresponds to a Spearman partial correlation coefficient computed on the data of both groups of participants for each selection of participants and stimulus condition separately. The corresponding two-sided p value is shown in parentheses. CI corresponds to a 95% equal-tailed two-sided confidence interval for the computed correlation coefficient. p values below 0.05 and confidence intervals that do not include 0 are highlighted in bold. ASD autism spectrum disorder, CI confidence interval, ROI region-of-interest, TD typically developing

Additional file 19:

Table S15. Fixed effects in linear mixed-effects models comparing slopes of the relationships between participant’s age and % looking time across the two groups of participants that are below a specified age. Significance of the fixed effects is assessed using analysis of variance type III sum of squares and the Wald χ2 test. p values below 0.05 are highlighted in bold. df degrees of freedom, ROI region-of-interest.

Additional file 20

Table S16. Mean % looking time for each individual region of interest, stimulus condition, group of participants and clinical site. n indicates the number of analyzed participants. ASD autism spectrum disorder, TD typically developing.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kaliukhovich, D.A., Manyakov, N.V., Bangerter, A. et al. Social attention to activities in children and adults with autism spectrum disorder: effects of context and age. Molecular Autism 11, 79 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-020-00388-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-020-00388-5

Keywords

Molecular Autism

ISSN: 2040-2392