Skip to main content
Download PDF

Objective measurement of head movement differences in children with and without autism spectrum disorder

Molecular Autism volume 9, Article number: 14 (2018) Cite this article

Abstract

Background

Deficits in motor movement in children with autism spectrum disorder (ASD) have typically been characterized qualitatively by human observers. Although clinicians have noted the importance of atypical head positioning (e.g. social peering and repetitive head banging) when diagnosing children with ASD, a quantitative understanding of head movement in ASD is lacking. Here, we conduct a quantitative comparison of head movement dynamics in children with and without ASD using automated, person-independent computer-vision based head tracking (Zface). Because children with ASD often exhibit preferential attention to nonsocial versus social stimuli, we investigated whether children with and without ASD differed in their head movement dynamics depending on stimulus sociality.

Methods

The current study examined differences in head movement dynamics in children with (n = 21) and without ASD (n = 21). Children were video-recorded while watching a 16-min video of social and nonsocial stimuli. Three dimensions of rigid head movement—pitch (head nods), yaw (head turns), and roll (lateral head inclinations)—were tracked using Zface. The root mean square of pitch, yaw, and roll was calculated to index the magnitude of head angular displacement (quantity of head movement) and angular velocity (speed).

Results

Compared with children without ASD, children with ASD exhibited greater yaw displacement, indicating greater head turning, and greater velocity of yaw and roll, indicating faster head turning and inclination. Follow-up analyses indicated that differences in head movement dynamics were specific to the social rather than the nonsocial stimulus condition.

Conclusions

Head movement dynamics (displacement and velocity) were greater in children with ASD than in children without ASD, providing a quantitative foundation for previous clinical reports. Head movement differences were evident in lateral (yaw and roll) but not vertical (pitch) movement and were specific to a social rather than nonsocial condition. When presented with social stimuli, children with ASD had higher levels of head movement and moved their heads more quickly than children without ASD. Children with ASD may use head movement to modulate their perception of social scenes.

Background

Autism spectrum disorder (ASD) is characterized by persistent impairments in social interaction and communication, as well as repetitive and stereotyped behaviors [1]. Previous research has identified deficits in motor development [2] and higher levels of motor stereotypies in children with ASD than children without ASD [3]. Atypical movement patterns, such as abnormalities in eye contact and body posture, and motor stereotypies are used in the evaluation of ASD, but little attention has focused on characterizing these motor differences through automated, objective measurement [1, 3, 4]. The current study examined whether head movement dynamics differentiated children with and without ASD, and contrasted head movement while watching video of nonsocial and social stimuli.

While movement stereotypies are common in typically developing infants, they decrease rapidly over the first 2 years of life [3]. Atypical head movements in young children have garnered little attention, even though this stereotypy is clinically viewed as highly suggestive of ASD [3, 5, 6]. Descriptively, clinicians have noted that children with ASD exhibit atypical head movements as they stare at their fingers or objects closely from a “strange angle” [3], repetitively peer at objects “from the side” [7], and examine objects from “odd angles or peripheral vision” [8]. Goldman et al. [3] found that this stereotypy is rare, but seemingly specific to children with ASD.

Head movement stereotypy may be an adaptive strategy that facilitates perception or social communication [9, 10]. Turning away from over-stimulating stimuli often marks a child’s need to self-regulate [11]. By engaging in head movement stereotypies or similar movements, individuals with ASD may be regulating incoming visual and social information that is perceived as over-arousing [9].

On the other hand, atypical head movements in children with ASD may contribute to the social impairments that characterize children with ASD. Motor movement is crucial for verbal and nonverbal communication, formation of friendships, and the maintenance of social interactions. Head nods and turns, for example, serve to influence turn-taking between social partners [12]. In successful social interactions, motor movements must be initiated and coordinated [13] as typical motor control functions link the perception of other’s actions and one’s own actions [14]. Motor delays in ASD, such as the inability to coordinate functional head and arm movements, may prevent head turning in response to one’s name and gaze following, and contribute to failures to engage in gestural nonverbal communication such as joint attention [11]. Better quantification of these motor movements will further our understanding of their role in the development of ASD.

Motor movement in ASD has typically been assessed descriptively via parent report and trained human observers. While parents have opportunities to observe their children in multiple contexts, their reports are prone to bias [4, 15]. Coding schemes of motor movement and stereotypies conducted by trained observers are frequently study-specific and receive little or no independent validation [3, 16]. In response to the limitations of qualitative efforts, automated measurement has been used to objectively document atypical motor movement and stereotypies [3, 4, 16,17,18]. ASD is associated with atypical gait in toddlers and children [19,20,21,22], reduced postural stability in children [23,24,25,26], and increased repetitive and stereotypic behaviors in children [3, 27, 28]. A recent meta-analysis revealed that motor impairments in movement preparation, upper extremity motor function, and gait were significantly more pronounced in individuals with ASD than individuals without ASD [4].

Automated measurement and machine-learning algorithms have been used to examine motor movements to both enhance clinical assessment [29, 30] and to elucidate the mechanisms and heterogeneity of ASD [22, 31,32,33]. Machine learning algorithms have successfully distinguished children with severe ASD (age 2–4 years) from children without ASD during a reach-to-grasp task [29]. Machine learning analysis of motor patterns of children playing with smart tablet computers correctly identified children with ASD from children without ASD [30]. Children with ASD contacted the table with greater force, had different distributions of force within a gesture, and displayed faster and larger movements than children without ASD [30, 32].

An initial report on postural sway examined head movement differences between children with and without ASD. Children with ASD exhibited greater head movement and sway while standing than children without ASD, and both groups reduced their postural sway during performance of a nonsocial task [23]. However, with the exception of postural sway tasks [23], investigations of motor movement have not focused on head movements in children with and without ASD. Taken together, previous research supports the importance of head movement atypicalities in ASD and suggests they warrant further exploration.

Current study

We conducted a quantitative comparison of head movement dynamics in children with and without ASD, matched on mental age, between 2.5- and 6.5-years-old, using an automated head tracking system. In lieu of subjective, manual coding, automated tracking provided objective measurement to quantify differences in head movement dynamics. We hypothesized that children with ASD would exhibit greater and more rapid head movement than children without ASD. As children with ASD typically exhibit preferential attention to nonsocial versus social stimuli [34,35,36], we conducted an a priori analysis to ascertain whether differences in head movement dynamics between children with and without ASD varied by social and nonsocial stimulus presentation.

Methods

Participants

Participants were 2.5–6.5-year-old children (mean = 4.72 years, SD = 1.14 years, range = 4.25 years) with (n = 21) and without (n = 21) ASD. Children with ASD were the older siblings of infants recruited from a longitudinal study of high-risk development. Children without ASD were typically developing children, with no reported risks or diagnoses at the time of study, and were recruited from a longitudinal study of high-risk development and from the community, through recruitment flyers. Children were excluded from the study if they had a gestational age below 37 weeks or major birth complications. Parents were reimbursed $50 for their child’s participation in the study. Recruitment and procedures were approved by the University’s Internal Review Board and written, parental consent was obtained before participation.

Measures and procedure

Clinical diagnosis of ASD or the absence of ASD was determined at study entry. The Autism Diagnostic Observation Schedule [37] and Autism Diagnostic Interview-Revised [38] were used to inform the DSM-IV-based best estimate diagnosis from a licensed psychologist, who was unfamiliar with the child’s previous diagnosis. To assess children’s mental age, children were administered with either the Wechsler Preschool and Primary Scale of Intelligence (n = 33; WPPSI-III, [39]) or the Mullen Scales of Early Learning (n = 6; Mullen, [40]). The Mullen was typically administered when children were 37 months of age or younger. Except for two 36-month-olds (1 ASD, 1 No ASD), the WPPSI was administered when childern were older than 37 months. Three children (2 ASD, 1 No ASD) did not receive a cognitive assessment. Groups were comparable on the assessments administered, χ2(2) = 1.27, p = .53.

Groups were matched a priori on mental age [41]. Groups did not differ on chronological age, F (1,41) = 4.00, p > .05; mental age, F (1,38) = .007, p > .05 (Table 1); or gender, Fisher’s exact test p = .58 (Table 2).

Table 1 Chronological age and mental age by ASD group
Full size table
Table 2 Gender by ASD group
Full size table

Children were seated approximately 65 cm in front of a 19-in. video monitor. They were asked to watch a short video, while a camera positioned on top of the monitor recorded their face and upper body at 29.971 frames/s. The protocol consisted of a 16-min video, composed of both social and nonsocial stimuli. The monitor displayed six videos of stimuli designed to elicit joint-attention and emotion expression in children. Video 1 was a 3-min social stimulus presentation of an actual boy pointing in a virtual environment to a side television of an animated character (SpongeBob), which was designed to elicit looks from the boy to the television (joint attention). Video 2 was a 2-min presentation of a non-social, audio-visual screensaver. Video 3 was a 3-min social stimulus presentation of an animated boy pointing in a virtual environment to a side television of an animated character (SpongeBob), which was designed to elicit looks from the boy to the television (joint attention). Video 4 was a social, 6-min emotion-eliciting story of a birthday party told by a woman. Video 5 was a social, 1-min Wonder Pets cartoon clip, and video 6 was a social, 1-min Mickey Mouse cartoon clip (Fig. 1).

Fig. 1
figure 1

Stimuli presentation by video. The 16-min video consisted of social and nonsocial stimuli, designed to elicit joint-attention and emotion expression in young children

Full size image

Based on an a priori hypothesis, video 2 served as the nonsocial stimulus and the first 2-min of video 4 served as the social stimulus (the same pattern of results was observed when analyzing the full 6-min of video 4). Other videos contained a mixture of actual and animated figures and were not appropriate for sociality contrasts.

Head tracking

To quantify head movement dynamics, a fully automatic, person-independent computer-vision algorithm was used to track pitch, yaw, and roll of head movement (http://zface.org/, Zface, [42]). For each video frame, the algorithm registered a dense 3D face shape in real-time. This was accomplished using a fast cascade regression framework trained on high-resolution 3D face-scans of posed and spontaneous face and head motion. Zface was computationally efficient but delivered high precision tracking. Experimental findings strongly support the validity of real-time, 3D registration and reconstruction from 2D video [42]. Compared to 10 other computer-vision based approaches for head tracking, Zface achieved the lowest absolute angular error for head pitch and the second lowest angular error for yaw (2.66 and 3.93 degrees, respectively) [43].

For each video frame, the algorithm outputted 3° of rigid head movement—pitch (vertical movement; head nods), yaw (horizontal movement; head turns), and roll (lateral head inclinations toward the shoulder) (Fig. 2) or a failure message when a frame could not be tracked (see Table 3 for the range of pitch, yaw, and roll).

Fig. 2
figure 2

Head orientation. The 3° of rigid head movement (pitch, yaw, and roll) are indexed above by the x, y, and z arrows. The green arrow indexes pitch, the blue arrow indexes yaw, and the red arrow indexes roll

Full size image
Table 3 Range of pitch, yaw, and roll
Full size table

17.4% of the frames could not be tracked, which is comparable with previous work in this area [44]. Several conditions contributed to tracking failure, including self-occlusion (hands on the face), extreme head movement, and location change (e.g., i.e., child moved out of the frame). Proportions of successfully tracked frames were examined for ASD group differences.

Data reduction

To ensure that missing data would not bias measurements, head movement dynamics were measured separately for each consecutively tracked segment (epoch). Epochs were defined as successfully tracked consecutive frames within a video (mean epoch length = 577.35 frames, at 29.971 frames per second). A 2 (group) by 6 (video) repeated-measures ANOVA indicated that the number of epochs per video did not differ significantly between groups, F (40) = 2.70, p = .11, Marginal MeanASD = 18.1, Marginal MeanNonASD = 8.0. A 2 (group) by 6 (video) showed that the mean duration of an epoch also did not differ significantly between groups, F (40) = 1.89, p = .18, Marginal MeanASD = 747.98 frames/epoch, Marginal MeanNonASD = 1049.04 frames/epoch (Table 4). Nevertheless, children with ASD tended to have more epochs of briefer duration than children without ASD.

Table 4 Number of epochs and mean epoch duration by ASD Group
Full size table

Within each epoch, head movement dynamics were quantified with respect to the three principal axes of pitch, yaw, and roll. For each of these axes, angular displacement and angular velocity were calculated for each frame of video. Angular values in displacement and velocity of pitch, yaw, and roll were measured in radians and radians/frame, respectively. For pitch, yaw, and roll, angular displacement was calculated as the difference between each observed head angle value and the overall mean of head angle within each epoch. Similarly, for pitch, yaw, and roll, angular velocity was calculated as the temporal derivative of the angular displacement for each movement direction using the finite difference method (the location difference between successive video frames).

The root mean square (RMS) then was used to measure the magnitude of angular displacement and angular velocity of pitch, yaw, and roll, respectively [44,45,46,47]. The RMS value was calculated as the square root of the arithmetic mean of the squares of the original values, in our case the angular displacements and the angular velocities. To account for the varying lengths of epochs caused by untracked frames, the RMS value for each epoch was weighted by its epoch duration. These weighted values were averaged across epochs to obtain a normalized RMS value (nRMS; Eq. 1). The obtained nRMS for angular displacement and angular velocity for pitch, yaw, and roll are used in subsequent analyses and are referred to as angular displacement and angular velocity for simplicity.

$$ {\mathrm{nRMS}}_x=\sqrt{\frac{1}{n}\left({x}_1^2+{x}_2^2+\dots +{x}_n^2\right)} $$
(1)

where x21…x2 n are the squared differences between the value of a frame and the mean value of frames within an epoch.

Analytic approach

Preliminary analyses

A preliminary 2 (group) × 6 (video) repeated-measures analysis of variance (ANOVA) compared the proportion of successfully tracked frames by ASD group to determine whether children with and without ASD differed in levels of automated tracking.

ASD group differences

A second 2 (group) × 6 (video) repeated-measures ANOVA was used to test for differences between children with and without ASD in the angular displacement and angular velocity of pitch, yaw, and roll respectively. We hypothesized that children with ASD would exhibit greater angular displacement and angular velocity of pitch, yaw, and roll than children without ASD.

ASD group by stimulus type interaction

Planned contrasts were then used to test for the interaction between stimulus type (social versus nonsocial) and group (ASD versus no ASD). A 2 (group) × 2 (NonsocialVideo2 vs. SocialVideo4) repeated-measures ANOVAs examined whether children with and without ASD differed in pitch, yaw, and roll angular displacement and angular velocity separately between nonsocial (video 2) and social stimuli (video 4). All main analyses were then repeated covarying chronological age to determine the degree to which differences between the mental-age-matched groups might be due to chronological age. (Analyses of supplementary head movement variables, which yielded results similar to those outlined below, are found in Additional file 1.)

Results

Preliminary analyses

A one-way analysis of the proportion of successfully tracked frames over the entire course of the protocol revealed no group differences, F (39) = .08, p = .77, partial η2 = .003 (Fig. 3). A repeated-measures ANOVA indicated a main effect of video, F (3.58, 38) = 3.01, p = .03 partial η2 = .07, and no interaction of video by group, F (3.58, 38) = .15, p = .95, partial η2 = .004. There were no group differences in proportion of successfully tracked frames by video, ps > .69.

Fig. 3
figure 3

Proportion of tracked frames by group. Children with ASD did not differ in their proportion of frames successfully tracked by the automated software (Zface) than children without ASD. Overall, 85% of frames for children with ASD were tracked and 87% of frames for children without ASD were tracked. Error bars: ± 1 SEM

Full size image

ASD group differences

For angular displacement, a 2 (group) × 6 (video) repeated-measures analysis of variance (ANOVA) revealed main effects of video for pitch and yaw. No significant interactions of video and group were found for the angular displacement of pitch, yaw, and roll. Children with ASD exhibited greater angular displacement of yaw than children without ASD, indicating greater head turning, F (1, 37) = 4.36, p = .04, partial ηp2 = .11 (Fig. 4, Table 5). Children with ASD did not differ from children without ASD on pitch and roll angular displacement, ps > .05.

Fig. 4
figure 4

Between-group differences in yaw angular displacement. Children with ASD have greater yaw angular displacement than children without ASD. Note. Error bars: ± 1 SEM

Full size image
Table 5 Repeated-measures ANOVA of pitch, yaw, and roll
Full size table

For angular velocity, repeated-measures ANOVA revealed a main effect of video for pitch and roll. No significant interactions of video and group were found for angular velocity of yaw, pitch, and roll. Children with ASD exhibited greater angular velocity of yaw, F (1, 37) = 4.01, p = .050, partial ηp2 = .10, and roll, F (1, 37) = 7.35, p = .010, partial ηp2 = .17 than children without ASD, indicating greater head movement (Fig. 5, Table 5). Pitch angular velocity did not differ between children with and without ASD, p > .05.

Fig. 5
figure 5

Between-group differences in yaw and roll angular velocity. Children with ASD had greater yaw and roll angular velocity than children without ASD. Note. Error bars: ± 1 SEM

Full size image

ASD group by stimulus type (social versus nonsocial video) interaction

Planned contrasts revealed an interaction between video and group for yaw angular displacement, F (1,40) = 7.86, p < .01, ηp2 = 16, and a significant between-subjects effect of group, F (1) = 5.99, p = .019, ηp2 = .13 (Fig. 6). Children with ASD had greater angular displacement of yaw in the social video (video 4), than children without ASD, and did not differ in their angular displacement of yaw in the nonsocial video (video 2) than children without ASD. There were no interactions between video and group for angular displacement of pitch and roll, ps > .05.

Fig. 6
figure 6

Video (nonsocial vs. social) by group interaction. Compared to children without ASD, children with ASD differed in angular displacement of yaw (a) and angular velocity of yaw (b) and roll (c) only during the social stimulus (video 4), but not the nonsocial stimulus (video 2). Error bars: ± 1 SEM

Full size image

For angular velocity of yaw, there was an interaction between video and group, F (1,40) = 8.35, p < .01, ηp2 = .17, and a significant between-subjects effect of group, F (1,40) = 4.90, p = .033, ηp2 = .11 (Fig. 6). There was also an interaction between video and group for angular velocity of roll F (1,40) = 4.27, p = .045, ηp2 = .10, with a significant between-subjects effect of group, F (1,40) = 4.69, p = .036, ηp2 = .11 (Fig. 6). Children with ASD had greater angular velocity of yaw and roll in video 4 (social video) than children without ASD and did not differ in their angular velocity of yaw and roll in video 2 (nonsocial video). There was no interaction between video and group for angular velocity of pitch, p > .05.

Controlling for age

A 2 (group) × 6 (video) repeated-measures analysis of variance (ANOVA) was conducted with chronological age as a covariate. As when not considering this covariate, children with ASD exhibited greater angular displacement of yaw than children without ASD, indicating greater head turning, F (1, 36) = 5.36, p = .02, η p 2 = .13. As when not considering the age covariate, children with ASD exhibited greater angular velocity of roll, F (1, 36) = 5.45, p = .02, ηp2 = .13, than children without ASD, indicating greater head rolling motion. Unlike previous findings without age, children with ASD did not exhibit greater angular velocity of yaw, F (1, 36) = .73, p = .40, η p 2 = .02 when controlling for chronological age. All other findings were unchanged.

The planned contrast models (social versus nonsocial video) were repeated with angular velocity including chronological age as a covariate. As in previous findings without age as a covariate, there was an interaction between video and group for angular velocity of yaw, F (1,39) = 4.83, p < .03, ηp2 = .11, but there was no between subject’s effect of group, F (1,39) = 1.72, p = .20, ηp2 = .04. Children with ASD had greater angular velocity of yaw in the social video (video 4) than children without ASD, and the two groups did not differ in the angular velocity of yaw and roll in the nonsocial video (video 2). Unlike previous analyses without age as a covariate, no interaction between group and video was found for angular velocity of roll when chronological age was included in the model, F (1,39) = 2.97, p = .09, ηp2 = .07. All other findings were unchanged.

Discussion

Using automated, objective measurement, we quantified differences in head movement dynamics between children with and without ASD, shedding light on head movement atypicalities previously described by clinicians. Children with ASD showed greater angular displacement of yaw and greater angular velocity of yaw and roll than children without ASD. Angular displacement is interpreted as head movement quantity, and angular velocity is interpreted as the speed of head movement. Thus, children with ASD exhibited greater head turning (yaw)—and turned their heads (yaw) and inclined their heads (roll) with greater speed—than children without ASD. Differences in head movement dynamics between children with and without ASD were specific to the presentation of a social stimulus. That is, children with ASD exhibited greater yaw angular displacement and yaw and roll angular velocity during presentation of the social stimulus than children without ASD.

Analyses were repeated including chronological age as a covariate—groups were matched a priori on mental age—to disentangle age and ASD differences [3, 48]. When controlling for chronological age, children with ASD continued to exhibit greater head turning (yaw) and inclined their heads (roll) with greater speed than children without ASD. When controlling for chronological age, differences in head movement dynamics between children with and without ASD remained specific to the presentation of a social stimulus for angular displacement of yaw and angular velocity of yaw, but not angular velocity of roll. Comparison of models, with and without statistical controls for chronological age, highlight angular displacement of yaw and angular velocity of yaw and roll as consistent signatures of ASD.

The current findings add to a small but growing body of literature utilizing automated measurement of body and head movement to objectively quantify the ASD phenotype [32, 49]. In a previous investigation, for example, 9-year-old children with ASD exhibited greater sway while standing in both the anterior-posterior (front-to-back) and medial-lateral (side-to-side) axes than did children without ASD, but sway was reduced during the search task, suggesting better movement control when pursuing a goal [23]. By contrast, we measured 3° of rigid head movement (pitch, yaw, and roll) from video-recordings of younger, seated children. Younger children with ASD exhibited greater head displacement and velocity in the horizontal (yaw) and lateral (roll) but not vertical (pitch) axes than children without ASD. These differences in displacement and velocity were specific to social stimuli presentation. Together, these findings suggest that nonsocial engagement constrains excess head movement dynamics in children with ASD, while spontaneous activity, particularly in reaction to social stimuli, is associated with increased head movement dynamics.

Children with ASD may use head movement as a way to modulate their sensory experience [50]. Previous primary research [4] and meta-analytic results of observational measures [51] indicate that infants and children with ASD displayed higher levels of motor impairments than infants and children without ASD. Motor impairments may constitute a core feature of ASD, a finding supported by the current studies comparisons of children with and without ASD [4, 32]. However, when head movement was compared during the presentation of social and nonsocial stimuli, head movement differences were specific to the presentation of social stimuli. Previous research using eye-tracking indicates that children with ASD look less at social stimuli than nonsocial stimuli [36, 51, 52], suggesting that children with ASD shift their gaze to regulate overstimulating social information. Viewing faces and engaging with social partners requires complex timing and attunement, which may be effortful for children with ASD [53]. Together, these findings suggest that increased head movement in reaction to social stimuli may reflect increased sensitivity to social scenes among children with ASD.

Children with ASD may engage in more extreme and quicker head movement than children without ASD because they are unable to regulate incoming social information. Possible disruptions in motor planning and head movements early in development may have cascading effects in later social engagement [54, 55]. Given early associations between motor experience and the development of social behaviors [56], early disruptions in head movement may index atypical developmental trajectories [6, 57].

Limitations and future directions

Differences between children with and without ASD in head displacement and velocity were obtained in a small sample, highlighting the need for replication. The current study tested specific a priori hypotheses regarding head movement dynamic differences by nonsocial and social stimuli. Future research could build upon this research and explore whether head movement dynamics varies proportionally as a result of the degree of sociality of the stimulus. Future research with larger sample sizes and a fully counterbalanced protocol will allow researchers to examine more nuanced research questions.

While use of automated measurement marks progress in objectively quantifying head movement dynamics, there were limitations associated with this approach. The inability of the automated software to track extreme head movement and self-occlusion resulted in missing data (~ 17%). Although missing data did not vary by group, the presence of missing data necessitated using epochs of continuous data collection as a unit of analysis. Moreover, although not significant, children with ASD tended to have more epochs of briefer duration than children without ASD. It is possible that an inability to quantify head movement between epochs yielded a conservative assessment of group differences.

Angular displacement and velocity of pitch, yaw, and roll were moderately correlated in our data, and we chose to examine these dynamics separately. An alternative approach could be to model these movements together to assess differences in children with and without ASD. The addition of postural adjustments and muscle tension measurements to the model would allow for examination of coupling between head, neck, and torso in human movement, and potential differences in coupling associated with ASD.

Conclusions

Using automated measurement, we quantified differences in the quantity and speed of head movement between children with and without ASD, finding differences in the lateral (yaw and roll) but not vertical (pitch) domain. Children with ASD had greater yaw angular displacement and greater yaw and roll angular velocity, and these differences were most pronounced during social stimulus presentation. The results are consistent with the hypothesis that children with ASD use head movement to regulate their direct exposure to potentially arousing social situations. The study reports on a promising advance in objectively characterizing head movement dynamics. Our findings highlight the possibility of using automated measurement of head motion to supplement current diagnostic approaches for ASD. Automated measurement of head motion in varied contexts could provide an objective method of differentiating children with and without ASD. In contrast to previous approaches to head movement quantification, the computer-vision based approach we used here is non-invasive, may be applied to already collected video of children, and may be well suited for use in monitoring change over the course of the disorder and in response to interventions. 

Abbreviations

ANOVA:

Analyses of variance

ASD:

Autism spectrum disorder

nRMS :

Normalized root mean square

RMS:

Root mean square

References

  1. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. 5th ed. Arlington: American Psychiatric Publishing; 2013.

  2. Provost B, Lopez B, Heimerl S. A comparison of motor delays in young children: autism spectrum disorder, developmental delay, and developmental concerns. J Autism Dev Disord. 2007;37(2):321–8.

    Article  PubMed  Google Scholar 

  3. Goldman S, et al. Motor stereotypies in children with autism and other developmental disorders. Dev Med Child Neurol. 2009;51(1):30–8.

    Article  PubMed  Google Scholar 

  4. Fournier, et al. Motor coordination in autism spectrum disorders: a synthesis and meta-analysis. J Autism Dev Disord. 2010;40(10):1227–40.

    Article  PubMed  Google Scholar 

  5. Freeman BJ, et al. The behavior observation scale for autism: initial methodology, data analysis, and preliminary findings on 89 children. J Am Acad Child Psychiatry. 1978;17(4):576–88.

    Article  CAS  PubMed  Google Scholar 

  6. Zwaigenbaum L, et al. Behavioral manifestations of autism in the first year of life. Int J Dev Neurosci. 2005;23(2–3):143–52.

    Article  PubMed  Google Scholar 

  7. Kim SH, Lord C. Restricted and repetitive behaviors in toddlers and preschoolers with autism spectrum disorders based on the autism diagnostic observation schedule (ADOS). Autism Res. 2010;3(4):162–73.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Ozonoff S, et al. A prospective study of the emergence of early behavioral signs of autism. J Am Acad Child Adolesc Psychiatry. 2010;49(3):256–66. e2

    PubMed  PubMed Central  Google Scholar 

  9. Mottron, et al. Lateral glances toward moving stimuli among young children with autism: early regulation of locally oriented perception? Dev Psychopathol. 2007;19(1):23–36.

    Article  PubMed  Google Scholar 

  10. Hellendoorn A, et al. The relationship between atypical visual processing and social skills in young children with autism. Res Dev Disabil. 2014;35(2):423–8.

    Article  PubMed  Google Scholar 

  11. Mundy P, Newell L. Attention, joint attention, and social cognition. Curr Dir Psychol Sci. 2007;16(5):269–74.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Duncan S. Some signals and rules for taking speaking turns in conversations. J Pers Soc Psychol. 1972;23(2):283.

    Article  Google Scholar 

  13. Piek JP, Dyck MJ. Sensory-motor deficits in children with developmental coordination disorder, attention deficit hyperactivity disorder and autistic disorder. Hum Mov Sci. 2004;23(3):475–88.

    Article  PubMed  Google Scholar 

  14. Wolpert DM, Doya K, Kawato M. A unifying computational framework for motor control and social interaction. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences. 2003;358(1431):593–602.

    PubMed Central  Google Scholar 

  15. Mooney E, Gray K, Tonge B. Early features of autism. Eur Child Adolesc Psychiatry. 2006;15(1):12–8.

    Article  PubMed  Google Scholar 

  16. Ozonoff S, et al. Gross motor development, movement abnormalities, and early identification of autism. J Autism Dev Disord. 2008;38(4):644–56.

    Article  PubMed  Google Scholar 

  17. Bryson SE, et al. A prospective case series of high-risk infants who developed autism. J Autism Dev Disord. 2007;37(1):12–24.

    Article  PubMed  Google Scholar 

  18. Loh A, et al. Stereotyped motor behaviors associated with autism in high-risk infants: a pilot videotape analysis of a sibling sample. J Autism Dev Disord. 2007;37(1):25–36.

    Article  PubMed  Google Scholar 

  19. Calhoun M, Longworth M, Chester VL. Gait patterns in children with autism. Clin Biomech. 2011;26(2):200–6.

    Article  Google Scholar 

  20. Esposito G, et al. Analysis of unsupported gait in toddlers with autism. Brain Dev. 2011;33(5):367–73.

    Article  PubMed  Google Scholar 

  21. Rinehart NJ, et al. Gait function in newly diagnosed children with autism: cerebellar and basal ganglia related motor disorder. Dev Med Child Neurol. 2006;48(10):819–24.

    Article  PubMed  Google Scholar 

  22. Rinehart NJ, et al. Gait function in high-functioning autism and Asperger’s disorder. Eur Child Adolesc Psychiatry. 2006;15(5):256–64.

    Article  PubMed  Google Scholar 

  23. Chang C-H, et al. Visual tasks and postural sway in children with and without autism spectrum disorders. Res Dev Disabil. 2010;31(6):1536–42.

    Article  PubMed  Google Scholar 

  24. Chen FC, et al. Postural responses to a suprapostural visual task among children with and without developmental coordination disorder. Res Dev Disabil. 2011;32(5):1948–56.

    Article  CAS  PubMed  Google Scholar 

  25. Fournier, et al. Decreased static and dynamic postural control in children with autism spectrum disorders. Gait & Posture. 2010;32(1):6–9.

    Article  Google Scholar 

  26. Memari AH, et al. Postural sway patterns in children with autism spectrum disorder compared with typically developing children. Res Autism Spectr Disord. 2013;7(2):325–32.

    Article  Google Scholar 

  27. Rodgers J, et al. Anxiety and repetitive behaviours in autism spectrum disorders and Williams syndrome: a cross-syndrome comparison. J Autism Dev Disord. 2012;42:175–80.

    Article  PubMed  Google Scholar 

  28. Singer HS. Motor stereotypies. Semin Pediatr Neurol. 2009;16(2):77–81.

    Article  PubMed  Google Scholar 

  29. Crippa A, et al. Use of machine learning to identify children with autism and their motor abnormalities. J Autism Dev Disord. 2015;45(7):2146–56.

    Article  PubMed  Google Scholar 

  30. Anzulewicz A, Sobota K, Delafield-Butt JT. Toward the autism motor signature: gesture patterns during smart tablet gameplay identify children with autism. Sci Rep. 2016;6:31107

  31. Rinehart NJ, et al. Movement preparation in high-functioning autism and Asperger disorder: a serial choice reaction time task involving motor reprogramming. J Autism Dev Disord. 2001;31(1):79–88.

    Article  CAS  PubMed  Google Scholar 

  32. Torres E, et al. Autism: the micro-movement perspective. Front Integr Neurosci. 2013;7:32.

  33. Torres EB, et al. Toward precision psychiatry: statistical platform for the personalized characterization of natural behaviors. Front Neurol. 2016;7:8.

  34. Pierce K, et al. Preference for geometric patterns early in life as a risk factor for autism. Arch Gen Psychiatry. 2011;68(1):101–9.

    Article  PubMed  Google Scholar 

  35. Klin A, et al. Visual fixation patterns during viewing of naturalistic social situations as predictors of social competence in individuals with autism. Arch Gen Psychiatry. 2002;59:809–16.

    Article  PubMed  Google Scholar 

  36. Chawarska K, Macari S, Shic F. Decreased spontaneous attention to social scenes in 6-month-old infants later diagnosed with autism Spectrum disorders. Biol Psychiatry. 2013;74(3):195–203.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Lord C, et al. The autism diagnostic observation schedule—generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000;30(3):205–23.

    Article  CAS  PubMed  Google Scholar 

  38. Lord C, Rutter M, Le Couteur A. Autism diagnostic interview-revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J Autism Dev Disord. 1994;24(5):659–85.

    Article  CAS  PubMed  Google Scholar 

  39. Wechsler D. The Wechsler Primary and Preschool Scale of Intelligence. San Antonio, TX: The Psychological Corporation; 2002.

    Google Scholar 

  40. Mullen EM. Mullen scales of early learning. MN: AGS Circle Pines; 1995.

    Google Scholar 

  41. Staples KL, Reid G. Fundamental movement skills and autism spectrum disorders. J Autism Dev Disord. 2010;40(2):209–17.

    Article  PubMed  Google Scholar 

  42. Jeni, L.A., J.F. Cohn, and T. Kanade, Dense 3D face alignment from 2D videos in real-time. 2015, FG.

  43. Jeni LA, Cohn JF. Person-independent 3d gaze estimation using face frontalization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. Las Vegas: 2016. p. 87-95.

  44. Hammal Z, et al. Head movement dynamics during normal and perturbed parent-infant interaction. In: Humaine Association Conference on Affective Computing and Intelligent Interaction (ACII), 2013. Geneva: 2013. p. 276-282.

  45. Hammal Z, Cohn JF, George DT. Interpersonal coordination of headmotion in distressed couples. Affective Computing, IEEE Transactions on. 2014;5(2):155–67.

    Article  Google Scholar 

  46. Barnes G, Asselman P. The mechanism of prediction in human smooth pursuit eye movements. J Physiol. 1991;439(1):439–61.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. McLean L, et al. The effect of head position, electrode site, movement and smoothing window in the determination of a reliable maximum voluntary activation of the upper trapezius muscle. J Electromyogr Kinesiol. 2003;13(2):169–80.

    Article  CAS  PubMed  Google Scholar 

  48. Mahone EM, et al. Repetitive arm and hand movements (complex motor stereotypies) in children. J Pediatr. 2004;145(3):391–5.

    Article  PubMed  Google Scholar 

  49. Cohen I, et al. Rating scale measures are associated with Noldus EthoVision-XT video tracking of behaviors of children on the autism spectrum. Mol Autism. 2014;5(1):15.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Dunn W. The impact of sensory processing abilities on the daily lives of young children and their families: a conceptual model. Infants & Young Children. 1997;9(4):23–35.

    Article  Google Scholar 

  51. Shic F, et al. Limited activity monitoring in toddlers with autism spectrum disorder. Brain Res. 2011;1380:246–54.

    Article  CAS  PubMed  Google Scholar 

  52. Klin A, et al. Two-year-olds with autism orient to non-social contingencies rather than biological motion. Nature. 2009;459(7244):257–61.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Happé F, Frith U. The weak coherence account: detail-focused cognitive style in autism Spectrum disorders. J Autism Dev Disord. 2006;36(1):5–25.

    Article  PubMed  Google Scholar 

  54. Trevarthen C, Delafield-Butt JT. Autism as a developmental disorder in intentional movement and affective engagement. Front Integr Neurosci. 2013;7:49.

  55. Cook J. From movement kinematics to social cognition: the case of autism. Phil Trans R Soc B. 2016;371(1693):20150372.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Libertus K, Needham A. Reaching experience increases face preference in 3-month-old infants. Dev Sci. 2011;14(6):1355–64.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Landa R, Garrett-Mayer E. Development in infants with autism spectrum disorders: a prospective study. J Child Psychol Psychiatry. 2006;47(6):629–38.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

Autism Speaks National Institute of General Medical Sciences (1R01GM105004).

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available as participants were not consented for public data release, but datasets are available from the corresponding author on reasonable request and consent of participants.

Author information

Authors and Affiliations

  1. Department of Psychology, University of Miami, 5665 Ponce de Leon Blvd, Coral Gables, FL, 33146, USA

    Katherine B. Martin, Jennifer C. Britton, Anibal Gutierrez & Daniel S. Messinger

  2. Robotics Institute, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA, 15213, USA

    Zakia Hammal

  3. Center for Computational Science, University of Miami, 1320 S Dixie Hwy, Miami, FL, 33146, USA

    Gang Ren

  4. Department of Psychology, University of Pittsburgh, 210 S. Bouquet St., Pittsburgh, PA, 15260, USA

    Jeffrey F. Cohn

  5. Human Computer Interaction, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA, 15213, USA

    Justine Cassell

  6. Department of Computer Science, University of Miami, 1365 Memorial Drive, Coral Gables, FL, 33146, USA

    Mitsunori Ogihara

Authors
  1. Katherine B. Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zakia Hammal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gang Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jeffrey F. Cohn
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Justine Cassell
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mitsunori Ogihara
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jennifer C. Britton
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Anibal Gutierrez
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Daniel S. Messinger
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KM analyzed and interpreted the head movement data and drafted the manuscript for submission. ZH tracked the videotaped participants using Zface, compiled a dataset of head movement, and revised the manuscript critically. JCohn oversaw the measurement of head movement and was a major contributor in writing the manuscript and revising it critically. JCassell made substantial contributions to the design of the study and contributed video stimuli. AG contributed to the acquisition of data. GR analyzed the head movement data and MO contributed to the analytic approach and interpretation of the data. JB contributed to the analytic approach of the data and revised the manuscript critically. DM contributed to the conception and design of the study, oversaw the acquisition of data, reviewed the analytic approach, and was a major contributor in the writing of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Katherine B. Martin.

Ethics declarations

Authors’ information

JCohn leads efforts to develop methods for the automatic analysis of facial expression and automated tracking of rigid and non-rigid head motion and applied those tools to research in psychopathology. ZH is part of the JCohn’s interdisciplinary group and has applied computer vision and machine learning to improve measurement of and theoretical advances in mother-infant interaction, depression, pain, and social interaction. JCassell is the director of the Human-Computer Interaction Institute, in the school of Computer Science at Carnegie Mellon University, and focuses on applying computer vision systems to the study of human interactions. GR is a postdoctoral fellow at the Center for Computational Science and is part of the Big Data Mining and Data Analytics team, and MO is a professor in the Department of Computer Science at the University of Miami. Together, GR and MO have expertise in computational approaches to big-data. JB is an assistant professor in the Department of Psychology at the University of Miami with expertise in interdisciplinary research that utilizes advancements in technology to study the intersection of human development and clinical outcomes. AG is the assistant director for the Center for Autism and Related Disabilities (CARD) at the University of Miami. DM’s research uses objective measurement of body movement, facial expression, and vocalization to better understand communicative development in typically developing children and those affected by ASD.

Ethics approval and consent to participate

Recruitment and procedures were approved by the University of Miami’s Social and Behavioral Sciences Internal Review Board (reference number: 20070095). Written, parental consent was obtained before participation in the study.

Consent for publication

Parents consented to the following:

“VIDEOTAPES: When the researcher plays with your child and when your child watches the children’s videos, we will be videotaping your child. The videotapes of your child will be coded by experts, undergraduate students, and other parents. Additionally, the videos will be measured using computer software at the University of Miami, University of Pittsburgh, and the University of Denver. They may also be used in publications and at scientific conferences. You agree to all of these uses by taking part in this study….”

“CONFIDENTIALITY: Your child’s videotaped images will be rated by other people, analyzed by computer at the University of Pittsburgh, and presented in scientific reports. The images will not be linked to personal identifiers in any way. These videotaped images are scientifically valuable and will be stored permanently by the investigators as a record of this study. At your request, the images will be immediately destroyed. The US Department of Health and Human Services (DHHS) may request to review and obtain copies of your records. Your records may also be reviewed for audit purposes by authorized University employees or other agents who will be bound by the same provisions of confidentiality.”

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Summary of Supplementary Data Analyses. (DOCX 23 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martin, K.B., Hammal, Z., Ren, G. et al. Objective measurement of head movement differences in children with and without autism spectrum disorder. Molecular Autism 9, 14 (2018). https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-018-0198-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s13229-018-0198-4

Keywords

Molecular Autism

ISSN: 2040-2392