Getting into the game: evaluation of the reliability, validity and utility of the Ignite Challenge scale for school-aged children with autism spectrum disorder

Abstract

Purpose

Evaluate reliability, concurrent validity and utility of the Ignite Challenge motor skills measure for children with autism spectrum disorder (ASD).

Materials/Methods

In this measurement study, children completed the Ignite Challenge twice, 1–3 weeks apart. A physiotherapist assessor (one of seven) conducted a child’s test-retest assessments and scored administration ease and child engagement (/10 visual analogue scale). A second assessor rated baseline assessment videos. Validity data (parent-report PEDI-CAT) were collected at baseline. Reliability analysis employed ICCs (95% CI) and evaluated minimum detectable change (MDC₈₀). Pearson’s correlations (r) estimated validity.

Results

Forty-seven children with ASD (mean 9.34 years [SD = 2.35]; 10 girls; independent social communication) were tested at baseline; 45 were retested. Ignite Challenge baseline and retest mean scores were 69.0% (SD = 17.1) and 69.5% (SD = 16.6) respectively, with excellent inter-rater/test-retest reliability (ICC = 0.96 [95% CI 0.92, 0.97] and ICC = 0.91 [95% CI 0.84, 0.95]) respectively, and MDC₈₀ = 9.28. Administration ease and child engagement were 6.5/10 (SD = 2.4) and 6.7/10 (SD = 2.2). Ignite Challenge and PEDI-CAT Social/Mobility (n = 45) associations were r = 0.54 and 0.57. Minimal suggestions for measure revisions arose from child/assessor feedback.

Conclusions

Ignite Challenge can reliably identify movement strengths and challenges of children with ASD. Use may permit more appropriate evaluation and goal setting within physical activity-based programs.

IMPLICATIONS FOR REHABILITATION

• Ignite Challenge is a reliable and valid advanced motor skills measure for children with Autism Spectrum Disorder (ASD), ages 6 years and up.

• Ignite Challenge can be reliably scored in-person (“live”) even with younger children and those requiring increased assessor attention to optimize engagement.

• Most children enjoyed playing the Ignite Challenge “mini games”—this positive engagement (“getting into the game”) helps support assessment of their best motor performance abilities.

• Ignite Challenge identifies motor-related challenges that impact a child’s physical activity participation, and thus informs meaningful goal setting/intervention with children with ASD.

Keywords:

• Autism spectrum disorder
• gross motor function
• reliability
• validity
• children
• measurement study

Acknowledgements

The authors would like to sincerely thank the children and their families for taking part in the Getting into the Game study. We also thank the wonderful physiotherapist assessor team and the allied health assistants who recorded the assessment sessions, and acknowledge the valuable expertise of Penny Miller, Novita’s Practice Lead (Neurodevelopmental). Finally, we thank Channel 7 Children’s Research Foundation and Novita for their generous support of the clinician and research staff time to carry out this project, and both Novita and Holland Bloorview Kids Rehabilitation Hospital for jointly supporting Dr Wright’s time as the senior scientist lead on the project at Novita.

Disclosure statement

The authors report no conflicts of interest to declare. While the authors were involved in various aspects of the development of the adapted Ignite Challenge, it is the intellectual property of Holland Bloorview Kids Rehabilitation Hospital/University of Toronto, and as such, the authors do not receive any royalties from its use.

Additional information

Funding

This work was supported by the Channel 7 Children’s Research Foundation, Adelaide, Australia (https://crf.org.au/), Reference 181721.