Study finds inconsistencies in a broadly used autism test
Rutgers researchers have found that a test widely used to diagnose whether children have autism is less reliable than previously assumed.
The study is published in the journal Neural Computation.
The standardized test, known as the Autism Diagnostic Observation Schedule (ADOS), assesses communication skills, social interaction and play for children who may have autism or other developmental disorders.
The researchers digitized the test by attaching wearable technology, like an Apple Watch, to two clinicians and 52 children who came in four times and took two different versions of the test.
When researchers looked at the scores of the entire cohort, they found they did not distribute normally – which could mean a chance of false positives inflating the prevalence of autism, among other implications.
The results showed that switching ADOS certified clinicians may change a child’s scores and consequently influences the diagnosis. The researchers found similar results when they analyzed open-access data of 1,324 people ages 5 to 65, said Elizabeth Torres, associate professor of psychology in Rutgers’ School of Arts and Sciences, and director of The New Jersey Autism Center of Excellence.
“The ADOS test informs and steers much of the science of autism, and it has done great work thus far,” said Torres, whose expertise has brought emerging computer science technology to autism. “However, social interactions are much too complex and fast to be captured by the naked eye, particularly when the grader is biased to look for specific signs and to expect specific behaviors.”
The researchers suggest combining clinical observations with data from wearable biosensors, such as smartwatches, smartphones and other off-the-shelf technology.
By doing so, they argue, researchers may make data collection less invasive, lower the rate of false positives by using empirically derived statistics rather than assumed models, shorten the time to diagnosis, and make diagnoses more reliable, and more objective for all clinicians.
Torres said autism researchers should aim for tests that capture the accelerated rate of change of neurodevelopment to help develop treatments that slow down the aging of the nervous system.
“Autism affects one out of 34 children in New Jersey,” she said. “Reliance on observational tests that do not tackle the neurological conditions of the child from an early age could be dangerous. Clinical tests score a child based on expected aspects of behaviors. These data are useful, but subtle, spontaneous aspects of natural behaviors, which are more variable and less predictable, remain hidden. These hidden aspects of behavior may hold important keys for personalized treatments, like protecting nerve cells against damage, or impairment, which could delay or altogether stop progression.”