NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.
Read Original Story

Brain scans accurate at spotting autism: U.S. study

Rating

1 Star

Categories

Brain scans accurate at spotting autism: U.S. study

Our Review Summary

This story is one of two we reviewed describing new research in the use of diffusion tensor MRI. Unlike the competing story by CNN, this story starts off on the wrong foot and does not recover. The headline badly distorts the true value of the research study. The story itself does little to analyze the evidence, provides no solid quantification of harms or benefits, leaves costs to the imagination and relies on one source: the lead author of the study in question. The story brings together two favorites of health writers: the frightening specter of autism and the MRI, the medical hero with X-ray vision. Neither topic is given a complete picture here.

 

Why This Matters

Autism and autism spectrum disorders are characterized by dysfunction in communication, socialization and behavior. Many children do not show signs of the disorder until 18-24 months of age. Identifying children at risk early is essential if any intervention is to work in reducing the impact of the disorder. The currently available specific testing methods for the diagnosis of autism and autism spectrum disorders are blunt instruments. While more accurate than routinely used tools, the current autism diagnostic tools are not as sensitive and specific as needed. To be useful, a diagnostic test for autism should have a high degree of sensitivity especially in young children. Given the estimated high prevalence of autism and the high costs — both financially and emotionally — to families, it is important for reporters to approach any study about autism with caution. Screening for autism early and making decisions based on that screening can have very real consequences. In the absence of proven clinical treatments for autism, parents spend whatever they can on natural remedies, specific diets and behavioral therapies. That is why we take strong issue with the overly effusive headline and the lack of context in the story. No one is served by exaggerating research findings in such an emotionally fraught arena.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

The cost of the specialized MRI scan and its interpretation is not provided. MRI scans are a major driver of healthcare costs and the use of this technology as a routine screening instrument could have a significant direct financial impact. The cost of a routine MRI could have been provided

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

The second sentence of the story says, “The test, which uses conventional magnetic resonance imaging or MRI machines, detected 94 percent of individuals with a high-functioning form of autism, they reported on Thursday.” The 94 percent number is completely out of context and exactly the kind of overstated statistic that gives readers false hope based on flimsy evidence. This was, after all, a study in 30 people with autism and 30 without.  Unlike the CNN story we reviewed, this story fails in keeping inappropriate enthusiasm at bay. The potential benefits of such a scan can only be speculated at this stage, and readers should have been provided absolute numbers to make it clear how many people were correctly identified, at what ages and to what end.

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

One would think from reading these stories that getting an MRI is as harmless as taking a shower. Neither this story nor the CNN story explained the real psychological and physical impacts of brain scans. For those who have had the pleasure, you know how tight and confining the scanner “chamber” can be. Younger children frequently require deep sedation for a scan due to the tightness and to the loud banging that occurs during the scan. Although there is no radiation emitted, MRI scans are uncomfortable, loud and intimidating especially for younger children. If this test is to become useful it would need to be conducted early in a child’s life. This should have been conveyed to the reader.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The story did not evaluate the quality of the evidence and missed several limitations of the study that were pointed out in the CNN story that we also reviewed. Unlike the CNN story we reviewed, this story provides comments from two of the investigators with no reservations. The only caveat noted suggests the study results are preliminary. That single statement is overshadowed by the headline and the remainder of the story content. To their credit, the study authors provided their view of the study limitations and a word of caution about over interpretation in the manuscript. Indeed, the press release comments of the senior author noted, “this is not yet ready for prime time use in the clinic yet, but the findings are most promising thus far.” The story should have shown similar restraint.

Does the story commit disease-mongering?

Satisfactory

The story did not engage in disease-mongering. Like the CNN story, the story correctly notes that 1 in 110 children in the US potentially has an autism spectrum disorder according to the CDC.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

This story has no independent sources, and, worse yet, it gives readers the mistaken impression that the lead author of the study is an independent voice. After the lead and setup, the story says. “These results are the best yet in the search for a biological basis in terms of being able to distinguish those with and without the disease,” said Nicholas Lange of Harvard Medical School, who directs the Neurostatistics Laboratory at McLean Hospital in Belmont, Massachusetts. Doesn’t that sound like someone outside the study explaining why the findings are important? Unless readers latched on to a passing reference to “researchers at McLean” they might read the entire story thinking Lange was unaffiliated. As CNN points out in its story, Lange actually helped create the MRI being used and would likely stand to benefit financially from its commercial rollout.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

At the present time there are no biologically based tests for autism. The diagnosis is made on the basis of subjective signs and symptoms. Unlike the CNN story we reviewed, this story makes no attempts to provide information on existing diagnostic testing.

Does the story establish the availability of the treatment/test/product/procedure?

Not Satisfactory

The story includes this odd claim: “You don’t need any fancy equipment. This is performed around the world,” Lange said in a telephone interview. Interestingly, neither the actual published study nor the McLean press release provides any explicit information about the MRI scanner used or the way in which its programming may have been altered. And neither does the story.

Does the story establish the true novelty of the approach?

Not Satisfactory

The novelty of the test is unclear from this story. Diffusion tensor imaging is not new and it has been used in previously published reports, a fact not provided to the reader. The way in which it was used was new and novel. We usually take people to task for suggesting a drug or medical device or procedure is novel when it is perhaps not. The story should have indicated that although the scanners used were conventional and others have employed the technique described, the programming is novel and not routinely available.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story does not rely on a news release. The story provides quotes from the investigators that do not appear in the institutional press release. Having said that the press release provides a far more balanced story that this one does.

Total Score: 2 of 10 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.