Thus the story’s headline, "CT Scans Deemed Best for Checking Heart Arteries," is extremely misleading. The statements that sometimes doctors want to assess the heart’s arteries without "putting a gadget in there," or that they "do not always want to run the risks" of catheterization imply that the study supports noninvasive testing as an alternative to invasive testing. It didn’t. It compared two types of noninvasive testing to each other.
It’s important to note that the researchers did not claim CT is the "best" way to diagnose coronary artery disease, nor did they suggest that CT should replace catheterization.
The oversights in this story are indeed unfortunate given the importance of coronary artery disease in the industrialized countries and its emerging importance in the developing world. It could add dubious fuel to the controversy, as described in a New York Times article, surrounding the evidence and expense related to CT scans of the heart.
The significant costs of both MRI and CT angiography are not discussed. Their adoption as screening tests could have a substantial impact on overall health care costs, and the omission of a discussion of costs is a major oversight. See this New York Times article for why the costs of CT angiography are relevant.
The story does provide some important details on the meta-analysis, including the number of studies and patients, as well as sensitivity results. However, we have two critiques:
1) It notes that the sensitivity results, 97% and 87%, were for the studies of people with suspected coronary artery disease. We believe that’s incorrect. According to the published study, these figures are for the overall population in the meta-analysis, which includes those with suspected OR known disease, including those with heart attacks. For the analysis just of patients with suspected coronary artery disease, the results were different: 98% and 89%. But that’s a minor problem. A bigger issue, to us, is the following.
2) We would have liked to have seen the specificity results, too. We’re unsure why they choose to report just sensitivity and not specificity. False positives are important, too, besides just false negatives.
3) The study had clear limitations that were ignored in the story. The authors of the study concluded, "Randomized studies are clearly needed to address the potential of coronary CT angiography for use in triage as a means of positively altering management and outcomes in patients with suspected CAD (coronary artery disease)." The take home message for readers of this story may be that CT scans are "Best for Checking Heart Arteries" – as the headline states – a conclusion that has yet to be clearly demonstrated.
Although the story highlights the presumed advantages of CT scans, there isn’t a single word about potential harms. That includes the radiation exposure leading to risks for cancer, which are acknowledges in the introduction to the published study. (According to the most recent estimates, the risks may be in the neighborhood of one case of cancer for every 800 individuals scanned.) The story also leaves out the specificity results of this research, ignoring the rates of false positives and their potential harms.
The story is clear about the type of study, that it was a meta-analysis or "review of studies." It also presents sensitivity rates and quotes outside sources noting that the conclusions were already known in general.
Now for the bad news. First, there is the misleading context, or lack of context, for this evidence, as we’ve described. We feel that the story, starting with its headline, is worded in such a general way that many readers will think the evidence supports the use of noninvasive over invasive imaging. Second, the story fails to report on specificity results, the percentage of healthy people who are correctly identified by the tests as not having the condition. See the Benefits criterion.
The story also does not note any of the limitations of the evidence acknowledged in the published study. These include:
We also see some other potential limitations to the study conclusions. Most (19/20) of the MRI studies in the analysis used older, less powerful technology, while a small minority (3/89) of the CT studies used older studies; therefore, the CT scans had a technological leg up in this analysis. We also question the similarity of patients across the studies used in this meta-analysis. Finally, the analysis acknowledges that the studies were of poor to moderate quality, and the MRI studies were of poorer quality than the CT studies.
Another part of evaluating the evidence is discussing what the review doesn’t show, what we still don’t know, and what future research is needed. The final sentence in the published study sums it up: "Randomized studies are clearly needed to address the potential of coronary CT angiography for use in triage as a means of positively altering management and outcomes in patients with suspected CAD [coronary artery disease]."
This story doesn’t exaggerate the burden of coronary artery disease, the biggest cause of deaths for humans in the developed world.
It’s worth nothing, however, that we think the story does exaggerate the number of people who are appropriate candidates for CT scans of the heart.
The story does cite two independent sources who appeared unrelated to the study.
The story did not identify any potential conflicts of interest. While the study publication identifies no primary funding sources, the senior author, Marc Dewey, reports in his conflict of interest statement financial relationships with Toshiba Medical Devices, Bayer-Scherling, and Guerbet, companies that manufacture imaging devices or contrast media used with them. These relationships were disclosed by the medical journal when they published the study – yet the story makes no menton of them.
The story notes that CT and MRI are each used for different reasons, but it implies erroneously that either is an all-around alternative to catheterization, and thus the "best" way to detect coronary artery disease.
The story notes that CT and MRI are currently used in clinical practice. Both techniques are routinely available for imaging of the heart in most academic and large community hospitals.
The story quotes an outside source as stating that "this article holds no surprises whatever," and that the underlying difference between CT and MRI were somewhat common knowledge already.
The story does not appear to rely on a news release.
Systematic, Criteria-Driven
The tale of two “negative” studies. Or, how spin is applied to make research findings look more impressive. A must read. https://johnmandrola.substack.com/p/the-tale-of-two-negative-studies
The @nytimes chose to interview one of the editors of the @AnnalsofIM (publisher of this paper) who "gushed with extraordinary glee: It’s huge! There are very few things that reduce your mortality by 30%."
Turns out coffee is not one of those few things despite all that glee. https://twitter.com/garyschwitzer/status/1533202075928215558
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like