Note to our followers: Our nearly 13-year run of daily publication of new content on HealthNewsReview.org came to a close at the end of 2018. Publisher Gary Schwitzer and other contributors may post new articles periodically. But all of the 6,000+ articles we have published contain lessons to help you improve your critical thinking about health care interventions. And those will be still be alive on the site for a couple of years.
Read Original Story

Optimal balance of competing views on value of CT heart scans

Heart Scan Can Fine-Tune Risk Estimate for Patients Considering Statins

Our Review Summary

Credit NHLBI.

Credit NHLBI.

This story hits almost all the high points we look for in a news report. It gives readers not only the basic summary of an analysis of how CT scan results showing levels of calcium deposits in coronary arteries are associated with 10-year rates of heart attacks and other cardiovascular disease, but it includes more than one skeptical voice and plainly discusses study limitations and potential harms. Still, our criteria are demanding, and the story falls a bit short on two points: disclosures of researcher relationships with industry and then alternatives available to people who might consider getting one of these scans. But the strengths of this story are an example of how to get it right.

 

Why This Matters

Too often, stories about medical tests fall into the “why not” category. This story lays out the potential benefits reported by researchers, but it also provides readers clear and useful explanations of the nuances and potential pitfalls of this sort of CT scan. The story is important because the number of people placed on statins has progressively increased over the years — and if some people can avoid these drugs without putting themselves at increased risk, then it’s probably good that they avail themselves of the opportunity.

Criteria

Does the story adequately discuss the costs of the intervention?

Satisfactory

The story reports that a CT scan looking for calcium in coronary arteries “typically costs between $75 and $100. Still, it is generally not covered by insurance and so is not often used to assess risk.” That’s enough information to clear our bar handily, although we’d note that such scans can also turn up lung nodules that require additional follow-up and related costs.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

The story reports that among study participants, those with a zero calcium score on a heart CT scan had only half the expected number of heart attacks or disabling chest pain over a 10-year period. That’s a relative comparison, which as we frequently note does not provide the full picture regarding benefit. But the story goes on to give readers a better sense of what these numbers mean in absolute terms. It explains the example of a person with a 12 percent risk of a heart attack over a decade based on the risk calculator recommended by the American college of Cardiology and others. That person actually turned out to have only a 4 percent 10-year risk, below the widely-used 7.5 percent risk threshold for recommending a statin.

The story makes clear that the scan does not provide a direct health benefit, but it provides information to people who are trying to decide about whether to start taking cholesterol-reducing statins. To help with that decision, it would have been nice for the story to include some discussion of the benefits associated with statin use, especially the numbers needed to treat (NNT) with a statin in order to save a life.

The story includes only one patient anecdote, a woman who was feeling depressed and had trouble getting out of bed when she took statins, and then decided to stop taking the drugs after having a CT scan that showed zero calcium. We often find fault with stories that introduce readers to only one patient, who claims to have greatly benefited; however, the placement of the anecdote low in the story and the preceding context that included limitations and expert cautions mean this single patient story doesn’t overwhelm the other information.

Link to online Atherosclerotic Cardiovascular Disease (ASCVD) Risk Estimator: http://tools.acc.org/ASCVD-Risk-Estimator/

Does the story adequately explain/quantify the harms of the intervention?

Satisfactory

The story clearly lays out some of the ways that testing can go awry. It reports that the CT scans expose people to about the same amount of radiation as a mammogram, implying a level that many people routinely accept, though it does not go into detail about potential radiation effects. The story also explains the risk of “incidentalomas”, things that can pop up on this sort of scan besides coronary artery calcium, such as nodules in lungs, that might lead a person down a path of further testing and treatment. And it spells out the potential consequences of having a scan that reveals high levels of calcium deposits, prompting further testing and treatments, perhaps leading to substantial harms.Overall, we think the harms are admirably covered.

Does the story seem to grasp the quality of the evidence?

Satisfactory

The story points out that the study was observational, “not the highest level of evidence”. It goes on to explain that since people in the study were not randomly assigned to testing or no testing, the results do not demonstrate that changing current practice would change real health outcomes.

Does the story commit disease-mongering?

Satisfactory

The story reports that proponents are suggesting this sort of scan only for people who need more information to make a decision about statin treatment. It also includes skeptics who doubt the value of the test for most people. The tone is calm, not shrill. We saw no evidence of disease mongering.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

This was a split decision that we ultimately ruled Not Satisfactory. There are multiple independent sources in the story, so it clearly addresses that element of the criterion. However, the story does not report the financial relationships some of the study authors have with manufacturers of scanners and other medical devices. One of our reviewers argued that these scanning machines are essentially generic and that therefore a conflict of interest disclosure is not relevant in this case. Two others voted that the potential conflict, minimal though it might be, was still directly relevant to the story and merited a brief mention. This is an instance where a binary Satisfactory/Not Satisfactory rating does not capture the nuance involved in our decision-making, which is why we always encourage readers to pay more attention to the comments than the ratings.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

There is no mention of alternative risk calculators that include lifestyle and other factors, which people on the fence can use to help clarify their thinking about statin treatment. It also does not clearly point out that people who are uncertain about statin treatment can try the drug to see if they experience bothersome side effects. In other words, there are alternative ways for people to gather information that could help them decide about statin treatment.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

The story makes clear that this test is readily available, and points out that it is generally not covered by insurance.

Does the story establish the true novelty of the approach?

Satisfactory

The story notes that CT scans for coronary artery calcium are not new, and that what is new is the analysis of how test scores are associated with 10-year rates of heart attacks and other cardiovascular disease.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story clearly does not rely on a news release. There is original reporting that includes feedback from the original authors of the paper as well as independent experts.

Total Score: 8 of 10 Satisfactory

Comments (3)

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.

Jeanne Lenzer

October 8, 2015 at 4:27 pm

It’s hard for me to imagine how HealthNewsReview could award an 8/10 score to the New York Times article on CT scanning. The story was based on the bizarre premise that to limit overprescribing of statins, people should undergo a test that has no proven clinical benefit and does have significant harms.
There are two key problems with the premise of the article; first, overprescribing of statins should be dealt with by not following compromised guidelines recommending widespread prescribing; instead prescribers should follow the independent assessments of groups like Therapeutics Initiative and TheNNT.com Second, readers should review independent assessments of the science regarding coronary calcium CT scanning; despite attempts to prove clinical value, none has been found. Promoters of the scan rely on surrogate markers and have ignored the serious downsides of the test, including false positives, false negatives and the devastating health and financial costs of downstream testing caused by incidentalomas and false positives.
Finally, the NYT piece relied on anecdote to persuade (it had to since it had no quality outcomes data to do otherwise). The reaction engendered by promoting this test as a way to reduce overtreatment could be anticipated and comprises a marketing strategy used by promoters of the test, who had encountered opposition when it was promoted simply as a way to pick up more people who they say need more treatment but weren’t getting it. There is no clinical proof to date that the net effect of the scan will be anything other than, as Vikas Saini, President of the Lown Institute put it: a recipe for mayhem. For more on the science (and the moneyed interests) see my article on a “documentary” promoting the scan in The BMJ that appeared on the same day as the NYT article: http://t.co/jsNXe4U0yB

Reply

    Andrew Holtz

    October 9, 2015 at 8:59 am

    The issues Jeanne Lenzer raises are real, but it is important to distinguish between the debate over proper use of these calcium scans and the separate matter of the quality of reporting on that debate.

    Our review of the story is based on how it rated on our criteria, not whether CT scans for coronary artery calcium are a good thing to do. The story summarized the journal article by Krumholz et. al, but it also clearly pointed out important limitations in the work and prominently featured experts who presented a different view of the evidence. Jeanne Lenzer comments that the test “has no proven clinical benefit”. We noted that the story reported, “there has never been a rigorous study randomly assigning people to a change in treatment based on a scan and demonstrating that the change improves outcomes.” Lenzer also comments that the test “does have significant harms”. We gave the story credit for reporting both that this sort of scan can turn up “incidentelomas” leading to further testing and treatment, along with accompanying risks, and for presenting a detailed scenario of the potential consequences of a scan that identifies calcium deposits in coronary arteries, perhaps even resulting in death from treatment complications. She criticizes the use of an anecdote of a patient who was glad she was scanned. We noted that we often fault stories for including only one positive anecdote, but that in this case that anecdote was placed deep in the story, following the reporting on study limitations, several critiques from independent sources and detailed scenarios about potential harms resulting from this sort of scan.

    We did not see the story as blindly favoring proponents of testing. Rather, we saw that in reporting on a study that suggests a reason for more CT scans, the reporter and editors noted limitations in the study, included skeptical independent voices and explained to readers some of the ways such scanning could harm people.

    Reply

      Jeanne Lenzer

      October 9, 2015 at 10:54 am

      I appreciate your comments, Andrew and the need to separate a decision about the science from the nature of reporting. However, it’s rather undeniable that the thrust of the story was that the scan can prevent overtreatment by reassuring patients they might not need statins (just look at the Twitter comments of some doctors). Simply noting that no RCT has been performed and then giving emotive anecdote about a woman saved from a life of worry and statins (which may have been false reassurance, yet that’s not noted with the appropriate stats for false negatives) is bad journalism.
      If publishing “maybe it works” stories with powerful anecdote to drive the premise home is acceptable, then we might as well start reporting on coffee enemas, crystals to cure cancer and all other manner of “but maybe it works” claims.