NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.
Read Original Story

Pacemaker-like device combined with defibrillator reduces deaths in mild heart failure by 29%

Rating

3 Star

Pacemaker-like device combined with defibrillator reduces deaths in mild heart failure by 29%

Our Review Summary

Strong point:  use of the number needed to treat or NNT.

Weaker point: seemed to be more boosterish, less balanced than competing Wall Street Journal story.

 

Why This Matters

Because defibrillators are a significant investment, stories like this also need to provide readers the context of how much additional benefit individuals and society as a whole would reap from increased use of these expensive devices. This story provided the crucial “number needed to treat” calculation, giving readers a good metric for how to weigh the device’s benefits, but it also fell short in other areas.

Criteria

Does the story adequately discuss the costs of the intervention?

Satisfactory

The story provides this great detail when discussing costs: “Fourteen patients had to be treated with the $35,000 device to prevent one death.” More context around costs and a better explanation of the $40 billion price tag attached to heart failure would have been welcome.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

By using the NNT, as mentioned above, and providing some other figures, the story did an adequate job quantifying the benefits.

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

The story says that “Complications were about twice as common with the combination device, primarily because connecting the leads to the ventricles takes longer and requires a higher skill level. The extra leads also increase the possibility of infections.” We would have liked to have seen the actual numbers, which were provided in the Wall Street Journal piece. We also think that, instead of attributing the reason for the complications, as the Journal did, to the study’s lead author, the story gives unqualified legitimacy to the basis for the harms. Without any hard numbers and without the proper sourcing, we think the handling of harms here falls short.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The story did not evaluate the quality of the evidence as thoroughly as the Wall Street Journal. The WSJ, for example, gave readers both the relative reduction and the absolute reduction in deaths. This story did provide one improvement over the Journal story, something we rarely see: the number needed to treat (NNT). The story says “Fourteen patients had to be treated with the $35,000 device to prevent one death.” Unfortunately, the story also included a lot of unchallenged statements, saying that the study “gives us reason for renewed enthusiasm about heart failure treatment” and that it “supports the idea that doing this works.” Maybe. Readers of the Journal article may have a different takeaway.

Does the story commit disease-mongering?

Not Satisfactory

In the Wall Street Journal story, the lead says that the device “can significantly improve the chance for survival among the tens of thousands of heart-failure patients with only mild symptoms.” That’s a reasonable and cautious statement. The LA Times story, by contrast, goes a little over the top, to our minds, saying, “The report is the second one indicating that such combination devices, which are about the size of a cellphone, can save the lives of many of the 6 million Americans with heart failure, and many surgeons are already using them for that purpose. About 70% of heart failure patients have the milder form of the disease for which the new study was conducted. The condition requires frequent hospitalizations and costs the U.S. healthcare system an estimated $40 billion per year, according to the American Heart Assn.” By frontloading the story with that framing, the story is selling this device to the readers as a way to save millions of lives, instead of carefully walking readers through the evidence, as the Journal does.

Does the story use independent sources and identify conflicts of interest?

Satisfactory

The story does quote outside sources, but we wish that the story had taken the same care in bringing in some outside perspective on the cost-benefit question as the Wall Stteet Journal did. Both stories contained elements of boosterism, but this story did not have the balance that the Journal story did.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

The story did not adequately explain this approach as compared to other approaches to reduce adverse effects in people with mild heart failure, the population of interest. One would read this story and leave with the mistaken impression that literally millions of Americans have just one choice: get this expensive surgery or risk dying.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

The story explains that the device studied is in clinical trials for the targeted patient population and that a similar device is on the market. ” Last year, U.S. researchers reported that a combination device manufactured by Boston Scientific reduced the death rate by 29% for patients with moderate heart failure in a study of about 1,800 patients. In September, the Food and Drug Administration gave the company approval to market the device for this indication.” We would have liked to have seen some estimate of how many people have these devices implanted every year.

Does the story establish the true novelty of the approach?

Satisfactory

The story makes it clear that there are multiple companies pursing a similar device and that one is already on the market.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story did not rely on a news release.

Total Score: 6 of 10 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.