NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.
Read Original Story

Unnecessary Procedure?

Rating

4 Star

Unnecessary Procedure?

Our Review Summary

This evening news segment on new evidence showing some back surgeries aren’t effective does a very good job on many levels. It: 

  • states the findings clearly
  • uses a number of sources with different viewpoints, including a clinician who does the surgery and finds it very beneficial, and a patient who got relief from the placebo treatment
  • suggests the barriers to applying new findings to clinical care
  • puts the findings in the context of the national debate over the role of evidence-based care in controlling health care costs, including an interview excerpt of President Obama raising the issue

Given all this, one is tempted to give the segment a pass for its omissions, such as a failure to mention that the studies’ size and brevity prevent them from being conclusive and that the placebo may have had some effect that non-treatment in a clinical context would not. But two omissions are harder to overlook: 

  • The surgery has risks, which adds another important factor to the treatment decision equation.
  • Standard non-surgical treatment has risks too, some linked to successful treatment and some linked to failure to provide relief.

It’s true that both of these issues fall outside the findings of the studies. But so does the material about health care costs and evidence-based medicine. Some mention, at least brief, should have been made of the risks of surgery and the questions about non-surgical treatment. This would have provided a clearer picture of the findings’ implications.

As good as the segment was, it could have also helped viewers think about some important take-home questions: 

  1. Why were we doing it in the first place if the evidence was poor – i.e. why did it take this long to get the evidence?;  
  2. How will this evidence result in the cost savings the nation needs?
  3. Will doctors stop doing the procedure on their own?
  4. Will patients know enough not to want it?
  5. Will insurers stop paying for it? 

This highlights what health care reform needs to do to address saving costs on expensive low return interventions.  

Criteria

Does the story adequately discuss the costs of the intervention?

Satisfactory

The segment reports the procedure costs $2,000 to $5,000.

The reporter gets extra points for putting these costs in the context of larger concerns over health care spending on procedures that are not proven effective. 

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

The segment makes only a very general statement about results: "there was no difference up to six months later for patients who actually had the procedure and those who had a fake or placebo treatment instead."

But this echoes the un-nuanced language of the conclusions stated in the abstracts. One says the improvements for the groups "were similar" and the other says the surgeries "had no beneficial effect."

The segment also made clear that patients in both groups saw improvement rather than no change, a useful observation about the benefits. 

The segment therefore minimally earns a "satisfactory" rating despite its lack of detail. 

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

Given the fact that the studies suggests the surgery has no benefits, the segment should have mentioned its risks.

Vertebroplasty is considered very safe. But it carries some risks: cement leakage into nearby tissues and the possibility [though data are inconclusive] of increasing the risk of fracture in other vertebrae. There are small risks of soft-tissue damage and nerve-root pain and compression.

Like all surgeries, vertebroplasty carries risks of bleeding, infection and anesthesia, which are higher for the elderly population than the general population. 

Does the story seem to grasp the quality of the evidence?

Satisfactory

The segment is based on results of two studies published in the New England Journal of Medicine. The studies are of very high quality: single-blinded, randomized, placebo-controlled, multi-center clinical trials.

While both studies are relatively small (131 and 78 patients), the conclusions are strengthened by the fact that they produced similar findings. 

Ideally, the segment would have stated that the studies followed patients for no more than six months, leaving the question of benefits [or risks] over the longer term unanswered. 

It’s also worth noting that the placebo was not a fake injection of the cement but a short-acting anesthetic, which may have had an effect on the condition that non-treatment would not. 

On balance, the segment earns a satisfactory rating. 

Does the story commit disease-mongering?

Satisfactory

The story does nothing to exaggerate the prevalence or severity of the conditions that vertebroplasty is used to treat.

Does the story use independent sources and identify conflicts of interest?

Satisfactory

The producers earn extra points for using three well-selected sources:

  • the author of one of the studies
  • an authoritative advocate of evidence-based treatment with knowledge of these studies
  • the U.S. President
  • most importantly, an independent clinician who does the surgery a lot, considers it useful and isn’t quite sure what to make of the results.

The segment earns even more bonus points for using an anecdote involving someone who got the placebo procedure and still felt the surgery benefited her–a rare case when a personal story makes a point other than the usual, "Well, the treatment worked for me."

Does the story compare the new approach with existing alternatives?

Not Satisfactory

Major flaw here: The segment fails to look at non-surgical treatments for painful osteoporotic fractures that, by inference, should be more widely considered. 

This is an important issue.

Patients who get this surgery are usually in considerable pain. Quality of life is reduced. While the studies suggest placebo treatment works as well as surgery, this is of little consolation to someone with a painful, disabling condition who needs relief.

Standard non-surgical treatment for painful osteoporotic fractures doesn’t work in some severe cases and carries its own risks.

Treatment usually includes use of pain relievers, including some narcotics, which can cause gastrointestinal problems, poor balance and the risk of addiction. Other pain meds are poorly tolerated in an older population.

Bed rest carries its own risks for older people with osteoporosis, including physical deterioration. 

Physical therapy is often beneficial, but compliance can be low and hard to sustain.

Finally, without successful treatment, the condition can lead to joint problems, spine misalignment, impaired gait and balance, muscle spasms and falls.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

The segment reports that about 40,000 vertebroplasties are done each year, implying wide availability.

Does the story establish the true novelty of the approach?

Satisfactory

The segment clearly illustrates that the procedure is not novel–and the fact that it is so widely done makes the findings relevant to the larger issue of health-care costs. 

Does the story appear to rely solely or largely on a news release?

Satisfactory

Several press releases were issued about this story, but this report does not appear to draw on them.

Total Score: 8 of 10 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.