This is one of two stories we reviewed that cover results of a phase 1 trial to study the use of a modified poliovirus to fight glioblastoma, a fatal brain cancer. The results of the study were published in the New England Journal of Medicine. The story delves into the harms of the treatment and refrains from disease-mongering.
Yet the definitive cause-and-effect framing of the lead and the headline, along with a single non-representative patient anecdote, might lead readers to believe the evidence is stronger than it is. The story also lacked independent sources and a mention of other similar research. We also reviewed a story by NPR, which had similar shortcomings.
Stories about experimental treatments for fatal conditions such as glioblastoma should shy away from cause-and-effect framing and overly positive anecdotes in order to avoid raising false hopes.
You can hear a podcast that describes the emotional pain that premature hype around a glioblastoma treatment inflicted on one patient and his family.
There’s no mention of how much this might cost, but we’ll rate this N/A since the story makes it clear that this concept still requires more research.
The story did give numbers, reporting that “21% or so of patients helped by the vaccine all survived at least three years,” while 4% of patients in the the historic control group were alive after three years. But in a small study, why not give readers the absolute numbers: how many out of how many? Why make them do the math in their heads?
Some of data were incomplete. For example, the story said of the 61 treated, “eight patients had no evidence of the tumors growing any more and two had no evidence of a brain tumor at all,” without indicating how much time had passed since those patients were diagnosed and treated.
Better than the NPR story that we also reviewed, NBC did a good job of spelling out harms, stating 19% of patients had “notable adverse events” and more than a quarter experienced brain damage affecting speech and communication. Again, though, we think it’s better to give readers the absolute number of adverse events – how many out of how many?
The story did some things right on this score, but we wish it had refrained from cause-and-effect language and the inclusion of a single — extremely positive — patient anecdote.
To its credit, the story stated in the second graph that this is “no miracle cure.”
However, we take issue issue with the lead’s definitive tone, which stated that the treatment “helped some patients live for years longer.” That assertion was echoed in the headline. The journal manuscript did not use such language, but referred only to the survival rate being higher than the rate among historical controls.” As the American Cancer Society states, “(Phase I) studies are not designed to find out if the new treatment works against cancer.” Their primary focus is on whether the approach is safe. So the “helped some live for years longer” language is misleading. More trials with randomized controls are needed to determine whether this treatment actually led to better outcomes.
The story quoted a 20-year-old patient who said she was “amazed” at her improvement after taking the treatment. However, the story didn’t alert readers that she was one of just two of the 61 to have survived six or more years.
Lastly, the story should have described limitations of using a sample of past patients as a control group — a practice that might generate more favorable findings than a randomized control trial.
The story didn’t exaggerate the prevalence of this disease.
The story has no independent sources, and does not mention that seven study authors have a financial tie with a firm that holds the patent.
The story mentioned standard treatment for glioblastoma can include surgery, chemotherapy, and radiation.
However, the story would have been stronger if had mentioned that there are other experimental viral treatments under study for glioblastoma.
The story makes it clear that this is an experimental treatment and is not widely available.
The story made it sound like this was a new concept, but this research has been dancing in and out of the sensational spotlight for years.
This story does not rely on a Duke news release although it does mimic the news release’s cause-and-effect framing.
Systematic, Criteria-Driven
With the discontinuation of @HealthNewsRevu, there's a genuine concern that well-written and researched "reality checks" in healthcare are not economically interesting. This should be disconcerting to anyone, and yet I'm only seeing more and more piling into "promising findings"
Thanks for ALL you do and have done, Gary. https://t.co/93K4hzQXZj
Thanks for sharing this with all of us today, @garyschwitzer @HealthNewsRevu
A nice gift.
#healthcare #healthcarenews #journalism #reporting #factsmatter #truthmatters https://t.co/hNHdZDl2rc
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like