This TV segment, based on results of an early stage clinical trial of a stem cell treatment for MS, suffers from a major structural flaw: It focuses exclusively on the case of a single patient with an excellent outcome, without mentioning findings about the larger study group. In fact, it doesn’t even say that the study was published.
Given the magnitude of that failure, and the story’s resulting capacity to mislead viewers, other flaws are nearly irrelevant. Still, it’s worth mentioning that no independent sources were interviewed to put the case in context.
The story does manage to do a few things well:
It’s hard to imagine why the producers decided to focus on the case of a single outlier without even acknowledging the rest of the findings, or even that they are published. One fears that it’s done to create the impression of "exclusivity"–that CBS alone had this story. If this is the reason, the viewers’ ignorance about the larger study findings, and their limitations, is serious collateral damage.
It’s worth noting that despite the hosts’ efforts to explain that the study is small and the results preliminary, some visitors to the CBS online comment area wanted to know where they could get the treatment. It’s a useful reminder that stories that emphasize positive outcomes may provoke irrational hope.
Which in turn should remind for journalists to present scientific findings as fairly and accurately as possible–even when they’ve landed a memorable interview.
This story mentioned several times that this was a small early trial – so we think it’s OK that they didn’t discuss projected costs of this treatment.
The story fails to deliver any detail about the benefits of the treatment other than the single anecdote.
Consequently, viewers have no idea what outcomes the other 20 patients had.
The published study shows good results for 17 of the 21 patients, with all at least stabilzing and most showing improvement by at least one point on a commonly used scale of MS symptoms. Some patients required a second treatment. The story should have said this.
Instead of reporting these details about the study, the producers allow viewers to assume that the featured patient’s results are typical. It appears he is an outlier, the example of the best and most successful outcome of the study. The segment should have said this too.
The story fails to mention potential harms related to the procedure, including those related to chemotherapy and the disabling of the immune system.
The segment is based on results of a small, preliminary clinical trial. The reporter discloses this, and indicates that a larger, randomized clinical trial will be required to verify the findings.
Oddly, however, the segment fails to mention that results of this trial have been published in a medical journal, The Lancet Neurology. This could lead the viewer to believe the study is less credible than it is.
Further, the segment focuses on one patient so thoroughly that it implies the one case is evidence of treatment efficacy.
Finally, the report fails to mention other key limitations on the evidence, including that the study looked only at people with the early stage of the disease, that an earlier trial on patients with more advanced cases had negative results and that the long-term outcomes are unknown.
The segment uses one anecdote at length, which describes a single patient’s case of MS from diagnosis to outcome. Because he is young, his prognosis poor and the outcome of the stem cell treatment so apparently successful, this could be misleading.
Having said that, the report does not exaggerate the prevalence or severity of the disease, so it minimally earns a "satisfactory" rating.
The segment is built around a single patient [with his mother, during the studio interview portion] and the researcher conducting the trial. No other sources are consulted.
At least one independent expert in MS treatment should have been consulted to provide perspective.
The segment says that this patient was given conventional drugs at first, implying drugs are the first treatment. This is correct and useful.
Other treatments are used for MS, including deep-brain stimulation, though it is not approved for use on MS.
The segment would have been stronger with more information about current treatments, but it minimally reaches "satisfactory" status under this criterion.
The story makes clear the stem cell treatment for MS is still under study and not yet available.
It would have been useful to tell people whether the larger randomized trail is still recruiting patients and, if so, how to get more information.
The story fails to note that previous trials have employed stem cell treatments for MS. The novelty of this approach is the use of a priming process that is less toxic than the previously used chemotherapy protocols.
A press release from Northwestern University was published on February 3, seven days before the Early Show story appeared.
The segment does not draw excessively from the press release.
Systematic, Criteria-Driven
Monday at #ADA2021, an infectious disease epidemiologist, a journalist, and a researcher shared perspectives on communication of risk in the era of COVID-19: http://ow.ly/ROfR30rMeE7 @AstleyCM @garyschwitzer @berthahidalgo @ADA_DiabetesPro
Shoutouts to @susan_bewley @drkevinknopf @MichaelBaum11 in this call for more than fawning coverage from press releases for these kinds of stories.
Also, linked history inside goes back 5 years just on Grail apparently trying to become Holy Grail. https://twitter.com/garyschwitzer/status/1408849696416841731
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like