Reviewers for HealthNewsReview.org sometimes get asked, “What do you want, a totally boring story?” This piece shows that you can provide the right note of caution while reporting on a scientific study without over-hyping, promising a cure-all, or throwing all caveats out the window.
This piece highlights a novel agent that in an early-stage study showed small benefits of a short duration that weren’t even definitely proven to be related to the medicine. The fact that this study–not even published or presented at a meeting–generates press shows how important and vexing this problem is. The need for new medications that work in different ways than existing medicines available and in the pipeline is clear. However, as this piece highlights, it is uncertain whether this new drug will be investigated further, with studies that involve more patients for longer periods of time.
There are no mentions of costs in the piece. Ordinarily, we expect to see some discussion of what the cost may be–especially when Wall Street is closely watching the drug’s progress. In this case, however, the story makes it abundantly clear that the results were lackluster and so this drug is unlikely to be on the marketplace anytime soon.
Look at the headline of this story: “In small Alzheimer’s study, hints of modest benefit from unusual drug.” Now look at the first sentence: “A little-known drug company announced modestly encouraging results for its experimental Alzheimer’s drug on Monday, a rare but still preliminary glimmer of hope in a field that has been battered by failure after failure.” We had to do a triple take because this level of reflection and circumspection is so rare and so welcome.
The story then goes on to spell out why the reporter used terms like “hints of modest benefit” and “modestly encouraging” and, if you read the links, the story also backs up the history of failure in this field.
When it comes to quantifying the benefits, we’re told, specifically, that “the patients who received all six low doses did the best; their average improvement after the 12 weeks was 1.5 points on the 100-point cognitive test.” It then says, “Patients receiving a placebo (most were also on standard Alzheimer’s drugs) lost 1.1 points.” We’re told the difference was not statistically significant.
The story notes that the study might not have been long enough to detect serious risks with long term use. It says, “If it works, patients would likely have to take Bryostatin-1 for the rest of their lives. The main adverse event was diarrhea.”
The story gets at most aspects of the nature of the study in a very efficient way. And the reporter went into the study to find out how many people finished the study. It says, “Neurotrope enrolled 147 patients with an average age of 72 and moderately severe to severe Alzheimer’s. Some dropped out, so in the end, 33 got a high dose of the drug (known as Bryostatin-1), given intravenously every two weeks; 38 got a low dose, also every two weeks; and 42 got a placebo.”
It also talks about the short duration of the study, how it was not published in a peer reviewed journal, and how it was not part of any scientific convening. Every reporter, when the facts present themselves this way, should just write a similar sentence: “Neurotrope’s results have not been published in a scientific journal or presented at a medical meeting, so outside experts have not been able to evaluate that and other important details.”
There was no disease mongering in the piece. Alzheimer’s is a disease for which there is no cure or effective treatment. The patients studied in this piece had moderate to severe disease–meaning that their living were significantly impacted by the memory disorder.
The story had several independent sources but it didn’t disclose at least one important relationship.
It said “Dr. Sam Gandy…is not affiliated with Neurotrope.” However, he has worked as a consultant for them, as the “industry relationships” section of his bio explains.
Update 5/4/2017: STAT has issued a correction at the bottom of their story: “This story has been corrected to say that Dr. Sam Gandy consults for Neurotrope.”
The story mentions FDA approved drugs: “There are four FDA-approved drugs for Alzheimer’s, which affects 5.5 million people in the US: donepezil (sold as Aricept), galantamine (Razadyne), rivastigmine (Exelon), and memantine (Namenda). But none is a cure, and none affects the destruction of neurons and synapses, which causes the disease’s memory loss and cognitive catastrophe.” It also highlights that this new agent works in a different way from existing medications.
The story explains where the drug is in the regulatory process–still far from being on the market.
And it indicates how likely it is for the drug to get approval, saying, “A 2.6-point edge over placebo may fall slightly short of what the Food and Drug Administration would require for approval of a new Alzheimer’s drug… the FDA typically wants to see a net benefit of at least 3 or 4 points.”
The piece does a good job of describing how this drug is working in a different way than existing medicines and other drugs undergoing clinical evaluation. And how the patients being studied have far more advanced disease than most clinical trial participants.
The story does not overly rely on a news release.
Systematic, Criteria-Driven
Why fact-checking is not enough to prevent the spread of misleading health care news...@HealthNewsRevu https://t.co/fzC2JbDYGV
Simply fact-checking an article "fails to capture questions of nuance and context that arise – or should arise – whenever evaluating medical evidence." https://t.co/HrYkGj12q1
We wrote only about efforts that label themselves as “fact-checking” projects. You’ll see that if you read the piece.
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like