Joy Victory is Deputy Managing Editor of HealthNewsReview.org. She tweets at @thejoyvictory.
Last week we introduced our new ongoing series looking at problematic PR releases, surfacing trends in news releases that discuss health care interventions.
We found, for example, that news releases sometimes fail to include the most basic data findings from the research they’re promoting, leaving it to journalists to sift through (often paywalled) studies to find that information.
Our latest concern: News releases announcing results from phase 1 clinical trials, which is the first of several trials a drug or intervention must undergo before it can be approved for use.
Phase 1 is not meant to determine if a drug works. As clinicaltrials.gov explains they are “studies that are usually conducted with healthy volunteers and that emphasize safety. The goal is to find out what the drug’s most frequent and serious adverse events are and, often, how the drug is metabolized and excreted.”
For this reason, rarely do phase 1 trial results merit widespread media attention–though you wouldn’t know that by perusing websites that publish news releases, where it’s a common topic.
Worryingly, these releases sometimes bury the whole “safety” aspect of phase 1 trials and instead make it sound like the drug or intervention was shown to be effective. Framing the results of a phase 1 trial this way might be good for the drugmaker’s stock prices, but it’s not good for conveying science accurately.
Let’s take a look at a few examples:
Duke University Medical Center
The news release focuses on the secondary results of the study–the survival rates. And it frames those rates as showing a “survival benefit” in a subheadline. Yet, as the published paper explains, it was a “dose-finding and toxicity” study to primarily determine side effects and proper dosing. Tellingly, the headline published in the New England Journal of Medicine (“Recurrent Glioblastoma Treated with Recombinant Poliovirus”) shies away from making any claims of benefit.
By focusing on the three-year survival rates, the news release makes the research sound more advanced than it is. But since researchers are still at the stage where they are trying to figure out the best dose, we don’t really know 1) if that 21 percent survival rate will hold true once the researchers pick the safest dose, and then test it on a wider group of people, nor 2) if the survival rate will be worth it when compared to the adverse event rate, nor 3) if patients receiving the experimental treatment are truly similar enough to the control group to make this a fair comparison.
Fortunately, in our reviews of the NPR and NBC News coverage, we noticed the stories didn’t back away from these limitations. One fact that no outlet emphasized, but is important to keep in mind: Despite receiving this therapy, the experimental group’s median survival rate was just 12.5 months, compared with 11.3 months for the control group.
Tolero Pharmaceuticals
That’s a mouthful of a headline, so we’ll strip it down to the news nugget: Pharma company announces that one patient has received an experimental drug.
Yes, you read that right. This news release isn’t even announcing study results from a completed trial. It’s announcing that one patient in the trial has received the medicine they’re testing.
One. Patient.
How is this news? What are journalists supposed to do with this information? We’re not sure.
On the upside, the release is at least clear about what the study will measure: Safe dosing levels and any toxic side effects. That one patient is brave, in other words.
Dana Farber Cancer Institute
This one is from last December, but we wanted to include it here to show how it did some things right–and how it did some things wrong.
Thumbs up: The headline is upfront that this was a phase 1 trial, and it mentions adverse events.
Thumbs down: The first five paragraphs focus on how the experimental drug worked quickly and robustly to treat a blood disorder. The lead researcher gushes that “the rapidity of the improvement is extremely dramatic.”
Thumbs down: The “few” adverse events mentioned in the headline were never explained. But a “few” can turn into “a lot” when tested on larger groups of patients, so these details matter.
Thumbs up: Although it’s not until the final paragraph, we learn this:
“This Phase 1 trial was designed primarily to identify a safe dose of BLU-285, not to evaluate the drug’s effectiveness.”
Considering that the news release spent so much time discussing effectiveness, that line felt dissonant, but at least it’s there.
Comments (1)
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
John D
August 9, 2018 at 11:42 amNice summary of an ongoing issue regarding clinical trials. What should be mentioned is that Phase 1 are not required to report data to clinicaltrials.gov. However, starting next year scientists are required to upload the study protocol when registering a study. I guess that counts for something…
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like