Michael Joyce produces multimedia for HealthNewsReview.org and tweets as @mlmjoyce
This is our third go-round looking for disconnects between what a headline implies or emphasizes, and what the substance of the referenced study really is. And we are beginning to see some themes that almost invariably raise our eyebrows, such as headlines that make factual claims from what are clearly preliminary results. Or headlines that–usually in a provocative way–extrapolate far beyond what the data really mean. Finally, one we see so often we have a graphic for it: “Just say no to news stories on mice research.”
I too write headlines and I have to admit that sometimes–in striking a balance between trying to be informative and capturing attention–the latter wins out. So this series is not so much motivated by a policing or scolding attitude as it is a reminder to ourselves and others that headlines that misinform, or even mislead, are not benign. We certainly write headlines to bring readers to our content, but we also have an obligation to deliver that content.
Taken in that context, a headline might just as well be considered a promise we intend to keep.
Since we last looked at headlines vs studies in January, we’ve published 17 new news story reviews, and 18 news release reviews. Here’s how they stack up.
Headline: Common weed could help fight deadly superbug, study finds
Study: A pre-clinical study of mice looking at whether the Brazilian peppertree plant might contain important antimicrobial properties.
Our review: “As we’ve stressed many times, preliminary rodent research rarely (if ever) rises to the occasion of big health news. We generally recommend putting these studies away and waiting until more conclusive human research comes along.”
Headline: How your morning coffee might slow down aging
Study: The study identified certain genes (or groups of genes) associated with inflammation in older adults. Caffeine was noted to have an inhibitory effect on one gene associated with inflammation. However, the sample size involved in the caffeine-related part of the study was small and only addressed the one gene in particular.
Our review: “… the news story translates this as meaning that drinking coffee can slow down aging. That’s a stretch. The story also uses vague — and potentially overstated — language to infer that inflammation is the causal factor for a host of diseases. While many chronic diseases are associated with inflammation, there’s little conclusive evidence that lowering inflammation levels — or drinking coffee for that matter — will prevent these diseases.”
Headline: Phase III COMPASS study with Bayer’s Rivaroxabon in Patients with Coronary or Peripheral Artery Disease shows Overwhelming Efficacy and Meets Primary Endpoint Early
Study: Ostensibly, the study is the largest clinical trial to date on the drug Xarelto (rivaroxaban), used to prevent major adverse cardiac events such as heart attacks and strokes in people with coronary artery or peripheral vascular disease. However, Bayer didn’t release the study–just a news release about it.
Our review : “The release describes the study parameters (number enrolled, dosage, time frame, etc.) and discusses in clear detail the drug’s availability. But it left out potential harms from Xarelto and it also doesn’t cover the drug’s costs, talk about any of the specific benefits of the drug, or compare it to other treatments. In short, it’s like a Superbowl ad for the drug without the all the fast-talking caveats at the end.”
Our reviewers felt this was important because “even when drug makers are required to disclose when [a drug] reaches ‘primary endpoints,’ it’s to the benefit of investors, regulators, the medical community and hopeful patients to avoid hyping the results, emphasize study limitations, and highlight the lack of vetting by peers. That context is going missing in a number of announcements from big drug companies.”
For a more general discussion of data-free drug announcements see Managing Editor Kevin Lomangino’s recent post on a “troubling PR trend.”
Headline: Breath test could help detect stomach and esophageal cancers
Study: Could a simple breath test predict esophageal or stomach cancer, therefore allowing earlier diagnosis and introduction of treatment? Results showed that, in most cases, breath analysis could only distinguish between people who were already known to have stomach or esophageal cancer (advanced in most cases) with people who did not have any signs of cancer.
Our review: “The release did note at the end that researchers have yet to study whether this breath analysis can detect cancers among people in the general population. That’s an important point and one that would have been good to emphasize earlier in the release. The release gave only the briefest nod to the existence of numerous other breath tests for cancer that are being studied and didn’t explain how this particular research compares to other efforts.”
Headline: Encouraging clinical results for an antibody drug to prevent or treat HIV
Study: A preliminary clinical trial of a new biological agent called “10-10704” to treat HIV, involving just 33 people (19 people infected with HIV and 14 who were not).
Our review: “The stated purpose of the research was ‘to determine whether the antibody was safe and whether it had antiviral activity in humans’ but the news release didn’t tell us the actual results of the trial and what this might mean in the larger context of HIV treatment.”
Have you come across any headlines lately that drew you in, but when you read the associated study, left you wondering “where’s the beef?”
If so, let us know in the comments section below.
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Comments are closed.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like