Michael Joyce is a writer-producer with HealthNewsReview.org and tweets as @mlmjoyce
After 12 years in which we’ve published more than 2,500 news story reviews, we’ve found that reports out of medical meetings are among the most superficial and imbalanced journalism that we evaluate.
Study abstracts presented at these meetings are often pitched as urgent or a ‘breakthrough’, when actually they’re usually preliminary and yet to be rigorously scrutinized by others.
Headlines like these popping up in the coverage of this week’s Alzheimer’s Association International Conference (AAIC) in Chicago are a striking case in point:
Lowering Your Blood Pressure Could Stave Off Dementia (Bloomberg)
Lowering Blood Pressure Cut Risk of Memory Decline: US Study (Reuters)
There May Finally Be Something You Can Do to Lower Your Risk of Dementia (Time)
The research that generated these headlines comes from an extension of the SPRINT study — called Sprint MIND — that looked into whether more aggressive lowering of blood pressure affects “Mild Cognitive Impairment” (MCI) which is defined in small/italic print at the end of the AAIC news release as:
MCI causes a slight but noticeable and measurable decline in cognitive abilities, including memory and thinking skills, but the changes are not severe enough to interfere with daily life or independent function. A person with MCI is at an increased risk of developing Alzheimer’s or another dementia. However, MCI does not always lead to dementia. In some people, MCI reverts to normal cognition or remains stable.
None of the news stories we reviewed told readers how MCI was measured or defined in the study. Richard Hoffman MD, MPH, director of the Division of General Internal Medicine for the University of Iowa Carver College of Medicine, considers this important information.
“It’s mentioned that subjects completed ‘at least one follow-up cognitive assessment.’ But I’d want to know what was the protocol for following cognitive impairment — not just the type and timing of the assessments, but was the follow-up comparable for both groups.”
Any disparity in how those assessments were carried out could imbalance the study outcomes. But that’s not the kind of detailed information that readers can glean from a study abstract presented at a meeting.
Another major deficiency with many news stories is that they erroneously equate MCI with dementia (see Bloomberg and TIME headlines above).
In fact, the study authors looked for, but didn’t find, a statistically significant reduction in the rate of dementia among those treated with more aggressive blood pressure lowering. While it’s possible that such a benefit could emerge as the participants continue to be followed, it’s entirely speculative and misleading to suggest that this outcome has already been documented.
Kenny Lin MD, MPH, is a professor of family medicine at Georgetown University. Like Hoffman, he wanted to know more about the cognitive assessments. But he also expressed another concern.
“There’s no mention of previous trials (here and here) on the effect of lowering blood pressure on dementia prevention which showed mixed results or no benefit of antihypertensive medication on the development of dementia.”
Most of the news coverage reported the study’s major finding as this: Of the over 9,000 adults with increased cardiovascular risk (but no known diabetes, dementia, or stroke), those randomized to receive more intensive blood pressure treatment (blood pressure goal ≤ 120 mm mercury) were ‘19% less likely to develop MCI’ than those with more relaxed blood pressure goals (≤140 mm mercury).
That’s a relative risk reduction, which often serves to exaggerate the size of the actual benefit.
The absolute risk reduction was not reported in the study abstract, but the Wall Street Journal — which apparently dug deeper than anyone else for those numbers — reported it as just over one percentage point:
“Researchers found that 285 participants receiving intensive blood-pressure treatment, or 6.1% of the group, developed mild cognitive impairment, versus 348, or 7.4%, in the standard treatment group.”
We’re left wondering what the difference is between a 19% improvement and an improvement of 1 percentage point, and that’s something the news release from the Alzheimer’s Association should have made clear.
Also very troubling is the fact that, although the Alzheimer’s Association news release DID provide detailed information about adverse consequences from aggressively lowering blood pressure, none of the news coverage we came across did so. We’ve encountered omissions like this before in our extensive coverage of the SPRINT study, whose findings were initially reported as a slam dunk that would immediately change practice. Only later did details emerge that would make many clinicians question the validity of the findings and their relevance to broad swaths of patients.
“The original SPRINT trial generated a robust discussion amongst clinicians regarding how low is too low, especially for older patients,” said Preeti Malani, MD, a professor of medicine at the University of Michigan.
“The decisions regarding a blood pressure goal are very nuanced and individualized. While appropriate treatment of high blood pressure is one of the most important clinical interventions that can be made for patients, decreasing dementia risk is probably not what drives the calculus around lower blood pressure goals. So although the MCI data from this study may be encouraging, I’d like to see something more definitive before calling this an effective means to ‘stave off dementia.’ That’s overstated based on this abstract.”
Right now we’re about 24 hours into the coverage of this meeting abstract that has yet to be published in a peer-reviewed journal. Dozens of news stories have already been circulated but crucial details are missing. We recommend, at the very least, paying attention to the following.
Go beyond a single source — much of the coverage only quotes the lead author. Most often the quotes are glowing and not balanced by independent sources that ought to be used to confirm or refute findings.
Check the hyperbole — glowing quotes by lead authors are often major sources of unjustified or hyperbolic language. The lead author of this research was quoted by Bloomberg (above link) as saying this about aggressive blood pressure treatment: “It may give another five or 10 years with a healthy brain.” That’s based on speculation, not data.
“Preliminary & Unpublished” — kudos to the Associated Press who had this to say about the study results: “They’re considered preliminary until published, expected later this year.”
Look beyond the meeting — as mentioned by Dr. Lin above, there are often existing published studies available that address the same topic. Not infrequently, the findings may be quite different. Giving readers that information empowers them to better weigh harms and benefits.
There is something about embargoed news releases coming from medical meetings that triggers an unhelpful sense of urgency amongst healthcare reporters.
Very, very rarely do such abstracts contain breakthroughs, paradigm shifts, or unassailable information that will immediately change patient care. And even if they did, isn’t that exactly the kind of information reporters would want to take more time with?
Here’s more of our coverage of the 2018 Alzheimer’s Association International Conference:
Motherhood affects Alzheimer’s risk? Here’s what you need to know
We also appreciated this coverage of the Sprint MIND trial by Larry Husten of Cardiobrief:
No, A big NIH trial did not show that lowering blood pressure will prevent dementia
Comments (1)
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
ALICIA TAYLOR
July 27, 2018 at 5:34 pmWow. I have been saying this about studies for years – quick claims and not enough data. It truly is sad how journalists fail to dig without actually fact checking. I mean, isn’t that part of the job?
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like