Gary Schwitzer is publisher of HealthNewsReview.org. He knows the contribution that observational research can make, but frequently writes about miscommunication of such findings. He tweets as @garyschwitzer, or under our project handle, @HealthNewsRevu.
Step back. Breathe deeply. Join us in sucking in some recent research news coverage.
USA Today reported, “Caffeine may lead to a longer life.”
Or, it may not, the story could just as easily–and accurately– have reported.
Instead, it makes a leap to this news-you-can use assertion: “Perk up. That daily cup of coffee could guarantee many more mornings.”
Guarantee?
The story mentions a study but doesn’t link to a study. Rather, it links to a Stanford news release that is much better than the more widely-distributed USA Today story. The Stanford release only refers to an “association” and a “correlation,” but never to proof of cause-and-effect. That’s because the work was based on an analysis of blood samples, mouse research, and an analysis of patient data.
Important, but not a level of evidence that should be framed as a “guarantee” of longer life.
The New York Times reported, “Licorice During Pregnancy Tied to Problems in Children.”
It began: “Pregnant women may want to avoid licorice, which may affect the cognitive abilities of their children, a study suggests.”
It ended: “We know that there are limitations in observational studies like this,” said the lead author.
Yes, we certainly do know that. But burying the caveat at the end of the story may only further hide that fact from readers who get drawn in by the headline and first sentence. And allocating just 250 words to health science news is hardly in the best tradition of the New York Times. But, as another Minnesotan wrote, the Times they are a-changin’.
What this collection of words didn’t tell you was that the study in question assumed that the women who consumed more than the equivalent of 8.8 ounces of pure licorice a week are no different than the women in the study who consumed little or none.
But you–and the Times–should be asking: What could be other, confounding factors that might help explain the results? Maybe licorice wasn’t the only candy or sweetener the women were consuming in greater quantities. What else might be different in the upbringing of the children born of the big licorice eaters from the upbringing of offspring of the lesser licorice eaters? For instance, maybe a mother who would consume more than the equivalent of 8.8 ounces a week of pure licorice would have a different notion of what she would allow her kids to eat and drink during these critical childhood years.
No, I’m not trying to blame moms/parents for one more thing, but these are the kinds of questions that should come to mind when thinking of confounding factors that can influence observational research results.
Smart readers are catching on, tired of the flood of fearful or fanciful health care news based on inadequately explained observational research. Times readers left these comments:
So, journalists, if you aren’t getting the message from us after nearly 11 years of trying to get these points across, you’d better listen to your readers. You’re losing them. And this is one reason why.
And readers, please keep coming back here to continue your education and to sharpen your critical thinking about all those studies you hear about every day.
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Comments are closed.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like