Mary Chris Jaklevic is a reporter-editor at HealthNewsReview.org. She tweets as @mcjaklevic.
Wake me when it’s over.
There was a lot of misleading information in news stories this week about a study of sleep traits and risk of breast cancer. It was a complex study to decipher, but instead we got simplistic headlines like this one from HealthDay: “Early Birds May Have Lower Breast Cancer Risk.”
That story stated: “Compared to night owls, women who are early risers had a 40 percent lower risk of breast cancer, the study found.”
Forty percent lower risk? No, not really. Despite what readers might glean from this story and others, this research did not prove that getting up early lowers a woman’s breast cancer risk.
Moreover, it did not even show an association between getting up early and reduced breast cancer risk.
What HealthDay didn’t make clear to readers is that researchers didn’t actually look at whether women rose early or went to bed late. Rather, they analyzed data from two databases encompassing about 400,000 women. They examined women’s self-reported responses when asked where the fell on a scale between being a “morning person” and being an “evening person” as well as genetic variations associated with sleep preferences.
HealthDay also didn’t provide real numbers to indicate how much of a difference a “40 percent lower risk” might represent—nor how sleep preferences might compare with established risk factors for breast cancer. For more information on why it’s important to include real numbers, see our primer on absolute versus relative risk.
The story said “women who slept longer than the recommended seven to eight hour a night had a 20 percent increased risk of breast cancer for each additional hour slept.” That data, too, is problematic because it was based on women’s self-reporting of how much they slept. The story did not explain how that data was collected.
To its credit, HealthDay clarified that the study “did not prove a cause-and-effect relationship between sleeping patterns and breast cancer risk” and quoted a researcher who said “it may not be the case that changing your habits changes your risk of breast cancer.”
But those caveats appeared several paragraphs into the story, where readers might not notice them. Moreover, the story included other quotes that were less cautious and seemingly contradictory, such as one referring to “a protective effect” of morning sleep preference.
Stories on this research also ran in BBC News, CNN, and USA Today. All appeared to take their cues from a misleading news release entitled “Women who are ‘larks’ have a lower risk of developing breast cancer.”
BBC News was the only one of the four we looked at that provided absolute data. It wrote that the study “only looked at a small, eight-year snapshot of a woman’s life,” during which time “it showed two in 100 owls developed breast cancer compared with one in 100 larks.”
CNN did the most complete job of explaining the evidence. It mentioned caveats missed by other stories:
A research method called Mendelian randomization was mentioned in all of the stories except HealthDay’s. Only CNN discussed its limitations, quoting a researcher who said, “The statistical method used in this study, called Mendelian randomization, does not always allow causality to be inferred.”
As a BMJ primer explains, the method “depends on assumptions, and the plausibility of these assumptions must be assessed. Moreover, the relevance of the results for clinical decisions should be interpreted in light of other sources of evidence.”
So, even though we can expect to hear much more about this method as it’s used to study the role of genetic variants in health outcomes, it is still dicey to tell the public that cause-and-effect has been undeniably established.
All of the stories noted that the study wasn’t in a peer-reviewed journal; an abstract was presented at a medical conference.
The fact that this research hasn’t been published is one more reason why the data can’t be considered reliable. The validity and importance of unpublished research often hasn’t been established, as our primer on news from scientific meetings explains.
So as far as this report goes, sleep tight — whenever you please.
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Comments are closed.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like