Let’s revisit this oft-violated tenet of scientific communication.
Just because an association is established, it doesn’t mean a causal link has been established.
The latest botching of this message was two weeks ago when the Journal of the National Cancer Institute published a study looking at women, how much alcohol they drank and how often they got cancer.
The study’s lead author told The Guardian, “Given that this is the largest study in the world to look at this, it’s clear that even at low levels of alcohol consumption, there does seem to be a very significant increase in cancer risk, and most women are probably not aware of that.”
Several friends wrote to me about news coverage of this study.
It was page one news in the Washington Post, for example, where the headline incorrectly states: “A Drink A Day Raises Women’s Risk of Cancer.”
One Post reader wrote the following to me:
It is a good example of what confuses the public. The Post article overflows with causal language, using phrases such as “increases the risk,” and “may cut the risk” multiple times. The writing is naïve and I am doubtful that he understands the hierarchy of evidence, or the difference between observational and experimental. Unfortunately, the investigators are complicit here, as well. The reporter quotes the investigator saying “increasing your risk,” which is consistent with her language, “Low to moderate alcohol consumption in women increases the risk of certain cancers…” in the abstract of the paper itself.
(The journal article) uses associative language quite a bit as well and I’ll bet the authors understand the difference. Why they slip into causal language, I don’t know. I guess it sounds better and varies the syntax. Or it sells better. I have observed a lot of this in the scientific literature—in JAMA, the NEJM, JNCI and others. This is frustrating because it leads the journalists down that path, wittingly or not. Makes it harder to educate the journalist, if you are having to instruct them that the investigators are sometimes wrong and may mislead them.
Another friend sent me a link to an online article by Patrick Basham and John Luik, ” Women, keep drinking: Why was a flimsy study apparently showing a link between booze and breast cancer so uncritically accepted?” Excerpts:
Allen (the lead author) came across with even scarier news for Americans, telling the Washington Post that the take-home message’ was this: If you are regularly drinking even one drink per day, that’s increasing your risk for cancer [since] there doesn’t seem to be a threshold at which alcohol consumption is safe.’
One can’t help but wonder just what Allen herself has been drinking… After all, her public pronouncements, her recommendations to government, and the reports about her study in the media are certainly not supported by her results.
First, Allen’s study is an observational one, based on data from the UK’s Million Women Study, which is a study about the association between Hormone Replacement Therapy and cancer and heart disease. Allen’s study comes from self-reports about the drinking habits of women in that study.
This means that the study, as an observational study – the weakest kind of epidemiological endeavour and certainly nothing close to the gold standard of a randomised controlled trial – is inherently unable to draw any causal conclusions about a link between drinking and cancer.
Second, the study fails to meet even the most basic requirement of science – that is, being able to validate its measurements – since it is entirely based on the women’s self-reports of their recollection of their drinking. None of these reports was checked and the authors can make no claim about how reliable they are. No one knows how much or how little these women really drank since no one bothered to measure it.
This makes any conclusions based on such evidence’ just a tad dicey. At its foundation, therefore, the study can’t warrant that any of its data about the key fact – the drinking habits of its subjects – is accurate.
Basham and Luik went on to point out that “teetotallers had a higher population incidence of cancer than those consuming up to 14 drinks a week!” And that “of the cancer-drinking correlations examined, virtually none was statistically significant.”
Their conclusion:
What is the real take-home message of this study? Perhaps it should be to avoid drinking policy advice produced by Oxford epidemiologists.
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Comments are closed.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like