Michael Joyce is a writer-producer with HealthNewsReview.org and tweets as @mlmjoyce
Two weeks ago it was “ultra-processed” foods and cancer.
Last week it was sugar-sweetened soft drinks and cancer.
Two cohort studies that can show a link between one factor and another, but cannot conclude one factor (like a food or drink) actually caused the other (cancer).
But such studies often become media darlings. Maybe because the studies are impressive in their size and scope, or — more likely — because they often explore the relationships between common lifestyle choices and disease.
Regardless of why they attract headlines, large cohort studies almost always hold two very important lessons for reporters and consumers that tend to be overlooked.
Here are two headlines generated by this study of sugary soft drinks and obesity-related cancers from the Melbourne Collaborative Cohort.
The Guardian: Just one soft drink a day could increase cancer risk, study finds
ATV-10 (Melbourne, Australia): Sugary soft drinks increase risk of cancer: study
The ATV-10 headline illustrates our first lesson: using unequivocal, definitive, cause-and-effect language in studies such as this is incorrect. It runs a huge risk of misleading readers into believing that the study proves sugary drinks are a risk factor for cancer. This study can not prove that. Its design is capable only of showing a statistical association between two things — not that one thing caused another to happen.
The Guardian headline – by inserting the word “could” – would suggest a more tempered approach; however, the use of an active framing (“could increase”) still implies that sugar may have caused a change in cancer risk. Casual readers may still come away with an erroneous sense that a single soft drink might increase their cancer risk.
The Guardian article does do two things well. First, it summarizes the study findings with cautious language:
… the study found a positive association between soft drink consumption and cancer risk, independent of obesity, after statistically adjusting for weight circumference
Wording like “associated with … tied to … linked to” is appropriate. The Guardian also does well to point out that further studies are needed. Most of the news coverage I reviewed did not make this clear.
My take home message for reporters is this: state this limitation clearly. Just tell readers: This study cannot prove cause-and-effect. Only associations. More studies are needed.
Although the researchers in this study tried to control for as many factors as they could that might contribute to cancer risk, they clearly state there may be have been residual confounding factors “which may not have been adequately controlled for.”
It turns out that drinking sugary soft drinks is associated with other unhealthy behaviors such as exercising less, and smoking and drinking alcohol more often. In other words, it was impossible for researchers to completely separate out these behaviors (which are known risk factors for cancer) from the behavior (drinking sugar soft drinks) they wanted to clarify might also be a risk factor for cancer. This makes it nearly impossible to say, for example, “the increased risk for cancer is definitely attributable to just sugar in soft drinks.” Instead, you have to admit that other factors could have contributed to this risk.
Teasing apart confounding factors from the one being studied is a universal problem with almost all cohort studies. A major problem. Yet it’s often neglected in the reporting on such studies, as was the case in nearly all the coverage of the Melbourne study I reviewed.
This was a prospective cohort study investigating if there was an association between drinking sugar-sweetened soft drinks and developing obesity-related cancer. (These include colorectal, breast, prostate, kidney, liver, ovarian, and several others.) Subjects who drank artificially-sweetened soft drinks were also studied for comparison. From a pool of over 35,000 subjects, there were 3,283 incidents of obesity-related cancer (during two waves of follow-up: 1990-1994 and 2003-2007; subject ages 40-69).
Results: More frequent consumption of sugar-sweetened soft drinks was associated with both higher waist circumference and a modest increase in the number of obesity-related cancers that were reported. However, although more frequent consumption of artificially-sweetened soft drinks was also associated with higher waist circumference, it was NOT associated with an increase in obesity-related cancers.
Some final points to be made here.
First, although this discrepancy between sugar-sweetened and artificially-sweetened drinks and cancer risk seems to implicate sugar as a risk factor, much more research is needed to confirm or refute this.
Second, just how much sugary soft drinks subjects consumed was based on self-report in questionnaires. The authors clearly state this is “the main weakness or our study … self-report may not be accurate” and is nearly impossible to validate. This major limitation was not included in any of the reporting I reviewed.
So, in summary, here’s what you need to know:
Comments (3)
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Milo Schield
March 9, 2018 at 5:36 amHealthNewsReview.org: To Michael Joyce on your Feb 26, 2018 column. Granted: an observational study “cannot prove” causation in the way that an experiment or randomized clinical trial can. But you also said, “cannot conclude” causation. Is this “cannot conclude” because of the observational study design or the small hazard ratio ( 10)?
Milo Schield
March 9, 2018 at 6:45 amIf we “cannot conclude” because of the observational study design, does that mean we “cannot conclude” that smoking causes lung cancer (RR > 10)?
Michael Joyce
March 9, 2018 at 10:53 amDr. Schield,
Thanks for your comment.
I am not an expert in statistics, however it is my understanding that there are very limited circumstances under which a body of literature based on observational studies can be used to draw a causal inference. Smoking, and its extremely strong association with lung cancer observed across many studies, is a good example. This surgeon general report outlines the criteria that must be met to justify causal claims based on observational data:
https://www.ncbi.nlm.nih.gov/books/NBK44698/
Sugar-sweetened soda and obesity-related cancer — or, for that matter, any dietary association with health risk based only on observational data– does not meet these criteria.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like