Note to our followers: Due to a lack of sufficient funding, HealthNewsReview.org will cease daily publication of new content at the end of 2018. Publisher Gary Schwitzer and other contributors may post new articles periodically. If you wish to donate, your gift might help keep the site available to the public for a few more years, by defraying costs of web hosting and maintenance. All of our 6,000+ published articles contain lessons to help people improve their critical thinking about health care. Read more about our change in status. And here's how to make a donation.

Your kitchen could hurt you, save you, or make your children overweight

Michael Joyce is a writer-producer with HealthNewsReview.org and tweets as @mlmjoyce

The health section of Newsweek kicked off the week letting readers know there are apparently foods in your kitchen that can cut your risk of dying by 18%, and cleansers under your sink that could make your kids overweight “by messing up their gut bacteria.”

Here are the headlines — keeping in mind they are from a publication that was once a leading news magazine:

Wine, Beer and Chocolate: Eating and Drinking These Foods Linked To Living Longer

Household Cleaning Products Might Be Making Your Children Fat

Welcome to our world! Where every week we come across a misguided and misleading recipe for “news” that goes something like this:

Find an observational study touching on a lifestyle choice or widespread health concern … take the associations found in the study and erroneously present them with cause-and-effect language …  finally, make matters worse by de-emphasizing caveats and limitations but emphasizing clickbait headlines, thereby leading readers down the path to misinformation.

Here’s what you need to know about this latest bumper crop of substandard stories:

Your fridge

According to this 16-year Swedish study of 68,000 people, “adherence to a diet with high anti-inflammatory potential may reduce all-cause, CVD (cardiovascular disease), and cancer mortality and increase survival.”

This is based on an “anti-inflammatory diet index,” or AIDI, that includes 16 food types, 11 of which are designated as “anti-inflammatory” (including fruits, vegetables, nuts, whole grains, wine/beer, coffee, and chocolate) and five as “pro-inflammatory” (such as red meat, soft drinks, chips, and offal).

Newsweek explains inflammation this way:

The immune system triggers inflammation when the body is confronted with a potential threat, like a harmful chemical or microbes. That process can become problematic when inflammation becomes the body’s default state. And evidence suggests that conditions from Alzheimer’s to depression, cancer and heart disease could be caused by chronic inflammation.”

The italicized bit is our emphasis to underscore pure speculation. Why include that and not the following?

  • Much of the research into what foods are inflammatory vs. anti-inflammatory is either observational or based on animal models.
  • There is limited evidence to support this leap of reasoning: Inflammatory foods cause diseases that, in turn, shorten your lifespan.
  • Food questionnaires are notoriously unreliable, and even if they weren’t, this study cannot fully account for other lifestyle or health variables that may have contributed to the findings.

Other than remove the causal language found throughout the story, the next best thing the story could have done is asked sources: What are the limitations of this study and why is that important to readers?

Under your sink

Next to get featured was this study from the Canadian Healthy Infant Longitudinal Development cohort. It suggests “emerging links” between maternal use of household cleaning products and children having a higher body mass index by age three. The research authors go on to speculate whether this could be due changes in the gut microbiome measured at age 3 to 4 months, depending on what type of cleaner a mom reported she used.

The study has plenty–plenty–of caveats, and Newsweek’s take did offer these cautions:

  • [the author] “acknowledged the study may have been hampered by the reliance on parents reporting their disinfectant use.”
  • “The team can’t be certain other factors didn’t contribute to a child’s weight.”
  • From the lead author: “We found no evidence that these gut microbiome changes caused the reduced obesity risk.”

But why — after acknowledging three such critical limitations — would Newsweek then print a headline suggesting causality between household cleaning products and childhood obesity? And why would the story go on to say:

Nevertheless [the lead author] believes the evidence her team collected is enough to suggest the overuse of disinfectants should be avoided, as it may harm our human microbiota.

This observational study didn’t even address that. Again, that’s pure speculation.

Under the radar

association is not the same as causationIt’s sobering to point out these two articles were published on the same day by a single news organization. Imagine the misleading reporting on observational studies that can reach the public in a week? A month? One year?

Suffice it to say observational studies are a target-rich environment for news organizations looking for eye-catching headlines on popular health topics. And although observational studies can make valuable contributions to science (see below), their limitations are significant enough to render many of the headlines they generate little more than hype.

Unfortunately, the limitations of these studies are under the radar of too many journalists.

To address that shortcoming, reporters would serve their readers best by at least including the following:

  1. Clearly state: This is an observational study. It cannot prove cause-and-effect.
  2. Quote an independent source not associated with the study and discuss study limitations: “The strengths of this study are ___ and the limitations are ___.”
  3. Double-check your headline: Does it suggest cause-and-effect in a way that could mislead readers? [Consider this primer on How to Write Better Headlines on Diet Studies]

These may seem like small steps, but they could have a huge impact on readers trying to make well-informed health care decisions.


Please note: Observational studies (as with the research that linked smoking to cancer and other problems) can indeed pile up such overwhelming evidence that it would be prudent to make public health recommendations on that basis.

However, it’s rare that observational studies reported in the news media rise to this level of evidence. Statistical association is not proof of cause-and-effect. It is not unimportant. But no one should make it more than what it is.

You might also like

Comments

We Welcome Comments. But please note: We will delete comments left by anyone who doesn’t leave an actual first and last name and an actual email address.

We will delete comments that include personal attacks, unfounded allegations, unverified facts, product pitches, or profanity. We will also end any thread of repetitive comments. Comments should primarily discuss the quality (or lack thereof) in journalism or other media messages about health and medicine. This is not intended to be a forum for definitive discussions about medicine or science. Nor is it a forum to share your personal story about a disease or treatment -- your comment must relate to media messages about health care. If your comment doesn't adhere to these policies, we won't post it. Questions? Please see more on our comments policy.