NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.
Read Original Story

Moderate Drinking May Cut Disease Risk for Women

Rating

1 Star

Categories

Tags

Moderate Drinking May Cut Disease Risk for Women

Our Review Summary

It missed several opportunities to help readers interpret these findings critically. Most of the deficiencies could probably have been remedied by talking to an independent expert or two.

The Washington Post did slightly better in its competing blog post about the same study.

 

Why This Matters

This new analysis of the ongoing, prospective Nurses’ Health Study is not novel, but adds to the evidence base about the effects of moderate alcohol use on chronic disease incidence.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Applicable

The cost of alcohol is not in question.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

We expect that a story will attempt to provide us with some measure of the size of an association beyond just the relative risks, which can often give an inflated sense of the effects. That’s what happens in this story when it says that women who drank lightly almost every day “were nearly 50% less likely to develop disease.” Sounds like a big difference, but the figure would certainly be much smaller if expressed in absolute terms. The story could have made these statistics more meaningful with comments from an independent expert.

See how the “Behind the Headlines” project in the UK analyzed the evidence and included the absolute differences.

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

Any story that discusses the potential benefits of alcohol consumption should say a word or two about the potential harms of overdoing it, since heavier drinking is unequivocally related to a host of health risks. This story didn’t include any such warning.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

We liked that this story is generally careful not to suggest that alcohol “reduced risk” for diseases, which is something an observational study cannot prove. But it lost focus where it counts most, which is in the headline. There, it uses cause-and-effect language. We might have forgiven this, but the story also should have included some caveats regarding the limitations of this research and some alternate explanations for the results. For example, older women who get together frequently for a drink might benefit from the increased social interaction and support they receive from one another. Women who drink lightly probably have other attributes (higher socioeconomic status, etc.) compared with teetotalers or heavier drinkers. Although the authors tried to adjust for these factors, they note that they might not have caught them all, and that “the findings should be interpreted with caution.” Readers should be given the same disclaimer.

Does the story commit disease-mongering?

Satisfactory

There was no disease-mongering.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

The story quotes from the study, but includes no independent perspectives.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

Again, an expert could have put these results in perspective with other factors known to promote healthy aging, such as a healthy diet and regular physical activity, which were not mentioned in the story.

Does the story establish the availability of the treatment/test/product/procedure?

Not Applicable

The availability of alcoholic drinks is not in question.

Does the story establish the true novelty of the approach?

Not Satisfactory

The story didn’t really capture what is novel about this research. Many studies show potential health benefits for light to moderate alcohol consumption, but this is one of the few studies to look at whether the positive effects extend into older adulthood. The story didn’t hype the “newness” of the findings, but it didn’t quite earn a satisfactory here, either.

Does the story appear to rely solely or largely on a news release?

Not Applicable

The story didn’t lift anything direct from a press release about the study. Since there are no independent perspectives provided, however, we can’t say for certain how much this story relied on the release. We’ll call it not applicable.

Total Score: 1 of 7 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.