Starting with the headline, this story is careful to explain that the study observed fewer strokes in those who ate more chocolate; it doesn’t suggest that the chocolate prevented strokes. It also features excellent use of statistics, a more explicit description of potential harms, and mentions alternative approaches to prevention. The only major shortcoming was a lack of an independent perspective on the findings.
Some journalists may balk at our insistence that stories about observational studies include appropriate discussion of the limitations of the evidence. In only 378 words, this story provides another example that this can be done – and it doesn’t require the length of a full medical journal article to do so.
We’ll rule this not applicable because, in general, most people have ballpark knowledge of how much chocolate costs. The story did not mention that dark chocolate is typically more expensive than milk chocolate — especially for the premium brands with very high concentrations of cocoa solids. A brief explanation would have been helpful.
The story went the extra mile here, providing the absolute rates of stroke seen in the groups consuming the lowest and highest quantities of chocolate. “Among those with the highest weekly chocolate intake — more than 45 grams — there were 2.5 strokes per 1,000 women per year. That figure was 7.8 per 1,000 among women who ate the least (less than 8.9 grams per week).” These statistics weren’t provided in the study text, suggesting that the writer made the calculations based on data contained in one of the study tables. We applaud the extra effort made to provide meaningful statistics to readers!
Close call here, but the story goes a step further than WebMD when discussing the possible adverse effects of consuming too much chocolate. In addition to warning that chocolate has a lot of fat, sugar and calories, it explicitly notes that eating too much of it “could be counterproductive.” WebMD offers no comparable warning and suggests that eating more chocolate than was consumed in this study would result in similar health benefits.
This story was much more cautious in its depiction of the findings than the competing WebMD coverage. Most important, it was careful to explain high up that the study found only a correlation between chocolate intake and lower stroke risk. As one of the study authors explains: “Given the observational design of the study, findings from this study cannot prove that it’s chocolate that lowers the risk of stroke.” We also appreciate the story’s more nuanced language regarding which constituents of chocolate might be responsible for possible benefits. Whereas WebMD states unequivocally that flavonoids and antioxidants “deserve the credit” for these benefits, Reuters says more judiciously that flavonoids “may be responsible for chocolate’s apparent effects on health.” [Emphasis ours.] “Whether that theoretical benefit translates into real-life benefits remains to be proven by rigorous studies, however,” Reuters appropriately adds.
This was the only major shortcoming — no independent perspective. An expert in epidemiology might have pointed out, for example, that the data on chocolate consumption were collected from subject self-reports, and therefore should be viewed cautiously.
The availability of chocolate is not in question. The story appropriately notes that there is a stronger statistical association with dark chocolate as opposed to milk chocolate.
The story notes that previous research has linked higher levels of chocolate consumption with improved heart health.
The story includes comments attributed to a direct email from one of the study authors, so we can confirm our overall impression that this story wasn’t based on a press release.
Systematic, Criteria-Driven
Like Michael Corleone of science reporting that @garyschwitzer is (he tries to get out, bullshit disguised as #science #journalism keeps pulling him back in!), he drops this on @nytimes idiocy 🙄 in reporting T1 diabetes "cure"
HT @HealthNewsRevu
https://www.healthnewsreview.org/2021/11/cure-for-type-1-diabetes-weve-been-down-this-road-before-with-ny-times/
A great read on this weekend’s NYT claims of a cure for Type 1.
Cure for Type 1 diabetes? We’ve been down this road before with NY Times https://www.healthnewsreview.org/2021/11/cure-for-type-1-diabetes-weve-been-down-this-road-before-with-ny-times/
"But it is the framing and the emphasis of the #journalism by a leading science journalist at a leading newspaper that demands scrutiny. It has an impact on readers and on sick people that may cause harm by promoting false hope about extremely preliminary research"
👍👏💪 truth https://twitter.com/garyschwitzer/status/1465399358137024518
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like