NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.

Exercise improves mental health? What you need to know

Joy Victory is Deputy Managing Editor of HealthNewsReview.org. She tweets at @thejoyvictory.

Last week, HealthDay News (and many other news sites) covered a study from The Lancet Psychiatry looking at the association between exercise and depression. People who said they exercised tended to report fewer days of poor mental health compared to those who said they didn’t exercise, according to the study.

That finding was unfortunately misreported as showing that “exercise really can chase away the blues, to a point.” Why was this misleading? The observational study wasn’t capable of showing cause and effect (or, as statisticians might say, that it wasn’t a “causal” relationship).

It’s the classic chicken-or-egg dilemma. We don’t know, for example, if exercise led to better mental health or better mental health led people to exercise. It’s feasible that both are true, too.

Even though the data set had 1.2 million people, observational findings like these–that can only detect patterns–are reversed all the time when a true experimental, randomized controlled trial (RCT) is conducted. Just last week we wrote about this happening when savvy researchers used both an observational study and an RCT to study workplace wellness programs. While observational data showed the workplace wellness programs got employees to exercise more, the RCT found that wasn’t the case.

That’s not to say there’s isn’t some RCT evidence indicating positive effects of exercise on mental health. There is. However, that research isn’t definitive and generally doesn’t speak to the claims generated by this study, which purports to show specific durations and types of exercise that have the greatest beneficial effects. Such claims simply aren’t supported by the evidence on offer.

In a must-read Twitter thread, PhD student Anne Scheel did an excellent job of making this point and picking apart the multiple problems with this Lancet study and the ensuing news coverage:

Deep into her thread, she revealed one telling detail many journalists didn’t: Adam Chekroud, the lead study author on the Lancet paper, has a significant conflict of interest. He’s the founder of the startup Spring Health, which Chekroud said via a tweet thread is “using these findings to develop personalized exercise plans.” So, in other words, he stands to gain financially by selling plans that are underpinned by these results.

Spring Health, as Scheel points out, retweeted news headlines that overstate the study’s findings. The Lancet also retweeted some misleading news stories.

This wasn’t at all surprising to Darren L Dahly, PhD, an epidemiologist at University College Cork, Ireland.

“And there it is. There’s the bullshit everyone. Noise mine a giant observational dataset. Act like you understand causes, while hand-waving about associations. Then move right onto selling personalized exercise and wellness plans,” he tweeted.

You might also like

Comments (2)

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.

Gary Schwitzer

August 21, 2018 at 10:17 am

In another story, the Wall Street Journal buried this caveat in the 12th paragraph:

“It wasn’t a randomized controlled study and therefore didn’t prove causality, just an association between exercise and better mental health. It can’t explain if poor mental health causes people to exercise less or exercise causes people to have better mental health.”

But, earlier, the story discussed the “effect” of exercise and which types provide “greater benefits.” And the headline makes causal claims: “The Exercise That Helps Mental Health Most: Certain fitness routines do more to help avoid depression, stress or other emotional problems.”

You can’t accurately discuss effect and benefits when the research has not established cause-and-effect.

So the story leaves readers with their heads spinning. One reader left a comment online: “This is a meandering mess – is this what they teach in journalism? Its a mess”

Gary Schwitzer
Publisher
HealthNewsReview.org

Suzanne Holt

August 21, 2018 at 3:54 pm

Here’s another problem. According to the columnist the lead author claims a 43% improvement in mental health for exercisers. But the research findings states “43% fewer days of poor mental health in the previous month” (ceteris paribus). These are not equivalent statements. In a 30-day month, exercisers averaged 28 days of non-poor mental health vs. 26.6 days of non-poor mental health for non-exercisers. Those 1.4 days of better health per month is only a 5% improvement, not a 43% improvement.