Michael Joyce is a writer-producer with HealthNewsReview.org and tweets as @mlmjoyce
The New York Times “Well” section is once again … unwell.
This time, it’s an article titled “Facial Exercises May Make You Look 3 Years Younger,” which employs a clickbait headline and the veneer of scientific legitimacy to hype a small study of highly questionable significance. It quotes two sources –both co-authors of the study–and buries the significant limitations toward the end of the story; limitations which render the provocative headline unsubstantiated.
This is a recurring issue that we’ve documented many times before:
Again and again we find the Times’ wellness stories falling down on crucial responsibilities: quoting biased sources rather than independent ones, not scrutinizing the evidence or citing alternative studies, erroneously implying cause-and-effect from observational studies, and not raising conflict of interest issues.
Again and again we find that readers of their wellness stories send in comments that are often more informative and germane regarding the topic at hand than the article itself. Here are some examples from the facial exercises article:
The Northwestern University study is entitled, “Association of Facial Exercises With the Appearance of Aging,” and was recently published in JAMA Dermatology. Here are the basics:
“But what does that ‘three years younger’ really mean in real-world terms for real patients?” asked UNC-Chapel Hill dermatologist Ade Adamson, MD.
“Both this pilot study, and the media coverage of it, have problems. The study has multiple limitations including: non-objective measures of the outcomes, the very small size, the drop-out rate, no control group, and that they didn’t really account for the multiple comparisons — about 20 I think — which means their results could easily be attributed to chance alone. As for the media coverage it was quite variable but, for the most part, was way too optimistic given the limitations of the study.” (Learn more about the problems with multiple comparisons in research studies here.)
This is a study in which the two primary outcomes — “Did the patients appear younger after the exercises?” and “Were the patients pleased?” — rely heavily on subjective interpretations. The women who invested substantial time in the program may well want to believe that it’s working for them. Could this be reflected in their responses to the survey questions? The only way to assess this effect would be through a control group of women who underwent a comparable sham intervention.
Also, having 11 subjects drop out can introduce bias: Does this leave only the women who perceived that the exercises were working for them (skewing the results in favor of the intervention)? Does it leave us with a highly motivated (and highly select) subgroup that is even more unlikely to be representative of the general public?
Let’s be clear: Some of these limitations were mentioned in The Times ‘Well’ article. But they were buried near the end of an article that didn’t seek critical opinions from people unaffiliated with the study.
I agree with the comment of Ellen from Williamsburg (above) who felt the piece read like an advertisement and I would add this: If it reads like promotional fluff, even if you do include limitations, but don’t make it clear how those limitations render your headline worthless, haven’t you already done your readers more harm than good?
Perhaps it’s not surprising that stories directed at ‘improving’ our faces are quite common. And also quite suspect. Here are a few more we’ve written about: “resting bitch face” and “are your lips attractive?“
Comments (1)
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Janet Camp
January 22, 2018 at 8:38 amShucks, you didn’t include my scathing comment! I only click on Wellness section stories to hone my rebuttal skills. I was heartened to see how many people saw through this one, but I wonder if the Times notices?
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like