This news release clearly describes the key findings of a comparison study of several nonsurgical treatments for knee osteoarthritis in a way that is likely to be useful to patients. However, the brevity of the release and the methods of the underlying meta-analysis mean that readers are not given specifics about the absolute clinical benefits of the treatments, only their relative rankings. There is only a brief, general mention of potential harms of some of the drugs included in the analysis. The release says that almost half of Americans are at risk of developing knee osteoarthritis. This eye-catching number comes straight from the journal article, but it is far higher than other estimates and is based on a study of only the older residents of single rural county in North Carolina.
Sophisticated statistical methods for combining the results of multiple clinical trials, such as the network meta-analysis used in this case, are powerful tools for discerning larger, more useful, conclusions from the results of many smaller research efforts. However, the very power of these methods imposes a substantial responsibility on the researchers to perform the work capably and carefully… and then a subsequent responsibility on journalists reporting the story to seek out independent sources who are qualified to comment on the work.
Although the news release does refer to the low-cost of naproxen (brand names including Aleve and Naprosyn), it does not discuss the costs of other treatments that were ranked highly by this meta-analysis. Injections of corticosteroids may cost about $100, not including associated clinic and provider charges. All of the treatments need to be repeated, so the cumulative cost should be considered.
The news release does not provide any specifics about the benefits of the treatments, referring only to their relative rankings. It should be noted that the researchers also did not address absolute clinical benefits in their journal article. The conclusions as stated may still be useful to patients who may have personal experience with at least some of the treatments. However, to satisfy this criterion the release should have provided some description of the absolute clinical benefit to patients.
We note that the news release highlights the conclusion of the researcher’s analysis that the results of hyaluronic acid injections were not significantly different than placebo injections. The attention to a lack of benefit is important news for patients.
The news release does refer to some potential harms of nonsteroidal anti-inflammatory drugs, including naproxen and ibuprofen. However, it does not quantify these risks and it does not address any of the potential harms of the other treatments in the analysis.
The news release includes key attributes of the methods the authors used to compare the results of clinical trials. These methods are what make this report potentially newsworthy.
The sort of network meta-analysis the researchers used is a powerful method for combining the results of many individual trials. However, the sophistication and complexity of the method also mean that the conclusions depend on the skill, discipline and effort of the researchers. Indeed, the authors criticize an earlier network meta-analysis for including lower-quality studies. Journalists reporting on this study should seek out qualified independent sources in order to get informed perspectives about how well this meta-analysis was performed.
The news release leads off with the statement that an “estimated 45 percent of people are at risk of developing knee osteoarthritis (OA) in their lifetime.” The journal article also leads with this statistic. However, the “45 percent” figure comes from a study of people living in one county in rural North Carolina. Another recent study estimates a far lower lifetime risk of about 14 percent. The authors of the latter report addressed the discrepancy, writing that the North Carolina study looked at an older population with different sex, race and weight distributions than the US population as a whole… and it noted that people without knee problems might have been less likely to stay in touch with researchers, which could lead to a higher estimate of lifetime risk.
The news release identifies only where the authors work. It does not include the disclosures listed in the journal article. These disclosures should have been included in the news release.
A comparison of existing alternatives is the point of the journal article. The news release highlights the comparisons in clear language.
It is clear that all the treatments noted in the release are generally available.
The release includes a quote from an author that, “This is the first comprehensive mixed-comparison analysis comparing best-evidence scientific research and excluding lower quality studies that can bias the outcomes.” A search of PubMed.gov did not find any other similar meta-analyses, except for one that the authors discussed in their journal article. They criticized that earlier meta-analysis for including lower quality studies that they said muddled the results.
This news release clearly summarizes the main conclusions of the researchers’ journal article. Other than repeating the questionable estimate of lifetime risk of knee osteoarthritis noted above, the language of the release is moderate and useful.
Systematic, Criteria-Driven
Following a shift in journalism’s business model, a diverse ecosystem of publications, many covering science, has sprung up online. This has made it more difficult to sort out what qualifies as journalism, what doesn’t, and whether the public even cares.
https://t.co/qO2a27FiSe
Researchers and journalists do the public a grave disservice when they spin health study results to make them appear safer or more effective than warranted, says @HealthNewsRevu founder @garyschwitzer https://t.co/QIKsRbP6Ed
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like