This is a classic story of the potential promise of a new technology for the health care sector. A nice anecdote sets the stage and then a number of preliminary findings are used as proxies for real evidence. It is implied that the technology will keep people healthier, happier and at less cost to our costly system. This is, unfortunately, often a fairy tale mainstay of health news journalism.
It’s interesting that several leading journalists wrote to us with concerns about this story. One wrote, "She didn’t interview a real skeptic. It is still quite possible that these devices will only yield minor results, since heart failure is, after all, an end stage disease, so it may just be rearranging the deck chairs on the Titanic."
Mixed bag. The story explained that the devices "can cost as much as $30,000." And there was one data point from one study on one device that users’ hospital costs were $1,600 less per admission. But the device costs are variable and device performance will be variable. We’ll give the story the benefit of the doubt but it painted the cost picture with really broad strokes.
Information about the potential to increase longevity was presented from a study that has not yet been published. The information was presented as a relative increase rather than an absolute increase. The story didn’t contain sufficient information to quantify the benefit to any specific group of patients.
The story did mention the problem of potential information overload however there was no discussion of actual harm such as inappropriate shocks from implanted defibrillator devices, for example. There was no questioning of the accuracy of the data potentially transmitted by devices.
This was a far too rosy picture – almost as if all the data was so terrific that the only downside could be the volume of terrific data. Other things can go wrong as past experience shows when you try to regulate the heart.
In our eyes, a red flag went up when the story cited "a paper under review." We don’t know the quality of the paper nor have peer reviewers completed their review yet. So that’s giving the researcher free rein to say whatever he wants about that study. We also must address the headline which stated ‘New tools for helping heart patients’ before we have concrete demonstration that the new tools actually do help.
The story opened with an anecdote that implied that something terrible was avoided. That, of course, is always hard to know. The punch line is that without the device reporting in to a clinician, the situation was one in which it "could have gone for months before the problem was discovered." The story never considered the question of whether there is always value in immediate recognition of a situation.
Clinicians who were involved with the makers of the devices discussed were quoted in this piece.
The alternative of how things are currently done is not clear. Many involve the patient manually checking the device at home over a phone or going to the doctor. For many patients, this new technology may be of marginal benefit at unclear cost.
In addition to the new devices, one needs a new system of "non-visit" based care and monitoring. This is something that isn’t routine in most doctors’ offices and would require changes in how they operate and in theory how they get paid.
The story was a tapestry of information about devices that are currently available, devices in clinical studies, and the potential benefit from devices to be developed in the future. The story could have been clearer about products that are and are not readily available to patients. We had to read the piece several times in order to reflect on which device, from which company, was at which stage of research or development.
The story wove together information from devices that available – through those used in clinical trials and those under development.
Does not appear to rely on a news release.
Systematic, Criteria-Driven
Questions to ask about new Alzheimer’s drug research by @KatKStone incl:
-does study focus on patient outcomes or surrogate markers?
-does study rely on selective subgroups? (yield more favourable outcomes)
-who were the patients? https://www.healthnewsreview.org/2017/08/6-questions-to-ask-when-writing-and-reading-about-new-alzheimers-research/#.YRw5xNVXths.twitter @HealthNewsRevu
Monday at #ADA2021, an infectious disease epidemiologist, a journalist, and a researcher shared perspectives on communication of risk in the era of COVID-19: http://ow.ly/ROfR30rMeE7 @AstleyCM @garyschwitzer @berthahidalgo @ADA_DiabetesPro
Shoutouts to @susan_bewley @drkevinknopf @MichaelBaum11 in this call for more than fawning coverage from press releases for these kinds of stories.
Also, linked history inside goes back 5 years just on Grail apparently trying to become Holy Grail. https://twitter.com/garyschwitzer/status/1408849696416841731
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like