So many reports of potential tests for Alzheimer’s Disease have been announced recently that one might wonder what exactly is newsworthy about yet another announcement of a small study proclaiming preliminary results, particularly when the source is the founder of the company developing this test. This story about a blood test for antibodies that appear to be associated with Alzheimer’s meets almost all our specific criteria, but it would have been a better story if instead of merely announcing a “New Blood Test for Alzheimer’s” it had led with what distinguishes this potential test from others in development.
The real challenge of diagnostic tests for a condition like Alzheimer’s is that you want a very specific test. That means that if we say you’re going to develop Alzheimer’s, you will. Though the story reports that the test correctly identified 92 out of 100 patients who didn’t have Alzheimers, what you really want to know is whether a person who tests positive or negative today is going to develop Alzheimers in the next 1, 2 or more years. The study didn’t do this and that’s the key problem with the study and the reporting of these very preliminary results.
Memory loss with aging causes tremendous fear in our society – often for good reason. Alzheimer’s is particularly challenging because it can be hard to diagnose in its early stages and because there are no effective treatments that meaningfully slow the progression or ultimate outcome of this disease. Stories about potential tests need to acknowledge the fear, in part by clearly explain not only the potential benefits, but also the limitations and potential harms of tests.
The story includes a tentative estimate of what this sort of blood test might cost if it is approved.
It would be difficult for readers to get a true sense of the value of this test from this story. Readers should have been told more clearly that in this study, the test failed to correctly identify 4 percent of the Alzheimer’s patients and it mislabeled more than 7 percent of the healthy participants. Also, the phrase that “knowing early has many advantages” is likely to create a misperception about the potential benefits of testing – at least until some treatments are developed. The story mentioned only two potential benefits, financial planning and the ability to participate in clinical trials of experimental treatments.
The story does not discuss the potential harms of this sort of test. As mentioned above, some healthy people would be told in error that they have signs of Alzheimer’s Disease. Such a misdiagnosis could have profoundly grave consequences.
Although the story does include the results reported by the researchers, notes the small number of individuals in the study, and points out the preliminary nature of this work; it falls short. Although the headline proclaims “ Blood Test May Spot Alzheimer’s Before Symptoms Appear,” as the story points out lower down, the researchers have not yet studied people over time, so they cannot make any claims about predictive power. And, indeed, that’s really what people want to know, whether someone with some memory problems is going to progress to Alzheimer’s Disease, something that these researchers have yet to investigate. Then the lead sentence states the test is 96 percent “accurate,” which is not the full story. The researchers reported that this blood test correctly identified 96 percent of Alzheimer’s patients and 92.5 percent of healthy people. The story would have been better if it had pointed out that the second number means that as things stand, for every 100 healthy people tested, seven or eight would be misdiagnosed as having signs of Alzheimer’s, a frightening result for those individuals.
The story does not exaggerate the extent or severity of Alzheimer’s Disease. However, it might have been helpful to include some description of the sort of individual who might consider using this sort of test.
Stories like this need to be clear that since there is no meaningful treatment currently available for Alzheimer’s disease, many individuals may not want to be burdened with the prospect of impending dementia when there is no known way to do anything about it. The story would have been better if rather than focusing on individuals and the fearful prospect of Alzheimer’s, it had given more attention to the most likely near-term use for Alzheimer’s tests: as aids to researchers studying potential treatments in controlled trials.
The story includes a spokesperson from the Alzheimer’s Association. It does not appear that this group was involved with this study. We would have preferred hearing from an independent scientist rather than someone from an advocacy group. Nonetheless the Association spokesman adds some important perspectives. The story does point out near the top that the lead researcher is the founder of the company developing the test.
A strength of this story is that it prominently points out that many other potential tests for Alzheimer’s Disease are being developed. The story would have been better if it had explained why some people might choose not to be tested.
Deep in the story, it explains that “if all goes well” the developer is hopeful the test could be available within a year. That is followed by an Alzheimer’s Association spokesman saying this is “preliminary.” So the developer’s optimism is tempered somewhat.
This rating is a close call. The story does include comments pointing out that there are a number of other tests for Alzheimer’s Disease being developed, but it might have been better to frame the headline and lead in a way that immediately makes clear to readers where this test fits in the context of other research. The lead could have used a phrase such as “one more potential test for Alzheimer’s enters the pipeline.”
The story includes interview quotes and does not appear to rely on a news release.
Systematic, Criteria-Driven
Monday at #ADA2021, an infectious disease epidemiologist, a journalist, and a researcher shared perspectives on communication of risk in the era of COVID-19: http://ow.ly/ROfR30rMeE7 @AstleyCM @garyschwitzer @berthahidalgo @ADA_DiabetesPro
Shoutouts to @susan_bewley @drkevinknopf @MichaelBaum11 in this call for more than fawning coverage from press releases for these kinds of stories.
Also, linked history inside goes back 5 years just on Grail apparently trying to become Holy Grail. https://twitter.com/garyschwitzer/status/1408849696416841731
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like