Our Review Summary
This story provided an incomplete profile about the attempts to develop a diagnostic test for a disease without known treatment – Alzheimer’s disease. It did little to help viewers understand the worth of such testing to the individual or the benefit this test, if successful, could have in terms of developing therapies for managing and treating this disease.
The real story here is to understand that diagnosis and treatment of a disease or condition are not the same thing; that the ability to diagnosis is often years ahead of ability to treat. But the story never touches that theme. Further, it is important for people to be aware that test results are not infallible and a false-positive result, where a person would be diagnosed with the condition when if fact he/she did not have the condition would be a very sad scenario. The story never addressed the issue of false positives.
Other issues:
- The story didn’t quote an independent expert about the test. (it has a company spokesman and an independent expert who only talked about the subtlety of the disease – but who did not address these test results.)
- The story didn’t address the fact that this study was published as a letter to Nature Medicine – what’s the significance of that for trying to draw conclusions from the findings?
- The story inaccurately said this was a study of 259 blood samples. Tests were done on a much smaller number.
Criteria
Not Applicable
Potential costs not addressed. However, this is not a commercially available test or even available in most research labs so costs are very difficult to predict. But a story like this also could have touched on the whole issue of the downstream costs associated with testing everyone with some memory loss – which could be enormous – and the costs of providing what are now relatively ineffective current drug treaments.
Not Satisfactory
The story did not provide any means for assessing benefit of advanced knowledge about whether one were to develop Alzheimer’s disease. The enthusiasm for the test should be limited to its role as a research tool. The tone of the broadcast implied that knowing about the disease early would allow for treatment to benefit the patient when this is not the case.
Not Satisfactory
Two harms of treatment, difficulty getting insurance when one has a prexising condition and not wanting to know that one was going to develop this disease, were mentioned in the broadcast.
But the story never addressed the issue of false positive test results – which could be a huge issue. Imagine being told erroneously that you test positive for Alzheimers disease!
Not Satisfactory
The broadcast reported that in the one study, the test was 90% accurate. However it failed to provide any context that might help viewers understand what this means in terms of the proportion of individuals who were predicted to develop Alzheimer’s but didn’t or the number of people who developed Alzheimer’s without being previously predicted to do so.
They failed to describe the type of population that was studied, how representative they may or may not have been. In addition, the story stated this was a study on 259 blood samples. Rather the test was developed from these samples and tested on a rarified sample of about 50.
Finally, the story didn’t address the fact the study was published in Nature Medicine as a letter – not as an original research article. What is the significance of that for judging the quality of the evidence?
Not Satisfactory
The story does not exaggerate the problem and prevalence of Alzheimer’s disease. However, by repeating the mantra that an early diagnosis by a blood test is a good thing, one is led to believe that there is an intervention that may be widely applicable. (It states: "For millions who worry their forgetfulness could be the first sign of something worse, a blood test could, in the future, provide answers.") In this sense, there is disease mongering by implying many could benefit from this test when the notion of benefit is speculative at best.
Not Satisfactory
The story quoted someone from the company developing the test and quoted only one "expert" but he did not comment on the test but only on the subtlety of the disease. This is insufficient sourcing for a story that states: "For millions who worry their forgetfulness could be the first sign of something worse, a blood test could, in the future, provide answers."
Satisfactory
The story states that "only an autopsy can establish for sure whether a patient had Alzheimer’s. Brain scans and spinal taps are helpful, but they’re not certain. But the story did not provide insight about treatment options and what one could and couldn’t do with advance information about pending development of Alzheimer’s disease.
Satisfactory
The report clearly states that "plenty of lab work" still remains before it’s proven that a simple blood test can diagnose Alzheimer’s. Even though this is tacked on as a disclaimer as the last sentence of an otherwise exuberant report, we’ll give it the benefit of the doubt on this criterion.
Satisfactory
The broadcast did lay out for viewers that currently, it is only after death that Alzehimer’s disease can be definitely diagnosed and so if this test were demonstrated to be valid, it would represent something new.
Not Applicable
We can’t be sure if the story relied solely or largely on a news release.
Total Score: 3 of 8 Satisfactory
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like