There are 429 words in this news release. Nearly half are contained in just two exuberant quotes from Stanford researchers. If the study itself backed up the claims made in these quotes, we would applaud the release for its economy of language.
As it stands, the release needed much more information to help journalists and other readers understand that this is a very limited study that may or may not turn into a true alternative to other cancer diagnostics.
The news release makes a huge claim with its headline: “New blood test may transform the way cancer is monitored and treated.” It then doesn’t provide any evidence to support this claim. It could just as well have declared “new blood test may not transform the way cancer is treated.”
We like that the cost issue is addressed. But the terms are vague. It says that the test is “relatively low cost.” Relative to what? To traditional “whole body imaging,” as the release notes above? Then provide some of those costs. It also says, “especially compared to next-generation DNA sequencing,” which costs how much?
We were expecting a thorough explanation and quantification of how this test was used to more regularly track the growth and spread of cancer cells. But there was no quantification in the release.
There is no mention of harms. The assumption here is that more regular monitoring of patients via blood samples will lead to better outcomes, when we actually know from repeated studies that more monitoring for disorders leads to more unnecessary treatments and surgeries.
What is the false positive rate? The false negative rate? What are the possible clinical harms that can result from either of these scenarios?
The release does explain, after a very effusive quote about how broadly applicable this test may be, that the test was only examined in six patients who had only two types of cancers. Then it says, “the researchers were able to identify tumor-derived circulating DNA from three out of six patients.” So the study was extremely limited in scope. The release would have even been better to call out this caveat explicitly instead of leaving it up to the reader to figure out. Other releases we have seen say things like, “This study was only conducted in six patients and would need to be repeated with a much larger group in order to make strong claims about its broad efficacy in cancer diagnosis and monitoring.”
There is no disease mongering in the release.
There is no mention of funding sources or conflicts of interest in the release, nor in the study itself.
The release makes a glancing reference to “other methods.” It says, “The single-color digital PCR test offers several advantages over other methods of circulating tumor DNA analysis, compared to next-generation targeted sequencing and fluorescent probe-based digital PCR assays. The main advantage is that the new technique does not rely on pre-amplification, which can introduce errors and biases.” This is not an adequate comparison.
It would have been helpful to mention specific blood tests for the tumor types looked at even in this small sample size–this would have given context and why this work is important.
It is clear from the release that the test is not widely available and is only just now being developed.
The novelty of the test is not established in the release.
We think that given the extremely small number of patients who even had test results that could be monitored for cancer growth — three people! — making broad claims about this being a low-cost alternative for all cancers is over the top. This is what the release says:
“For monitoring patient tumors, only a handful of blood tests are available which are limited to only several types of cancers. Nearly all cancer patients require monitoring by whole body imaging, which can be costly, complex, and time-consuming. In contrast, molecular tests like the one we have developed will enable patients to be monitored at every visit, and thus have the potential for quickly tracking cancer growth and spread.”
Does that sound like a test that was only used on six patients, only three of whom had detectable cancer?
There are 429 words in this news release. Nearly half are contained in just two exuberant quotes from Stanford researchers. If the study itself backed up the claims made in these quotes, we would applaud the release for its economy of language.
As it stands, the release needed much more information to help journalists and other readers understand that this is a very limited study that may or may not turn into a true alternative to other cancer diagnostics.
The news release makes a huge claim with its headline: “New blood test may transform the way cancer is monitored and treated.” It then doesn’t provide any evidence to support this claim. It could just as well have declared “new blood test may not transform the way cancer is monitored and treated.”
We like that the cost issue is addressed. But the terms are vague. It says that the test is “relatively low cost.” Relative to what? To traditional “whole body imaging,” as the release notes above? Then provide some of those costs. It also says, “especially compared to next-generation DNA sequencing,” which costs how much?
We were expecting a thorough explanation and some numbers that illustrate how this test could more regularly track the growth and spread of cancer cells. But there was no quantification in the release.
There is no mention of harms. The assumption here is that more regular monitoring of patients via blood samples will lead to better outcomes, when we actually know from repeated studies that more monitoring for disorders leads to more unnecessary treatments and surgeries.
What is the false positive rate? The false negative rate? What are the possible clinical harms that can result from either of these scenarios?
The release does explain, after a very effusive quote about how broadly applicable this test may be, that the test was only examined in six patients who had only two types of cancers. Then it says, “the researchers were able to identify tumor-derived circulating DNA from three out of six patients.” So the study was extremely limited in scope. The release would have been better to call out this caveat explicitly instead of leaving it up to the reader to figure out. Other releases we have seen say things like, “This study was only conducted in six patients and would need to be repeated with a much larger group in order to make strong claims about its broad efficacy in cancer diagnosis and monitoring.”
There is no disease mongering in the release.
Funders are noted in the sidebar where this release is hosted on EurekAlert! but not in the release itself. We encourage news release writers to include funders in the body of the release. There is no mention of conflicts of interest in the release, nor in the study itself.
The release makes a glancing reference to “other methods.” It says, “The single-color digital PCR test offers several advantages over other methods of circulating tumor DNA analysis, compared to next-generation targeted sequencing and fluorescent probe-based digital PCR assays. The main advantage is that the new technique does not rely on pre-amplification, which can introduce errors and biases.” This is not an adequate comparison.
It would have been helpful to mention specific blood tests for the tumor types looked at even in this small sample size–this would have given context and why this work is important.
It is clear from the release that the test is not widely available and is only just now being developed.
The release establishes novelty here:
The test, which is called single color digital PCR, requires only a fraction of a tube of blood and can detect as few as three mutation-bearing molecules in a single reaction.
We think that given the extremely small number of patients who even had test results that could be monitored for cancer growth — three people! — making broad claims about this being a low-cost alternative for all cancers is over the top. This is what the release says:
“For monitoring patient tumors, only a handful of blood tests are available which are limited to only several types of cancers. Nearly all cancer patients require monitoring by whole body imaging, which can be costly, complex, and time-consuming. In contrast, molecular tests like the one we have developed will enable patients to be monitored at every visit, and thus have the potential for quickly tracking cancer growth and spread.”
Does that sound like a test that was only used on six patients, only three of whom had detectable cancer?
Systematic, Criteria-Driven
Excelente conversación entre @garyschwitzer de @HealthNewsRevu y @marynmck sobre exageración y #COVID19 en el excelente MOOC de @utknightcenter. Vale la pena verlo. https://www.youtube.com/watch?v=SkgXiPojtg4&feature=youtu.be
Words of real wisdom, as usual @garyschwitzer
And: “There were no details, charts, graphs, numbers, nothing published in a journal."
#Pharma chairman:“If you don’t put out data people will say why are you withholding the data?”
Well, yes, that is exactly what people are asking. https://twitter.com/garyschwitzer/status/1264572399523180548
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like