Virtual colonoscopy a less invasive cancer screener October 08, 2008 ![]()
A very troubled story – cheerleading for virtual colonoscopy (“science fiction..Star Wars..video game..Disney World”) – never mentioning an independent review questioning the evidence for the test. Our Review Summary
On September 18, 2008, the long anticipated results of the American College of Radiology Imaging Network (ACRIN) CT Colonography trial were published in the New England Journal of Medicine. This trial represented the largest, multicenter trial evaluating CT colonography as a screening method for colon cancer in asymptomatic adults. The hope was that this study would clarify whether CT colonography could be considered a recommended routine screening method on par with colonoscopy and other established tests. In the study, CT colonography identified 9 out of 10 large polyps as seen on colonoscopy, but performed less well for smaller lesions. The American Cancer Society and other organizations moved to endorse CT colonography, but the US Preventive Services Task Force (USPSTF) did not, citing several drawbacks to the test, including the need for follow-ups on extracolonic findings (suspicious findings found outside the colon on the CT scan), radiation exposure and concerns about operator variability in the interpretation of the CT scans. The story quotes multiple experts but attained no balance because all of those quoted were fans of the approach. The evidence-based perspective of the USPSTF was not reflected in the story. The story does not adequately describe the availability of virtual colonoscopy, which may be limited to large or academic medical centers. Nor does the study adequately describe the testing alternatives. The story mentions colonoscopy but does not mention other alternatives to CT colonography, such as fecal-occult blood testing or flexible sigmoidoscopy as colon cancer screening methods. Although the story mentions radiation exposure (underplaying the controversy over this) and missed polyps as potential harms of CT colonography, it does not mention additional harms such as operator variability in the interpretation of the CT scans and extracolonic findings. Also, not only does the story overstate the cost of traditional colonoscopy (it is much less than $3000), it should not have gone so far as to speculate that HHS would rule in favor of covering virtual colonoscopy, especially given the recent USPSTF recommendations. Furthermore, the story does not adequately describe the strength of the available evidence to support virtual colonoscopy as a routine colon cancer screening method. The story mentions the recent study but does not fully describe the findings of the study, such as the fact that the test performed poorly in finding small polyps and that suspicious findings were found outside of the colon in almost 1 in 5 study participants. These findings required additional testing and follow up evaluation. In addition, the story mentions that the American Cancer Society and the American College of Oncology endorse the test, but does not mention that the USPSTF does not recommend routine use of the test based on their independent evidence review. The story also exaggerates the novelty of CT colonography by referring to it as "science fiction" and likening it to "Star Wars" and a "video game". Clearly, CT technology - even with 3D reconstruction - is not new but the idea that it can be used for colon cancer screening is relatively new. Finally, although the story does not exaggerrate the prevalence or mortality of colon cancer, the story crosses the line into disease mongering in its description of polyps, calling them a "monster... sprouting inside a patient's large intenstine like a mushroom". More importantly, though, it falsely claims that most polyps develop into cancer in 10 years. This kind of misstatement does a disservice to the reader in obscuring the clinical reality with fear mongering.
Click on Criteria for definitions. ![]() Establish the availability of the treatment/test/product/procedure? - NOT SATISFACTORY
The story does not adequately describe the availability of virtual colonoscopy, which may be limited to large or academic medical centers. ![]() Discuss costs? - NOT SATISFACTORY
Not only does the story overstate the cost of colonoscopy (it is much less than $3000) but it should not have gone so far as to speculate that the U.S. Department of Health & Human Servies would rule in favor of covering virtual colonoscopy, especially given the U.S. Preventive Services Task Force conclusion that "the evidence is insufficient to assess the benefits and harms of computed tomographic colonography" - a conclusion widely available and publicized before this story was even published! ![]() Avoid "disease-mongering"? - NOT SATISFACTORY
The story does not exaggerate the prevalence or mortality of colon cancer. However, the story crosses the line into disease mongering in its description of polyps, calling them a "monster... sprouting inside a patient's large intestine like a mushroom". More importantly, though, it falsely claims that most polyps develop into cancer in 10 years. This kind of misstatement does a disservice to the reader in obscuring the clinical reality with fear mongering. ![]() Evaluate the quality of evidence? - NOT SATISFACTORY
The story does not adequately describe the strength of the available evidence to support virtual colonoscopy as a routine colon cancer screening method. The story mentions the recent study but does not fully describe the findings of the study, such as the fact that the test performed poorly in finding small polyps and that suspicious findings were found outside of the colon in almost 1 in 5 study participants. These findings required additional testing and follow up evaluation. Furthermore, the story mentions that the American Cancer Society and American College of Oncology endorse the test, but does not mention that the US Preventive Services Task Force does not recommend routine use of the test based on their independent evidence review. ![]() Quantify the potential harms? - NOT SATISFACTORY
Although the story mentions radiation exposure and missed polyps as potential harms of CT colonography, it does not mention additional harms such as operator variability in the interpretation of the CT scans and extracolonic findings (findings outside of the colon seen on the CT scan that may or may not be serious but which require additional testing and evaluation). Also, the impact of the radiation exposure is more controversial than how the story frames it. ![]() Establish the true novelty of the treatment/test/product/procedure? - NOT SATISFACTORY
The story exaggerates the novelty of CT colonography by referring to it as "science fiction" and likening it to "Star Wars" and a "video game". Clearly, CT technology - even with 3D reconstruction - is not new but the idea that it can be used for colon cancer screening is relatively new. ![]() Quantify the potential benefits? - SATISFACTORY
The story does state that CT colonography identified 9 out of 10 of the large polyps seen on conventional colonoscopy. The story could have added other outcomes, such as how well the test performed for smaller polyps and the percentage of patients with extracolonic findings. ![]() Appear to rely solely or largely on a news release? - SATISFACTORY
Because the story quotes multiple experts, the reader can assume that the story did not rely on a press release as the sole source of information. ![]() Use independent sources and identify conflicts of interest? - NOT SATISFACTORY
The story quotes multiple experts - but no balance was attained because everyone interviewed was a fan. As already stated, the U.S. Preventive Services Task Force had already provided all the fodder for important balance - but the newspaper ignored it or wasn't aware of it. ![]() Compare the new approach with existing alternatives? - NOT SATISFACTORY
The story mentions colonoscopy but does not mention other alternatives to CT colonography, such as fecal-occult blood testing or flexible sigmoidoscopy as colon cancer screening methods. Total Score: 2 of 10 Satisfactory The U.S. Preventive Services Task Force is considered the gold standard of preventive health recommendations - including on screening tests. It's a good source for journalists and consumers.
About 70% of the stories reviewed from 2006-9 failed to adequately discuss costs, or to explain how big (or small) are the potential benefits and harms of treatments, tests, products and procedures.
We have documented a disturbing trend of news stories taking an advocacy stance, promoting certain screening tests outside the boundaries of scientific evidence.
Stories on new technologies like Cyberknife, DaVinci robotic surgery systems, and proton beam cancer therapy often fail to scrutinize the evidence and/or to discuss the costs involved.
Rather than suggesting that everyone should be screened for everything, news stories could explain: "All screening tests cause harm; some may do good."
The first 38 network TV network morning health news stories reviewed in 2009 earned an average score of 1.2 stars. 13 of the 38 stories got ZERO stars.
Both TIME magazine and BusinessWeek have published terrific stories explaining the importance of the Number Needed to Treat - or NNT.
Knowing relative risk reduction is like knowing you have a 50% off coupon but not knowing whether it's for a Lexus or a lollipop. Absolute risk reduction tells you what the "coupon" is worth. Read more.
The website NoFreeLunch.org posts "a database of health care professionals who have pledged to accept no gifts from industry and to rely on non-promotional sources of information."
To help journalists cover stories responsibly, we post a list of independent experts who state that they do not have financial ties to drug or medical device manufacturers.
We apply the same ten standardized criteria to the review of every story.
We have about 30 story reviewers. Each story is reviewed by 3 different people.
Gary Schwitzer's seven words you shouldn't use in medical news: cure, miracle, breakthrough, promising, dramatic, hope, victim. Read why.
|