Note to our followers: Our nearly 13-year run of daily publication of new content on HealthNewsReview.org comes to a close at the end of 2018. Publisher Gary Schwitzer and other contributors may post new articles periodically. But all of the 6,000+ articles we have published contain lessons to help you improve your critical thinking about health care interventions. And those will be still be alive on the site for a couple of years.
Read Original Story

High score for HealthDay coverage of “scoring system” for colonoscopy candidates

Rating

4 Star

Categories

'Scoring System' May Spot Those in Greatest Need of Colonoscopy; But one expert cautions that even 'low risk' patients can still develop suspicious polyps

Our Review Summary

colonoscopy

Can a new scoring system help some people avoid a colonoscopy?

This is an important story that touches on all sorts of issues involved in public health, including how to best to screen for a disease that takes a terrible toll, how to determine who is at highest risk and how to get the best use out of a test (colonoscopy) that is both expensive and invasive.

The story does a good job summarizing the study authors’ efforts to devise a scoring algorithm that might answer some of those questions, but makes only perfunctory references to cost and doesn’t acknowledge the long history of similar calculators that have been developed and never widely used. That’s pertinent context for this new effort. Despite leaving some room for improvement, the story makes a strong effort at interpreting a relatively simple algorithm with complex ramifications, and draws on two outside experts for perspective — something we wish more stories would take the time to do.

 

Why This Matters

The concept of “risk stratification” — which is what this story and the related research paper address — is difficult for physicians and patients alike. Risk prediction tools are often created and then not used by physicians because they are cumbersome or their use historically has not been incorporated into guidelines because they have important limitations, including that even low-risk people still sometimes develop the cancer or condition. Since this new tool appears to suffer from these same limitations, it’s not clear if it will fare any differently than previous efforts, but the issue is worth exploring.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

The question of cost is cited in the final line of the story, which suggests that the scoring system can “address escalating health care cost issues.” But we didn’t think that was specific enough to warrant a Satisfactory score. The story doesn’t clue readers in to the fact that the financial burden can be measured in billions of dollars — a single screening test recommended for millions of Americans can cost thousands of dollars apiece. The other cost issue specific to this test is that it takes valuable time for providers to retrieve a reputable risk calculator when sitting with a patient and enter in the specific data points, including in this case waist circumference, which clinicians often do not measure as a ‘vital sign’ per se.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

The story cites a study that credits colonoscopy with reducing the risk of death from colon cancer by about 50 percent, by removing polyps. It would have been helpful for the story to explain what that relative reduction in risk means in absolute terms (e.g. did the rate of cancer death go from 50% to 25% or from 2% to around 1%?)

The story also notes that the study found that patients with a low to intermediate risk score “still have a risk between of between 1.9 percent to 9.9 percent of harboring a polyp that can develop into cancer.”

We’ll give credit here for the story’s provision of these key statistics, which do give a sense as how well the test accurately identifies truly low-risk individuals. However, we’d note that the benefit here should ideally refer to the ability of the algorithm to classify people at all risk levels (including high-risk), and therefore target the highest-risk patients for colonoscopy. The story doesn’t really get into discussion of the predictive power of the test, referred to as a likelihood ratio, which is in the study manuscript. However, this is a difficult concept for most health care providers and patients, and we think it’s understandable that the story did not include a full discussion of this topic.

Does the story adequately explain/quantify the harms of the intervention?

Satisfactory

The harm of a screening test such as this really is “getting it wrong” in terms of predicting someone to be at low risk and finding them to have a higher risk polyp or malignancy. As noted above, the story cautions that “low- to intermediate-risk patients still have a risk between of between 1.9 percent to 9.9 percent of harboring a polyp that can develop into cancer.”

Does the story seem to grasp the quality of the evidence?

Satisfactory

This story accurately explains that the research was about predictive modeling, and explains the components of the risk score as well as the study design. There are some cautionary notes in the text, including a statement from outside expert that “the data from this study is not strong enough to spur any changes in current screening recommendations,” an opinion shared by an editorialist on the study. We think this is sufficient for a Satisfactory rating.

Does the story commit disease-mongering?

Satisfactory

The story does not hype the incidence or seriousness of the disease. The prevalence statistics cited are consistent with these National Cancer Institute figures.

Does the story use independent sources and identify conflicts of interest?

Satisfactory

The story contains two independent voices. The perspective they provide is a particular strength of the article. We wish that more stories would reach out to experts not affiliated with the studies being reported on for context.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

The story notes that a variety of screening tests exist, but the relevant alternative here is actually other risk calculators, which the authors of the study describe and cite but are not routinely used. The story doesn’t mention these other calculators and why they are seldom used — context that would have deepened reader understanding of the issue.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

Although availability isn’t explicitly addressed, this risk calculator is now available (implicitly) by virtue of publication of the paper.  It is a simple scoring system that can be implemented based on the information in the paper, and the story makes this clear. We’ll rate this Satisfactory.

Does the story establish the true novelty of the approach?

Not Satisfactory

The story makes it sound as if this is a first-of-its-kind tool. However, risk calculation tools for colon cancer have been in circulation for many years.

Does the story appear to rely solely or largely on a news release?

Satisfactory

We could not find a news release related to this study. But in any case, the comments from two independent experts assure us that the story wasn’t based on a news release.

Total Score: 7 of 10 Satisfactory

Comments (2)

We Welcome Comments. But please note: We will delete comments left by anyone who doesn’t leave an actual first and last name and an actual email address.

We will delete comments that include personal attacks, unfounded allegations, unverified facts, product pitches, or profanity. We will also end any thread of repetitive comments. Comments should primarily discuss the quality (or lack thereof) in journalism or other media messages about health and medicine. This is not intended to be a forum for definitive discussions about medicine or science. Nor is it a forum to share your personal story about a disease or treatment -- your comment must relate to media messages about health care. If your comment doesn't adhere to these policies, we won't post it. Questions? Please see more on our comments policy.

Laurence Alter

August 18, 2015 at 8:01 am

Your reviewer(s) failed to note that “race” is also a risk factor, which the article, in their naming of 5 risk factors, omitted.
Nice review, nevertheless.
Respectfully,
Laurence Alter

Reply

    Kevin Lomangino

    August 18, 2015 at 8:38 am

    Thanks for the comment Laurence. The story was naming the 5 risk factors that are used to compute the risk score discussed in the article, and race was not one of those risk factors. So, while the reviewers certainly could have made note that race is also a risk factor, I wouldn’t necessarily deem it a failure of the story or review that race wasn’t named.

    Kevin

    Reply