NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine -
Read Original Story

Study: PSA Testing Cuts Worst Prostate Cancers


4 Star


Study: PSA Testing Cuts Worst Prostate Cancers

Our Review Summary

The story made an important attempt to evaluate the quality of the evidence, explaining that “studies looking back at cancer trends in a population are very unreliable when it comes to showing what caused those trends.” This doesn’t make up for some of the other gaps in the story  but it provides readers with invaluable information for helping them make a very important medical decision.


Why This Matters

This story says that the new study “seems to make a powerful argument in favor of PSA testing”. It’s true that retrospective studies can be powerful tools for understanding health trends, but they are not created equal. This study raises more questions than it answers, and, it’s important for health care journalists to frame stories about studies like this in the right way. That’s why the independent comments WebMD solicited are so crucial to helping readers understand the limitations of these backward looking statistical modeling studies.


Does the story adequately discuss the costs of the intervention?

Not Satisfactory

There is no cost information in the story, and this is a big gap seen in other stories that covered the topic – in and HealthDay. Mentioning the cost of a PSA test and whether insurance typically covers it would have been great, as well as the costs of some of the subsequent tests and treatments.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?


The story quantified the benefits claimed in the University of Rochester study, saying, “If it weren’t for routine PSA prostate cancer screening, an extra 17,000 Americans each year would learn that they had the worst form of the disease, a new study suggests.”

More important, it made an effort to question this type of statistical modeling “look-back” study.

Does the story adequately explain/quantify the harms of the intervention?


The story lists some of the potential harms of screening at the very end.

Does the story seem to grasp the quality of the evidence?


In clear terms, the story explains how the study was conducted. “In 2008, about 8,000 U.S. men were diagnosed with metastatic prostate cancer. By projecting data from the pre-PSA era forward, Messing calculates that without routine PSA tests, 25,000 men would have been diagnosed in 2008 — an extra 17,000 cases of deadly disease.” Then it immediately follows up by saying, “Studies looking back at cancer trends in a population are very unreliable when it comes to showing what caused those trends.”

We wish the story had addressed more explicitly the limitations of such a statistical modeling analysis – to familiarize readers with such techniques and the potential flaws therein.

Does the story commit disease-mongering?


The story did not engage in disease mongering and did a good job explaining that prostate cancers are not all the same. “That kind of prostate cancer — metastatic prostate cancer, in which the cancer spreads to the bone or other parts of the body — is rapidly fatal, usually within two years or less.”

Does the story use independent sources and identify conflicts of interest?


Most stories on this study relied heavily on the study’s lead author, Dr. Edward Messing, a urologist, who, like most of his colleagues believes strongly in the need for more PSA screening. He’s quoted here, too, of course, but the story also shares with readers important context from Dr. Barnett Kramer of the National Institutes of Health. And it includes input from a US Preventive Services Task Force member.

Does the story compare the new approach with existing alternatives?


The alternative to PSA screening is the choice to decline screening, which is implicit in the discussion about the tradeoffs.

Does the story establish the availability of the treatment/test/product/procedure?


The story says that PSA screening is “widespread.”

Does the story establish the true novelty of the approach?

Not Satisfactory

We react pretty strongly to the statement way up high in the 3rd sentence of the story:  “The new study seems to make a powerful argument in favor of PSA testing.”  Even though that statement is countered 3 paragraphs later by Dr. Barry Kramer, the sentence may have set an early tone for readers that is difficult to overcome with later skepticism.  Instead, why not put in the 3rd sentence of the story something about the limitations of such a statistical modeling analysis?

We admit we’re hard line on this:  but the framing of screening stories is important.

Does the story appear to rely solely or largely on a news release?


The story did not rely on a press release.

Total Score: 8 of 10 Satisfactory


Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.