NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.
Read Original Story

Mammogram Benefit Seen for Women in Their 40s

Rating

4 Star

Mammogram Benefit Seen for Women in Their 40s

Our Review Summary

This story includes strong comments from independent experts that can help readers get a broader understanding of the results of a study that compared breast cancer death rates among women in their 40s who lived in areas of Sweden that did or did not offer routine mammography. However, because the story reports only the percentage difference in death rates, without including absolute numbers or the number of women who need to be screened to prevent one death, readers may get the impression that the effect of mammography was larger than what the researchers actually reported.

 

Why This Matters

People commonly overestimate the risk of breast cancer death among women in their 40s. By not including any information about the absolute numbers of deaths among women in this study or in the population at large, the story misses an opportunity to correct common misconceptions.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

The story does not discuss the costs of annual mammography screening, or even provide a range of costs.  The story does not discuss any health care policy cost repercussions of breast cancer screening recommendations.  The story does not discuss the cost of unnecessary biopsies or other treatments for women who have a false positive diagnosis via mammography (greater in women 40-49).

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

The story highlights the 26 percent difference in breast cancer death rates, but fails to include any information about the overall risk. The researchers reported that based on their results you would have to screen 1252 women for a decade in order to prevent one breast cancer death. In other words, for the remaining 1251 women, a decade of mammograms did not alter their breast cancer mortality.

Does the story adequately explain/quantify the harms of the intervention?

Satisfactory

Although this story does not go into detail about the potential harms of screening mammography, it does include comments from independent experts who point out that the scans do lead to the diagnosis and treatment of women whose tumors would never have become life-threatening.

Does the story seem to grasp the quality of the evidence?

Satisfactory

This story briefly explains key features of this study. It also includes critiques from independent experts who note limitations of the study design and analysis – although the statement that the researchers "did not compare the broader breast cancer death rates" in the counties" is unclear.  Overall, there is much more the Times could have done to analyze methodological questions surrounding the Swedish study. (For example, read our blog on this matter.) Interviews with Peter Gotzsche and with Donald Berry saved the story.  But so much more could have been done – another reason why more than 471 words should have been devoted to the reporting.

Does the story commit disease-mongering?

Satisfactory

The story does not discuss the prevalence of breast cancer among women in their 40s. That omission would not usually be considered disease mongering, but since surveys indicate most people overestimate the risk of breast cancer among women in their 40s, failing to mention the actual rates leaves those misconceptions intact.

The story does include comments from experts who raise concerns about overdiagnosis; that is, the number of breast tumors discovered that are not actually life-threatening.

Does the story use independent sources and identify conflicts of interest?

Satisfactory

A strong point of this story is the inclusion of comments from several independent experts with a variety of perspectives on the meaning of the latest study results. The story does not mention any potential conflicts of interest, but the researchers did not list any in their journal article.

Does the story compare the new approach with existing alternatives?

Satisfactory

Although not discussed in detail, the story does mention that the United States Preventive Services Task Force has questioned the value of screening mammograms for women younger than 50, thus implying that not being screened is an option to consider.

Does the story establish the availability of the treatment/test/product/procedure?

Not Applicable

The availability of mammography was not explicitly addressed, but we can’t criticize the story for that.  Instead, we give a Not Applicable score for this criterion.

Does the story establish the true novelty of the approach?

Satisfactory

This story could have done a better job explaining how this study – and its methods – are different from earlier research on the topic.
But two things lead us to give it a barely satisfactory score. First, there was a brief attempt to mention the unique "circumstances" of the Swedish study.  Second, the story also pointed out that there’s a historical ideological pattern in the study authors’ work – noting that they "have long been advocates of mammography screening." 

Does the story appear to rely solely or largely on a news release?

Satisfactory

It’s clear that the story was not based on a news release.

Total Score: 7 of 9 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.