Read Original Story

Breast biopsy accuracy is questioned in experimental study

Rating

4 Star

Breast biopsy accuracy is questioned in experimental study

Our Review Summary

Having acknowledged the overall quality of the coverage, we’d note that our wish list for this story includes a couple of contextual details. Since the story advocates for a second opinion from a pathologist, it would’ve been helpful to explain how it easy it might be to get that opinion and whether insurance would cover it. We also wish the story would’ve discussed the factors associated with worse performance in diagnosing difficult cases. Specifically, the study found that pathologists who interpret fewer breast biopsies, who practice in nonacademic settings, and who work in small practices had a greater disagreement with the consensus diagnosis.

 

Why This Matters

Each year nearly 1.6 million women in the United States undergo a breast biopsy.  Clinicians and patients depend on an accurate pathology report to decide whether treatment is necessary, determine the future frequency of screening, and choose the right screening methods.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

Since the first sentence of the piece focuses on “another reason for getting a second medical opinion,” readers would have benefited from some discussion of the costs of that opinion. The issue is a little murky. While many insurance policies cover a second opinion, this is traditionally understood to mean a second surgeon reading the original pathology report. Getting a second read on the pathology is not well established and coverage not as clear.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

The article discussed the rates at which average pathologists misdiagnosed the presence of DCIS and the presence of abnormal, precancerous cells compared with a panel of leading experts. We’ll call this good enough for a satisfactory rating. However, the piece should also have noted that these abnormal, precancerous cells are termed atypia, since this is the term women would see in a pathology report. In addition, the story failed to quantify the rate at which pathologists correctly diagnosed invasive breast cancer (96%). Its says merely that the results show pathologists “are very good at determining when invasive cancer is present in breast tissue.” By contrast, rates of misdiagnosis are precisely quantified. Quantifying the reassuring rates of correct diagnosis would have provided more balance to the story.

Does the story adequately explain/quantify the harms of the intervention?

Satisfactory

The piece explains that accurate diagnosis of both DCIS and abnormal, precancerous cells (atypia) is important.  Up to 160,000 American women are diagnosed with atypia each year.  Because the study determined that less than half of these diagnoses are accurate, tens of thousands of women may be getting inappropriate treatment: over-treatment or under-treatment.

Does the story seem to grasp the quality of the evidence?

Satisfactory

The story does enough to earn a satisfactory rating here. It notes that the study was an experiment and that pathologists were not permitted to consult with other pathologists when determining a diagnosis. As a result, the study results do not necessarily reflect a real world practice.  The story also quotes a JAMA editorial that accompanied the study, which observed that “the study lacks information on patient outcomes, so there’s no proof that the experts made the correct diagnosis.”

The article could have provided some more details about the expert panel, who unanimously agreed on a diagnosis only 75% of the time. Also, study participants reviewed only one slide, not the multiple slides that pathologists usually review when determining a diagnosis.

Does the story commit disease-mongering?

Not Satisfactory

While this story does not disease monger in the classic sense, we wish that it had provided more emphasis on the rate of correct diagnosis for invasive cancers, which is somewhat reassuring. The uncertainty here surrounds the cases that fall into a gray area and don’t as clearly require immediate treatment. In addition, the article states the DCIS “can sometimes spread so usual treatment is surgery and radiation.”  Readers should also have been told that watchful waiting is an option with a DCIS diagnosis. The cumulative effect of these omissions throws the story off balance, a problem we’ll address here with a Not Satisfactory rating.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

The piece includes a quote from Dr. David Rimm, a Yale University pathology professor and co-author of the accompanying JAMA editorial.

Does the story compare the new approach with existing alternatives?

Not Applicable

There are no proven alternatives to pathologist’s interpretation of biopsy slides.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

The article includes the information that 1.6 million breast biopsies are performed in the United States each year, suggesting that access to the procedure is widespread. As noted above, it would have been helpful to have more information about the availability of a second pathologist’s interpretation of tissue samples. In addition, it would have been very helpful to include information from the study about the factors associated with pathologists who had greater disagreement with the consensus-derived reference diagnosis.  Specifically, the study found that pathologists who interpret fewer breast biopsies, who practice in nonacademic settings, and who work in small practices had a greater disagreement with the consensus diagnosis.

Does the story establish the true novelty of the approach?

Satisfactory

The study notes, “Previous research has shown that interpreting mammograms can also be tricky and lead to under- or over-treatment.”

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story includes original reporting and quotes from the lead researcher, so we can be sure it’s not based on a news release.

Total Score: 6 of 9 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.