Promising Test for Dendreon's Prostate Cancer Drug April 15, 2009 ![]() Story about a drug company's announcement of positive study results fails readers in every important way. Distressing to see such a credulous, feeble, negligent piece published anywhere in the NYT. Our Review Summary
This story about a drug company's announcement of positive study results fails readers in every important way.
Click on Criteria for definitions. ![]() Establish the availability of the treatment/test/product/procedure? - NOT SATISFACTORY
The story describes the findings of the clinical trial as "decisive," and speculates the "widely anticipated results could pave the way" for the drug's approval. The result is to imply imminent availability, an outcome that is by no means certain. ![]() Discuss costs? - NOT SATISFACTORY
While the story anticipates approval and comments on the drug maker's stock price, it fails to anticipate the drug's cost or comment on the expense required to extend life by several months. ![]() Avoid "disease-mongering"? - NOT SATISFACTORY
The story quotes the drug maker's chief executive estimating that 100,000 American men per year are diagnosed with cancer that has spread beyond the prostate gland and is not benefitting from other therapies. The reporter should not have depended on this self-interested source. Other news stories, quoting a variety of independent sources, estimated the number of affected men at 40,000 to 60,000 per year. In addition, the reporter allows a source with dual conflicts of interest--he is a patient who could benefit from the treatment and a stockholder in the company that makes the drug--to make emotional appeals for approval. He says many men have been "lost" since the FDA's failure to approve the drug, and that he and other patients are "looking into the abyss" and just "want a chance" to live. ![]() Evaluate the quality of evidence? - NOT SATISFACTORY
The story does not report until paragraph eight that the "decisive" study results have not been released by the company and will not be presented at a medical meeting for about two weeks. The story does not indicate that even then, the results will not have been peer-reviewed or published.
![]() Quantify the potential harms? - NOT SATISFACTORY
The story suggests the drug's side effects are milder than those of standard chemotherapy. But the source of this assessment is a member of the study team who is a consultant to the drug maker. There is no description from an independent source of the drug's safety profile. The story accurately describes Provenge as a novel type of cancer vaccine therapy. It describes the history of similar drugs, none of which has been approved. ![]() Quantify the potential benefits? - NOT SATISFACTORY
The drug maker's chief executive is quoted saying the results were "an unambiguous hit on the primary endpoint of overall survival." It paraphrases his saying the outcome met the goals the FDA had previously set for the drug. The story additionally paraphrases the chief executive verifying that the drug "would have had to reduce the risk of death by 22 percent compared to a placebo" to meet FDA requirements. The chief executive is parsing his language very carefully, skillfully avoiding making an explicit claim about the drug's proven benefits. Rather than stating that the chief executive would not plainly describe the results, the reporter enables his evasion by connecting the dots between what the FDA said must be shown with the chief executive's assurances that it had been. For context, see "Relies on Press Release," below. ![]() Appear to rely solely or largely on a news release? - NOT SATISFACTORY
The story's tortured formulation suggesting that the goals the FDA had set for the drug had been met--while avoiding plainly stating what the FDA had required and what the results showed--first appears in the company's press release.
![]() Use independent sources and identify conflicts of interest? - NOT SATISFACTORY
The story quotes six sources:
Too many sources are biased in favor of the company and its product, and they are given signficantly more space in the story than independent voices. There is no source who is openly skeptical or even ambivalent about the findings. There is no one who suggests that conclusions made before findings are published may be premature. ![]() Compare the new approach with existing alternatives? - NOT SATISFACTORY
The story says the only approved treatment for the cancers Provenge treats is Taxotere, which has been shown to extend life by three months. This may be technically accurate as stated. But the American Cancer Society lists at least eight other chemotherapy agents used to treat advanced prostate cancer. Total Score: 1 of 10 Satisfactory The U.S. Preventive Services Task Force is considered the gold standard of preventive health recommendations - including on screening tests. It's a good source for journalists and consumers.
About 70% of the stories reviewed from 2006-9 failed to adequately discuss costs, or to explain how big (or small) are the potential benefits and harms of treatments, tests, products and procedures.
We have documented a disturbing trend of news stories taking an advocacy stance, promoting certain screening tests outside the boundaries of scientific evidence.
Stories on new technologies like Cyberknife, DaVinci robotic surgery systems, and proton beam cancer therapy often fail to scrutinize the evidence and/or to discuss the costs involved.
Rather than suggesting that everyone should be screened for everything, news stories could explain: "All screening tests cause harm; some may do good."
The first 38 network TV network morning health news stories reviewed in 2009 earned an average score of 1.2 stars. 13 of the 38 stories got ZERO stars.
Both TIME magazine and BusinessWeek have published terrific stories explaining the importance of the Number Needed to Treat - or NNT.
Knowing relative risk reduction is like knowing you have a 50% off coupon but not knowing whether it's for a Lexus or a lollipop. Absolute risk reduction tells you what the "coupon" is worth. Read more.
The website NoFreeLunch.org posts "a database of health care professionals who have pledged to accept no gifts from industry and to rely on non-promotional sources of information."
To help journalists cover stories responsibly, we post a list of independent experts who state that they do not have financial ties to drug or medical device manufacturers.
We apply the same ten standardized criteria to the review of every story.
We have about 30 story reviewers. Each story is reviewed by 3 different people.
Gary Schwitzer's seven words you shouldn't use in medical news: cure, miracle, breakthrough, promising, dramatic, hope, victim. Read why.
|