Health News Review

The star score doesn’t reflect the strong points about this piece. The story was told with an engaging and interesting style, and provided historical reflections on the science and on past journalism on the topic.  Still, we wish it had provided more evidence and more outside perspective.

Our Review Summary

This is a story about the early promise of gene therapy failing to translate into an array of new clinical treatments. In a way, the story mirrors the problems with gene therapy that it describes. It promises to be a powerful antidote to all the hype surrounding gene therapy. It provides some targeted information relevant to a subset of patients, but it ultimately does not deliver a very well rounded picture of the drug it describes, skipping over specific details about benefits, harms, availability and true novelty. We give NPR a lot of credit for taking on the topic at all and admire the economy of storytelling for such a complicated topic. At the same time, the story may have covered more ground in the same amount of time by including some independent voices and providing a few hard numbers to back up claims that the drug was “remarkable” and “stunning.”


Why This Matters

Gene therapy continues to garner hyperbolic claims. We wish more reporters would follow the lead of this story and showcase the “long, hard slog,” as this story describes it. One of the best aspects of the story is how it takes on the notion of “a cure.” It quotes a patient who is taking the drug as saying, “Everyone talks about curing a disease — cure CF, cure these other diseases. [But] Kalydeco controls CF at the basic defect, so I’m OK with the other ‘c’ word, control, because I’m living it and I’ve never felt better in my life.” While we wish there were more evidence provided about how well the drug controls the disease, we applaud the way the story shifts the focus away from finding silver bullets toward finding treatments that can improve patients’ lives, even if they still suffer from the underlying disease. Sometimes control is a more achievable goal.


Criteria

Satisfactory

Does the story adequately discuss the costs of the intervention?

Satisfactory

It doesn’t come until the last sentence in the story, but it also leaves listeners and readers with a pretty sobering reality: “The time from gene discovery to successful drug may be shortening, but there are only a handful of successful drugs so far, and for a while at least, the appearance of new ones will be slow. They’re also likely to be expensive. Kalydeco costs in the neighborhood of $300,000 per year.”

Not Satisfactory

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

We kept reading this piece and listening to the audio for any sort of data to back up some of the claims made. We understand that numbers don’t always translate well on the radio, but even a supplementary graphic illustrating how effective this drug is would have provided some much needed context. The story does say, “It only works on a small subset of people with CF. They have to have a particular mutation in the CF gene, or the drug is of little use.” Then it says, though, “But for people who do have that mutation, the drug works remarkably well.” How small is that subset? And how well does it work?

Not Satisfactory

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

There was no mention of harms in the story. We think that it’s especially important to include information about harms when you feature a patient who describes the benefits of the drug by saying “something huge had happened. It was just something I had never felt in my life before.”

The prescribing information for the drug states: “Overall, the most common adverse reactions in 353 patients with CF were headache (17%), upper respiratory tract infection (16%), nasal congestion (16%), nausea (10%), rash (10%), rhinitis (6%), dizziness (5%), arthralgia (5%), and bacteria in sputum (5%).”

Satisfactory

Does the story seem to grasp the quality of the evidence?

Satisfactory

The story doesn’t get into the evidence in depth, but we give the story high marks for the way it frames the gene treatment discovery process. We have seen very few stories tackle the topic in this fashion, and it is a service to the public to cut through the hype and provide a more clear-eyed picture. For example, the story points out that the drug company “tested over 600,000 chemicals in cells with the defective protein that causes cystic fibrosis” and that, ultimately, the company “knew there was a problem with Kalydeco: It only works on a small subset of people with CF. They have to have a particular mutation in the CF gene, or the drug is of little use.”

Satisfactory

Does the story commit disease-mongering?

Satisfactory

There is no disease mongering here. The story does a nice job describing the disease in a short space.

Not Satisfactory

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

The reporter clearly did a lot of digging to craft this very well told piece, but the only two people ultimately quoted are Fred Van Goor at Vertex Pharmaceuticals, which developed the drug in question, Kalydeco, and Emily Schaller, who was in a clinical trial for the drug and apparently saw a big benefit.  No truly independent expert source was quoted.

 

Not Satisfactory

Does the story compare the new approach with existing alternatives?

Not Satisfactory

There’s no mention of what people typically do to treat cystic fibrosis and what advantage, if any, this drug brings. The mention of the clinical trial says that a patient was given a placebo and then the drug. But have tests been done comparing existing treatments to this new treatment?

A Wall Street Journal story on the drug last February at least mentioned that until now patients took “medicines that only tackled the symptoms of the disease, such as antibiotics to treat the infections. Patients typically spent a few hours each day wearing vibrating vests to dislodge mucus build-up.”

Satisfactory

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

Readers can infer that this drug is available from the final sentence that establishes cost. It would have been easy for the story to specify clearly that the drug is now available by prescription, with some estimate of how widespread is the use.  Nonetheless, we’ll give the story the benefit of the doubt.

Not Applicable

Does the story establish the true novelty of the approach?

Not Applicable

We’re torn about how to apply this criterion to this story.  The story doesn’t make any overt claims of novelty – nothing about being “first” or “only.”  We’ve already dinged the story on the “Compare With Alternatives” criterion, so we’ll rule this one Not Applicable.

Satisfactory

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story does not rely on a press release.

Total Score: 5 of 9 Satisfactory


Comments

Joe Palca posted on January 7, 2013 at 10:29 am

Thanks for the thoughtful comments. They are all valid. I wonder, however, if you’ve ever considered the possibility that independent experts were consulted, just not quoted in the piece? I can assure that was the case for this story. Does a reporter have to prove to his audience that he has done due diligence in covering the story, or can the audience trust his professionalism?
You guys provide a valuable service.. Keep up the good work.

Reply

    Gary Schwitzer posted on January 7, 2013 at 12:13 pm

    Joe,

    First, thanks for your kind comments about our work.

    I can assure you that we do indeed, consider that a journalist may have consulted other sources but just not quoted any in the story. That’s why the wording – as in this story review – often emphasizes only whether an independent source was quoted. Sometimes we are more direct in our comments. For example, sometimes in such cases we may write that we don’t know whether anyone else was interviewed; we only know that no one was quoted.

    In that regard, we acknowledge that we set the bar high. And we realize that some media formats don’t allow hard-working journalists to include everything they’d like to include. That’s one of the reasons we led our review with “The star score doesn’t reflect the strong points about this piece.” And we encourage our readers not to judge a story by the “star score” it receives, but, rather, to read the full review.

    Your reputation and your professionalism is well known by anyone who has followed your work. And those who haven’t followed your work should start.

    Regards,

    Gary Schwitzer
    Publisher

    Reply

      Joe Palca posted on January 8, 2013 at 10:07 am

      Gary,

      I hope my comment didn’t come across as defensive. I really think that reminding journalists of the multiple levels of understanding and explanation they need to consider when reporting their stories is an invaluable service.

      Joe


We Welcome Comments

But please note: We will delete comments that include personal attacks, unfounded allegations, unverified facts, product pitches, profanity or any from anyone who doesn't list what appears to be an actual email address. We will also end any thread of repetitive comments. We don't give medical advice so we won't respond to questions asking for it. Please see more on our comments policy.