Our Review Summary
This is a story about the early promise of gene therapy failing to translate into an array of new clinical treatments. In a way, the story mirrors the problems with gene therapy that it describes. It promises to be a powerful antidote to all the hype surrounding gene therapy. It provides some targeted information relevant to a subset of patients, but it ultimately does not deliver a very well rounded picture of the drug it describes, skipping over specific details about benefits, harms, availability and true novelty. We give NPR a lot of credit for taking on the topic at all and admire the economy of storytelling for such a complicated topic. At the same time, the story may have covered more ground in the same amount of time by including some independent voices and providing a few hard numbers to back up claims that the drug was “remarkable” and “stunning.”
Why This Matters
Gene therapy continues to garner hyperbolic claims. We wish more reporters would follow the lead of this story and showcase the “long, hard slog,” as this story describes it. One of the best aspects of the story is how it takes on the notion of “a cure.” It quotes a patient who is taking the drug as saying, “Everyone talks about curing a disease — cure CF, cure these other diseases. [But] Kalydeco controls CF at the basic defect, so I’m OK with the other ‘c’ word, control, because I’m living it and I’ve never felt better in my life.” While we wish there were more evidence provided about how well the drug controls the disease, we applaud the way the story shifts the focus away from finding silver bullets toward finding treatments that can improve patients’ lives, even if they still suffer from the underlying disease. Sometimes control is a more achievable goal.
Criteria
Satisfactory
It doesn’t come until the last sentence in the story, but it also leaves listeners and readers with a pretty sobering reality: “The time from gene discovery to successful drug may be shortening, but there are only a handful of successful drugs so far, and for a while at least, the appearance of new ones will be slow. They’re also likely to be expensive. Kalydeco costs in the neighborhood of $300,000 per year.”
Not Satisfactory
We kept reading this piece and listening to the audio for any sort of data to back up some of the claims made. We understand that numbers don’t always translate well on the radio, but even a supplementary graphic illustrating how effective this drug is would have provided some much needed context. The story does say, “It only works on a small subset of people with CF. They have to have a particular mutation in the CF gene, or the drug is of little use.” Then it says, though, “But for people who do have that mutation, the drug works remarkably well.” How small is that subset? And how well does it work?
Not Satisfactory
There was no mention of harms in the story. We think that it’s especially important to include information about harms when you feature a patient who describes the benefits of the drug by saying “something huge had happened. It was just something I had never felt in my life before.”
The prescribing information for the drug states: “Overall, the most common adverse reactions in 353 patients with CF were headache (17%), upper respiratory tract infection (16%), nasal congestion (16%), nausea (10%), rash (10%), rhinitis (6%), dizziness (5%), arthralgia (5%), and bacteria in sputum (5%).”
Satisfactory
The story doesn’t get into the evidence in depth, but we give the story high marks for the way it frames the gene treatment discovery process. We have seen very few stories tackle the topic in this fashion, and it is a service to the public to cut through the hype and provide a more clear-eyed picture. For example, the story points out that the drug company “tested over 600,000 chemicals in cells with the defective protein that causes cystic fibrosis” and that, ultimately, the company “knew there was a problem with Kalydeco: It only works on a small subset of people with CF. They have to have a particular mutation in the CF gene, or the drug is of little use.”
Satisfactory
There is no disease mongering here. The story does a nice job describing the disease in a short space.
Not Satisfactory
The reporter clearly did a lot of digging to craft this very well told piece, but the only two people ultimately quoted are Fred Van Goor at Vertex Pharmaceuticals, which developed the drug in question, Kalydeco, and Emily Schaller, who was in a clinical trial for the drug and apparently saw a big benefit. No truly independent expert source was quoted.
Not Satisfactory
There’s no mention of what people typically do to treat cystic fibrosis and what advantage, if any, this drug brings. The mention of the clinical trial says that a patient was given a placebo and then the drug. But have tests been done comparing existing treatments to this new treatment?
A Wall Street Journal story on the drug last February at least mentioned that until now patients took “medicines that only tackled the symptoms of the disease, such as antibiotics to treat the infections. Patients typically spent a few hours each day wearing vibrating vests to dislodge mucus build-up.”
Satisfactory
Readers can infer that this drug is available from the final sentence that establishes cost. It would have been easy for the story to specify clearly that the drug is now available by prescription, with some estimate of how widespread is the use. Nonetheless, we’ll give the story the benefit of the doubt.
Not Applicable
We’re torn about how to apply this criterion to this story. The story doesn’t make any overt claims of novelty – nothing about being “first” or “only.” We’ve already dinged the story on the “Compare With Alternatives” criterion, so we’ll rule this one Not Applicable.
Satisfactory
The story does not rely on a press release.
Total Score: 5 of 9 Satisfactory
Comments (3)
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Joe Palca
January 7, 2013 at 10:29 amThanks for the thoughtful comments. They are all valid. I wonder, however, if you’ve ever considered the possibility that independent experts were consulted, just not quoted in the piece? I can assure that was the case for this story. Does a reporter have to prove to his audience that he has done due diligence in covering the story, or can the audience trust his professionalism?
You guys provide a valuable service.. Keep up the good work.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like