Michael Joyce is a writer-producer with HealthNewsReview.org and tweets as @mlmjoyce
There is a delay of about 300 days from the time a drug company issues a news release about a new study of a cancer drug, to the time the complete results of the study are published in a peer-reviewed journal.
This according to a study published last week in JAMA Oncology.
This certainly raises the question of why does it take so long?
But it also raises some very different questions touching on issues we see frequently:
It creates a disconcerting limbo period — nearly a year in some cases — during which this incomplete and often imbalanced information dangles out there for interested doctors and patients, even though it has yet to be vetted for publication or even presented at a medical conference.
That’s a set-up for misleading both doctors and patients, and potentially leading to significant harms.
Two important issues need to be considered here.
First, is it even ethical to claim benefits of a drug (very often to the exclusion of noteworthy harms) and publicly release them without supporting data?
Second, which matters more if the goal is fostering innovation and improving patient outcomes? Completeness or speed?
“In theory, rapid and early dissemination of new research findings — both to the medical community and the lay public — may get appropriate care to patients sooner, and help important ideas spread,” said Michael Hochman MD when I spoke to him last summer.
Hochman is an internist and director of the Gehr Family Center for Implementation Science. I had turned to him for insights regarding the accelerated dissemination of research findings — commonly seen in news releases and medical meetings — that had not yet been peer-reviewed or meticulously vetted for publication. He added:
In practice, however, it seems that the dissemination of early stage research findings often leads to the cart getting out ahead of the horse. It’s hard to know where the optimal balance lies. There are clearly benefits to immediate communication, but there are also real risks that preliminary, un-adjudicated results will be taken out of context. And there are countless examples of new medical treatments and tests becoming widely disseminated before the data support their widespread dissemination.
But do preliminary and un-adjudicated results (including from Phase III cancer trials) find their way to the public? And are they taken out of context?
Yes and yes. Here are some examples from Phase III cancer trials we’ve recently written about:
Reuters lets Roche Make data-free claims about drug’s impact on lung cancer
“The headline of the story, ‘Roche’s Tecentriq cocktail adds to lung cander survival success,’ asks readers to take Roche’s word for it, because neither it nor Roche offers any quantitative data to support the claim.”
Keytruda for bladder cancer: No independent scrutiny of Merck-reported results
” … the story should have explained that since the data are unpublished and not available for review by anyone, we have no way of knowing if what the drug company says is accurate”
In both cases the burden of proof — which is the defining aim (and responsibility) of a clinical trial — is now shifted to to the reader (doctor or patient) who is now hamstrung by incomplete — and prematurely released –information. Do they have what they need to make a shared and informed decision?
It’s worth mentioning that the Securities Exchange Commission (SEC) requires companies to release research results as quickly as possible so their investors can — ironically enough — make “informed decisions.”
At issue is whether that information can be presented more responsibly, and whether news organizations can do a better job reporting on such announcements. Clearly, some companies use this as an opportunity to hype their results, hoping to move the stock price, months before anyone will have a chance to verify the claims.
As you might expect companies will very often lean toward framing these preliminary results in a way that encourages investment. The problem is this framing is often echoed in news releases, which is then often parroted by reporters, and eventually makes its way to the public.
We followed a classic example of this last spring with Amgen’s cholesterol-lowering drug Repatha. Amgen dubbed it a “landmark study,” the news release provided no data to back up this claim, but this didn’t stop some breathless coverage.
So who was better served — investors or patients?
Delays in publishing aren’t unique to medicine. As noted in this 2016 Nature article, it’s a growing problem across many scientific disciplines.
A short list of guesses on why it’s happening includes:
The list goes on but the fact remains that the delays are real, are frustrating for those involved, and percolate down to affect doctors and patients.
“These delays can matter. We all want to offer treatment options in which benefits outweigh harms,” says Andrae Vandross, MD, a hematology-oncology specialist at UCLA.
“But it’s tricky. If the reason for the delay is peer review and careful analysis, presumably this will improve our own analysis in deciding if the intervention is appropriate for our patients. If the reason for delay is strategic marketing, journal downloads, etc., this makes it hard to justify when juxtaposed to patient care considerations.
“All in all, I would prioritize a well done study that would provide a viable treatment option, even if the perception is that it’s delayed.”
Dr. Matt Katz is a radiation oncologist based in Massachusetts who brings up another point.
“Delays in publishing can slow implementation, especially since 70% of patients receive their cancer care outside of academic medical centers. Oncologists in the community setting are unlikely to make major changes in practice before publication. It’s peer-reviewed publication — not abstracts from meetings or press releases from for-profit companies — that dictate changes in policy, practice guidelines, and my own discussions of treatment options with patients.
I’ve heard it said “we don’t need more books, we need more good writers.” I’ve also heard many doctors say something analogous about clinical studies: “we don’t need more clinical studies, we need more well designed ones.”
But once we have such well designed studies, and the potentially meaningful results that come with them, our next priority should be how do we pass this information along to the doctors and patients who need it most. Do we rely on for-profit drug companies to package that information for the concerned public or concerned investors? And should we demand that negative results and study limitations be included alongside the touted benefits?
I guess the answers to those questions depend on who you think the research is for.
Comments (1)
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Len Lichtenfeld MD
April 23, 2018 at 9:49 amThere is another “wrinkle” to this story:
I was recently asked by a reputable news entity to do a quick turnaround and comment on a paper being presented at AACR that would likely have considerable clinical impact. The abstract and press release were made available. I noted that there was going to be simultaneous release of the peer reviewed paper in the NEJM.
Given that the peer reviewed paper would in my opinion be a better source of accurate information about the study, I asked to see that embargoed report before I would make any comment.
Long story short: the NEJM paper was not provided, I did not have the opportunity to do the interview, and I “settled” for writing a blog instead–and I was fine with that. Reputation should always be more about accuracy than visibility.
The lesson from this experience is that in that this fast changing world of medical science, if a report from a major meeting is going to be published simultaneously in a peer reviewed journal, ALL of the relevant information should be provided (and read!!!) to those of us asked to comment by the media.
And then there is another secondary question: I am frequently asked to offer a comment based on an abstract. I do not have access to the presentation (or the discussion) at the meeting. This lack of access and information (understanding that the interview requests frequently come before the paper is presented verbally or by poster) diminishes the value of any comment–and even with such information, a comment absent peer review publication can be problematic.
Every interviewee should note those cautions and concerns, and every reporter should make it clear in their report. Unfortunately, the temptation to do otherwise can at times be overwhelming.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like