Our Review Summary
If the Times account of the study reviewed here was good, and WebMD’s was bad, then this write-up is just ugly. Misleading description of the experiment. Sensational terms. No independent perspective. They might have served readers better by simply posting a link to a more detailed press release about the study.
Why This Matters
Advances in technology could help ease the burden of managing insulin for individuals with type 1 diabetes, and the study covered here is an important step forward. That being said, journalists aren’t doing anyone any favors when they fail to ask tough questions about a study and overhype its results.
Criteria
Not Satisfactory
If we’re far enough along to determine that that the "artificial pancreas" was better than conventional techniques at managing glucose, we’re far enough along to start talking about what this approach may cost.
Many patients with type 1 diabetes are not using currently available pumps and sensors because of the high cost of these devices. It seems likely that this new treatment, if it ever becomes widely available, will be as expensive or more so than the current pump and sensor technology.
Not Satisfactory
The story cites study data showing that the system increased the amount of time the study participants spent with normal blood sugar levels and that it "halved" the amount of time blood sugar dropped to "worrying or dangerous levels." Saying that the system "halved" time with low blood sugar suggests a big effect, but absolute rates were 4.1% for the experimental group and 2.1% for the control group — a 2% absolute difference. The true clinical significance of these differences may not be another matter.
Not Satisfactory
The story gives no sense of what could go wrong if this technology malfunctions and delivers the wrong dose of insulin while someone is sleeping. The consequences could be fatal.
Not Satisfactory
The story misstates what happened in this experiment, giving the impression that the "new system" automatically monitored and adjusted patients’ insulin throughout the night, when in fact there were nurses adjusting the patients’ insulin pumps based on the calculations made by an algorithm. It might not be that hard to develop a device that would handle these adjustments automatically, but we won’t know for sure until we see the study proving it. The story also should have done more to call attention to the small size of this study and what kind of conclusions we can draw from an experiment involving only 17 patients. Although there are some cautionary notes sounded in an interview with one of the investigators, the claim made in the headline — that "the new device works better than conventional treatment"– is not well supported. It will take much larger and longer studies with patients living at home (and using an actual device that hasn’t been built yet) to show whether this new technololgy is safe and manages glucose better than conventional methods.
Not Satisfactory
The description of type 1 diabetes in this story is a bit sensational. If type 1 diabetes is left untreated, the story states, "blood vessels and nerves are destroyed, organs fail and patients die."
While this is technically true, patients with type 1 diabetes are treated and their experiences with the disease, while often frustrating and frightening, are not well-represented by this overly dramatic one-sentence description. We’ll flag this one for disease-mongering.
Not Satisfactory
The story cites one interview with a study researcher and provides no other independent perspective. It does not inform us that this source had financial ties to one of the study sponsors.
Not Satisfactory
The story doesn’t describe how type 1 diabetes is currently managed and why new automated systems might be an improvement. An important benefit would be the prevention of nighttime episodes of hypoglycemia. The story doesn’t make this clear.
Not Satisfactory
The story suggests that it will be several more years before the "new device" supposedly tested in this study will be available on the commercial market. But as the competing story in the New York Times makes clear, the researchers in this study did not test a "device" per se but rather an algorithm that could hypothetically be used to link up a glucose monitor and an insulin pump to create a new device for automatically managing blood glucose. The suggestion that there is a device already in testing exaggerates the level of progress that has been made and will give readers a false sense as to how close this product is to becoming a reality.
Satisfactory
The story says that medical device makers have been working for years to develop a so-called artificial pancreas. While this is perhaps enough to satisfy the criterion, the story could have mentioned that some of the most important features that an "artificial pancreas" might provide can already be found on commercially available products. A Medtronic Insulin pump can suspend insulin delivery when it gets a low blood glucose reading from the continuous glucose monitor to prevent hypoglycemia. This pump is not available in the U.S. because it doesn’t have regulatory approval–something that is also likely to take a long time for an "artifical pancreas."
Not Applicable
Because there are no independent perspectives in this piece, we can’t be sure of the extent to which it may have been influenced by a news release.
Total Score: 1 of 9 Satisfactory
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like