Read Original Story

Test of “artificial pancreas” offers diabetes hope

Rating

1 Star

Test of “artificial pancreas” offers diabetes hope

Our Review Summary

If the Times account of the study reviewed here was good, and WebMD’s was bad, then this write-up is just ugly. Misleading description of the experiment. Sensational terms. No independent perspective. They might have served readers better by simply posting a link to a more detailed  press release about the study.

 

Why This Matters

Advances in technology could help ease the burden of managing insulin for individuals with type 1 diabetes, and the study covered here is an important step forward. That being said, journalists aren’t doing anyone any favors when they fail to ask tough questions about a study and overhype its results.   

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

If we’re far enough along to determine that that the "artificial pancreas" was better than conventional techniques at managing glucose, we’re far enough along to start talking about what this approach may cost. 

Many patients with type 1 diabetes are not using currently available pumps and sensors because of the high cost of these devices. It seems likely that this new treatment, if it ever becomes widely available, will be as expensive or more so than the current pump and sensor technology.

 

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

The story cites study data showing that the system increased the amount of time the study participants spent with normal blood sugar levels and that it "halved" the amount of time blood sugar dropped to "worrying or dangerous levels."  Saying that the system "halved" time with low blood sugar suggests a big effect, but absolute rates were 4.1% for the experimental group and 2.1% for the control group — a 2% absolute difference. The true clinical significance of these differences may not be another matter. 

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

The story gives no sense of what could go wrong if this technology malfunctions and delivers the wrong dose of insulin while someone is sleeping. The consequences could be fatal.  

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The story misstates what happened in this experiment, giving the impression that the "new system" automatically monitored and adjusted patients’ insulin throughout the night, when in fact there were nurses adjusting the patients’ insulin pumps based on the calculations made by an algorithm. It might not be that hard to develop a device that would handle these adjustments automatically, but we won’t know for sure until we see the study proving it. The story also should have done more to call attention to the small size of this study and what kind of conclusions we can draw from an experiment involving only 17 patients. Although there are some cautionary notes sounded in an interview with one of the investigators, the claim made in the headline — that "the new device works better than conventional treatment"– is not well supported. It will take much larger and longer studies with patients living at home (and using an actual device that hasn’t been built yet) to show whether this new technololgy is safe and manages glucose better than conventional  methods.

Does the story commit disease-mongering?

Not Satisfactory

The description of type 1 diabetes in this story is a bit sensational. If type 1 diabetes is left untreated, the story states, "blood vessels and nerves are destroyed, organs fail and patients die."

While this is technically true, patients with type 1 diabetes are treated and their experiences with the disease, while often frustrating and frightening, are not well-represented by this overly dramatic one-sentence description. We’ll flag this one for disease-mongering.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

The story cites one interview with a study researcher and provides no other independent perspective. It does not inform us that this source had financial ties to one of the study sponsors.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

The story doesn’t describe how type 1 diabetes is currently managed and why new automated systems might be an improvement. An important benefit would be the prevention of nighttime episodes of hypoglycemia. The story doesn’t make this clear.  

Does the story establish the availability of the treatment/test/product/procedure?

Not Satisfactory

The story suggests that it will be several more years before the "new device" supposedly tested in this study will be available on the commercial market. But as the competing story in the New York Times makes clear, the researchers in this study did not test a "device" per se but rather an algorithm that could hypothetically be used to link up a glucose monitor and an insulin pump to create a new device for automatically managing blood glucose. The suggestion that there is a device already in testing exaggerates the level of progress that has been made and will give readers a false sense as to how close this product is to becoming a reality. 

Does the story establish the true novelty of the approach?

Satisfactory

The story says that medical device makers have been working for years to develop a so-called artificial pancreas. While this is perhaps enough to satisfy the criterion, the story could have mentioned that some of the most important features that an "artificial pancreas" might provide can already be found on commercially available products. A Medtronic Insulin pump can suspend insulin delivery when it gets a low blood glucose reading from the continuous glucose monitor to prevent hypoglycemia. This pump is not available in the U.S. because it doesn’t have regulatory approval–something that is also likely to take a long time for an "artifical pancreas."    

Does the story appear to rely solely or largely on a news release?

Not Applicable

Because there are no independent perspectives in this piece, we can’t be sure of the extent to which it may have been influenced by a news release.

Total Score: 1 of 9 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.