Note to our followers: Our nearly 13-year run of daily publication of new content on HealthNewsReview.org came to a close at the end of 2018. Publisher Gary Schwitzer and other contributors may post new articles periodically. But all of the 6,000+ articles we have published contain lessons to help you improve your critical thinking about health care interventions. And those will be still be alive on the site for a couple of years.
Read Original Story

“Just add water” for student weight loss? Strong CBS report missed on costs and study limitations

Rating

4 Star

Categories

School water coolers may help kids lose weight

Our Review Summary

iStock_000031268340_SmallDespite it being a fairly short report, CBS covers a lot of ground: it quantifies the benefits in absolute terms, outlines the study design and weighs the advantages of modern water dispensers against “old-fashioned” water fountains. But in other areas, the story falls short. There is no mention of costs and of study limitations. Although it quotes from the accompanying JAMA Pediatrics editorial, the CBS story doesn’t feature any critical perspectives on the study. We would have liked a closer look at some of the study’s shortcomings, which could have been achieved by comments from an independent source, or someone who was not involved in the study. More context on where this study fits in “the growing body of evidence” would have also been welcome.

Finally, word choice could have been better. CBS refers to the JAMA editorial and writes that “the study’s findings are significant.” However, “statistically significant” has a different meaning than what the public believes is “significant.” The distinction should be clear, or another word should be used.

 

Why This Matters

Childhood obesity is a health concern that is on the minds of many parents and policymakers. The Centers for Disease Control and Prevention (CDC) estimates childhood obesity has more than doubled in children and quadrupled in adolescents in the past 30 years. In 2012, more than one third of children and adolescents were overweight or obese, the CDC said. And compared to other countries around the world, the US comes out on top when it comes to obesity among adults, according to a 2014 OECD report.

There are even speculations that high obesity rates may cause life expectancy in the US to decline. Therefore, any efforts to curb the “obesity epidemic” in America is newsworthy, especially if the intervention is low cost, low risk and for children.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

The CBS article does not mention any costs associated with the installation of a water dispenser. The JAMA Pediatrics article states that water jets are “relatively low-cost” interventions, with a one-time cost of about $1,000 per machine. There are also ongoing maintenance expenses, as well as additional costs for disposable cups. In addition, if the jets affect sales of milk and other beverages on school grounds, the costs would actually be higher still.

We believe the water jet cost should have been covered in the story, since researchers in the original journal article emphasized the association between a “relatively low-cost water availability intervention and decreased student weight.” That’s why we give the CBS article an Not Satisfactory rating here.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

The CBS story does a good job quantifying the benefits in absolute terms, when the lead researcher points out that water dispensers were associated with “a one percentage point reduction in the likelihood of being overweight for boys and a little over half a percentage point reduction for girls.” The article translated this for readers as “a modest weight drop among students.”

The piece also notes that water jets were linked with “a decrease” in the amount of half-pints of milk students bought, but it does not give any specific numbers. Specifically, researchers found a 12.3 decrease in the number of all types of milk purchased per student per year.

We think the quantification of benefits in absolute terms is enough to merit a Satisfactory rating here.

Does the story adequately explain/quantify the harms of the intervention?

Not Applicable

Students in New York City schools had access to water through drinking fountains before this intervention study. This study looked at a new way to deliver New York city tap water to kids, which may have encouraged them to opt for water instead of sugary beverages, like soda.

We rate this one Not Applicable.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The CBS story doesn’t mention any study limitations or take any sort of critical angle on the research.

But in the original journal article, researchers point out some of the shortcomings of their data. For one, they only looked at administrative data on water jet delivery and did not directly observe water consumption in the cafeteria. They also used the same technique for milk purchases, and they acknowledged that they had no data on which beverages students usually consume in school.

Since the CBS story doesn’t point out any limitations to the evidence, we give it an Not Satisfactory rating here.

Does the story commit disease-mongering?

Satisfactory

There is no disease mongering in the story.

Does the story use independent sources and identify conflicts of interest?

Satisfactory

No conflicts of interests were reported in the original journal article. The study was funded by the Eunice Kennedy Shriver National Institute of Child Health and Human Development.

The CBS report only quoted comments from the study’s lead researcher and then excerpts from the accompanying JAMA Pediatrics editorial. Technically, these editorial comments are sufficient to clear our bar, but we’d note that the thrust of the quote is mainly to confirm what the researchers are reporting. We would have liked to have seen a quote from someone willing to provide a more critical perspective on the study, such as the significance of its limitations and their impact on the research.

While we give the benefit of the doubt here as we always do, the story didn’t really fulfill the spirit of this criterion.

Does the story compare the new approach with existing alternatives?

Satisfactory

The story explains how water jets may be more effective than old-fashioned water fountains, due to concerns over water quality and fountain cleanliness. Drinking fountains also are less efficient at serving large numbers of children, the article adds.

Does the story establish the availability of the treatment/test/product/procedure?

Not Applicable

The availability of water dispensers is not in question, which is why we rate this Not Applicable.

Does the story establish the true novelty of the approach?

Satisfactory

We would have liked to have seen a bit more context in the CBS story. Research looking at water availability is nothing new and has been conducted in the US and abroad – for example in Germany, researchers said. One US study found that water consumption nearly tripled after the installation of water jets, while the German study saw a decreased risk for students being overweight if more water was available in the classroom.

However, the CBS article does quote the JAMA editorial, which pointed out this study “adds to the growing body of evidence supporting the importance of providing drinking water access in schools.”

We think that’s good enough for a Satisfactory rating.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The article does not rely on any news releases we found online. There is also evidence of original reporting in the lead researcher’s second comment, as he “told CBS News.”

Total Score: 6 of 8 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.