Our Review Summary
As the story points out, these claims are usually based on very thin evidence from manufacturer-funded studies. The story also included some good background information on why food manufacturers are so tempted to stretch the truth when making these claims. The short answer is that the claims help sell products even when they are not believable.
We would like to have seen some more details on the studies POM cites in support of its promotional statements. Apart from this and a few other minor shortcomings, however, the story met our expectations for quality journalism.
Why This Matters
The ability to make health claims is a very important marketing tool for food companies. Unfortunately, though, nobody seems to have much authority to regulate these claims or tell us which are based on sound science. The result is that we get companies touting chocolate toddler formula for its health benefits; sugar cereals that purportedly support immunity; and, in the case discussed here, pomegranate juice which apparently can treat heart disease, prostate cancer, and erectile dysfunction. (Hat tip to Marion Nestle’s Food Politics blog for pointing us to the preceding examples; there are many others cataloged on her site.)
And these are just the few cases we hear about because the claims may run afoul of the law. There are many other processed food products out there that are unlikely to be very healthful and yet carry labels suggesting otherwise. Consumers can benefit from stories which examine the truth behind the claims.
Criteria
Satisfactory
The story says a bottle of POM costs $4, meeting our standard for a satisfactory. It could have specified that the $4 cost refers to 16 oz bottle and not a larger package. There also is no information about how often you’d need to drink the juice to obtain the claimed benefits, so we don’t know if people are supposed to drink a bottle a day or a bottle a week — which would make a big difference on the cost front. (The latter problem may not be the fault of the article, as a quick perusal of the POM website turned up no specific information about serving recommendations from the manufacturer.)
.
Not Satisfactory
This story explained why the purported health benefits of POM and other drinks are difficult to quantify due to a lack of appropriate research. This gap between claims and proof is highlighted in the story headline and the lead sentence, which points out the absurdity of the claim that POM is “40% as effective as Viagra” — a statistic which has no real meaning or purpose except to make the product sound more appealing.
Still, the expectation is that somewhere in a story there will be some discussion of the absolute risk reductions seen in the primary studies used to substantiate a claim about benefits. This is a problem touched on earlier under the Evidence Evaluation criterion; we’ll dock the points here.
Not Applicable
The story perhaps could have mentioned that too much POM juice might contribute to obesity and related health risks such as type 2 diabetes. But we can’t really fault it for not discussing the harms of pomegranate juice, because there really aren’t any direct adverse effects that have been well established. (The same is not necessarily true for antioxidant supplements, which may well be harmful in some cases.) We’ll call this one not applicable.
Satisfactory
For a piece that was all about scrutinizing product health claims, the story didn’t do quite as much digging into the evidence as we would have liked. The research supporting POM isn’t dissected until the last paragraphs of this relatively long article, and the analysis is limited to telling us what was wrong with the studies. — e.g the claims about arterial plaque were based on a single POM-funded pilot study “that included just 19 people,” and the claims about blood flow came from a study “that included just 45 people and only lasted for three months.”
A bit more detail on the design of these studies would have been appropriate for such an in-depth piece.
With that being said, the story did an excellent job of providing context around the issue of health claims. It noted that manufacturer-funded studies, which are often used to support health claims, are much more likely than independent studies to report favorable results. It also had some great discussion of the “health halo,” which is when companies tout unlikely claims on food packaging to distract people from the real nutritional content of the product.
This one was close, but the major expectation here is that the story include some kind of analysis of the quality of the evidence, which clearly is provided. There was also some excellent background information that will give readers a better understanding of why health claims are made and why they should be viewed skeptically. On that basis, we’ll award a satisfactory.
Satisfactory
The story doesn’t exaggerate any of the conditions POM supposedly prevents or treats.
Satisfactory
The diversity of voices in this story is a strong point. We hear from consumer advocates, industry and independent researchers, as well nutrition experts. One quibble is that comments from the industry-funded researchers are relegated to the very end of the story and they are made to sound like shills for POM. There’s nothing inherently wrong with industry-funded research, and these researchers can’t necessarily be held responsible for how the funding company portrays their findings. Whether pomegranate juice has health benefits is a question worth exploring; the problems arise when companies oversell or distort the results.
Not Satisfactory
The purported health benefits of POM and other health drinks are based on their supposedly high content of antioxidant compounds. People can obtain similarly high levels of antioxidants, at much lower cost, just by eating a healthy diet with lots of regular fruits and vegetables, which are also rich in antioxidants. In fact, it’s probably better to rely on a variety of different foods to make sure you get enough of everything and not too much of any specific compound. The story should have pointed this out.
Satisfactory
We know that one company racked up $91 m in sales in one recent year, giving some indication of how widespread is the use of some of these products.
Satisfactory
The story notes that POM is hardly the only juice drink making questionable health claims. VitaminWater, kombucha tea, coconut water, and juice drinks made from acai, goji berry, and mangosteen are all mentioned as promoting health claims on their labels.
Satisfactory
This story was clearly not based on a news release.
Total Score: 7 of 9 Satisfactory
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like