October 6, 2017 Read Original Release

Spin Alert: GW claims text program helps pregnant women quit smoking, but study found no benefit

Reviewed By

Rating

Text messaging program may help pregnant women kick the smoking habit

Our Review Summary

Editor’s note: On the day this review was published, the news release it’s based on was removed from the EurekAlert! site. We have saved the original news release as a pdf.

Using mobile devices to inform, persuade and ultimately change health behaviors is all the rage. A recent meta-analysis suggests that these efforts can be effective when it comes to convincing pregnant smokers to cut back, although it also finds that persuading smokers to stop is less successful.

This news release describes a study that used an experimental design (randomized intervention and control groups) to explore whether text messages would be effective in helping pregnant women to stop smoking. Those messages did not produce any statistically significant reduction in smoking cessation rates, as the study itself makes clear. So it’s concerning to see this news release headlined: “Text messaging program may help pregnant women kick the smoking habit.” A more accurate headline would have been: “Text messaging program not shown to help pregnant women kick the smoking habit.”

The researchers did find a possible benefit in older mothers-to-be and in individuals further along in their pregnancies. However, finding from such smaller subgroups are considered “hypothesis-generating,” meaning they can point to trends that merit further study. They cannot provide conclusive evidence that a treatment provides a health benefit. You can read more about subgroups and their limitations here.

The bottom line here seems to be that the messages were not very influential, although the news release portrays the effort as a success story. And that misleading framing has already been carried through to some news stories about the study. Other journalists looking into the study should tread carefully.

Why This Matters

Mothers-to-be smoking while pregnant poses health harms for fetuses and early childhood, yet a reported 10 percent of pregnant women continue to smoke. Figuring out ways to persuade them to stop has merit.

Criteria

Does the news release adequately discuss the costs of the intervention?

Not Satisfactory

It is not made clear what costs would accompany this kind of mobile health message strategy, and whether the costs would be absorbed by health plans and health care providers that use the service, or by individual patients.

Wide use presumes thousands of app downloads and significant infrastructure costs on the part of those maintaining the service.

It’s assumed there is profit motive, given the licensing agreement.

Does the news release adequately quantify the benefits of the treatment/test/product/procedure?

Satisfactory

The release appropriately describes the outcomes in absolute terms. For example, “16 percent of the women who were enrolled in both Text4baby and Quit4baby had quit compared with just 11 percent of women getting just Text4baby.”

But while the body of the release clarifies that this difference between groups was not statistically significant, the headline and lead sentence gloss over this fact. We’ll address that issue below under the Evidence criterion.

Does the news release adequately explain/quantify the harms of the intervention?

Not Applicable

There is no mention of harms but it’s hard to imagine there are any harms from voluntarily receiving from 1 to 8 text messages a day. We’ll rate this Not Applicable.

Does the news release seem to grasp the quality of the evidence?

Not Satisfactory

The headline and lead sentence of the release are an exercise in spin. The reduction in smoking rates for the study overall was not statistically significant — full stop. That should have been the headline. It’s not acceptable for the release to bury the lack of statistical significance in the body of the text while claiming benefits in the headline.

The researchers did report statistically significant reduction in smoking rates among smaller subgroups of the main study. However, findings from such limited subgroups should be interpreted very cautiously, and a positive subgroup finding should never be the headline if the overall results of the study were negative.

Does the news release commit disease-mongering?

Satisfactory

No disease mongering here. Risks to fetuses from smoking are real.

Does the news release identify funding sources & disclose conflicts of interest?

Satisfactory

The release offers information about both funding and conflicts of interest. It notes that the lead author, “Dr. Abroms has stock in Wellpass Inc. (formerly Voxiva, Inc.) and has licensed Text2quit and Quit4baby to Wellpass.” This is a real strength of the release.

Does the news release compare the new approach with existing alternatives?

Not Satisfactory

The text makes the point that there’s scarce assistance for quitting smoking for pregnant women since some stop-smoking aids carry additional risks. But we think the release should have mentioned some of those alternatives that do exist — quitting cold turkey, gradual quitting, nicotine replacement, medications like bupropion, and counseling. Options that include medications should include consultation with one’s doctor to weigh the risks and benefits of using smoking cessation aids during pregnancy.

Does the news release establish the availability of the treatment/test/product/procedure?

Not Satisfactory

Although the release notes that this experiment took place within the confines of an “established” text messaging program (Text4baby), the availability of the “Quit4baby” sub-program, which is the focus of the research, is not clear.

Does the news release establish the true novelty of the approach?

Satisfactory

The release notes that very little is available to assist pregnant women with smoking cessation, so a new intervention is noteworthy. The original research article references a small number of pilot studies of attempts to use social media and text messaging to convince pregnant women to stop smoking.

Does the news release include unjustifiable, sensational language, including in the quotes of researchers?

Satisfactory

The main message of the release is misleading if not deceptive. However, we’ve already addressed that issue and see no other unjustified statements that would merit a Not Satisfactory rating here.

Total Score: 5 of 9 Satisfactory

Comments

We Welcome Comments. But please note: We will delete comments left by anyone who doesn’t leave an actual first and last name and an actual email address.

We will delete comments that include personal attacks, unfounded allegations, unverified facts, product pitches, or profanity. We will also end any thread of repetitive comments. Comments should primarily discuss the quality (or lack thereof) in journalism or other media messages about health and medicine. This is not intended to be a forum for definitive discussions about medicine or science. Nor is it a forum to share your personal story about a disease or treatment -- your comment must relate to media messages about health care. If your comment doesn't adhere to these policies, we won't post it. Questions? Please see more on our comments policy.

COMMENTS button We welcome comments, which users can leave at the end of any of our systematic story reviews or at the end of any of our blog posts.

But before leaving a comment, please review these notes about our policy.

You are responsible for any comments you leave on this site.

This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.

We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.

We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.

There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”

The authors of the Retraction Watch comments policy urge commenters:

“Shed light, not just heat. Facts, challenges, disagreements, corrections — those are all fine. Attacking the person, instead of the idea or the interpretation, is neither acceptable nor helpful.”

We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.

And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.

The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.