June 19, 2017 Read Original Release

Basic numbers needed to back claims of effectiveness for insomnia therapy

Reviewed By

Rating

Online cognitive behavioral therapy for insomnia is effective for military

Our Review Summary

When claiming something is “effective” always have back-up. Researchers at the University of North Texas announced that cognitive behavioral training for insomnia (CBTi) delivered through the internet was more helpful than no CBTi for military personnel, but that in-person therapy was better than both, according to a small randomized study. The release doesn’t put the benefit of the therapy in any context for readers so we can know how much the online training helped — was it a little or a lot? A discussion of cost and study limitations would have made the release much stronger.

Why This Matters

For military personnel who face unique job demands, a safe and effective treatment for sleep disturbances seems to be a high priority. This study tried to assess if cognitive behavioral therapy could be delivered as effectively via the internet, versus in-person, or minimal contact (infrequent phone calls) intervention. Since military personnel are often deployed in locations where in-person CBTi might be difficult to arrange, such research could lead to better deployment of resources. Since insomnia is linked to “post-traumatic stress disorder, depression and substance abuse, absenteeism and occupational accidents,” according to Daniel Taylor, University of North Texas professor of psychology and director of UNT’s Sleep Health Research Laboratory, it is an important condition to try to improve for these serving military personnel.

Criteria

Does the news release adequately discuss the costs of the intervention?

Not Satisfactory

Obviously there are likely major differences in costs associated with in-person CBTi versus internet-delivered CBTi so it is unfortunate these were not discussed in this release.

The only mention of cost was that of the $1.16 million grant the University received for the 6-week study.

Does the news release adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

There were numbers to back up the claimed benefits. The only references to benefits are very vague: “the study participants who received in-person cognitive behavioral treatment for their insomnia reported significantly greater improvements in sleep quality — as determined by the sleep diaries and activity monitors — than those who received the Internet therapy. Both groups had greater improvements in sleep quality than those who did not receive cognitive behavioral therapy. ”

The release could have given some stats from the sleep diaries kept by the participants or data collected from the the activity monitors (he “Actiwatch”) they were asked to wear.

The release provides somewhat better context for understanding benefits when describing an unrelated study in civilians in which “cognitive behavioral therapy led to significant improvements in sleep efficiency, with the research subjects’ use of sleep medication declining from 87.5 percent before therapy to 54 percent afterward…”

Does the news release adequately explain/quantify the harms of the intervention?

Not Satisfactory

There are no harms mentioned in the release. According to the scientific paper, “AEs [adverse events] determined to be related to the research included one patient with an increase in insomnia after primary care physician reduced hypnotic medication and six patients with skin irritation from wearing the Actiwatch.” While these appear to be minimal, releases should still try to address any potential harms.

Does the news release seem to grasp the quality of the evidence?

Not Satisfactory

The release describes the 3-armed nature of the randomized trial and the number of study participants (100).

Unfortunately, the release doesn’t describe any limitations of the research. The published report suggests the trial may have been under-powered. Researchers wrote that they intended to have 63 participants per treatment group in order to have the recommended power of 80 percent to observe how the intervention affected sleep efficiency. Instead they had 33 per group.

The release should also have mentioned that the Internet CBTi participants were more than twice as likely to drop out of treatment and that a high percentage of participants did not complete the 6-month follow-up to assess longer term results: “Dropout from the study was higher at the 6-month follow-up assessment (42%–59%).”

Does the news release commit disease-mongering?

Satisfactory

No signs of disease mongering here. The release also provides some context on what chronic insomnia is and how it is a risk factor for other health conditions.

Does the news release identify funding sources & disclose conflicts of interest?

Satisfactory

The release names the funding source. The researchers reported no conflicts of interest.

Does the news release compare the new approach with existing alternatives?

Satisfactory

The release describes how two types of CBTi (online and in-person) compared. It mentions medications are used as a therapy for about 10 percent of the deployed military but that they can leave people groggy and with slow cognitive processing and reaction times — which are dangerous in conflict zones.

Does the news release establish the availability of the treatment/test/product/procedure?

Not Satisfactory

The extent to which Internet-delivered CBTi is available for military personnel or the general public isn’t mentioned.

Does the news release establish the true novelty of the approach?

Satisfactory

The release doesn’t claim novelty. It references previous work that showed CBTi helped reduce the dependence on sleeping medications in the general population.

Does the news release include unjustifiable, sensational language, including in the quotes of researchers?

Satisfactory

There was no inappropriate or unjustifiable language used to describe this study.

Total Score: 5 of 10 Satisfactory

Comments

We Welcome Comments. But please note: We will delete comments left by anyone who doesn’t leave an actual first and last name and an actual email address.

We will delete comments that include personal attacks, unfounded allegations, unverified facts, product pitches, or profanity. We will also end any thread of repetitive comments. Comments should primarily discuss the quality (or lack thereof) in journalism or other media messages about health and medicine. This is not intended to be a forum for definitive discussions about medicine or science. Nor is it a forum to share your personal story about a disease or treatment -- your comment must relate to media messages about health care. If your comment doesn't adhere to these policies, we won't post it. Questions? Please see more on our comments policy.

COMMENTS button We welcome comments, which users can leave at the end of any of our systematic story reviews or at the end of any of our blog posts.

But before leaving a comment, please review these notes about our policy.

You are responsible for any comments you leave on this site.

This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.

We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.

We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.

There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”

The authors of the Retraction Watch comments policy urge commenters:

“Shed light, not just heat. Facts, challenges, disagreements, corrections — those are all fine. Attacking the person, instead of the idea or the interpretation, is neither acceptable nor helpful.”

We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.

And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.

The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.