Read Original Story

A 50% reduction in suicide risk? NPR story overstates the benefits of ‘Safety Planning Intervention’

Rating

3 Star

Categories

Tags

A Simple Emergency Room Intervention Can Help Cut Suicide Risk

Our Review Summary

This article reports results of a study on the effectiveness of the Safety Planning Intervention (SPI), a simple intervention conducted by staff in emergency departments when a patient has been treated for an attempted suicide. The intervention involves creating a safety plan for each patient and following up with phone calls after discharge.

The story — and the study that it’s based on — both tout that SPI reduced the risk of short-term suicidal behavior in half. That’s a misleading way to frame the results. More precisely, 3.03% of the patients who received the SPI intervention engaged in suicidal behavior within six months of discharge, compared to 5.29% of those receiving usual care. This is a key example of why news stories should report the absolute risk reduction.

 

Why This Matters

Suicide is one of the top ten leading causes of death in the United States. Almost 45,000 people died as a result of suicide in 2016. Many of these people are treated in emergency departments. Unfortunately, nearly half of suicide patients do not attend treatment afterward, or discontinue treatment quickly. Yet risk for repeated suicidal behavior is greatest during the first 6 months following a suicidal crisis. Thus, emergency department personnel may be the only point of mental health care at a critical time in these patients’ lives.

A brief SPI intervention that helps patients and their families plan how to deal with suicidal thoughts and provides follow-up care could make a critical difference. But news stories must be careful to explain the study–and its limitations–so that people come away understanding what it couldn’t measure (see evidence quality, below).

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

We’re told the intervention takes a few minutes up to two hours for nurses or social workers to administer when a patient comes to the emergency room after a suicide attempt. We assume this counseling is provided at no additional cost, but we’d like to know for certain. One possible additional cost is having a delegated staff person in the ED at all times to accommodate these patients. Also, there may be cost savings in not having these patients wait for a full psychiatric evaluation by a psychiatrist or a psychiatric social worker or nurse.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

The story explains that people who received the Safety Planning Intervention cut their odds of repeated suicidal behavior in the next six months by nearly half. But that what’s known as the relative risk reduction, and it’s not the full picture.

More precisely, 3.03% of the patients who received the SPI intervention engaged in suicidal behavior compared to 5.29% of those receiving usual care. This is a key example of why news stories should report the absolute risk reduction.

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

Patients could be potentially harmed if a hospital relies too heavily on the SPI instead of more thorough and immediate psychiatric care. For example, if a patient with a serious mental illness isn’t diagnosed and treated promptly.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The story informs us that the study involved 1,200 patients at 5 VA hospitals around the country who were given the treatment, compared to patients at 4 hospitals who were just sent home, and therefore served as a comparison group.

But the full picture is more complicated. The story doesn’t note that this wasn’t actually a randomized controlled trial — medical records were used for the control group instead of actively enrolling patients. Also, patients who were admitted to inpatient care directly from the emergency room were excluded from the trial–so the data may only reflect lower-risk patients–and not all patients with suicidal ideation. As the study authors note, this also may explain in part why the number of suicide attempts post-hospital were low in both groups. We just don’t how this intervention helps higher-risk patients.

Lastly, the patients were all mostly middle-aged military men, so we don’t know if the intervention will have similar results for other groups.

Does the story commit disease-mongering?

Satisfactory

Suicide is the 10th leading cause of death in the United States overall and suicide rates have increased by more than 30% in half of U.S. states since 1999. Suicide rates are especially high among middle-aged men and veterans. This story doesn’t inflate the prevalence.

Does the story use independent sources and identify conflicts of interest?

Satisfactory

Two expert sources not involved with the study are cited, and we didn’t detect any conflicts of interest that should have been disclosed.

Does the story compare the new approach with existing alternatives?

Not Satisfactory

The story doesn’t adequately explain what the alternatives are–if a hospital doesn’t have this protocol in place, what normally happens with suicidal patients?

There’s some history of alternative approaches that could have put this intervention into context. Up until 10 years ago “no-suicide contracts” were commonly used after emergency department visits, but they were repeatedly shown to be ineffective. Around that time, safety plans were recommended as an alternative, and clinical trials among active duty military found them to lower suicide risks. Post-discharge follow-up by in-person visit or phone calls was also shown to lower suicidal behavior by up to 30%. The authors of this study, then, developed and evaluated a combination of the two approaches.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

We’re told that the SPI approach is becoming increasingly more available in hospitals across the country.

Does the story establish the true novelty of the approach?

Satisfactory

This is the first large-scale test of the SPI intervention, so even though it is already being used in many emergency departments, the evidence for effectiveness is new.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story did not appear to rely on the news release.

Total Score: 5 of 10 Satisfactory

Comments

We Welcome Comments. But please note: We will delete comments left by anyone who doesn’t leave an actual first and last name and an actual email address.

We will delete comments that include personal attacks, unfounded allegations, unverified facts, product pitches, or profanity. We will also end any thread of repetitive comments. Comments should primarily discuss the quality (or lack thereof) in journalism or other media messages about health and medicine. This is not intended to be a forum for definitive discussions about medicine or science. Nor is it a forum to share your personal story about a disease or treatment -- your comment must relate to media messages about health care. If your comment doesn't adhere to these policies, we won't post it. Questions? Please see more on our comments policy.