Note to our followers: Our nearly 13-year run of daily publication of new content on HealthNewsReview.org came to a close at the end of 2018. Publisher Gary Schwitzer and other contributors may post new articles periodically. But all of the 6,000+ articles we have published contain lessons to help you improve your critical thinking about health care interventions. And those will be still be alive on the site for a couple of years.
Read Original Story

Well-written, Newsweek’s look at blood tests for mental illnesses needed more hard data

Rating

3 Star

Categories

CAN BLOOD TESTS DETECT SCHIZOPHRENIA AND OTHER MENTAL ILLNESSES?

Our Review Summary

Young woman is going to donate blood in blood bankThis is a story looking at the possibilities for developing lab tests for mental illness diagnoses, primarily schizophrenia and bipolar disorder.

The story covers a wide array of information, and that’s not a simple task given the topic. Synthesizing years of research can be tough, and we don’t envy the challenge.

However, the story needed a more thorough examination of the quality of the evidence for the various research studies that are mentioned, a better quantification of the benefits that are mentioned, some mention of the risks involved in widespread screening for mental disorders, and a sense of the costs that would be involved.

 

Why This Matters

Given the prevalence of mental illness, any tools to help improve diagnostics is a welcome development. For readers, it’s important to discuss the unknowns and limitations of new screening tests, along with factors that affect accuracy, such as the false-positive and false-negative rate.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

There is no mention of costs in this piece. With the variety of tests that are being discussed, it would have been possible to at least mention a range of possible costs per test.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

In a piece with multiple studies mentioned, there was no quantification of any of the benefits found in any of those studies. Readers won’t find out if these tests found five people with various disorders or 500.

We were also concerned about overstatement of the benefits of this study: “The test, says Bahn, can accurately predict whether someone will ‘develop schizophrenia over the next two years.'” What does the story mean by “accurate” here? We encourage journalists to always discuss and define the test’s sensitivity (how well the test finds people who have the disease) and specificity (how well the test rules out people who don’t have the disease). In this story, we’re not given any data points to see how this conclusion was made. And there’s a general sense given to the reader that biomarker-based assessments would clearly be superior to diagnostic interviews, something that’s not supported by any evidence presented in the story.

Does the story adequately explain/quantify the harms of the intervention?

Not Satisfactory

There are no potential harms mentioned, and yet screening carries the potential for harm because of false positive and false negative rates that may lead to the wrong intervention.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

It is unclear in most of the examples of research cited how many people were being studied, the circumstances of the study, whether these were controlled trials, etc. In a few cases, a journal name is mentioned, which is helpful. But much more could have been done to give readers a sense of how solid this research is.

Does the story commit disease-mongering?

Satisfactory

There is no disease mongering in this piece, and we give it high marks for how it approaches the topic of mental health. It is trying to bring readers into the very real problem of accurately diagnosing these disorders. In that way, it is a very welcome piece of reporting.

However, we did want to note that saying a delayed diagnosis may come “too late” is somewhat hyperbolic–it implies that there is a limited period in which prevention or effective treatment is possible, and after that, it’s no longer possible. This is not always the case.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

The story interviews a patient, a professor who is an expert in mental disorders, and a researcher looking at one avenue for biomarker identification. It’s also clear that the reporter read through a lot of studies to develop this piece.

However, the story doesn’t point out that source Dr. Sabine Bahn has apparent financial stakes in the success of this blood test.

Does the story compare the new approach with existing alternatives?

Satisfactory

The story does not perform any head-to-head comparisons between traditional diagnostic methods and biological testing, but we feel the framing of the story gets the point across that there are traditional ways of diagnosing these disorders and a promising wave of new biological tests.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

The story goes into some detail about how experimental these diagnostic tests are and even some of the difficulties entailed in bringing them to market.

Does the story establish the true novelty of the approach?

Satisfactory

It’s made clear that lab-based biomarker diagnostic tests for mental illnesses would be novel.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story does not rely on any news releases, as far as we can tell.

Total Score: 5 of 10 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.