There are many bold statements made in this story about the single patient that is the focus of the piece and about the efficacy of different treatments for migraines. Yet no evidence is analyzed or presented to back up these claims. The person with severe migraines is presented here as a pitiable character experiencing extreme pain and resistant to all efforts at treatment. She eventually finds help through dietary changes and exercise, but we’re not offered any proof, beyond the story’s assurance and an expert’s opinion, that such changes have been shown to be broadly effective for people with migraines. The story does include a discussion of the harms caused by too much diagnostic testing in people with headaches that was very valuable. But the message about treatment is not nearly as strong as it could have been with support from real evidence.
Many people suffer from chronic headache. It interferes with jobs, relationships, quality of life, and adds to healthcare costs.
Costs are not discussed in any way, either for the treatments that the woman at the heart of this story ostensibly underwent or the handful of alternatives tossed in at the end of the story.
When you first read the headline of this story — “For Headaches, A Lifestyle Change May Be Better Than A Doctor Visit” — you assume that it will show you evidence of lifestyle changes improving a significant number of people’s lives where medicine has failed. The story does not do that. It provides no quantification of the benefits of lifestyle changes and, in fact, does not even mention them until the final two paragraphs of the story.
A strong point of this story is that it does explore the potential harm from unnecessary diagnostic tests. We applaud the mention, as too few stories address this phenomenon, but the facts that are presented to help the audience understand why a test would be harmful are somewhat confusing. The story says:
Mafi’s study did not include patients with tumors or other serious problems that can cause headaches. He only looked at otherwise healthy patients who suffered chronic headaches. And in these cases, repeated diagnostic testing can lead to further unnecessary procedures like biopsies. On top of that, exposure to radiation in tests like CT scans adds up over time and can increase the risk of certain cancers.
In other words, diagnostic tests could find something like a tumor that is causing a headache or early bleeding in the brain prior to an aneurysm, for example. But those people weren’t part of this study so we have no way to make a true comparison to people who had a test and found a problem versus people who had an unnecessary test.
The story should have explained the exclusion of patients with tumors more clearly. The patients here are chronic headache patients, as opposed to people who have developed headache as a new symptom or a new type of headache. Depending on their presentation, the latter two may need a series of tests.
The entire story is framed by the idea that more and more people are being diagnosed with migraine headaches and are likely receiving unnecessary and potentially harmful tests. The clinicians are presented in this story as experts in migraines and migraine treatment. In one case, a study about diagnostic tests is referenced with no examination of the quality of that study. How many people? Under what conditions? Were the findings published in a peer reviewed journal? In the other case, the story presents as fact that patients are changing their diets or exercising more and seeing their migraines go away. The story says:
Some people find relief through exercise. “I write an exercise prescription probably as often as I write a prescription for medication,” Bernstein says. She acknowledges it’s sometimes difficult to encourage a patient with cracking head pain to get up and exercise. But even a little can help, and according to Bernstein it doesn’t have to be jogging for miles and miles. It can be yoga, tai chi or even just a little stretching.
The story is implying that “just a little stretching” is just as effective at reducing migraines as medication. Maybe it is, but we aren’t provided enough information about how this evidence was analyzed to make that judgment.
We’re flagging the story for several problems that collectively rise to the level of Not Satisfactory:
1. The narrow focus on one patient’s extreme experience with migraines compared to the lack of focus on any meaningful evidence about how to relieve migraine symptoms.
2. The extrapolation of this one patient’s experience to “12 million Americans” and then to “one quarter of the population,” which would be about 80 million people. This seems high, and there is no reference provided for the number.
3. The anecdotal evidence presented as fact without any attempt to back it up. The story says:
Over the years, Bradford, who is 50 years old and lives in Bedford, Mass., has searched desperately for pain relief. She’s been to the doctor countless times for countless tests. “Everything I’ve had, I’ve had twice,” she says. “I’ve had two spinal taps; I’ve had so many nerve blocks I’ve lost count.”
Has she really been to the doctor so many times that it is impossible to count? This feels needlessly dramatic. Perhaps a walk through the woman’s documented medical history would have supported the same point without that feeling of over-dramatization. Even well-meaning people can provide misleading information about their own medical histories, especially if a condition has been ongoing for years.
Those three components make this story feel off-kilter, and take the focus off of the thoughtful exploration of potential solutions.
It’s not clear whether either of the clinical sources in this story have any conflicts of interest or particular agendas. But in both cases they are commenting on areas where they couldn’t be considered objective. In one case, the source discusses a study that he coauthored, and in the other case, the source discusses the treatment of one of her patients. We’ll give the benefit of the doubt, because the second source speaks mainly about headaches in general rather than the patient discussed in the story. Ideally, a completely independent expert would have been tapped to question and evaluate the evidence presented.
The story mentions alternatives to medical or surgical treatment in the last two paragraphs of the story but it does not explain the relative benefits or harms of any approach.
If the concept is that lifestyle changes are effective at treating migraines, then it is assumed that people can change their diets or exercise more no matter where they live. The story supports that impression, and we’ll award a satisfactory on that basis. For extra credit, the story could have elaborated on why it was so hard for the woman in this story to find a doctor to prescribe this kind of therapy. Are doctors who embrace this approach difficult to locate? If these approaches are effective, why aren’t they more widely used?
Studies and articles documenting over-use of tests and their lack of benefit for specific diseases are still few in number. However, the story does not establish that fact or address the novelty of this line of research. Nor does it establish that the evidence presented about the efficacy of lifestyle changes for treating migraines is or isn’t novel.
The story does not rely on a news release.