Do ADHD meds prevent future substance abuse? An observational study can’t prove that.

Does the news release adequately discuss the costs of the intervention?

Not Satisfactory

There was no discussion of costs. It would have been helpful to include the average cost of ADHD drugs with and without insurance. A 30-day supply of generic Adderall averages $25, according to GoodRx.

Does the news release adequately quantify the benefits of the treatment/test/product/procedure?

Not Satisfactory

The release notes that, “The risk of substance use problems during periods of medication use was 35 percent lower in men and 31 percent lower in women in the study.”  The release doesn’t give us any indication of what “problems” the authors were referring to. Further, this is purely an observational finding and does not prove cause and effect.

We were also concerned that the release conflated the odds ratio and risk.

We’ve written before about how it is tricky to refer to odds ratios when writing about clinical trials since the results always seem more impressive when using odds ratios instead of relative or absolute risks. The two numbers — odds ratio and relative risk — can be quite close when the outcome of interest happens rarely (say less than 10 percent). Otherwise, they can be drastically different and we should be told the relative risk. There’s a rather simple formula for converting odds ratio to relative risk. A google search reveals several such calculators.

Does the news release adequately explain/quantify the harms of the intervention?

Not Satisfactory

The release did not make any mention of potential side effects of stimulants used to treat ADHD. Common side effects include headache, upset stomach, increased blood pressure, dizziness, decreased appetite, insomnia and dry mouth.

Does the news release seem to grasp the quality of the evidence?

Not Satisfactory

The release briefly described how the study was conducted, but didn’t offer any analysis on what the methods meant for the quality of the evidence. The release didn’t mention any limitations of the study. One thing that could have used more clarification was the term “substance use,” and how it was defined. The study looked at trips to the emergency room because of drugs or alcohol, but there are many substance users that don’t go to the emergency room. Emergency room visits were used as a surrogate marker of general substance abuse, but the release made no mention of that.

Furthermore, the researchers collected data from a database of employee health insurance coverage, meaning everyone in their sample was employed and had commercial insurance. This automatically leaves out anyone who is unemployed, has personal insurance, or paid for their emergency room trip via cash or other methods.

Other limitations that should have been mentioned: the fact that this was an observational study so it is unable to prove causality, and the fact that the researchers did not have enough data to calculate long-term benefits among the women of the study.

Does the news release identify funding sources & disclose conflicts of interest?

Not Satisfactory

The release noted the funders but did not mention any of the authors’ conflicts of interest. One of the authors has served as a speaker for Eli Lilly and Shire, and was awarded a research grant from Shire. Shire produces ADHD medications, including Vyvanse and Adderall. Eli Lilly also produces an ADHD medication, Strattera. This is a big conflict of interest that should have been noted in the release, particularly since both Adderall and Strattera were mentioned by brand name in the release.

Does the news release compare the new approach with existing alternatives?

Not Satisfactory

The release did not mention any alternatives for treating ADHD such as non-stimulant medications or cognitive behavioral therapy.