NOTE TO READERS: When this project lost substantial funding at the end of 2018, I lost the ability to continue publishing criteria-driven news story reviews and PR news release reviews - once the bread-and-butter of the site going back to 2006. The 3,200 archived reviews, while still educational, are getting old and difficult for me to technically maintain on the back end of the website. So I am announcing that I plan to remove these reviews from the site by April 1, 2021. The blog and the toolkit - two of the most popular features on the site - will remain. If you wish to peruse the reviews before they disappear, please do so by the end of March 2021. After that date you may still be able to access them via the Internet Archive Wayback Machine - https://archive.org/web/.
Read Original Story

AP story on ‘selfie medicine’ adherence programs overlooked evidence showing they don’t work well

Rating

3 Star

Categories

Tags

Selfie medicine: Phone apps push people to take their pills

Our Review Summary

This story about the potential use of smartphone apps to monitor how well patients stick to their prescriptions is clear that the technology still has to prove itself. It includes concerns about privacy and data security.

But, the story did not adequately report relationships between some sources and app developers. Also, the story could have done a better job highlighting the possibility that these apps may not provide the benefits that fans hope for, especially for people who have limited access to smartphones (or limited ability to use them).

 

Why This Matters

News stories do not always need to wait for conclusive studies before reporting on new medical interventions, but when reporters tackle speculative topics it is important to balance the promises offered by advocates with a clear discussion of the potential for failure. Readers should have been told about existing studies of similar technologies that failed to demonstrate benefits or found ways that things could go wrong.

Criteria

Does the story adequately discuss the costs of the intervention?

Not Satisfactory

Although the story does include some discussion of costs, the specifics implied that smartphone app systems are inherently less expensive than alternatives. However, as the story points out, the actual costs and effectiveness of the apps discussed are still being studied. The hoped-for cost savings might not materialize. It’s possible that the apps might be cheaper, but also less effective, perhaps leading to more expensive remedial interventions or poorer health outcomes. The story did not address several important cost questions. Even if insurers or public programs paid for the apps, who would pay for the smartphones, data plans and other costs? For people with low incomes, these costs could create barriers to treatment.

Does the story adequately quantify the benefits of the treatment/test/product/procedure?

Not Applicable

The story does not claim that smartphone apps are beneficial, just that the potential benefits are being studied.

Does the story adequately explain/quantify the harms of the intervention?

Satisfactory

The story noted privacy and data security concerns near the top and expanded on them in the body of the piece. The story would have been more balanced if it had declared more strongly that while these apps could be helpful, until studies are done, it is also just as possible that they could be useless or even harmful in ways that were not discussed in the story, such as diverting patients from proven interventions.

Does the story seem to grasp the quality of the evidence?

Not Satisfactory

The story clearly states that the smartphone apps still need to be studied. It labeled supporters as “fans,” which helps to convey that their arguments are at least partly based on beliefs that go beyond the available evidence.

But, the story should have provided more context for readers by noting the disappointing results of evidence that has been completed. For example, in a UCSF study, “participants were unable to fully navigate the apps’ functions, and most expressed frustration and disappointment with the experience.” A recent study of medication adherence apps, the subject of this story, found a “concerning lack of [health care professional] involvement in app development and evidence base of effectiveness.”

Does the story commit disease-mongering?

Satisfactory

The story uses examples of health conditions in which medication adherence is known to affect outcomes. It could have been clearer that treatment for tuberculosis is temporary, whereas treatment for opioid use disorder may be more extended and thus affect retention rates.

Does the story use independent sources and identify conflicts of interest?

Not Satisfactory

While the story does include a couple of independent sources, it could have done a better job identifying the connections between other sources and industry. The story does not tell readers that Dr. Judith Tsui is an advisor to the company developing the app she is studying. Another quoted source, Alain Litwin, appears to have received consulting fees from several pharmaceutical companies. The story does identify one proponent of smartphone apps, Dr. Richard Garfein, as a co-developer of an app.

Does the story compare the new approach with existing alternatives?

Satisfactory

We will give the story a satisfactory rating on this criterion because it does discuss existing methods for monitoring medication adherence and it makes clear that the apps mentioned still need to be studied. However, the overall tone of the story implies confidence that the apps will prove themselves to be more efficient than current methods, which is a proposition that has yet to be adequately tested.

Does the story establish the availability of the treatment/test/product/procedure?

Satisfactory

The story reports that these apps are available in pilot programs and studies. It also refers to Skype, which most readers will know is generally available. One issue that remains to be seen is how accessible these apps will be to lower-income or homeless people, or those who have limited technology experience and/or limited eyesight.

Does the story establish the true novelty of the approach?

Satisfactory

The story describes how proponents of smartphone apps describe what’s new about these smartphone apps.

Does the story appear to rely solely or largely on a news release?

Satisfactory

The story discusses a number of different apps and quotes sources from a variety of institutions.

Total Score: 6 of 9 Satisfactory

Comments

Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.