Yesterday we profiled a Wall Street Journal column about the statistical flaws in some studies. Today we point out a Los Angeles Times column that gives readers a better understanding of the strengths and weaknesses of epidemiologic studies. Excerpts:
“(Critics say that) far too many of these epidemiological studies — in which the habits and other factors of large populations of people are tracked, sometimes for years — are wrong and should be ignored.
In fact, some of these critics say, more than half of all epidemiological studies are incorrect.
The studies can be influential. Often, in response to them, members of the public will go out and dose themselves with this vitamin or that foodstuff.
And the studies also influence medical practice — doctors, the critics note, encouraged women to take hormones after menopause long before their effects were tested in randomized clinical trials, the gold standard of medical research.
Some of epidemiology’s critics are calling for stricter standards before such studies get reported in medical journals or in the popular press.
(One) of the foremost critics argues that epidemiological studies are so often wrong that they are coming close to being worthless. “We spend a lot of money and we could make claims just as valid as a random number generator,” he says.
Epidemiology’s defenders say such criticisms are hugely overblown.
They are “quite simplistic and exaggerated,” says Dr. Meir Stampfer, a professor of epidemiology and nutrition at the Harvard School of Public Health and a professor of medicine at Harvard Medical School.
…The debate is unlikely to be resolved any time soon. “If you put five epidemiologists and five statisticians in a room and have this debate,” (one critic) says, “and try to get each one to convince the other side, at the end of the day it will still be five to five.”
The important thing for journalists and for readers to understand is that there is a hierarchy of evidence – and that not all studies hold equal weight or power to point to a conclusion. Both the Wall Street Journal and Los Angeles Times stories are important in reminding us of that.
Comments
Please note, comments are no longer published through this website. All previously made comments are still archived and available for viewing through select posts.
Comments are closed.
Our Comments Policy
But before leaving a comment, please review these notes about our policy.
You are responsible for any comments you leave on this site.
This site is primarily a forum for discussion about the quality (or lack thereof) in journalism or other media messages (advertising, marketing, public relations, medical journals, etc.) It is not intended to be a forum for definitive discussions about medicine or science.
We will delete comments that include personal attacks, unfounded allegations, unverified claims, product pitches, profanity or any from anyone who does not list a full name and a functioning email address. We will also end any thread of repetitive comments. We don”t give medical advice so we won”t respond to questions asking for it.
We don”t have sufficient staffing to contact each commenter who left such a message. If you have a question about why your comment was edited or removed, you can email us at feedback@healthnewsreview.org.
There has been a recent burst of attention to troubles with many comments left on science and science news/communication websites. Read “Online science comments: trolls, trash and treasure.”
The authors of the Retraction Watch comments policy urge commenters:
We”re also concerned about anonymous comments. We ask that all commenters leave their full name and provide an actual email address in case we feel we need to contact them. We may delete any comment left by someone who does not leave their name and a legitimate email address.
And, as noted, product pitches of any sort – pushing treatments, tests, products, procedures, physicians, medical centers, books, websites – are likely to be deleted. We don”t accept advertising on this site and are not going to give it away free.
The ability to leave comments expires after a certain period of time. So you may find that you’re unable to leave a comment on an article that is more than a few months old.
You might also like