Healthy Skepticism Library item: 1833

Warning: This library includes all items relevant to health product marketing that we are aware of regardless of quality. Often we do not agree with all or part of the contents.

Publication type: news

Follow-Up Studies Often Contradict Earlier Research on Same Treatments
Medical News Today 2005 Jul 14
http://bmj.bmjjournals.com/cgi/content/full/331/7509/165?ehom

Keywords:
NEJM JAMA

Notes:

Ralph Faggotter’s Comments : This analysis shows that even the results of a good quality Randomised Controlled Trial must be viewed with caution until it’s findings are indepentently confirmed by further trials.

Full text:

Follow-Up Studies Often Contradict Earlier Research on Same Treatments, New JAMA Report Says
14 Jul 2005

Almost one-third of large medical studies published in three “influential” journals between 1990 and 2003 were later contradicted or found to overstate results, according to a report published on Wednesday in the… Journal of the American Medical Association, the AP/Las Vegas Sun reports. For the report, John Ioannidis, a researcher at the University of Ioannina in Greece, reviewed a number of large studies published in the New England Journal of Medicine, the Lancet and JAMA — 45 of which involved claims about the effectiveness of a medication or treatment. According to the report, later research contradicted the results of seven, or 16%, of the studies and found that an additional seven studies, or 16%, overstated results. The report found the subsequent research in those 14 cases — which included studies contradicting the original findings that hormone replacement therapy protected menopausal women from heart disease, that nitric oxide improved survival rates for patients with respiratory failure and that antibody treatment improved survival rates for some sepsis patients — involved larger numbers of participants or had improved designs. Ioannidis said, “Contradicted and potentially exaggerated findings are not uncommon in the most visible and most influential original clinical research.” However, Ioannidis added, “There’s no proof that the subsequent studies … were necessarily correct.” NEJM editors said in a statement that accompanied the report, “A single study is not the final word, and that is an important message.” JAMA Editor in Chief Catherine DeAngelis added that the media can contribute to the problem with misleading headlines that overstate the results of studies (Tanner,

Online An abstract of the study is available online.