Why most biomedical findings echoed by newspapers turn out to be false: the case of attention deficit hyperactivity disorder

PLoS One. 2012;7(9):e44275. doi: 10.1371/journal.pone.0044275. Epub 2012 Sep 12.

Abstract

Context: Because positive biomedical observations are more often published than those reporting no effect, initial observations are often refuted or attenuated by subsequent studies.

Objective: To determine whether newspapers preferentially report on initial findings and whether they also report on subsequent studies.

Methods: We focused on attention deficit hyperactivity disorder (ADHD). Using Factiva and PubMed databases, we identified 47 scientific publications on ADHD published in the 1990s and soon echoed by 347 newspapers articles. We selected the ten most echoed publications and collected all their relevant subsequent studies until 2011. We checked whether findings reported in each "top 10" publication were consistent with previous and subsequent observations. We also compared the newspaper coverage of the "top 10" publications to that of their related scientific studies.

Results: Seven of the "top 10" publications were initial studies and the conclusions in six of them were either refuted or strongly attenuated subsequently. The seventh was not confirmed or refuted, but its main conclusion appears unlikely. Among the three "top 10" that were not initial studies, two were confirmed subsequently and the third was attenuated. The newspaper coverage of the "top 10" publications (223 articles) was much larger than that of the 67 related studies (57 articles). Moreover, only one of the latter newspaper articles reported that the corresponding "top 10" finding had been attenuated. The average impact factor of the scientific journals publishing studies echoed by newspapers (17.1 n = 56) was higher (p<0.0001) than that corresponding to related publications that were not echoed (6.4 n = 56).

Conclusion: Because newspapers preferentially echo initial ADHD findings appearing in prominent journals, they report on uncertain findings that are often refuted or attenuated by subsequent studies. If this media reporting bias generalizes to health sciences, it represents a major cause of distortion in health science communication.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Attention Deficit Disorder with Hyperactivity / drug therapy
  • Attention Deficit Disorder with Hyperactivity / genetics
  • Attention Deficit Disorder with Hyperactivity / pathology*
  • Biomedical Research*
  • Communications Media
  • Dopamine Plasma Membrane Transport Proteins / genetics
  • Genetic Predisposition to Disease
  • Humans
  • Journal Impact Factor
  • Meta-Analysis as Topic
  • Newspapers as Topic*
  • Receptors, Dopamine D4 / genetics
  • Substance-Related Disorders / pathology
  • Universities

Substances

  • DRD4 protein, human
  • Dopamine Plasma Membrane Transport Proteins
  • Receptors, Dopamine D4

Grants and funding

This work was supported by the Centre National de la Recherche Scientifique (CNRS UMR 5293 and UPR 3255), the University of Bordeaux and by grants from the Région Aquitaine, from the Institut des Sciences de la Communication du CNRS (ISCC) and from the Agence Nationale de la Recherche (ANR VSN-RAP). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.