New study finds publication bias among trials submitted to FDA

Nov 25, 2008

A quarter of drug trials submitted in support of new drug applications to the US Food and Drug Administration (FDA) remain unpublished five years after the fact, says new research published in the open access journal PLoS Medicine.

Among those trials published, unexplained discrepancies between the FDA submissions and their corresponding publications—the addition or deletion of outcomes, changes in the statistical significance of reported outcomes, and changes in overall trial conclusions—tended to lead to more favorable presentations of the drugs in the medical literature available to health care professionals.

Lisa Bero and colleagues from the University of California San Francisco reviewed the publication status of all 164 efficacy trials carried out in support of the 33 new drug applications (NDA) for new molecular entities approved by the FDA in 2001, and compared information from the FDA reviews with published journal articles. Seventy-eight percent of the trials were published. Trials with favorable outcomes for the drugs were more likely to be published as those without favorable outcomes. Of a total of 179 primary outcomes included in the NDAs, 41 were omitted from the papers. The papers included 138 outcomes that were also in the NDAs (77%), plus 15 additional outcomes that favored the test drug, and two other neutral or unknown additional outcomes. Thus, the papers included more outcomes favoring the test drug than did the NDAs, report the authors.

The research also found additional discrepancies between the FDA reviews and the published papers. Of the 43 primary outcomes reported in the NDAs that showed no statistically significant benefit for the test drug, only half were included in the papers; for five of the reported primary outcomes, the statistical significance differed between the NDA and the paper and generally favored the test drug in the papers. Nine out of 99 conclusions differed between the NDAs and the papers; each time, the published conclusion favored the test drug. The authors did not investigate why the discrepancies existed, nor whether the changes were prompted by the drug sponsor, authors, or journals.

Because of their findings of publication bias and selective reporting, the authors conclude that "the information that is readily available in the scientific literature to health care professionals is incomplete and potentially biased."

In a commentary on the research, An-Wen Chan from the Mayo Clinic in Rochester (uninvolved in the study) says this new research makes an important contribution to the growing body of evidence that the trial literature is skewed towards reporting favorable results. "Biased reporting of results from NDA trials is particularly concerning because these journal articles are the only peer reviewed source of information on recently approved drugs for health care providers, who will have had limited clinical experience with these new treatments," Dr Chan says. "There are also substantial cost implications if the efficacy is overestimated and the drugs overused."

Before a new drug is approved for the treatment of a specific disease in the United States and becomes available for doctors to prescribe, the drug's sponsors must submit a "New Drug Application" (NDA) to the FDA, which provides details of the drug's development from laboratory and animal studies through to clinical trials. FDA reviewers use this evidence to decide whether to approve a drug.

Citation: Rising K, Bacchetti P, Bero L (2008) Reporting bias in drug trials submitted to the Food and Drug Administration: A review of publication and presentation. PLoS Med 5(10): e217. doi:10.1371/journal.pmed.0050217
medicine.plosjournals.org/perl… journal.pmed.0050217

Source: Public Library of Science

Explore further: Medtronic spends $350M on another European deal

add to favorites email to friend print save as pdf

Related Stories

Recommended for you

Medtronic spends $350M on another European deal

9 hours ago

U.S. medical device maker Medtronic is building stronger ties to Europe, a couple months after announcing a $42.9 billion acquisition that involves moving its main executive offices across the Atlantic, where it can get a ...

Mind over matter for people with disabilities

Aug 26, 2014

People with serious physical disabilities are unable to do the everyday things that most of us take for granted despite having the will – and the brainpower – to do so. This is changing thanks to European ...

Ukraine's former world's tallest man dies

Aug 25, 2014

Ukraine's tallest man, who briefly held the world record but gave it up to live as a recluse, has died due to complications from the condition that saw him never stop growing, local media reported Monday.

User comments : 2

Adjust slider to filter visible comments by rank

Display comments: newest first

Crucialitis
not rated yet Nov 25, 2008
Wow.. how do you trust your doctor who's in the pocket of big pharmy when big pharmy's being biased by the FDA... who ironically is in control of both what could cause and cure illnesses.
It's no wonder so many are uninsured!
VOR
not rated yet Nov 25, 2008
As a capitalist society we must be more vigalent for the affects greed/competition has on truth and the common good.