Doubts cast on credibility of some published clinical trials

Jul 02, 2009

Randomised Controlled Trials (RCTs) are considered the 'gold standard' research method for assessing new medical treatments. But research published in BioMed Central's open access journal Trials shows that the design of a remarkable 93 percent of 2235 so-called RCTs published in some Chinese medical journals during 1994 to 2005 was flawed, casting doubt on the reliability of research that is likely to influence medical decision-makers.

Researchers led by Taixiang Wu of the Chinese Cochrane Centre at Sichuan University, China and Ottawa Hospital Research Institute investigated clinical trials published in China between 1994 and 2005, searching the China National Knowledge Infrastructure (CNKI) electronic database for RCTs on 20 common diseases. To determine how many of these met recognised standards for randomly allocating participants to treatment groups, trained investigators interviewed the first or co-authors of 2235 trial reports by phone.

Less than seven percent of self-described RCTs published in some Chinese medical journals meet criteria for authentic randomisation. The researchers looked at both conventional and traditional Chinese medicine trials, but there was no difference between these in terms of study authenticity rates. However, all RCTs of pre-market drug clinical trial were authentic, and RCTs conducted at hospitals affiliated with medical universities were more likely to be authentic than trials conducted at lower tier level three and level two hospitals. More than half of the trials at university-affiliated hospitals met RCT criteria, which means lower-tier hospital research is the least rigorous in design terms.

"The fact that so many non-RCTs were published as RCTs reflected that peer-review needs to be improved and a Good Practice of Peer Review, including how to identify the authenticity of the study, urgently needs to be developed," says Wu.

Misleading reporting of medical research is not unique to China. Studies labelled as RCTs are more likely to influence health policy-makers meaning falsely reported RCTs have the potential to mislead health care providers, consumers and policy-makers. The results of this study suggest authors of systematic reviews - articles that combine the results of multiple RCTs - need to be aware that RCTs in some Chinese journals may not be RCTs at all.

The approximately 1100 medical journals now active in China are rapidly increasing their output of research reports, including many identified by their authors as RCTs. But these trials present mostly positive results (they favour the treatment being investigated), which can be influenced by inadequate randomisation of patients when designing the study.

More information: Randomized trials published in some Chinese journals: How many are randomized? Taixiang Wu, Youping Li, Zhaoxiang Bian, Guanjian Liu and David Moher, Trials (in press), www.trialsjournal.com/

Source: BioMed Central (news : web)

Explore further: Liver transplant recipient marks 25th anniversary

add to favorites email to friend print save as pdf

Related Stories

Recommended for you

Doctor behind 'free radical' aging theory dies

Nov 25, 2014

Dr. Denham Harman, a renowned scientist who developed the most widely accepted theory on aging that's now used to study cancer, Alzheimer's disease and other illnesses, has died in Nebraska at age 98.

Mexican boy who had massive tumor recovering

Nov 25, 2014

An 11-year-old Mexican boy who had pieces of a massive tumor removed and who drew international attention after U.S. officials helped him get treatment in the southwestern U.S. state of New Mexico is still recovering after ...

New medical device to make the mines safer

Nov 21, 2014

Dehydration can be a serious health issue for Australia's mining industry, but a new product to be developed with input from Flinders University's Medical Device Partnering Program (MDPP) is set to more effectively ...

User comments : 0

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.