Randomized Controlled Trials and Consolidated Standards of Reporting Trials Reporting Quality: An Evidence-Based Analysis of the American Society of Plastic Surgeons, American Burn Association, and American Society for Surgery of the Hand Conference Meetings
Sir: After the initiative by Plastic and Reconstructive Surgery and the American Society of Plastic Surgeons to promote evidence-based medicine1 and to strive for high levels of reporting quality,2 it is current belief that randomized controlled trials are the key to guiding and helping clinical decision making. The broad field of plastic surgery with its subdisciplines reconstructive surgery, burn surgery, aesthetic surgery, and hand surgery often lacks a fair amount of published randomized controlled trials. However, to date, there is no comparative analysis on the recent developments of randomized controlled trials in reconstructive, burn, aesthetic, and hand surgery. Furthermore, reporting quality of randomized controlled trials was addressed by the Consolidated Standards of Reporting Trials group first in 1996, and was updated in 2001 and very recently in 2010.3 The Consolidated Standards of Reporting Trials items aim to improve the reporting quality of randomized controlled trials in full article and in abstract form.4 Using the Consolidated Standards of Reporting Trials items, one can compare the reporting quality of randomized controlled trial conference abstracts, which was a second aim of this analysis. To analyze up to date, we decided to analyze various conferences rather than full articles, given the fact that not all randomized controlled trials presented as abstracts will find their way to a full article within the next 5 years. We analyzed 65 oral abstracts and 94 poster abstracts from the 2008 meeting of the American Society of Plastic Surgeons by two independent researchers. In addition, 152 oral and 100 poster presentations from the 2008 meeting of the American Burn Association were analyzed, as were102 abstracts from the American Society for Surgery of the Hand annual meeting. We determined the evidence-based medicine level of evidence for study design. Furthermore, the level of reporting quality according to the Consolidated Standards of Reporting Trials recommendations was determined with a maximum score of 17 of 17 points. We found that at the American Society of Plastic Surgeons 2008 meeting, 9 percent (5 percent oral and 4 percent poster abstracts) of presentations were randomized controlled trials. Reporting quality at the American Society of Plastic Surgeons meeting was 6.7 ± 1.2 for oral randomized controlled trials and 7.3 ± 1 for poster randomized controlled trials (p = 0.498; 95 percent confidence interval, –2.62 to 1.46) of 17 achievable points according to Consolidated Standards of Reporting Trials criteria. At the American Burn Association Annual Meeting, 7 percent randomized controlled trials were presented, with 5 percent oral and 2 percent poster presentations. Reporting quality according to Consolidated Standards of Reporting Trials criteria was not significantly different for oral versus poster randomized controlled trials (7.2 ± 1.4 versus 6.5 ± 1 of 17 points, p = 0.552; 95 percent confidence interval, –1.78 to 3.06). We identified 10 percent randomized controlled trials at the American Society for Surgery of the Hand meeting. Consolidated Standards of Reporting Trials reporting quality was 8.2 ± 1.4 of 17, somewhat higher than for randomized controlled trials presented at the American Society of Plastic Surgeons meeting. Our results indicate that the amount of randomized controlled trials presented either in oral or poster abstract form at American Society of Plastic Surgeons, American Burn Association, and American Society for Surgery of the Hand meetings is still below 10 percent of all presentations. Given the fact that not every conference abstract will be followed by a full article, these numbers should be discussed. In 1996, Amadio and colleagues studied the rate of full article randomized controlled trials from volume 1 to volume 19 (1994) of The Journal of Hand Surgery. From 3107 articles, letters, and abstracts, they identified 25 controlled clinical trials and eight randomized controlled trials (0.26 percent).5 A 10-year analysis of publications in Plastic and Reconstructive Surgery, Annals of Plastic Surgery, and Aesthetic Surgery Journal revealed a randomized controlled trial publication rate of 3.2 percent.6 A 16-year analysis of all articles published in Aesthetic Plastic Surgery revealed only a 1 percent randomized controlled trial publication rate (11 of 1048 original articles).7 In Plastic and Reconstructive Surgery, the number of randomized controlled trials published increased from 1983 to 2003 from 0 percent to 7 percent.8 As far as reporting quality is concerned, all conference abstracts presented at American Society of Plastic Surgeons, American Burn Association, and American Society for Surgery of the Hand meetings have plenty of room for improvement, with the Consolidated Standards of Reporting Trials statement to be endorsed substantially. Karsten Knobloch, M.D. Uzung Yoon Peter M. Vogt, M.D., Ph.D. Plastic, Hand, and Reconstructive Surgery Hannover Medical School Hannover, Germany
Read more