ISSN Online: 2177-1235 | ISSN Print: 1983-5175

Previous Article Next Article

Original Article - Year2019 - Volume34 - Issue 1

http://www.dx.doi.org/10.5935/2177-1235.2019RBCP0013

ABSTRACT

Introduction: In two previous studies, the quality of randomized clinical trials (RCTs) with the participation of at least one plastic surgeon was assessed in two periods: from 1966 to 2003 and from 2004 to 2008. The objective is to evaluate the evolution of the quality of RCTs published by plastic surgeons in the subsequent five-year period, from 2009 to 2013.
Methods: RCTs published from 2009 to 2013, in English, with the participation of at least one plastic surgeon, were identified by an electronic search and classified according to allocation concealment by two independent evaluators. The quality of the studies with adequate allocation concealment was evaluated by two evaluators using the Delphi List and the Jadad Scale.
Results: Of the 6,997 identified studies, 261 were classified according to allocation concealment. Of these, 43 (16.47%) had adequate allocation concealment. According to an assessment conducted using the Delphi List, there was an improvement in the items "most important characteristics of the prognosis" (p < 0.001), "use of an independent evaluator" (p = 0.0029), and "measures of variability and estimation of points for the primary variable" (p = 0.0057) compared to the 1966-2003 assessment ; there was no difference in the assessment of the same items from 2004-2008. Regarding the Jadad Scale, there was an increase in the scores from 2009 to 2013 compared to the 1996-2003 period (p < 0.0004); however, there was no significant difference in the 2004-2008 period.
Conclusion: There was no difference in the quality of the RCTs published by plastic surgeons in the 2009-2013 period compared to the previous five-year period (2004 to 2008). However, both periods indicated higher quality compared to the 1966-2003 period.

Keywords: Randomized controlled trials as a subject; Evidencebased medicine; Statistical analysis; Random distribution; Plastic surgery

RESUMO

Introdução: Em dois estudos prévios, avaliou-se a qualidade dos ensaios clínicos aleatórios (ECAs) com a participação de pelo menos um cirurgião plástico, em dois períodos: 1966 a 2003 e 2004 a 2008. O objetivo é avaliar a evolução da qualidade das publicações de ECAs por cirurgiões plásticos no período subsequente de cinco anos, de 2009 a 2013.
Métodos: ECAs publicados de 2009 a 2013, em língua inglesa, com a participação de pelo menos um cirurgião plástico, foram identificados por busca eletrônica e classificados quanto ao sigilo de alocação, por dois avaliadores independentes. Os estudos com sigilo de alocação adequado tiveram a qualidade avaliada por dois avaliadores, utilizando-se a Lista de Delphi e a Escala de Qualidade de Jadad.
Resultados: Dos 6.997 estudos identificados, 261 foram classificados quanto ao sigilo de alocação. Destes, 43 (16,47%) tinham sigilo de alocação adequado. Segundo a avaliação pela Lista de Delphi, houve melhora, em relação a 1966-2003, nos itens "características mais importantes do prognóstico" (p < 0,001), "uso de avaliador independente" (p = 0,0029) e "medidas de variabilidade e estimativa de pontos para a variável primária" (p = 0,0057); não houve diferença em relação a 2004-2008. Quanto à Escala de Qualidade de Jadad, houve um aumento dos escores em relação a 1996-2003 (p < 0,0004), mas também sem diferença significante em relação ao período 2004-2008.
Conclusão: Não houve diferença na qualidade das publicações de ECAs por cirurgiões plásticos no período de 2009 a 2013, em relação aos cinco anos anteriores (2004 a 2008). Entretanto, ambos os períodos apresentaram maior qualidade quando comparados ao período de 1966 a 2003.

Palavras-chave: Ensaios clínicos controlados aleatórios como assunto; Medicina baseada em evidências; Análise estatística; Distribuição aleatória; Cirurgia plástica


INTRODUCTION

A randomized clinical trial (RCT) is a prospective study design that compares the effect of interventions on humans in one or more groups against a control group. RCTs are the best source of evidence for health interventions. Evidence-based medicine (EBM) is defined as the use of the best existing scientific evidence, provided by appropriately designed and conducted RCTs results, combined with individual clinical expertise and patient preferences and values, for deciding on individual patient care1-4.

EBM became popular in the 1980s and impacted all fields of medicine, including Plastic Surgery5. The application of EBM principles can not only determine the best treatment for the patient but can also reduce the costs of healthcare systems2. However, particularly in the surgical areas, there are challenges to overcome, including the belief that the application of EBM could reduce the autonomy of surgeons, and that the best scientific evidence does not always exceed the best practices. This concern is even greater in Plastic Surgery, in which the results are measured not only by the occurrence of complications and need for reintervention, but mainly by patient satisfaction with aesthetic results6.

Nevertheless, the EBM practice in Plastic Surgery is no longer a trend, it is a reality6. Information obtained from research with methodological rigor has become the key point of EBM and translation of knowledge7. Therefore, the results of well-conducted RCTs can have a significant impact on medical care by contributing to the establishment of solid scientific evidence that will serve as basis for clinical care protocols and interventions8.

Research in Plastic Surgery will have a much greater influence on clinical practice if studies with greater impact are published9,10. Thus, the identification and systematic evaluation of the RCTs conducted by plastic surgeons, and their impact on the specialty, allow the implementation of evidence-based practice, with direct benefits for patients11,12.

Several studies have indicated that plastic surgeons recognize the need to improve the level of evidence of research in Plastic Surgery, and this recognition reflects in the continuous increase in publications of clinical trials by this specialty2,8,12-17.

A previous study identified RCTs with properly described allocation concealment, published by plastic surgeons between 1966 and 2003, and evaluated their quality18. Subsequently, in another study, the evolution was assessed over a subsequent five-year period (2004 to 2008), and a quantitative and qualitative increase in the RCTs published by plastic surgeons were observed8. This study aimed to test whether there was a quantitative and qualitative improvement in the RCTs in Plastic Surgery in another five-year period (2009 to 2013) compared to previously studied periods.

OBJECTIVE

To evaluate the evolution of randomized clinical trials in Plastic Surgery with adequately described allocation concealment, published between 2009 and 2013, compared to previously studied periods (1966-2003 and 2004-2008).

METHODS

The project was approved by the Research Ethics Committee of the Federal University of São Paulo – Paulista School of Medicine (UNIFESP - EPM), under the number 842.388, CAAE 37661814.8.0000.5505. The cases were selected by convenience, consisting of all the recovered RCTs that met the study eligibility criteria, published over a five-year period (January 2009 to December 2013)

Electronic searches were performed to identify the largest number of RCTs that were published by plastic surgeons in English. Specific search strategies were developed for each studied database, CCTR (Cochrane Central Register of Controlled Trials), LILACS (Latin American and Caribbean Health Science Literature), EMBASE (Excerpta Medica Database), and MEDLINE (MEDLARS- Medical Literature Retrieval System - online).

The abstracts of all retrieved articles were read by an evaluator and those that met the eligibility criteria (possible RCTs in which at least one plastic surgeon participated and published in English between 2009 and 2013) were selected for the reading of their full texts. Studies that were not conducted by plastic surgeons or without the participation of at least one plastic surgeon, and those published in a language other than English, were excluded. At this stage, whenever there was any doubt, the study was selected for reading in its entirety.

The full texts of the articles which had their abstracts selected were read by an evaluator to confirm the eligibility criteria. Subsequently, two independent evaluators classified the selected articles according to their allocation concealment19, and the disagreements were resolved in a consensus meeting. The RCTs published by plastic surgeons, with adequately described allocation concealment, were selected and constituted the sample of this study.

The selected RCTs were then evaluated for their quality. The evaluation was conducted independently by two evaluators, followed by a consensus meeting. Two validated instruments were used for quality assessment: the Delphi List20 and the Jadad Scale21.

The Delphi List is a list of generic criteria for quality evaluation of clinical trials that should be used in combination with other instruments. It does not use scores and all items have two answer choices: “yes” or “no” (Chart 1)20.

Chart 1 - Delphi List Items20
1.a. Were the patients randomly allocated to the treatment groups?
1.b. If individuals were randomly allocated to the treatment groups, was concealment allocation maintained?
2. Were the groups comparable in terms of the most important characteristics of the prognosis?
3. Were the inclusion and exclusion criteria specified?
4. Did an independent evaluator evaluate the results?
5. Did the caregiver wear a mask?
6. Did the patient wear a mask?
7. Were the measures of variability and the estimation of the points presented for the primary variable?
8. Did the study include an analysis by intention to treat (all allocated patients)?
Chart 1 - Delphi List Items20

The Jadad Scale is based on scores: one point is given for each “yes” answer, and a zero point for each “no” answer. Points counted for the first two items (randomization and double blinding) depend not only on how they are described, but also on the use of appropriate methods for this purpose. If the methods are described and appropriate, an additional point is given for each item. If the methods used to generate the randomization sequence or create the blinding conditions are described but inappropriate, the item will receive a zero point. Therefore, the scale encompasses scores from 0 to 5. The study will be considered of poor quality if it receives two or fewer points (Chart 2)21.

Chart 2 - Jadad Scale Items21
1.a. Was the study described as randomized (use of words such as "random" and "randomized")?
1.b. Was the method appropriate?
2.a. Was the study described as double-blind?
2.b. Was the method appropriate?
3. Were the losses and exclusions described?
Chart 2 - Jadad Scale Items21

The results were compared to those obtained in the two previous studies that used the same method to evaluate the quality of the RCTs published by plastic surgeons in the 1966-2003 and 2004-2008 periods8,18.

Statistical analysis

Kappa and McNemar tests were used to analyze the concordances and disagreements between the evaluators. The Chi-square test was applied to compare the categorical variables evaluated in the three periods (1966-2003, 2004-2008, and 2009-2013). Kruskal-Wallis analysis of variance was used to compare the Jadad scores in the three periods. The Kolmogorov-Smirnov test was applied to compare, two by two, the Jadad scores in the studied periods22.

Statistical analysis was performed using the BioEstat 5.3 program (Instituto Mamirauá, Pará and Amazonas, Brazil). In all tests, the level of significance used was 0.05 or 5%.

RESULTS

The electronic search identified 6,997 articles in the analyzed databases. One evaluator selected 616 articles, excluding 6,381 that were clearly not RCTs, were repeated in different databases, or did not include the participation of at least one plastic surgeon.

After reading the full texts of the 616 publications, the evaluator excluded 336 articles for the following reasons: one article was published in a language other than English (Russian); 219 did not include the participation of at least one plastic surgeon; 116 were not RCTs. Of the 280 remaining articles, 19 were repeated within the same database. Thus, the final selection comprised 261 studies.

Two evaluators independently classified the 261 selected studies according to their allocation concealment19. The kappa coefficient of agreement (kw) between the two evaluators was 0.94 (p = 0.000). After a consensus meeting, 43 RCTs published in English, with the participation of at least one plastic surgeon, and with adequately described allocation concealment were selected.

The comparison of the Delphi list items between the 2009-2013 period and previous study periods (1966- 2003 and 2004-2008) is shown in Table 1. A significant improvement in scores was observed when comparing the items “Groups were comparable in terms of the most important characteristics of the prognosis” (p < 0.001), “Inclusion and exclusion criteria were specified” (p = 0.0029), and “Measures of variability and estimation of points were presented for the primary variable” (p = 0.0057) in the 1966-2003 and 2004-2008 periods.

Table 1 - Quality assessment using the Delphi List after consensus meeting and comparison with the 1966-2003 and 2004-2008 periods.
  1966-2003 2004-2008 2009-2013 Chi-square test
  Yes No Yes No Yes No  
  n (%) n (%) n (%) n (%) n (%) n (%)  
1.a. Were the patients randomly allocated to the treatment groups? 34 0 28 0 43 0 -
(100.0)   (100.0)   (100.0)    
1.b. If individuals were randomly allocated to the treatment groups, was concealment allocation maintained? 34 0 28 0 43 0 -
(100.0)   (100.0)   (100.0)    
2. Were the groups comparable in terms of the most important characteristics of the prognosis? 14 20 27 1 30 13 χ2 = 21.6
-41.2 -58 -96.4 -3.6 -69.8 -30.2 p < 0.0001
Were the inclusion and exclusion criteria specified? 17 17 19 9 37 6 χ2 = 11.7
(50.0) (50.0) (67.9) (32.1) (86.0) (14.0) p = 0.0029
Did an independent evaluator evaluate the results? 17 17 18 10 21 22 χ2 = 1.85
-50 -50 -64.3 -35.7 -48.9 -51.1 p = 0.3964
5) Did the caregiver wear a mask? 11 23 9 19 16 27 χ2 = 0.28
-32.4 -67.6 -32.1 -67.9 -37.2 -62.8 p = 0.8709
6. Did the patient wear a mask? 20 14 14 14 24 19 χ2 = 0.49
-58.8 -41.2 -50 -50 -55.8 -44.2 p = 0.7814
Were the measures of variability and the estimation of the points presented for the primary variable? 15 19 19 9 34 9 χ2 = 10.32
-44.1 -55.9 -67.9 -32.1 -79 -21 p = 0.0057
8 Did the study include an analysis by intention to treat (all allocated patients)? 13 21 9 19 18 25 χ2 = 0.68
-38.2 -61.8 -32.1 -67.9 -41.8 -58.2 p = 0.7120
Table 1 - Quality assessment using the Delphi List after consensus meeting and comparison with the 1966-2003 and 2004-2008 periods.

The kappa coefficient of agreement (kw) between the two evaluators in the evaluation of the 43 RCTs for Jadad scores21 was 0.67 (p = 0.0000). Table 2 shows the distribution of the RCTs according to Jadad scores.

Table 2 - Quality Scale scores after consensus meeting.
SCORES STUDIES
  1966-2003 2004-2008 2009-2013
  n % n % n %
0 4 11.8 0 0 0 0
1 1 2.9 0 0 0 0
2 15 44.1 4 14.2 4 9.3
3 7 20.6 11 39.3 17 39.5
4 4 11.8 2 7.1 6 13.9
5 3 8.8 11 39.3 16 37.2
Total 34 100 28 100 43 100
  Kruskal-Wallis analysis of variance:
  p = 0.0001
  1966-2003 < 2004-2008 and 2009-2013
  Kolmogorov-Smirnov test:
  Maximum differences between the cumulative proportions:
  1966 - 2003 vs. 2004 - 2008: χ2= 12.18; p = 0.0023
  1966 - 2003 vs. 2009 - 2013: χ2= 18.63; p < 0.0001
  2004 - 2008 vs. 2009 - 2013: χ2= 0.16; p = 0.9192
Table 2 - Quality Scale scores after consensus meeting.

DISCUSSION

The present study evaluated the evolution of the quality of RCTs published by plastic surgeons since 1966. The long follow-up period of 47 years, using the same method, facilitated a clear analysis of the evolution of studies over this period.

Considering the growing demand for specialized treatments and the limitation of health resources, there has been a growing interest in the practice of so-called “evidence-based medicine,”12,14,23,24 and the qualitative and quantitative increase of publications of RCTs by plastic surgeons evaluated in the 47 years confirms this interest.

Conducting RCTs in surgical areas is accompanied by many difficulties and challenges, which includes ethical issues that make it impossible to use placebo procedures or even all procedures, compared to a surgical intervention; the impossibility of blinding the surgeon; learning curves; technical differences between surgeons, among others25,26. Thus, the production of RCTs in this field has been slower compared to other medical specialties24,27-31.

Despite the difficulties in conducting a randomized clinical trial in plastic surgery, evidence-based medicine is the key to the progress of this specialty15. Thus, the clinical trials that are effectively conducted should follow strict quality standards and methodological rigor, so that they may have more impact on clinical practice11,12,32.

In order to improve the quality of RCTs, a group of researchers and editors elaborated the CONSORT (Consolidated Standards of Reporting Trials) Statement, initially published in 1996 and updated in 200131,32. From the review on the use of the CONSORT Statement, published in 2010, which comprises a checklist and a flow diagram, it became popular and was adopted by most medical journals as the standard for describing RCTs33.

The use of the CONSORT Statement has contributed to an increase in the quality level of the published RCTs. An important limitation of the present study was the lack of use of the CONSORT checklist to assess the quality of published RCTs. However, it should be noted that the checklist, in its current form, was not available when the two previous studies were designed and conducted, and this study aimed to strictly use the same method as the two previous studies, thus, allowing a long-term evolution assessment.

A progressive increase in the number of RCTs published by plastic surgeons was observed over time. No RCT appropriately describing allocation concealment was published by plastic surgeons from 1966 to 1983. The first RCT with these characteristics was published in 1984, comparing the occurrence of capsular contracture after the use of saline implants or silicone gel for breast reconstruction34. From then on, a progressive increase was observed, following the popularization of EBM from the 1980 decade6, but with a substantial increase only from the 2000s onwards.

In the present study, a higher concentration of publications was observed in Europe and North America, following a trend described in the other two periods for comparison (1966-2003 and 2004-2008). Momeni et al.11, when evaluating RCTs in three major plastic surgery journals from 1990 to 2005, also observed a higher number of publications in Europe and North America.

The Delphi List20, used in this study, evaluates three dimensions of the quality of an RCT: internal validity (degree of validity of the study for the assessed sample), external validity (degree of validity of the study in extrapolating its results to the population), and statistical analysis. The comparison of the Delphi List items between the present study (2009-2013) and the first studied period (1966-2003) 20 indicates a greater number of responses, with statistical significance, for the items: “The groups were comparable in terms of the most important characteristics of the prognosis,” “The inclusion and exclusion criteria were specified,” and “Measures of variability and estimation of points were presented for the primary variable.” This shows an increase in the quality of RCTs published in the current period regarding these items. However, there was no change in the quality of the studies when the 2009-2013 period was compared to the previous five-year period (2004 to 2008).

The Jadad Scale is a short, simple, reliable, valid, and widely used instrument21,35. Originally designed to assess pain in RCTs, it can be applied in other fields of medicine, since the items are not specific21. Olivo et al.35, in a systematic review, analyzed the scales used to assess the methodological quality of RCTs in the health domain. They found that most of the scales did not have strict control over their development, nor were they tested for validity and applicability. They also observed that the Jadad Scale21 has been one of the most cited and used in the academic community of the health domain, besides having the best evidence for validity and applicability.

The evaluation of the Jadad scores21 indicated that there was a statistically significant increase in quality when comparing the 1966-2003 period to the 2004-2008 and 2009-2013 periods. However, there was no improvement in quality when comparing the 2009-2013 period to the previous five-year period (2004 to 2008), indicating a stabilization in the quality of RCTs.

Yu et al.36 conducted a cross-sectional study aimed at assessing the quality of RCTs publications on surgery that were published in the 2003-2013 period. They used the conformity of the items to the CONSORT 201032,36 checklist as quality criteria. They observed that the studies published in 2013 obtained higher scores than those published in 2003, and this was statistically significant, suggesting an improvement in the quality of publications. They concluded that there has been an increase in the quality of RCTs publications on surgery in the last decade. However, this quality remains at suboptimal levels, especially regarding surgical interventions36.

In this study, it was observed that the studies indicated a stabilization in quality compared to the last analyzed period (2009 to 2013) and the period before that (2004 to 2008) regarding the methodological criteria assessed using the Delphi List20 and the Jadad Scale21. This could indicate that plastic surgeons, after a significant improvement, may have reached a basic level of quality in terms of criteria used for the publication of RCTs. However, several other items would need to be incorporated in order to increase their quality. This need reflects in the constant improvement of the CONSORT 201037checklist, and in the requirement, by an increasing number of journals, of compliance with thechecklist items for an RCT to be accepted for publication.

Plastic Surgery is characterized by a long history of innovation, which continues to this day, and has many contributions to share with other medical, clinical, or surgical specialties31. Existing barriers should not be considered as obstacles to scientific growth of the specialty, but as challenges to be overcome.

CONCLUSION

There was no difference in the quality of randomized clinical trials (RCTs) with appropriately described concealment allocation, published by plastic surgeons from 2009 to 2013 compared to the previous five-year period (2004 to 2008). However, both periods had better quality RCTs than the 1966-2003 period.

COLLABORATIONS

TBM

Analysis and/or data interpretation, conception and design study, data curation, final manuscript approval, formal analysis, methodology, project administration, resources, writing - original draft preparation.

DFV

Analysis and / or interpretation of data, statistical analysis, study design and design, project administration, methodology, writing - review and editing, supervision.

MSN

Final approval of the manuscript.

LMF

Final approval of the manuscript.

REFERENCES

1. Swanson JA, Schmitz D, Chung KC. How to practice evidence-based medicine. Plast Reconstr Surg. 2010;126(1):286-94. DOI: https://doi.org/10.1097/PRS.0b013e3181dc54ee

2. Rohrich RJ, Eaves FF 3rd. So you want to be an evidence-based plastic surgeon? A lifelong journey. Plast Reconstr Surg. 2011;127(1):467-72. DOI: https://doi.org/10.1097/PRS.0b013e318203a2dd

3. Kowalski E, Chung KC. The outcomes movement and evidence-based medicine in plastic surgery. Clin Plast Surg. 2013;40(2):241-7. DOI: https://doi.org/10.1016/j.cps.2012.10.001

4. Sears ED, Burns PB, Chung KC. The outcomes of outcome studies in plastic surgery: a systematic review of 17 years of plastic surgery research. Plast Reconstr Surg. 2007;120(7):2059-65. DOI: https://doi.org/10.1097/01.prs.0000287385.91868.33

5. Rohrich RJ, Cho MJ. Evidence-Based Medicine in Aesthetic Surgery: The Significance of Level to Aesthetic Surgery. Plast Reconstr Surg. 2017;139(5):1195e-202e.

6. Leal DG, Rodrigues MA, Tedesco ACB, Nahas FX, Ferreira LM, Roxo ACW, et al. Evidence-Based Medicine in Plastic Surgery: Are We There Yet? Ann Plast Surg. 2018;80(1):71-5.

7. Boden C, Bidonde J, Busch A. Gaps exist in the current guidance on the use of randomized controlled trial study protocols in systematic reviews. J Clin Epidemiol. 2017;85:59-69. DOI: https://doi.org/10.1016/j.jclinepi.2017.04.021

8. Veiga DF, Veiga-Filho J, Pellizzon RF, Juliano Y, Ferreira LM. Evolution of reports of randomised clinical trials in plastic surgery. J Plast Reconstr Aesthet Surg. 2011;64(6):703-9. PMID: 21300583 DOI: https://doi.org/10.1016/j.bjps.2010.11.015

9. Sears ED, Burns PB, Chung KC. The outcomes of outcome studies in plastic surgery: a systematic review of 17 years of plastic surgery research. Plast Reconstr Surg. 2007;120(7):2059-65.

10. Waljee JF, Larson BP, Chung KC. Measuring treatment effectiveness: a guide to incorporating the principles of evidence-based medicine. Plast Reconstr Surg. 2012;130(6):1382-94. PMID: 23190822

11. Taghinia AH, Liao EC, May JW Jr. Randomized controlled trials in plastic surgery: a 20-year review of reporting standards, methodologic quality, and impact. Plast Reconstr Surg. 2008;122(4):1253-63. PMID: 18827662

12. Momeni A, Becker A, Antes G, Diener M, Blümle A, Stark BG. Evidence-based plastic surgery: controlled trials in three plastic surgery journals (1990 to 2005). Ann Plast Surg. 2009;62(3):293-6. PMID: 19240528

13. Karri V. Randomised clinical trials in plastic surgery: survey of output and quality of reporting. J Plast Reconstr Aesthet Surg. 2006;59(8):787-96. PMID: 16876074

14. Loonen MP, Hage JJ, Kon M. Publications of plastic surgery research 1972 through 2004: a longitudinal trend analysis of three international journals. J Plast Reconstr Aesthet Surg. 2007;60(8):934-45.

15. Becker A, Blümle A, Antes G, Bannasch H, Torio-Padron N, Stark GB, et al. Controlled trials in aesthetic plastic surgery: a 16-year analysis. Aesth Plast Surg. 2008;32(2):359-62. PMID: 18058165

16. Rohrich RJ. So you want to be better: the role of evidence-based medicine in plastic surgery. Plast Reconstr Surg. 2010;126(4):1395-8.

17. Agha RA, Camm CF, Edison E, Orgill DP. The methodological quality of randomized controlled trials in plastic surgery needs improvement: a systematic review. J Plast Reconstr Aesthet Surg. 2013;66(4):447-52.

18. Veiga-Filho J, Castro AA, Veiga DF, Juliano Y, Castilho HT, Rocha JL, et al. Quality of reports of randomised clinical trials in plastic surgery. Plast Reconstr Surg. 2005;115(1):320-3. PMID: 15622272

19. Guidugli F, Castro AA, Atallah AN. Systematic reviews on leptospirosis. Rev Inst Med Trop. 2000;42(1):47-9.

20. Verhagen AP, de Vet HC, de Bie RA, Kessels AG, Boers M, Bouter LM, et al. The Delphi list: a criteria list for quality assessment of randomized clinical trials for conducting systematic reviews developed by Delphi consensus. J Clin Epidemiol. 1998;51(12):1235-41. PMID: 10086815

21. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1-12. PMID: 8721797

22. Siegel S, Castellan NJ Jr. Non-Parametric Statistics for the Behavioral Sciences. 2nd ed. New York: McGraw Hill; 1988.

23. McCarthy CM, Collins ED, Pusic AL . Where do we find the best evidence? Plast Reconstr Surg. 2008;122(6):1942-7. PMID: 19050548

24. Thoma A, Sprague S, Temple C, Archibald S. The role of the randomized controlled trial in plastic surgery. Clin Plast Surg. 2008;35(2):275-84. PMID: 18298999

25. McCulloch P, Taylor I, Sasako M, Lovett B, Griffin D. Randomised trials in surgery: problems and possible solutions. BMJ. 2002;324(7351):1448-51.

26. Farrokhyar F, Karanicolas PJ, Thoma A, Simunovic M, Bhandari M, Devereaux PJ, et al. Randomized controlled trials of surgical interventions. Ann Surg. 2010;251(3):409-16. PMID: 20142732

27. Solomon MJ, McLeod RS. Should we be performing more randomized controlled trials evaluating surgical operations? Surgery. 1995;118(3):459-67.

28. Gattellari M, Ward JE, Solomon MJ. Randomized, controlled trials in surgery: perceived barriers and attitudes of Australian colorectal surgeons. Dis Colon Rectum. 2001;44(10):1413-20.

29. Huemer GM, Bauer T, Gurunluoglu R, Sakho C, Oehlbauer M, Dunst KM. Analysis of publications in three plastic surgery journals for the year 2002. Plast Reconstr Surg. 2004;114(5):1147-54. PMID: 15457026

30. Loiselle F, Mahabir RC, Harrop AR. Levels of evidence in plastic surgery research over 20 years. Plast Reconstr Surg. 2008;121(4):207e-11e. PMID: 18349600

31. Goulden O, Waters R. Evidence-based plastic surgery in 2017. JPRAS Open. 2017;12:31-8.

32. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276(8):637-9. DOI: https://doi.org/10.1001/jama.1996.03540080059030

33. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869. PMID: 20332511

34. Asplund O. Capsular contracture in silicone gel and saline-filled breast implants after reconstruction. Plast Reconstr Surg. 1984;73(2):270-5. PMID: 6695025 DOI: https://doi.org/10.1097/00006534-198402000-00022

35. Olivo AS, Macedo LG, Gadotti IC, Fuentes J, Stanton T, Magee DJ. Scales to assess the quality of randomized controlled trials: a systematic review. Phys Ther. 2008;88(2):156-75.

36. Yu J, Li X, Li Y, Sun X. Quality of reporting in surgical randomized clinical trials. Br J Surg. 2017;104(3):296-303.

37. Moher D, Jones A, Lepage L; CONSORT Group (Consolidated Standards for Reporting of Trials). Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001;285(15):1992-5.











1. Universidade Federal de São Paulo, São Paulo, SP, Brazil.

Institution: Universidade Federal de São Paulo, São Paulo, SP, Brazil.

Corresponding author: Thiago Bezerra Morais Av. República do Líbano, nº 251, Empresarial Riomar Trade Center, Torre 1, Sala 1708, Pina - Recife, PE, Brazil Zip Code 51110-160 E-mail: thibmr@hotmail.com

Article received: September 5, 2018.
Article accepted: February 10, 2019.

Conflicts of interest: none.



 

Previous Article Back to Top Next Article

Indexers

Licença Creative Commons All scientific articles published at www.rbcp.org.br are licensed under a Creative Commons license