Figures
Abstract
Objectives
To critically review the currently available evidence of studies comparing robotic partial nephrectomy (RPN) and open partial nephrectomy (OPN).
Materials and Methods
A comprehensive review of the literature from Pubmed, Web of Science and Scopus was performed in October 2013. All relevant studies comparing RPN with OPN were included for further screening. A cumulative meta-analysis of all comparative studies was performed and publication bias was assessed by a funnel plot.
Results
Eight studies were included for the analysis, including a total of 3418 patients (757 patients in the robotic group and 2661 patients in the open group). Although RPN procedures had a longer operative time (weighted mean difference [WMD]: 40.89; 95% confidence interval [CI], 14.39–67.40; p = 0.002), patients in this group benefited from a lower perioperative complication rate (19.3% for RPN and 29.5% for OPN; odds ratio [OR]: 0.53; 95%CI, 0.42–0.67; p<0.00001), shorter hospital stay (WMD: −2.78; 95%CI, −3.36 to −1.92; p<0.00001), less estimated blood loss(WMD: −106.83; 95%CI, −176.4 to −37.27; p = 0.003). Transfusions, conversion to radical nephrectomy, ischemia time and estimated GFR change, margin status, and overall cost were comparable between the two techniques. The main limitation of the present meta-analysis is the non-randomization of all included studies.
Conclusions
RPN appears to be an efficient alternative to OPN with the advantages of a lower rate of perioperative complications, shorter length of hospital stay and less blood loss. Nevertheless, high quality prospective randomized studies with longer follow-up period are needed to confirm these findings.
Citation: Wu Z, Li M, Liu B, Cai C, Ye H, Lv C, et al. (2014) Robotic versus Open Partial Nephrectomy: A Systematic Review and Meta-Analysis. PLoS ONE 9(4): e94878. https://doi.org/10.1371/journal.pone.0094878
Editor: Domenico Coppola, H. Lee Moffitt Cancer Center & Research Institute, United States of America
Received: January 7, 2014; Accepted: March 18, 2014; Published: April 16, 2014
Copyright: © 2014 Wu et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work has been supported by National Natural Science Foundation of China (81272817, 81172447), the Talents Project of Shanghai Health System (XBR2011027), the Scientific and Technological Talents Project of Shanghai (13XD1400100), Natural Science Foundation of Shanghai (11ZR1447800), The “Leading Talent” Project of Shanghai (2013046) Hospital "1255" Discipline Construction Projects (CH125520300), and Hospital's Youth Initiation Fund, but the funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Nephron-sparing surgery (NSS) has been recommended as the reference standard of care for localized renal cell carcinoma due to equivalent oncological, improved functional outcomes and better long-term survival compared to those of radical nephrectomy [1]–[4]. With the advent of minimally invasive surgery, laparoscopic partial nephrectomy (LPN) has become a viable alternative to open surgery for small renal masses with the advantage of faster recovery. However, LPN is a kind of procedure with highly technical demanding and has a steep learning curve. A population based study by Abouassaly revealed that the introduction of laparoscopy in renal surgery has decreased uptake and use of partial nephrectomy for renal cell carcinoma at least partially due to technical ease and decreased surgical morbidity in laparoscopic radical nephrectomy [5].
Robotic-assisted laparoscopy allows for improved dexterity, high-definition, three-dimensional optics, tremor filtration, and an ergonomic setting to enhance surgeon comfort. A recently published systematic review and meta-analysis of RPN versus LPN shows that the RPN series offers a significantly less warm ischemic time than with an LPN procedure [6]. And numerous reports have demonstrated that RPN is feasible and safe for large (>4–7 cm) tumors, high complex or hilar tumors [7]–[9]. Therefore, the robotic surgical system duplicates the techniques of LPN and OPN. As the indications of RPN has been expanded and at some institutions RPN has replaced OPN as the preferred technique, more and more investigators focus their interests on the comparative outcomes of RPN versus OPN [10]–[13].
The aim of this study is to systematically search and analyze the currently available literature to compare the surgical outcomes of RPN with OPN.
Methods
Search strategy and study selection
The systematic review was done according to the Cochrane review guidelines. A systematic literature search was done using the electronic database including Pubmed, Web of Science and Scopus. Searches were performed in [Title/Abstract/Topic Subject] with the following terms of “open”, “robotic/robot-assisted”, and “partial nephrectomy”. Searches were restricted to publications in English. The electronic search was done in October 9, 2013.
Article selection was according to the Preferred Reporting Items for Systematic Reviews and Meta-analysis of Observational Studies in Epidemiology Recommendations for studies reporting. All relevant randomized controlled trials (quasi-randomized studies, such as those allocating by using alternate days of the admission date, were also included) and retrospective comparative studies (cohort or case-control studies) comparing robotic partial nephrectomy (RPN) with open partial nephrectomy (OPN) were included for further screening. Studies comparing OPN, LPN and OPN were also included as long as the data of RPN and OPN could be extracted. Review articles, case reports, conference paper, short survey, note editorials, letters to the editor, and animal experimental studies were excluded. When multiple reports describing the same population were published, the most recent or complete report was used. Two independent reviewers completed this process and all disagreements were resolved by their consensus.
Data extraction and outcomes of interest
Studies comparing RPN with OPN were included. Articles comparing OPN, LPN and OPN were also included as long as the data of RPN and OPN could be extracted. Two independent authors reviewed the full texts of the included studies. Patient demographic characteristics, peri- and post- operative outcomes between the two procedures were compared. The following data was extracted from each eligible study: patients demographics, tumor size and nephrometry score, operative time, ischemia time, estimated blood loss, transfusion rate, conversion rate and complication rates. Postoperative complications were captured during the inpatient setting and within 30 days after surgery, and classified according to the Clavien-Dindo grading system [14]. The surgical conversion included: 1) RPN converted to conventional laparoscopic partial nephrectomy or open surgery; 2) RPN or OPN converted to radical nephrectomy.
Study quality assessment
The level of evidence was rated for each included study according to the most updated criteria provided by the Center for Evidence-Based Medicine in Oxford, UK [15]. The methodological quality of RCTs was scored with the Jadad composite scale, which is a 5-point scale [16], [17]. A score of 2 or less indicates low-quality while 3 or more high-quality [16], [18]. The methodological quality of non-RCTs was assessed with the modified Newcastle-Ottawa Scale (NOS) [19], [20], which is a “star system” and ranges between zero up to nine stars.
Statistical analysis
A meta-analysis was performed to assess the outcomes of RPN when compared with OPN. Odds ratio (OR) or Risk ratio (RR) and mean difference (MD) or standardized mean difference (SMD) was used for binary variables and continuous parameters, respectively. For studies presenting continuous data as medians and range values, means and standard deviations (SD) were calculated using the methodology described by Hozo et al [21] in keeping with the Cochrane Handbook [22]. Pooled estimates were calculated with fixed-effect model (Mantel-Haenszel method) [23] if no significant heterogeneity was detected, otherwise, random-effect model (DerSimonian-Laird method) [24] was used. The pooled effects were determined by Z-test and αof 0.05 was used for statistical significance. The Cochrane X2-test and Inconsistency (I2) [25] were used to evaluate the heterogeneity among studies. P<0.10 indicated the presence of heterogeneity, I2<50% indicated acceptable heterogeneity. Publication bias was assessed by a funnel plot. Review Manager software (RevMan 5.1, Cochrane Collaboration, Oxford, UK) was used for analysis.
Results
Characteristics and methodological quality of included studies
The literature search yielded 164 studies, of which 8 were selected in the final analysis including 3418 cases (757 cases for RPN and 2661 cases for OPN) (Fig.1). No additional records were identified through the manual searches of the references cited for these included studies. Table 1 presents the baseline characteristics of the studies. Four studies compared the outcomes of OPN, LPN and RPN [26]-[29]. The majority of studies reported on their single center's experience with RPN compared with OPN, Minervini et al [12] conducted a domestic multi-institutional analysis and Yu et al [29] assessed the NIS database and assessed the use, costs and comparative effectiveness of robotic assisted, laparoscopic and open urological surgery with a propensity adjusted comparison of RPN versus OPN. The patient recruitment periods were mostly between 2005 and 2010. The continuous parameters in the study by Simhan et al had to be pooled as two separate groups because the comparisons in the original study were stratified by moderately and highly complex tumor nephrometry scores [13].
Among the included studies, there was one prospective non-randomized comparative study (level of evidence: 2) [12]; 6 retrospective studies compared contemporary of patients (level of evidence: 3) [11], [13], [26]–[28]with the level of 1 study graded up for its large effect size(level of evidence: 2) [29]; and 1 retrospective study used a historical series as the control (level of evidence: 4). 3 retrospective studies declared prospective data collection [11], [13], [29]. The methodological quality of included studies was relatively high. None of the studies were randomized or blinded, with allocation usually at the discretion of the surgeon. Matching criteria between RPN and OPN groups were variable and only 3 studies [11], [13], [28]provided the duration of follow-up for both groups.
Patient demographics
Table 2 depicts the demographics of the included studies including number of patients, patient age, gender, body mass index (BMI), laterality, tumor size, and malignant/benign pathology ratio. There was no significant difference between the two groups for any of the demographic parameters except for the gender (OR: 0.78, 95% CI 0.62–0.99; p = 0.04), and the tumor size, which was larger for the OPN group (weighted mean difference [WMD]:−0.74; 95% confidence interval [CI], −1.11 to −0.37; p<0.0001). Six studies reported on the kidney tumor nephrometry score (RENAL or PADUA) as a continuous or ordinal outcome [11]–[13], [26]–[28].
Meta-analysis results
1. Complications, transfusions and conversions.
The overall complication rate was significantly lower for the RPN group by pooling the data from 6 studies [10]–[13], [28], [29] that investigate perioperative complications in 3090 patients (19.3% for RPN and 29.5% for OPN; OR: 0.53; 95%CI, 0.42–0.67; p<0.00001) (Fig.2a). Intraoperative complication rate was available for 3 studies [10], [12], [28], and no significant differences were detected between the two groups (3.5% for RPN and 4.9% for OPN; OR: 0.69; 95%CI, 0.29–1.62; p = 0.39). 5 studies [10]–[13], [28] including 1068 patients evaluated postoperative complication rates and all further divided into minor (Clavien Classification 1–2) and major (Clavien Classification 3–5) complications. The pooling data favored the RPN groups for overall postoperative complications (OR: 0.51; 95%CI, 0.36–0.72; p = 0.0001), minor complications (OR: 0.66; 95%CI, 0.45–0.96; p = 0.03) and major complications (OR: 0.58; 95%CI, 0.42–0.79; p = 0.0007) (Fig.2b).
(a) overall complications; (b) postoperative complications divided into Clavien grade 1–2 and 3–4; (c) transfusions; (d) conversions to radical nephrectomy; (e) ischemia time; (f) estimated GFR change; (g) unclamping rate; (h) length of stay; (i) estimated blood loss; (j) operative time; (k) positive margins. The following studies are cited: Alemozaffar et al 2013 [26], Laydner et al 2013 [27], Lee et al 2011 [10], Lucas et al 2012 [28], Masson-Lecomte et al 2013 [11], Minervini et al 2013 [12], Simhan et al 2012 [13], Yu et al 2012 [29].
There was no significant difference between the two groups in terms of perioperative transfusion rate (OR: 0.81; 95%CI, 0.54–1.23; p = 0.32) (Fig.2c). Four studies [10], [12], [13], [28] reported the conversion rate of RPN to OPN or LPN, and the weighted rate was 1.4% (4/292). Regarding the rates of conversion to radical nephrectomy, the pooled data of 3 studies [10], [12], [28] including 201 RPN patients and 486 OPN patients showed no significant difference between the two groups (0.7% in the RPN and 0.6% in the OPN; OR: 1.66; 95%CI, 0.37–7.40; p = 0.50) (Fig.2d).
2. Ischemia time and eGFR change.
There was no statistical difference found between RPN and OPN regarding ischemia time (WMD: 1.21; 95%CI, −0.97 to 3.39; p = 0.20) (Fig.2e) and eGFR change (WMD: −3.30; 95%CI, −8.37 to 1.77; p = 0.20) (Fig.2f). 3 studies [10], [12], [28] reported the intraoperative renal artery unclamping rate and the pooled data revealed a significantly higher rate in the OPN group than the RPN group (OR: 0.60; 95%CI, 0.38–0.95; p = 0.03) (Fig.2g).
3. Length of hospital stay, estimated blood loss and operative time.
There was a significantly shorter postoperative hospital stay in the RPN group (WMD: −2.78; 95%CI, −3.36 to −1.92; p<0.00001) (Fig.2h) and less estimated blood loss in this same group (WMD: −106.83; 95%CI, −176.4 to −37.27; p = 0.003) (Fig.2i), whereas the operative time was statistically longer in the RPN than OPN (WMD: 40.89; 95%CI, 14.39–67.40; p = 0.002) (Fig.2j).
4. Margin status, tumor recurrence and metastasis.
Five studies [10]–[13], [28]reported the margin status of surgical specimens. There was no significant difference regarding positive margin rates between the two groups by pooling the data of the 1068 patients in these five studies (OR: 0.78; 95%CI, 0.39–1.57; p = 0.49) (Fig.2k). Although four studies [10], [11], [13], [28] reported the tumor recurrence or metastasis rate and a trend was observed toward a higher failure of cancer control rate for OPN (2.2% versus 0.4%), the data were not pooled for meta-analysis for the differences in the length of follow-up duration between the studies.
5. Cost analysis.
Three studies compared costs associated with partial nephrectomy using robotic and open approaches, pooling the data of 2350 patients in these three studies showed no statistical difference between the RPN and OPN groups (WMD: −3115; 95%CI, −8053 to 1822; p = 0.22).
6. Reporting bias analysis.
Figure 3 shows funnel plots of the studies included in this meta-analysis reporting perioperative complication rates. All studies lie inside the 95% confidence intervals, with an even distribution around the vertical, indicating no obvious reporting bias.
Funnel plots of the studies included in this meta-analysis reporting overall complication rates (a) and postoperative complications with Clavien grade classifications (b). SE = standard error; OR = odds ratio.
Discussion
The present meta-analysis pooled the current available evidences comparing RPN with OPN in the treatment of the localized kidney tumor. No significant difference was observed between the two techniques regarding baseline demographics, except for gender and the tumor size, the weighted mean of which was lower for tumors treated with RPN. This can be regarded as a selection bias, and explained partially by the fact that the system was initially recommended for small masses. In the study of a two-year observational multicenter outcomes research of RPN versus OPN by Minervini et al, the clinical tumor size was significantly different between the two groups, whereas the tumor nephrometry score measured by PADUA was comparable [12]. Nephrometry scoring allows for systematic analysis of anatomical renal tumor characteristics and has an important role in PN outcomes reporting because it indicates the degree of technical complexity and allows for valid comparison among different cohorts. As to the surgical outcomes, no significant difference was observed regarding the transfusion rate, surgical conversion rate, ischemia time, and positive margin status.
The incidence of perioperative complications was significantly lower following RPN(19.3% versus 29.5%; p<0.00001). In the subgroup analysis of postoperative complications, both minor and major complications more frequently occurred following OPN(14.4% versus 19.2%, p = 0.03 and 3.6% versus 8.3%, p = 0.0007, respectively), whereas there was no Clavien grade 5 (death) complication in either group. Lucas et al reported one grade 4a complication in the RPN group (stroke) [28]. In the largest single center non-comparative series to date, which consists of 400 patients undergoing RPN, there were 61 cases (15.3%) of postoperative complications, which were mainly low grade (Clavien grade 3-4 in 3.2%) [30]. In the open group, Simhan et al reported that major complications requiring a secondary procedure developed in 29 patients (15.3%) [13]. In the multi-institutional comparative study, Minervini et al demonstrated that open surgical approach is the only independent risk factor associated with Clavien grade 3–4 complications [12].
The other encouraging finding in favor of robotic surgery was the shorter length of hospital stay, with a difference reaching statistical significance between the two groups. Besides, we unexpectedly found that the cost of RPN was not significantly higher than that of OPN (p = 0.22). Laydner et al assessed the Cleveland Clinic data and found that the increased cost of RPN due to instrumentation and supplies can be offset by decreased cost of hospitalization compared with the OPN group [27]. Yu et al used a population based approach to compare the perioperative costs of robotic, laparoscopic, and open surgery in urology. They found that health costs were higher for robotic vs laparoscopic and open surgery for all procedures except for partial nephrectomy, where costs were similar [29]. In this regard, post-discharge convalescence and return to work analysis should be included in the future study, which may have some impacts on the social cost.
The pooled data of operative time showed a significant difference between the two techniques, which was longer for the RPN (WMD: 40.89; 95%CI, 14.39–67.40; p = 0.002). The observed difference of approximately 40 min can be pertaining to the preparation and docking of the robot. Masson-Lecomte et al found the difference become insignificant when “skin-to-skin” time compared (excluding the setup and docking time), whereas the total operating room occupation was more than 100 min over the operative time itself for RPN [11]. Furthermore, many studies found that the surgeon experience also could affect the overall operative time.
There was a significant lower amount of estimated blood loss in the RPN group. However, in the present study, we found that there were more unclamping cases in the OPN (p = 0.03). This fact may have biased the parameter of estimated blood loss favoring RPN. The pooled data showed comparable ischemia time, postoperative renal function impairment and positive margin rate between the two techniques, which was also true in patients with moderate or high complex tumors, as reported by Simhan et al [13]. Although a trend was observed toward a higher failure of cancer control rate for OPN (2.2% versus 0.4%), it is not appropriate to estimate the weighted effect with the odds ratio of tumor recurrence and metastasis for the differences in the length of follow-up duration between the studies. A total of 11 cases of tumor recurrence and one of metastasis reported in OPN; while in the RPN group, one patient had metastatic disease within 1 year of surgery and no one patient experienced a local recurrence (including the eleven patients with a positive surgical margin) [10], [11], [13]. Lee et al report two OPN patients with a positive margin status had evidence of recurrent masses treated with radiofrequency ablation [10]. Nonetheless, the follow-up period was limited in the included studies, especially for the RPN patients, so long-term oncologic outcomes of RPN compared to OPN remain to be determined.
All dichotomous outcomes had a low heterogeneity, but which was significant for most of the continuous variables. Factors of different sample sizes, multiple surgeons with different surgical experience, tumor complexity, the variety of ischemia (warm, cold, and no ischemia) may contribute to the study-between-study heterogeneity. The fact that none of the RPN series in the included studies were totally performed within the surgeon's learning curve (first 25 cases as reported by Haseebuddin et al. [31]) might reduce the effect of heterogeneity.
The main limitation of the present meta-analysis is that all the included studies were retrospective non-randomized comparisons, except one prospectively derived comparative study. Ideally, every surgical option for the treatment of the renal masses should be compared to OPN which is the best matching standard and has robust data regarding surgical and oncological outcomes. Although it is laudable to call for prospective randomized studies comparing RPN with OPN, with true clinical equipoise, consisting of a homogeneous group of patients with renal masses, such studies are difficult to carry out in the real world. This review was performed timely and impartially, and conducted systematically and methodologically in accordance with Cochrane standards. This year is the 20th anniversary of LPN [32] and the 10th anniversary of RPN [33], while open surgery currently remains as a standard of care for partial nephrectomy in the 2013 European Urology guidelines on renal cell carcinoma [1]. The underlying reason is that RPN effects on long-term renal preservation and cancer-control compared with OPN are to be defined. Well-designed global multi-center studies with extensive follow-up are awaited before a new standard surgical approach of PN can be established.
Conclusions
Meta-analysis of the currently available evidence comparing RPN and OPN reveals that robotic technique results in a significantly lower rate of perioperative complications, less estimated blood loss with shorter hospital stay, albeit with a longer operative time, while transfusions, ischemia time and estimated GFR change, early cancer outcomes, and overall cost are similar to the open surgery. Given the inherent limitations of the included studies, however, well-designed prospective randomized controlled trials are needed to confirm and update our findings.
Author Contributions
Conceived and designed the experiments: ZJW MML BL CC HMY CL QY JS SQS LQ LX YHS LHW. Performed the experiments: ZJW MML. Analyzed the data: ZJW MML BL. Contributed reagents/materials/analysis tools: ZJW MML BL CC HMY CL QY JS SQS LQ LX YHS LHW. Wrote the paper: ZJW MML.
References
- 1.
Ljungberg B, Bensalah K, Bex A, Canfield S, Dabestani S, et al. (2013) Guidelines on Renal Cell Carcinoma. Uroweb 2013. Available: http://www.uroweb.org/gls/pdf/10_Renal_Cell_Carcinoma_LRV2.pdf. Accessed November 30, 2013.
- 2. MacLennan S, Imamura M, Lapitan MC, Omar MI, Lam TB, et al. (2012) Systematic review of oncological outcomes following surgical management of localised renal cancer. Eur Urol 61: 972–993.
- 3. Tan HJ, Norton EC, Ye Z, Hafez KS, Gore JL, et al. (2012) Long-term survival following partial vs radical nephrectomy among older patients with early-stage kidney cancer. JAMA 307: 1629–1635.
- 4. Sun M, Bianchi M, Hansen J, Trinh QD, Abdollah F, et al. (2012) Chronic kidney disease after nephrectomy in patients with small renal masses: a retrospective observational analysis. Eur Urol 62: 696–703.
- 5. Abouassaly R, Alibhai SM, Tomlinson G, Timilshina N, Finelli A (2010) Unintended consequences of laparoscopic surgery on partial nephrectomy for kidney cancer. J Urol 183: 467–472.
- 6. Aboumarzouk OM, Stein RJ, Eyraud R, Haber GP, Chlosta PL, et al. (2012) Robotic versus laparoscopic partial nephrectomy: a systematic review and meta-analysis. Eur Urol 62: 1023–1033.
- 7. Dulabon LM, Kaouk JH, Haber GP, Berkman DS, Rogers CG, et al. (2011) Multi-institutional analysis of robotic partial nephrectomy for hilar versus nonhilar lesions in 446 consecutive cases. Eur Urol 59: 325–330.
- 8. Gong Y, Du C, Josephson DY, Wilson TG, Nelson R (2010) Four-arm robotic partial nephrectomy for complex renal cell carcinoma. World J Urol 28: 111–115.
- 9. Sprenkle PC, Power N, Ghoneim T, Touijer KA, Dalbagni G, et al. (2012) Comparison of open and minimally invasive partial nephrectomy for renal tumors 4–7 centimeters. Eur Urol 61: 593–599.
- 10. Lee S, Oh J, Hong SK, Lee SE, Byun SS (2011) Open versus robot-assisted partial nephrectomy: effect on clinical outcome. J Endourol 25: 1181–1185.
- 11. Masson-Lecomte A, Yates DR, Hupertan V, Haertig A, Chartier-Kastler E, et al. (2013) A prospective comparison of the pathologic and surgical outcomes obtained after elective treatment of renal cell carcinoma by open or robot-assisted partial nephrectomy. Urol Oncol 31: 924–929.
- 12. Minervini A, Vittori G, Antonelli A, Celia A, Crivellaro S, et al. (2013) Open versus robotic-assisted partial nephrectomy: a multicenter comparison study of perioperative results and complications. World J Urol.
- 13. Simhan J, Smaldone MC, Tsai KJ, Li T, Reyes JM, et al. (2012) Perioperative outcomes of robotic and open partial nephrectomy for moderately and highly complex renal lesions. J Urol 187: 2000–2004.
- 14. Dindo D, Demartines N, Clavien PA (2004) Classification of surgical complications: a new proposal with evaluation in a cohort of 6336 patients and results of a survey. Ann Surg 240: 205–213.
- 15. Seveso M, Taverna GL, Maffezzini M, Giusti G, Benetti A, et al. (2002) [Nephron-sparing surgery. Reproducibility of results, personal cases, and comparison with the international literature]. Arch Ital Urol Androl 74: 65–68.
- 16. Kjaergard LL, Villumsen J, Gluud C (2001) Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med 135: 982–989.
- 17. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, et al. (1996) Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 17: 1–12.
- 18. Moher D, Pham B, Jones A, Cook DJ, Jadad AR, et al. (1998) Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 352: 609–613.
- 19.
Wells GA, Shea B, O'Connell D, Peterson J, Welch V, et al. (Available from:http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp. Accessed July 20,2012) The Newcastle-Ottawa Scale (NOS) for assessing the quality if nonrandomized studies in meta-analyses.
- 20. Fan X, Lin T, Xu K, Yin Z, Huang H, et al. (2012) Laparoendoscopic single-site nephrectomy compared with conventional laparoscopic nephrectomy: a systematic review and meta-analysis of comparative studies. Eur Urol 62: 601–612.
- 21. Hozo SP, Djulbegovic B, Hozo I (2005) Estimating the mean and variance from the median, range, and the size of a sample. BMC Med Res Methodol 5: 13.
- 22.
JPT H, S G. Cochrane handbook for systematic reviews of interventions, v.5.1.0 [updated March 2011]. Available from Cochrane Collaboration Web site. http://www.cochrane-handbook.org/.
- 23. Mantel N, Haenszel W (1959) Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst 22: 719–748.
- 24. DerSimonian R, Laird N (1986) Meta-analysis in clinical trials. Control Clin Trials 7: 177–188.
- 25. Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327: 557–560.
- 26. Alemozaffar M, Chang SL, Kacker R, Sun M, DeWolf WC, et al. (2013) Comparing costs of robotic, laparoscopic, and open partial nephrectomy. J Endourol 27: 560–565.
- 27. Laydner H, Isac W, Autorino R, Kassab A, Yakoubi R, et al. (2013) Single institutional cost analysis of 325 robotic, laparoscopic, and open partial nephrectomies. Urology 81: 533–538.
- 28. Lucas SM, Mellon MJ, Erntsberger L, Sundaram CP (2012) A comparison of robotic, laparoscopic and open partial nephrectomy. Jsls 16: 581–587.
- 29. Yu HY, Hevelone ND, Lipsitz SR, Kowalczyk KJ, Hu JC (2012) Use, costs and comparative effectiveness of robotic assisted, laparoscopic and open urological surgery. J Urol 187: 1392–1398.
- 30. Kaouk JH, Khalifeh A, Hillyer S, Haber GP, Stein RJ, et al. (2012) Robot-assisted laparoscopic partial nephrectomy: step-by-step contemporary technique and surgical outcomes at a single high-volume institution. Eur Urol 62: 553–561.
- 31. Haseebuddin M, Benway BM, Cabello JM, Bhayani SB (2010) Robot-assisted partial nephrectomy: evaluation of learning curve for an experienced renal surgeon. J Endourol 24: 57–61.
- 32. Winfield HN, Donovan JF, Godet AS, Clayman RV (1993) Laparoscopic partial nephrectomy: initial case report for benign disease. J Endourol 7: 521–526.
- 33. Gettman MT, Blute ML, Chow GK, Neururer R, Bartsch G, et al. (2004) Robotic-assisted laparoscopic partial nephrectomy: technique and initial clinical experience with DaVinci robotic system. Urology 64: 914–918.