Skip to main content
main-content

30.04.2018 | Original Article | Ausgabe 4/2018

Journal of Robotic Surgery 4/2018

Crowdsourced versus expert evaluations of the vesico-urethral anastomosis in the robotic radical prostatectomy: is one superior at discriminating differences in automated performance metrics?

Zeitschrift:
Journal of Robotic Surgery > Ausgabe 4/2018
Autoren:
Paul J. Oh, Jian Chen, David Hatcher, Hooman Djaladat, Andrew J. Hung
Wichtige Hinweise

Electronic supplementary material

The online version of this article (https://​doi.​org/​10.​1007/​s11701-018-0814-5) contains supplementary material, which is available to authorized users.

Abstract

Crowdsourcing from the general population is an efficient, inexpensive method of surgical performance evaluation. In this study, we compared the discriminatory ability of experts and crowdsourced evaluators (the Crowd) to detect differences in robotic automated performance metrics (APMs). APMs (instrument motion tracking and events data directly from the robot system) of anterior vesico-urethral anastomoses (VUAs) of robotic radical prostatectomies were captured by the dVLogger (Intuitive Surgical). Crowdsourced evaluators and four expert surgeons evaluated video footage using the Global Evaluative Assessment of Robotic Skills (GEARS) (individual domains and total score). Cases were then stratified into performance groups (high versus low quality) for each evaluator based on GEARS. APMs from each group were compared using the Mann–Whitney U test. 25 VUAs performed by 11 surgeons were evaluated. The Crowd displayed moderate correlation with averaged expert scores for all GEARS domains (r > 0.58, p < 0.01). Bland–Altman analysis showed a narrower total GEARS score distribution by the Crowd compared to experts. APMs compared amongst performance groups for each evaluator showed that through GEARS scoring, the most common differentiated metric by evaluators was the velocity of the dominant instrument arm. The Crowd outperformed two out of four expert evaluators by discriminating differences in three APMs using total GEARS scores. The Crowd assigns a narrower range of GEARS scores compared to experts but maintains overall agreement with experts. The discriminatory ability of the Crowd at discerning differences in robotic movements (via APMs) through GEARS scoring is quite refined, rivaling that of expert evaluators.

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

★ PREMIUM-INHALT
e.Med Interdisziplinär

Mit e.Med Interdisziplinär erhalten Sie Zugang zu allen CME-Fortbildungen und Fachzeitschriften auf SpringerMedizin.de. Zusätzlich können Sie eine Zeitschrift Ihrer Wahl in gedruckter Form beziehen – ohne Aufpreis.

Weitere Produktempfehlungen anzeigen
Zusatzmaterial
Supplementary material 1 (XLSX 24 KB)
11701_2018_814_MOESM1_ESM.xlsx
Literatur
Über diesen Artikel

Weitere Artikel der Ausgabe 4/2018

Journal of Robotic Surgery 4/2018 Zur Ausgabe
  1. Das kostenlose Testabonnement läuft nach 14 Tagen automatisch und formlos aus. Dieses Abonnement kann nur einmal getestet werden.

  2. Das kostenlose Testabonnement läuft nach 14 Tagen automatisch und formlos aus. Dieses Abonnement kann nur einmal getestet werden.

Neu im Fachgebiet Chirurgie

Mail Icon II Newsletter

Bestellen Sie unseren kostenlosen Newsletter Update Chirurgie und bleiben Sie gut informiert – ganz bequem per eMail.

Bildnachweise