Ureteropelvic junction obstruction (UPJO) is an uncommonly encountered pathology, posing a challenge for resident training. We describe the development and face validation of a robotic pyeloplasty simulation using a 3D-printed silicone-based model of UPJO for surgical training, in combination with crowdsourced scoring to objectively assess performance and learning outcomes. The organs were created using 3D modeling software and printed using a silicone-based material by Lazarus 3D, LLC. They were secured in a laparoscopic box trainer and the robotic system was docked. Eight residents and three faculty each performed two robotic-assisted right dismembered pyeloplasties on separate occaisions. Face validity was evaluated on a 5-point Likert scale. Crowd-Sourced Assessment of Technical Skills (C-SATS Inc.) scored surgical performance using the Global Evaluative Assessment of Robotic Skills (GEARS) criteria, based on video review of each simulation. All participants completed the simulation twice with fully patent anastomoses. Average time to complete the first and second trials was 44.4 min and 43.2 min, respectively. The average GEARS score was 17.1 and 17.6 for the first and second trials respectively. Participants improved on average in all 5 GEARS categories, with significant improvement in depth perception (p = 0.006). The model received mean scores (out of 5) of 4.36 for aesthetics, 4.18 for overall feel, 3.55 for realism, 4.72 for usability, and 4.72 for suturability. Residents had a significant increase in confidence between initial and final surveys on a 5-point Likert Scale: 1.63 vs. 2.38 (p = 0.03). Using 3D-printed silicone-based models, participants completed robotic-assisted dismembered pyeloplasties for training and skill acquisition. We demonstrated face validity of the simulation, which was also found to improve participant speed and significantly improve resident confidence. Crowdsourced assessment demonstrated significant improvement in depth perception.
