Skip to main content
Erschienen in: Surgical Endoscopy 2/2014

01.02.2014

Supervised classification of psychomotor competence in minimally invasive surgery based on instruments motion analysis

verfasst von: Ignacio Oropesa, Patricia Sánchez-González, Magdalena K. Chmarra, Pablo Lamata, Rodrigo Pérez-Rodríguez, Frank Willem Jansen, Jenny Dankelman, Enrique J. Gómez

Erschienen in: Surgical Endoscopy | Ausgabe 2/2014

Einloggen, um Zugang zu erhalten

Abstract

Background

Objective assessment of psychomotor skills has become an important challenge in the training of minimally invasive surgical (MIS) techniques. Currently, no gold standard defining surgical competence exists for classifying residents according to their surgical skills. Supervised classification has been proposed as a means for objectively establishing competence thresholds in psychomotor skills evaluation. This report presents a study comparing three classification methods for establishing their validity in a set of tasks for basic skills’ assessment.

Methods

Linear discriminant analysis (LDA), support vector machines (SVM), and adaptive neuro-fuzzy inference systems (ANFIS) were used. A total of 42 participants, divided into an experienced group (4 expert surgeons and 14 residents with >10 laparoscopic surgeries performed) and a nonexperienced group (16 students and 8 residents with <10 laparoscopic surgeries performed), performed three box trainer tasks validated for assessment of MIS psychomotor skills. Instrument movements were captured using the TrEndo tracking system, and nine motion analysis parameters (MAPs) were analyzed. The performance of the classifiers was measured by leave-one-out cross-validation using the scores obtained by the participants.

Results

The mean accuracy performances of the classifiers were 71 % (LDA), 78.2 % (SVM), and 71.7 % (ANFIS). No statistically significant differences in the performance were identified between the classifiers.

Conclusions

The three proposed classifiers showed good performance in the discrimination of skills, especially when information from all MAPs and tasks combined were considered. A correlation between the surgeons’ previous experience and their execution of the tasks could be ascertained from results. However, misclassifications across all the classifiers could imply the existence of other factors influencing psychomotor competence.
Literatur
1.
Zurück zum Zitat Aggarwal R, Moorthy K, Darzi A (2004) Laparoscopic skills training and assessment. Br J Surg 91:1549–1558PubMedCrossRef Aggarwal R, Moorthy K, Darzi A (2004) Laparoscopic skills training and assessment. Br J Surg 91:1549–1558PubMedCrossRef
2.
Zurück zum Zitat Usón J, Sánchez-Margallo FM, Pascual S, Climent S (2010) Formación en cirugía laparoscópica paso a paso, 4th edn. Centro de Cirugía de Mínima Invasión Jesús Usón, Cáceres Usón J, Sánchez-Margallo FM, Pascual S, Climent S (2010) Formación en cirugía laparoscópica paso a paso, 4th edn. Centro de Cirugía de Mínima Invasión Jesús Usón, Cáceres
4.
Zurück zum Zitat Moorthy K, Munz Y, Sarker SK, Darzi A (2003) Objective assessment of technical skills in surgery. Br Med J 327:1032–1037CrossRef Moorthy K, Munz Y, Sarker SK, Darzi A (2003) Objective assessment of technical skills in surgery. Br Med J 327:1032–1037CrossRef
6.
Zurück zum Zitat Hiemstra E (2012) Acquiring minimally invasive surgical skills. Department of Minimally Invasive Surgery in Gynaecology, Faculty of Medicine/Leiden University Medical Center (LUMC), Leiden University, Leiden Hiemstra E (2012) Acquiring minimally invasive surgical skills. Department of Minimally Invasive Surgery in Gynaecology, Faculty of Medicine/Leiden University Medical Center (LUMC), Leiden University, Leiden
8.
Zurück zum Zitat Oropesa I, Sanchez-Gonzalez P, Lamata P, Chmarra MK, Pagador JB, Sanchez-Margallo JA, Sanchez-Margallo FM, Gomez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171:E81–E95. doi:10.1016/j.jss.2011.06.034 PubMedCrossRef Oropesa I, Sanchez-Gonzalez P, Lamata P, Chmarra MK, Pagador JB, Sanchez-Margallo JA, Sanchez-Margallo FM, Gomez EJ (2011) Methods and tools for objective assessment of psychomotor skills in laparoscopic surgery. J Surg Res 171:E81–E95. doi:10.​1016/​j.​jss.​2011.​06.​034 PubMedCrossRef
9.
Zurück zum Zitat Chmarra MK, Klein S, de Winter JCF, Jansen FW, Dankelman J (2010) Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc 24:1031–1039PubMedCentralPubMedCrossRef Chmarra MK, Klein S, de Winter JCF, Jansen FW, Dankelman J (2010) Objective classification of residents based on their psychomotor laparoscopic skills. Surg Endosc 24:1031–1039PubMedCentralPubMedCrossRef
10.
Zurück zum Zitat Cotin S, Stylopoulos N, Ottensmeyer M, Neumann P, Rattner D, Dawson S (2002) Metrics for laparoscopic skills trainers: the weakest link! In: Dohi T, Kikinis R (eds) Medical image computing and computer-assisted intervention—MICCAI 2002. Springer, Berlin, pp 35–43CrossRef Cotin S, Stylopoulos N, Ottensmeyer M, Neumann P, Rattner D, Dawson S (2002) Metrics for laparoscopic skills trainers: the weakest link! In: Dohi T, Kikinis R (eds) Medical image computing and computer-assisted intervention—MICCAI 2002. Springer, Berlin, pp 35–43CrossRef
11.
Zurück zum Zitat Rosen J, Solazzo M, Hannaford B, Sinanan M (2002) Task decomposition of laparoscopic surgery for objective evaluation of surgical residents’ learning curve using hidden Markov model. Comput Aided Surg 7:49–61PubMedCrossRef Rosen J, Solazzo M, Hannaford B, Sinanan M (2002) Task decomposition of laparoscopic surgery for objective evaluation of surgical residents’ learning curve using hidden Markov model. Comput Aided Surg 7:49–61PubMedCrossRef
12.
13.
Zurück zum Zitat Feldman LS, Hagarty SE, Ghitulescu G, Stanbridge D, Fried GM (2004) Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. J Am Coll Surg 198:105–110PubMedCrossRef Feldman LS, Hagarty SE, Ghitulescu G, Stanbridge D, Fried GM (2004) Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. J Am Coll Surg 198:105–110PubMedCrossRef
15.
Zurück zum Zitat Reiley CE, Hager GD (2009) Task versus subtask surgical skill evaluation of robotic minimally invasive surgery. Med Image Comput Comput Assist Interv 12:435–442PubMed Reiley CE, Hager GD (2009) Task versus subtask surgical skill evaluation of robotic minimally invasive surgery. Med Image Comput Comput Assist Interv 12:435–442PubMed
16.
Zurück zum Zitat Leong JJH, Nicolaou M, Atallah L, Mylonas GP, Darzi A (2007) HMM assessment of quality of movement trajectory in laparoscopic surgery. Comput Aided Surg 12:335–346PubMed Leong JJH, Nicolaou M, Atallah L, Mylonas GP, Darzi A (2007) HMM assessment of quality of movement trajectory in laparoscopic surgery. Comput Aided Surg 12:335–346PubMed
18.
Zurück zum Zitat Allen BF, Nistor V, Dutson E, Carman G, Lewis C, Faloutsos P (2010) Support vector machines improve the accuracy of evaluation for the performance of laparoscopic training tasks. Surg Endosc 24:170–178. doi:10.1007/s00464-009-0556-6 PubMedCrossRef Allen BF, Nistor V, Dutson E, Carman G, Lewis C, Faloutsos P (2010) Support vector machines improve the accuracy of evaluation for the performance of laparoscopic training tasks. Surg Endosc 24:170–178. doi:10.​1007/​s00464-009-0556-6 PubMedCrossRef
20.
Zurück zum Zitat Huang J, Payandeh S, Doris P, Hajshirmohammadi I (2005) Fuzzy classification: towards evaluating performance on a surgical simulator. Stud Health Technol Inform 111:194–200PubMed Huang J, Payandeh S, Doris P, Hajshirmohammadi I (2005) Fuzzy classification: towards evaluating performance on a surgical simulator. Stud Health Technol Inform 111:194–200PubMed
21.
Zurück zum Zitat Oropesa I, Chmarra MK, Sanchez-Gonzalez P, Lamata P, Rodrigues SP, Enciso S, Sanchez-Margallo FM, Jansen FW, Dankelman J, Gomez EJ (2012) Relevance of motion-related assessment metrics in laparoscopic surgery. Surg Innov 20:302–315. doi:10.1177/1553350612459808 Oropesa I, Chmarra MK, Sanchez-Gonzalez P, Lamata P, Rodrigues SP, Enciso S, Sanchez-Margallo FM, Jansen FW, Dankelman J, Gomez EJ (2012) Relevance of motion-related assessment metrics in laparoscopic surgery. Surg Innov 20:302–315. doi:10.​1177/​1553350612459808​
22.
Zurück zum Zitat Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New York
23.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297 Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20:273–297
24.
Zurück zum Zitat Jang J-R (1993) ANFIS: adaptive-network-based fuzzy inference system: systems, man, and cybernetics. IEEE Trans 23:665–685 Jang J-R (1993) ANFIS: adaptive-network-based fuzzy inference system: systems, man, and cybernetics. IEEE Trans 23:665–685
25.
Zurück zum Zitat Pérez-Rodríguez R, Marcano-Cedeño A, Costa Ú, Solana J, Cáceres C, Opisso E, Tormos JM, Medina J, Gómez EJ (2012) Inverse kinematics of a 6 DoF human upper limb using ANFIS and ANN for anticipatory actuation in ADL-based physical neurorehabilitation. Expert Syst Appl 39:9612–9622. doi:10.1016/j.eswa.2012.02.143 CrossRef Pérez-Rodríguez R, Marcano-Cedeño A, Costa Ú, Solana J, Cáceres C, Opisso E, Tormos JM, Medina J, Gómez EJ (2012) Inverse kinematics of a 6 DoF human upper limb using ANFIS and ANN for anticipatory actuation in ADL-based physical neurorehabilitation. Expert Syst Appl 39:9612–9622. doi:10.​1016/​j.​eswa.​2012.​02.​143 CrossRef
27.
Zurück zum Zitat Jain AK, Duin RPW, Mao Jianchang (2000) Statistical pattern recognition: a review: pattern analysis and machine intelligence. IEEE Trans 22:4–37 Jain AK, Duin RPW, Mao Jianchang (2000) Statistical pattern recognition: a review: pattern analysis and machine intelligence. IEEE Trans 22:4–37
28.
Zurück zum Zitat Darzi A, Datta V, Mackay S (2001) The challenge of objective assessment of surgical skill. Am J Surg 181:484–486PubMedCrossRef Darzi A, Datta V, Mackay S (2001) The challenge of objective assessment of surgical skill. Am J Surg 181:484–486PubMedCrossRef
31.
Zurück zum Zitat Dumon KR, Traynor O, Broos P, Gruwez JA, Darzi A, Williams NN (2004) Surgical education in the new millennium: the European perspective. Surg Clin North Am 84:1471–1491, viii. doi:10.1016/j.suc.2004.06.005 Dumon KR, Traynor O, Broos P, Gruwez JA, Darzi A, Williams NN (2004) Surgical education in the new millennium: the European perspective. Surg Clin North Am 84:1471–1491, viii. doi:10.​1016/​j.​suc.​2004.​06.​005
32.
Zurück zum Zitat Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245:992–999PubMedCentralPubMedCrossRef Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245:992–999PubMedCentralPubMedCrossRef
33.
Zurück zum Zitat Yamaguchi S, Konishi K, Yasunaga T, Yoshida D, Kinjo N, Kobayashi K, Ieiri S, Okazaki K, Nakashima H, Tanoue K (2007) Construct validity for eye–hand coordination skill on a virtual reality laparoscopic surgical simulator. Surg Endosc 21:2253–2257PubMedCrossRef Yamaguchi S, Konishi K, Yasunaga T, Yoshida D, Kinjo N, Kobayashi K, Ieiri S, Okazaki K, Nakashima H, Tanoue K (2007) Construct validity for eye–hand coordination skill on a virtual reality laparoscopic surgical simulator. Surg Endosc 21:2253–2257PubMedCrossRef
Metadaten
Titel
Supervised classification of psychomotor competence in minimally invasive surgery based on instruments motion analysis
verfasst von
Ignacio Oropesa
Patricia Sánchez-González
Magdalena K. Chmarra
Pablo Lamata
Rodrigo Pérez-Rodríguez
Frank Willem Jansen
Jenny Dankelman
Enrique J. Gómez
Publikationsdatum
01.02.2014
Verlag
Springer US
Erschienen in
Surgical Endoscopy / Ausgabe 2/2014
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-013-3226-7

Weitere Artikel der Ausgabe 2/2014

Surgical Endoscopy 2/2014 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.