Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 11/2020

12.10.2020 | Original Article

Clearness of operating field: a surrogate for surgical skills on in vivo clinical data

verfasst von: Daochang Liu, Tingting Jiang, Yizhou Wang, Rulin Miao, Fei Shan, Ziyu Li

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 11/2020

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Automatic surgical skill assessment is an emerging field beneficial to both efficiency and quality of surgical education and practice. Prior works largely evaluate skills on elementary tasks performed in the simulation laboratory, which cannot fully reflect the variety of intraoperative circumstances in the real operating room. In this paper, we attempt to fill this gap by expanding surgical skill assessment onto a clinical dataset including fifty-seven in vivo surgeries.

Methods

To tackle the workflow and device constraints in the clinical setting, we propose a robust and non-interruptive surrogate for surgical skills, namely the clearness of operating field (COF), which shows strong correlation with overall skills and high inter-annotator consistency on our clinical data. Then, an automatic model based on neural networks is developed to regress surgical skills through the surrogate of COF using only video as input.

Results

The automatic model achieves 0.595 Spearman’s correlation with the ground truth of overall technical skill, which even exceeds the human performance of junior surgeons. Moreover, an exploratory study is conducted to validate the skill predictions against the clinical outcomes of patients.

Conclusion

Our results demonstrate that the surrogate of COF is promising and the approach is potentially applicable to clinical practice.
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
Complication data are obtained from the medical records and prospective registration database at the hospital. See the supplementary for details.
 
2
The significant level is at \({p} \le 0.05/3 = 0.0167\) based on Bonferroni correction for multiple comparisons.
 
Literatur
1.
Zurück zum Zitat Ahmidi N, Hager GD, Ishii L, Gallia GL, Ishii M (2012) Robotic path planning for surgeon skill evaluation in minimally-invasive sinus surgery. In: MICCAI Ahmidi N, Hager GD, Ishii L, Gallia GL, Ishii M (2012) Robotic path planning for surgeon skill evaluation in minimally-invasive sinus surgery. In: MICCAI
2.
Zurück zum Zitat Ahmidi N, Poddar P, Jones JD, Vedula SS, Ishii L, Hager GD, Ishii M (2015) Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty. In: IJCARS Ahmidi N, Poddar P, Jones JD, Vedula SS, Ishii L, Hager GD, Ishii M (2015) Automated objective surgical skill assessment in the operating room from unstructured tool motion in septoplasty. In: IJCARS
3.
Zurück zum Zitat Azari DP, Frasier LL, Quamme SRP, Greenberg CC, Pugh CM, Greenberg JA, Radwin RG (2019) Modeling surgical technical skill using expert assessment for automated computer rating. Ann Surg 269:574–581CrossRefPubMed Azari DP, Frasier LL, Quamme SRP, Greenberg CC, Pugh CM, Greenberg JA, Radwin RG (2019) Modeling surgical technical skill using expert assessment for automated computer rating. Ann Surg 269:574–581CrossRefPubMed
4.
Zurück zum Zitat Birkmeyer JD, Finks JF, Oreilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJ (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442CrossRefPubMed Birkmeyer JD, Finks JF, Oreilly A, Oerline M, Carlin AM, Nunn AR, Dimick J, Banerjee M, Birkmeyer NJ (2013) Surgical skill and complication rates after bariatric surgery. N Engl J Med 369:1434–1442CrossRefPubMed
5.
Zurück zum Zitat Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y(2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 Cho K, Van Merriënboer B, Gulcehre C, Bahdanau D, Bougares F, Schwenk H, Bengio Y(2014) Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:​1406.​1078
6.
Zurück zum Zitat Doughty H, Damen D, Mayol-Cuevas W (2018) Who’s better? Who’s best? CVPR, Pairwise deep ranking for skill determination Doughty H, Damen D, Mayol-Cuevas W (2018) Who’s better? Who’s best? CVPR, Pairwise deep ranking for skill determination
7.
Zurück zum Zitat Ershad M, Koesters Z, Rege R, Majewicz A (2016) Meaningful assessment of surgical expertise: semantic labeling with data and crowds. In: MICCAI Ershad M, Koesters Z, Rege R, Majewicz A (2016) Meaningful assessment of surgical expertise: semantic labeling with data and crowds. In: MICCAI
8.
Zurück zum Zitat Fawaz HI, Forestier G, Weber J, Idoumghar L, Muller PA (2019) Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networks. In: IJCARS Fawaz HI, Forestier G, Weber J, Idoumghar L, Muller PA (2019) Accurate and interpretable evaluation of surgical skills from kinematic data using fully convolutional neural networks. In: IJCARS
9.
Zurück zum Zitat Funke I, Mees ST, Weitz J, Speidel S(2019) Video-based surgical skill assessment using 3d convolutional neural networks. In: IJCARS Funke I, Mees ST, Weitz J, Speidel S(2019) Video-based surgical skill assessment using 3d convolutional neural networks. In: IJCARS
10.
Zurück zum Zitat Huang CM, Zheng CH (2015) Laparoscopic gastrectomy for gastric cancer: surgical technique and lymphadenectomy. Springer, BerlinCrossRef Huang CM, Zheng CH (2015) Laparoscopic gastrectomy for gastric cancer: surgical technique and lymphadenectomy. Springer, BerlinCrossRef
11.
Zurück zum Zitat Ismail Fawaz H, Forestier G, Weber J, Idoumghar L, Muller PA(2018) Evaluating surgical skills from kinematic data using convolutional neural networks. In: MICCAI Ismail Fawaz H, Forestier G, Weber J, Idoumghar L, Muller PA(2018) Evaluating surgical skills from kinematic data using convolutional neural networks. In: MICCAI
12.
Zurück zum Zitat Jin A, Yeung S, Jopling J, Krause J, Azagury D, Milstein A, Fei-Fei L (2018) Tool detection and operative skill assessment in surgical videos using region-based convolutional neural networks. In: WACV Jin A, Yeung S, Jopling J, Krause J, Azagury D, Milstein A, Fei-Fei L (2018) Tool detection and operative skill assessment in surgical videos using region-based convolutional neural networks. In: WACV
13.
Zurück zum Zitat Lea C, Flynn MD, Vidal R, Reiter A, Hager GD (2017) Temporal convolutional networks for action segmentation and detection. In: CVPR Lea C, Flynn MD, Vidal R, Reiter A, Hager GD (2017) Temporal convolutional networks for action segmentation and detection. In: CVPR
14.
Zurück zum Zitat Liu D, Jiang T, Wang Y, Miao R, Shan F, Li Z (2019) Surgical skill assessment on in-vivo clinical data via the clearness of operating field. In: MICCAI Liu D, Jiang T, Wang Y, Miao R, Shan F, Li Z (2019) Surgical skill assessment on in-vivo clinical data via the clearness of operating field. In: MICCAI
15.
Zurück zum Zitat Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR (2010) Eye metrics as an objective assessment of surgical skill. Ann Surg 252:177–182CrossRefPubMed Richstone L, Schwartz MJ, Seideman C, Cadeddu J, Marshall S, Kavoussi LR (2010) Eye metrics as an objective assessment of surgical skill. Ann Surg 252:177–182CrossRefPubMed
16.
Zurück zum Zitat Vedula SS, Ishii M, Hager GD (2017) Objective assessment of surgical technical skill and competency in the operating room. Annu Rev Biomed Eng 19:301–325CrossRefPubMedPubMedCentral Vedula SS, Ishii M, Hager GD (2017) Objective assessment of surgical technical skill and competency in the operating room. Annu Rev Biomed Eng 19:301–325CrossRefPubMedPubMedCentral
17.
Zurück zum Zitat Wang Z, Fey AM (2018) Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery. In: IJCARS Wang Z, Fey AM (2018) Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery. In: IJCARS
18.
Zurück zum Zitat Zhang Q, Li B (2015) Relative hidden Markov models for video-based evaluation of motion skills in surgical training. IEEE Trans Pattern Anal Mach Intell 37:1206–1218CrossRefPubMed Zhang Q, Li B (2015) Relative hidden Markov models for video-based evaluation of motion skills in surgical training. IEEE Trans Pattern Anal Mach Intell 37:1206–1218CrossRefPubMed
19.
Zurück zum Zitat Zia A, Essa I (2018) Automated surgical skill assessment in RMIS training. In: IJCARS Zia A, Essa I (2018) Automated surgical skill assessment in RMIS training. In: IJCARS
20.
Zurück zum Zitat Zia A, Sharma Y, Bettadapura V, Sarin EL, Essa I (2018) Video and accelerometer-based motion analysis for automated surgical skills assessment. In: IJCARS Zia A, Sharma Y, Bettadapura V, Sarin EL, Essa I (2018) Video and accelerometer-based motion analysis for automated surgical skills assessment. In: IJCARS
21.
Zurück zum Zitat Zia A, Sharma Y, Bettadapura V, Sarin EL, Ploetz T, Clements MA, Essa I(2016) Automated video-based assessment of surgical skills for training and evaluation in medical schools. In: IJCARS Zia A, Sharma Y, Bettadapura V, Sarin EL, Ploetz T, Clements MA, Essa I(2016) Automated video-based assessment of surgical skills for training and evaluation in medical schools. In: IJCARS
Metadaten
Titel
Clearness of operating field: a surrogate for surgical skills on in vivo clinical data
verfasst von
Daochang Liu
Tingting Jiang
Yizhou Wang
Rulin Miao
Fei Shan
Ziyu Li
Publikationsdatum
12.10.2020
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 11/2020
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02267-z

Weitere Artikel der Ausgabe 11/2020

International Journal of Computer Assisted Radiology and Surgery 11/2020 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.