Skip to main content
Erschienen in: Surgical Endoscopy 2/2013

01.02.2013

Surgeons blinded by enhanced navigation: the effect of augmented reality on attention

verfasst von: Benjamin J. Dixon, Michael J. Daly, Harley Chan, Allan D. Vescan, Ian J. Witterick, Jonathan C. Irish

Erschienen in: Surgical Endoscopy | Ausgabe 2/2013

Einloggen, um Zugang zu erhalten

Abstract

Background

Advanced image-guidance systems allowing presentation of three-dimensional navigational data in real time are being developed enthusiastically for many medical procedures. Other industries, including aviation and the military, have noted that shifting attention toward such compelling assistance has detrimental effects. Using the detection rate of unexpected findings, we assess whether inattentional blindness is significant in a surgical context and evaluate the impact of on-screen navigational cuing with augmented reality.

Methods

Surgeons and trainees performed an endoscopic navigation exercise on a cadaveric specimen. The subjects were randomized to either a standard endoscopic view (control) or an AR view consisting of an endoscopic video fused with anatomic contours. Two unexpected findings were presented in close proximity to the target point: one critical complication and one foreign body (screw). Task completion time, accuracy, and recognition of findings were recorded.

Results

Detection of the complication was 0/15 in the AR group versus 7/17 in the control group (p = 0.008). Detection of the screw was 1/15 (AR) and 7/17 (control) (p = 0.041). Recognition of either finding was 12/17 for the control group and 1/15 for the AR group (p < 0.001). Accuracy was greater for the AR group than for the control group, with the median distance from the target point measuring respectively 2.10 mm (interquartile range [IQR], 1.29–2.37) and 4.13 (IQR, 3.11–7.39) (p < 0.001).

Conclusion

Inattentional blindness was evident in both groups. Although more accurate, the AR group was less likely to identify significant unexpected findings clearly within view. Advanced navigational displays may increase precision, but strategies to mitigate attentional costs need further investigation to allow safe implementation.
Literatur
1.
Zurück zum Zitat Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142PubMedCrossRef Cleary K, Peters TM (2010) Image-guided interventions: technology review and clinical applications. Annu Rev Biomed Eng 12:119–142PubMedCrossRef
2.
Zurück zum Zitat Strauss G, Koulechov K, Rottger S, Bahner J, Trantakis C, Hofer M, Korb W, Burgert O, Meixensberger J, Manzey D, Dietz A, Luth T (2006) Evaluation of a navigation system for ENT with surgical efficiency criteria. Laryngoscope 116:564–572PubMedCrossRef Strauss G, Koulechov K, Rottger S, Bahner J, Trantakis C, Hofer M, Korb W, Burgert O, Meixensberger J, Manzey D, Dietz A, Luth T (2006) Evaluation of a navigation system for ENT with surgical efficiency criteria. Laryngoscope 116:564–572PubMedCrossRef
3.
Zurück zum Zitat Nithiananthan S, Brock KK, Daly MJ, Chan H, Irish JC, Siewerdsen JH (2009) Demons deformable registration for CBCT-guided procedures in the head and neck: convergence and accuracy. Med Phys 36:4755–4764PubMedCrossRef Nithiananthan S, Brock KK, Daly MJ, Chan H, Irish JC, Siewerdsen JH (2009) Demons deformable registration for CBCT-guided procedures in the head and neck: convergence and accuracy. Med Phys 36:4755–4764PubMedCrossRef
4.
Zurück zum Zitat Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C, Sutton E, George I, Kavic S, Mezrich R, Park A (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24:1976–1985PubMedCrossRef Shekhar R, Dandekar O, Bhat V, Philip M, Lei P, Godinez C, Sutton E, George I, Kavic S, Mezrich R, Park A (2010) Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography. Surg Endosc 24:1976–1985PubMedCrossRef
5.
Zurück zum Zitat Cheung CL, Wedlake C, Moore J, Pautler SE, Peters TM (2010) Fused video and ultrasound images for minimally invasive partial nephrectomy: a phantom study. Med Image Comput Comput Assist Interv 13(Pt 3):408–415PubMed Cheung CL, Wedlake C, Moore J, Pautler SE, Peters TM (2010) Fused video and ultrasound images for minimally invasive partial nephrectomy: a phantom study. Med Image Comput Comput Assist Interv 13(Pt 3):408–415PubMed
6.
Zurück zum Zitat Siewerdsen JH, Daly MJ, Chan H, Nithiananthan S, Hamming N, Brock KK, Irish JC (2009) High-performance intraoperative cone-beam CT on a mobile C-arm: an integrated system for guidance of head and neck surgery. Proc SPIE 7261(1):72610JCrossRef Siewerdsen JH, Daly MJ, Chan H, Nithiananthan S, Hamming N, Brock KK, Irish JC (2009) High-performance intraoperative cone-beam CT on a mobile C-arm: an integrated system for guidance of head and neck surgery. Proc SPIE 7261(1):72610JCrossRef
7.
Zurück zum Zitat Daly MJ, Chan H, Nithiananthan S, Qiu J, Barker E, Bachar G, Dixon BJ, Irish JC, Siewerdsen JH (2011) Clinical implementation of intraoperative cone-beam CT in head and neck surgery. Proc SPIE 7964:796426 Daly MJ, Chan H, Nithiananthan S, Qiu J, Barker E, Bachar G, Dixon BJ, Irish JC, Siewerdsen JH (2011) Clinical implementation of intraoperative cone-beam CT in head and neck surgery. Proc SPIE 7964:796426
8.
Zurück zum Zitat Daly MJ, Chan H, Prisman E, Vescan A, Nithiananthan S, Qiu J, Weersink R, Irish JC, Siewerdsen JH (2010) Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures. Proc SPIE 7625:762503CrossRef Daly MJ, Chan H, Prisman E, Vescan A, Nithiananthan S, Qiu J, Weersink R, Irish JC, Siewerdsen JH (2010) Fusion of intraoperative cone-beam CT and endoscopic video for image-guided procedures. Proc SPIE 7625:762503CrossRef
9.
Zurück zum Zitat Azuma RT (1997) A survey of augmented reality. In presence: teleoperators and virtual environments 4:355–385 Azuma RT (1997) A survey of augmented reality. In presence: teleoperators and virtual environments 4:355–385
10.
Zurück zum Zitat Teber D, Guven S, Simpfendorfer T, Baumhauer M, Guven EO, Yencilek F, Gozen AS, Rassweiler J (2009) Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 56:332–338PubMedCrossRef Teber D, Guven S, Simpfendorfer T, Baumhauer M, Guven EO, Yencilek F, Gozen AS, Rassweiler J (2009) Augmented reality: a new tool to improve surgical accuracy during laparoscopic partial nephrectomy? Preliminary in vitro and in vivo results. Eur Urol 56:332–338PubMedCrossRef
11.
Zurück zum Zitat Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreat Sci 18(4):506–509 Volonte F, Pugin F, Bucher P, Sugimoto M, Ratib O, Morel P (2011) Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion. J Hepatobiliary Pancreat Sci 18(4):506–509
12.
Zurück zum Zitat Fernandez-Esparrach G, San Jose Estepar R, Guarner-Argente C, Martinez-Palli G, Navarro R, Rodriguez de Miguel C, Cordova H, Thompson CC, Lacy AM, Donoso L, Ayuso-Colella JR, Gines A, Pellise M, Llach J, Vosburgh KG (2010) The role of a computed tomography-based image registered navigation system for natural orifice transluminal endoscopic surgery: a comparative study in a porcine model. Endoscopy 42:1096–1103PubMedCrossRef Fernandez-Esparrach G, San Jose Estepar R, Guarner-Argente C, Martinez-Palli G, Navarro R, Rodriguez de Miguel C, Cordova H, Thompson CC, Lacy AM, Donoso L, Ayuso-Colella JR, Gines A, Pellise M, Llach J, Vosburgh KG (2010) The role of a computed tomography-based image registered navigation system for natural orifice transluminal endoscopic surgery: a comparative study in a porcine model. Endoscopy 42:1096–1103PubMedCrossRef
13.
Zurück zum Zitat Simons DJ, Chabris CF (1999) Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception 28:1059–1074PubMedCrossRef Simons DJ, Chabris CF (1999) Gorillas in our midst: sustained inattentional blindness for dynamic events. Perception 28:1059–1074PubMedCrossRef
14.
Zurück zum Zitat Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12:80–90PubMedCrossRef Carswell CM, Clarke D, Seales WB (2005) Assessing mental workload during laparoscopic surgery. Surg Innov 12:80–90PubMedCrossRef
15.
Zurück zum Zitat Yeh M, Wickens CD (2001) Display signaling in augmented reality: effects of cue reliability and image realism on attention allocation and trust calibration. Hum Factors 43:355–365PubMedCrossRef Yeh M, Wickens CD (2001) Display signaling in augmented reality: effects of cue reliability and image realism on attention allocation and trust calibration. Hum Factors 43:355–365PubMedCrossRef
16.
Zurück zum Zitat Maltz M, Shinar D (2003) New alternative methods of analyzing human behavior in cued target acquisition. Hum Factors 45:281–295PubMedCrossRef Maltz M, Shinar D (2003) New alternative methods of analyzing human behavior in cued target acquisition. Hum Factors 45:281–295PubMedCrossRef
17.
Zurück zum Zitat Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128PubMedCrossRef Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31:1116–1128PubMedCrossRef
18.
Zurück zum Zitat Liu D, Jenkins SA, Sanderson PM (2009) Patient monitoring with head-mounted displays. Curr Opin Anaesthesiol 22:796–803PubMedCrossRef Liu D, Jenkins SA, Sanderson PM (2009) Patient monitoring with head-mounted displays. Curr Opin Anaesthesiol 22:796–803PubMedCrossRef
19.
Zurück zum Zitat Liu D, Jenkins SA, Sanderson PM, Fabian P, Russell WJ (2010) Monitoring with head-mounted displays in general anesthesia: a clinical evaluation in the operating room. Anesth Analg 110:1032–1038PubMedCrossRef Liu D, Jenkins SA, Sanderson PM, Fabian P, Russell WJ (2010) Monitoring with head-mounted displays in general anesthesia: a clinical evaluation in the operating room. Anesth Analg 110:1032–1038PubMedCrossRef
20.
Zurück zum Zitat Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. J Display Technol 4:451–467CrossRef Sielhorst T, Feuerstein M, Navab N (2008) Advanced medical displays: a literature review of augmented reality. J Display Technol 4:451–467CrossRef
21.
Zurück zum Zitat McCann RS, Foyle DC, Andre AD, Battiste V (1996) Advanced navigation aids in the flight deck: effects on ground taxi performance under low visibilty conditions. SAE Transact J Aerospace 105:1419–1430 McCann RS, Foyle DC, Andre AD, Battiste V (1996) Advanced navigation aids in the flight deck: effects on ground taxi performance under low visibilty conditions. SAE Transact J Aerospace 105:1419–1430
22.
Zurück zum Zitat Marescaux J, Rubino F, Arenas M, Mutter D, Soler L (2004) Augmented-reality-assisted laparoscopic adrenalectomy. JAMA 292:2214–2215PubMedCrossRef Marescaux J, Rubino F, Arenas M, Mutter D, Soler L (2004) Augmented-reality-assisted laparoscopic adrenalectomy. JAMA 292:2214–2215PubMedCrossRef
23.
Zurück zum Zitat Kawamata T, Iseki H, Shibasaki T, Hori T (2002) Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 50:1393–1397PubMed Kawamata T, Iseki H, Shibasaki T, Hori T (2002) Endoscopic augmented reality navigation system for endonasal transsphenoidal surgery to treat pituitary tumors: technical note. Neurosurgery 50:1393–1397PubMed
24.
Zurück zum Zitat Wickens CD (2005) Attentional tunneling and task management: Technical Report AHFD-05-23/NASA-05-10. University of Illinois, Urbana-Champaign Wickens CD (2005) Attentional tunneling and task management: Technical Report AHFD-05-23/NASA-05-10. University of Illinois, Urbana-Champaign
25.
Zurück zum Zitat Shappell SA, Wiegmann DA (2003) A human error analysis of general aviation controlled flight into terrain accidents occurring between 1990–1998. Final Rep. DOT/FAA/AM-03/4. Office of Aerospace Medicine, Washington, DC Shappell SA, Wiegmann DA (2003) A human error analysis of general aviation controlled flight into terrain accidents occurring between 1990–1998. Final Rep. DOT/FAA/AM-03/4. Office of Aerospace Medicine, Washington, DC
26.
Zurück zum Zitat Strayer DL, Johnston WA (2001) Driven to distraction: dual-task studies of simulated driving and conversing on cellular telephone. Psychol Sci 12:462–466PubMedCrossRef Strayer DL, Johnston WA (2001) Driven to distraction: dual-task studies of simulated driving and conversing on cellular telephone. Psychol Sci 12:462–466PubMedCrossRef
27.
Zurück zum Zitat Horrey WJ, Wickens CD (2006) Examining the impact of cell phone conversations on driving using meta-analytic techniques. Hum Factors 48:196–205PubMedCrossRef Horrey WJ, Wickens CD (2006) Examining the impact of cell phone conversations on driving using meta-analytic techniques. Hum Factors 48:196–205PubMedCrossRef
28.
Zurück zum Zitat McCann RS, Foyle DC, Johnston JC (1993) Attentional limitations with head-up displays. In: Jensen RS (ed) Proceedings of the Seventh International Symposium on Aviation Psychology 1993, Colombus, pp 70–75 McCann RS, Foyle DC, Johnston JC (1993) Attentional limitations with head-up displays. In: Jensen RS (ed) Proceedings of the Seventh International Symposium on Aviation Psychology 1993, Colombus, pp 70–75
29.
Zurück zum Zitat Fischer E, Haines RF, Price TA (1980) Cognitive issues in head-up displays. NASA Technical paper 1711. NASA Ames Research Center, Moffat Field Fischer E, Haines RF, Price TA (1980) Cognitive issues in head-up displays. NASA Technical paper 1711. NASA Ames Research Center, Moffat Field
30.
Zurück zum Zitat Wickens CD, Alexander AL, Horrey WJ, Nunes A, Hardy TJ (2004) Traffic and flight guidance depiction on a synthetic vision system display: the affects of clutter on performance and visual attention allocation. In: Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, pp 218–222 Wickens CD, Alexander AL, Horrey WJ, Nunes A, Hardy TJ (2004) Traffic and flight guidance depiction on a synthetic vision system display: the affects of clutter on performance and visual attention allocation. In: Proceedings of the 48th Annual Meeting of the Human Factors and Ergonomics Society, Santa Monica, pp 218–222
31.
Zurück zum Zitat Berbaum KS, Franken EA Jr, Dorfman DD, Miller EM, Krupinski EA, Kreinbring K, Caldwell RT, Lu CH (1996) Cause of satisfaction of search effects in contrast studies of the abdomen. Acad Radiol 3:815–826PubMedCrossRef Berbaum KS, Franken EA Jr, Dorfman DD, Miller EM, Krupinski EA, Kreinbring K, Caldwell RT, Lu CH (1996) Cause of satisfaction of search effects in contrast studies of the abdomen. Acad Radiol 3:815–826PubMedCrossRef
32.
Zurück zum Zitat Samuel S, Kundel HL, Nodine CF, Toto LC (1995) Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs. Radiology 194:895–902PubMed Samuel S, Kundel HL, Nodine CF, Toto LC (1995) Mechanism of satisfaction of search: eye position recordings in the reading of chest radiographs. Radiology 194:895–902PubMed
33.
Zurück zum Zitat Berbaum KS, Caldwell RT, Schartz KM, Thompson BH, Franken EA Jr (2007) Does computer-aided diagnosis for lung tumors change satisfaction of search in chest radiography? Acad Radiol 14:1069–1076PubMedCrossRef Berbaum KS, Caldwell RT, Schartz KM, Thompson BH, Franken EA Jr (2007) Does computer-aided diagnosis for lung tumors change satisfaction of search in chest radiography? Acad Radiol 14:1069–1076PubMedCrossRef
34.
Zurück zum Zitat Yeh M, Merlo JL, Wickens CD, Brandenburg DL (2003) Head-up versus head-down: the costs of imprecision, unreliability, and visual clutter on cue effectiveness for display signaling. Hum Factors 45:390–407PubMedCrossRef Yeh M, Merlo JL, Wickens CD, Brandenburg DL (2003) Head-up versus head-down: the costs of imprecision, unreliability, and visual clutter on cue effectiveness for display signaling. Hum Factors 45:390–407PubMedCrossRef
35.
Zurück zum Zitat Ververs PM, Wickens CD (1998) Head-up displays: effects of clutter, display intensity, and display location on pilot performance. Int J Aviat Psychol 8:377–403PubMedCrossRef Ververs PM, Wickens CD (1998) Head-up displays: effects of clutter, display intensity, and display location on pilot performance. Int J Aviat Psychol 8:377–403PubMedCrossRef
36.
Zurück zum Zitat Livingston MA (2005) Evaluating human factors in augmented reality systems. IEEE Comput Graph Appl 25:6–9PubMedCrossRef Livingston MA (2005) Evaluating human factors in augmented reality systems. IEEE Comput Graph Appl 25:6–9PubMedCrossRef
37.
Zurück zum Zitat Shenai MB, Dillavou M, Shum C, Ross D, Tubbs RS, Shih A, Guthrie BL (2011) Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance. Neurosurgery 68(1 Suppl operative):200–207; discussion 207 Shenai MB, Dillavou M, Shum C, Ross D, Tubbs RS, Shih A, Guthrie BL (2011) Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance. Neurosurgery 68(1 Suppl operative):200–207; discussion 207
38.
Zurück zum Zitat Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46:50–80PubMed Lee JD, See KA (2004) Trust in automation: designing for appropriate reliance. Hum Factors 46:50–80PubMed
39.
Zurück zum Zitat Sanderson PM, Liu D, Jenkins SA (2009) Auditory displays in anesthesiology. Curr Opin Anaesthesiol 22:788–795PubMedCrossRef Sanderson PM, Liu D, Jenkins SA (2009) Auditory displays in anesthesiology. Curr Opin Anaesthesiol 22:788–795PubMedCrossRef
Metadaten
Titel
Surgeons blinded by enhanced navigation: the effect of augmented reality on attention
verfasst von
Benjamin J. Dixon
Michael J. Daly
Harley Chan
Allan D. Vescan
Ian J. Witterick
Jonathan C. Irish
Publikationsdatum
01.02.2013
Verlag
Springer-Verlag
Erschienen in
Surgical Endoscopy / Ausgabe 2/2013
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-012-2457-3

Weitere Artikel der Ausgabe 2/2013

Surgical Endoscopy 2/2013 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

CME: 2 Punkte

Prof. Dr. med. Gregor Antoniadis Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

CME: 2 Punkte

Dr. med. Benjamin Meyknecht, PD Dr. med. Oliver Pieske Das Webinar S2e-Leitlinie „Distale Radiusfraktur“ beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

CME: 2 Punkte

Dr. med. Mihailo Andric
Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.