Skip to main content

Overall Proficiency Assessment in Point-of-Care Ultrasound Interventions: The Stopwatch is not Enough

  • Conference paper
  • First Online:
Imaging for Patient-Customized Simulations and Systems for Point-of-Care Ultrasound (BIVPCS 2017, POCUS 2017)

Abstract

With the shift in the medical education curriculum to a competency-based model, objective proficiency assessment is necessary. In this work, we use exploratory factor analysis to assess which primitive metrics convey unique information about proficiency in point-of-care ultrasound applications. We retrospectively validate the proposed methods on three datasets: FAST examination, femoral line, and lumbar puncture. We identify a minimal set of metrics for proficiency assessment in each application. Furthermore, we validate that overall proficiency assessment methods are unaffected by the removal of redundant metrics. This work demonstrates that proficiency in point-of-care ultrasound applications is multi-faceted, and that measuring completion time alone is not enough and application-specific metrics have added value in proficiency assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Reiley, C.E., Lin, H.C., Yuh, D.D., Hager, G.D.: Review of methods for objective surgical skill evaluation. Surg. Endosc. 25(2), 356–366 (2011)

    Article  Google Scholar 

  2. Vedula, S.S., Ishii, M., Hager, G.D.: Objective assessment of surgical technical skill and competency in the operating room. Annu. Rev. Biomed. Eng. 19(1), 301–325 (2017)

    Article  Google Scholar 

  3. Fraser, S.A., Klassen, D.R., Feldman, L.S., Ghitulescu, G.A., Stanbridge, D., Fried, G.M.: Evaluating laparoscopic skills. Surg. Endosc. Other Interv. Tech. 17(6), 964–967 (2003)

    Article  Google Scholar 

  4. Stylopoulos, N., et al.: Computer-enhanced laparoscopic training system (CELTS): bridging the gap. Surg. Endosc. 18(5), 782–789 (2004)

    Article  Google Scholar 

  5. Allen, B., Nistor, V., Dutson, E., Carman, G., Lewis, C., Faloutsos, P.: Support vector machines improve the accuracy of evaluation for the performance of laparoscopic training tasks. Surg. Endosc. 24(1), 170–178 (2010)

    Article  Google Scholar 

  6. Oropesa, I., et al.: Supervised classification of psychomotor competence in minimally invasive surgery based on instruments motion analysis. Surg. Endosc. 28(2), 657–670 (2014)

    Article  Google Scholar 

  7. Kramer, B.D., Losey, D.P., O’Malley, M.K.: SOM and LVQ classification of endovascular surgeons using motion-based metrics. In: Merényi, E., Mendenhall, M.J., O’Driscoll, P. (eds.) Advances in Self-Organizing Maps and Learning Vector Quantization. AISC, vol. 428, pp. 227–237. Springer, Cham (2016). doi:10.1007/978-3-319-28518-4_20

    Chapter  Google Scholar 

  8. Holden, M.S., Ungi, T., McKaigney, C., Bell, C., Rang, L., Fichtinger, G.: Objective evaluation of sonographic skill in focussed assessment with sonography for trauma examinations. In: CARS 2015—Computer Assisted Radiology and Surgery Proceedings of the 29th International Congress and Exhibition Barcelona, pp. S79–S80 (2015)

    Google Scholar 

  9. McGraw, R., et al.: Development and evaluation of a simulation-based curriculum for ultrasound-guided central venous catheterization. CJEM 18, 1–9 (2016)

    Article  Google Scholar 

  10. Yeo, C.T., Davison, C., Ungi, T., Holden, M., Fichtinger, G., McGraw, R.: Examination of learning trajectories for simulated lumbar puncture training using hand motion analysis. Acad. Emerg. Med. 22(10), 1187–1195 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthew S. Holden .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Holden, M.S., Keri, Z., Ungi, T., Fichtinger, G. (2017). Overall Proficiency Assessment in Point-of-Care Ultrasound Interventions: The Stopwatch is not Enough. In: Cardoso, M., et al. Imaging for Patient-Customized Simulations and Systems for Point-of-Care Ultrasound. BIVPCS POCUS 2017 2017. Lecture Notes in Computer Science(), vol 10549. Springer, Cham. https://doi.org/10.1007/978-3-319-67552-7_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67552-7_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67551-0

  • Online ISBN: 978-3-319-67552-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics