Skip to main content
Erschienen in: Journal of Medical Systems 4/2014

01.04.2014 | Systems-Level Quality Improvement

Usability Evaluation of Laboratory and Radiology Information Systems Integrated into a Hospital Information System

verfasst von: Ehsan Nabovati, Hasan Vakili-Arki, Saeid Eslami, Reza Khajouei

Erschienen in: Journal of Medical Systems | Ausgabe 4/2014

Einloggen, um Zugang zu erhalten

Abstract

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen’s heuristics to identify and classify usability problems and Nielsen’s severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, “consistency and standards” was violated most frequently. Moreover, mean severity of problems concerning “error prevention” and “help and documentation” heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.
Literatur
1.
Zurück zum Zitat Kohn, L. T., Corrigan, J. M., and Donaldson, M. S., To err is human: building a safer health system. Institute of Medicine, Washington, 2000. Kohn, L. T., Corrigan, J. M., and Donaldson, M. S., To err is human: building a safer health system. Institute of Medicine, Washington, 2000.
2.
Zurück zum Zitat Kaushal, R., Shojania, K. G., and Bates, D. W., Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch. Intern. Med. 163(12):1409–1416, 2003.CrossRef Kaushal, R., Shojania, K. G., and Bates, D. W., Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch. Intern. Med. 163(12):1409–1416, 2003.CrossRef
3.
Zurück zum Zitat Khajouei, R., and Jaspers, M. W., The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1):3–19, 2010. Khajouei, R., and Jaspers, M. W., The impact of CPOE medication systems’ design aspects on usability, workflow and medication orders: a systematic review. Methods Inf. Med. 49(1):3–19, 2010.
4.
Zurück zum Zitat Koppel, R., Metlay, J. P., Cohen, A., Abaluck, B., Localio, A. R., Kimmel, S. E., and Strom, B. L., Role of computerized physician order entry systems in facilitating medication errors. J. Am. Med. Assoc. 293(10):1197–1203, 2005.CrossRef Koppel, R., Metlay, J. P., Cohen, A., Abaluck, B., Localio, A. R., Kimmel, S. E., and Strom, B. L., Role of computerized physician order entry systems in facilitating medication errors. J. Am. Med. Assoc. 293(10):1197–1203, 2005.CrossRef
5.
Zurück zum Zitat Shu, K., Boyle, D., Spurr, C., Horsky, J., Heiman, H., O’Connor, P., Lepore, J., and Bates, D. W., Comparison of time spent writing orders on paper with computerized physician order entry. Stud. Health. Technol. Inform. 84(Pt 2):1207–1211, 2001. Shu, K., Boyle, D., Spurr, C., Horsky, J., Heiman, H., O’Connor, P., Lepore, J., and Bates, D. W., Comparison of time spent writing orders on paper with computerized physician order entry. Stud. Health. Technol. Inform. 84(Pt 2):1207–1211, 2001.
6.
Zurück zum Zitat Tierney, W. M., Miller, M. E., Overhage, J. M., and McDonald, C. J., Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. J. Am. Med. Assoc. 269(3):379–383, 1993.CrossRef Tierney, W. M., Miller, M. E., Overhage, J. M., and McDonald, C. J., Physician inpatient order writing on microcomputer workstations. Effects on resource utilization. J. Am. Med. Assoc. 269(3):379–383, 1993.CrossRef
7.
Zurück zum Zitat Horsky J, Kaufman DR, Patel VL (2003) The cognitive complexity of a provider order entry interface. AMIA Annual Symposium proceedings/AMIA Symposium AMIA Symposium:294–298 Horsky J, Kaufman DR, Patel VL (2003) The cognitive complexity of a provider order entry interface. AMIA Annual Symposium proceedings/AMIA Symposium AMIA Symposium:294–298
8.
Zurück zum Zitat Khajouei, R., Peek, N., Wierenga, P. C., Kersten, M. J., and Jaspers, M. W., Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int. J. Med. Inform. 79(10):690–698, 2010.CrossRef Khajouei, R., Peek, N., Wierenga, P. C., Kersten, M. J., and Jaspers, M. W., Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int. J. Med. Inform. 79(10):690–698, 2010.CrossRef
9.
Zurück zum Zitat Kushniruk, A. W., Triola, M. M., Borycki, E. M., Stein, B., and Kannry, J. L., Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int. J. Med. Inform. 74(7–8):519–526, 2005.CrossRef Kushniruk, A. W., Triola, M. M., Borycki, E. M., Stein, B., and Kannry, J. L., Technology induced error and usability: the relationship between usability problems and prescription errors when using a handheld application. Int. J. Med. Inform. 74(7–8):519–526, 2005.CrossRef
10.
Zurück zum Zitat Thyvalikakath, T. P., Monaco, V., Thambuganipalle, H. B., and Schleyer, T., A usability evaluation of four commercial dental computer-based patient record systems. J. Am. Dent. Assoc. 139(12):1632–1642, 2008.CrossRef Thyvalikakath, T. P., Monaco, V., Thambuganipalle, H. B., and Schleyer, T., A usability evaluation of four commercial dental computer-based patient record systems. J. Am. Dent. Assoc. 139(12):1632–1642, 2008.CrossRef
11.
Zurück zum Zitat Part 11 : Guidance on usability (ISO 9242–11) (1998). In: Ergonomic requirements for office work with visual display terminals (VDTs). Part 11 : Guidance on usability (ISO 9242–11) (1998). In: Ergonomic requirements for office work with visual display terminals (VDTs).
12.
Zurück zum Zitat Shah, S. G., and Robinson, I., Benefits of and barriers to involving users in medical device technology development and evaluation. Int. J. Technol. Assess. Health Care 23(1):131–137, 2007.CrossRef Shah, S. G., and Robinson, I., Benefits of and barriers to involving users in medical device technology development and evaluation. Int. J. Technol. Assess. Health Care 23(1):131–137, 2007.CrossRef
13.
Zurück zum Zitat Jaspers, M. W., A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int. J. Med. Inform. 78(5):340–353, 2009.CrossRef Jaspers, M. W., A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. Int. J. Med. Inform. 78(5):340–353, 2009.CrossRef
14.
Zurück zum Zitat Yui, B. H., Jim, W. T., Chen, M., Hsu, J. M., Liu, C. Y., and Lee, T. T., Evaluation of computerized physician order entry system-a satisfaction survey in Taiwan. J. Med. Syst. 36(6):3817–3824, 2012.CrossRef Yui, B. H., Jim, W. T., Chen, M., Hsu, J. M., Liu, C. Y., and Lee, T. T., Evaluation of computerized physician order entry system-a satisfaction survey in Taiwan. J. Med. Syst. 36(6):3817–3824, 2012.CrossRef
15.
Zurück zum Zitat Karahoca, A., Bayraktar, E., Tatoglu, E., and Karahoca, D., Information system design for a hospital emergency department: a usability analysis of software prototypes. J. Biomed. Inform. 43(2):224–232, 2010.CrossRef Karahoca, A., Bayraktar, E., Tatoglu, E., and Karahoca, D., Information system design for a hospital emergency department: a usability analysis of software prototypes. J. Biomed. Inform. 43(2):224–232, 2010.CrossRef
16.
Zurück zum Zitat Thyvalikakath, T. P., Schleyer, T. K., and Monaco, V., Heuristic evaluation of clinical functions in four practice management systems: a pilot study. J. Am. Dent. Assoc. 138(2):209–210, 2007. 212–208.CrossRef Thyvalikakath, T. P., Schleyer, T. K., and Monaco, V., Heuristic evaluation of clinical functions in four practice management systems: a pilot study. J. Am. Dent. Assoc. 138(2):209–210, 2007. 212–208.CrossRef
17.
Zurück zum Zitat Joshi, A., Arora, M., Dai, L., Price, K., Vizer, L., and Sears, A., Usability of a patient education and motivation tool using heuristic evaluation. J. Med. Internet Res. 11(4):e47, 2009.CrossRef Joshi, A., Arora, M., Dai, L., Price, K., Vizer, L., and Sears, A., Usability of a patient education and motivation tool using heuristic evaluation. J. Med. Internet Res. 11(4):e47, 2009.CrossRef
18.
Zurück zum Zitat Peute, L. W., and Jaspers, M. M., Usability evaluation of a laboratory order entry system: cognitive walkthrough and think aloud combined. Stud. Health. Technol. Inform. 116:599–604, 2005. Peute, L. W., and Jaspers, M. M., Usability evaluation of a laboratory order entry system: cognitive walkthrough and think aloud combined. Stud. Health. Technol. Inform. 116:599–604, 2005.
19.
Zurück zum Zitat Safdari, R., Dargahi, H., Shahmoradi, L., and Farzaneh Nejad, A., Comparing four softwares based on ISO 9241 part 10. J. Med. Syst. 36(5):2787–2793, 2012.CrossRef Safdari, R., Dargahi, H., Shahmoradi, L., and Farzaneh Nejad, A., Comparing four softwares based on ISO 9241 part 10. J. Med. Syst. 36(5):2787–2793, 2012.CrossRef
20.
Zurück zum Zitat Nielsen, J., Usability inspection methods. Wiley, New York, 1994. Nielsen, J., Usability inspection methods. Wiley, New York, 1994.
21.
Zurück zum Zitat Nielsen, J., Usability engineering, 1st edition. Morgan Kaufmann, San Francisco, 1993.MATH Nielsen, J., Usability engineering, 1st edition. Morgan Kaufmann, San Francisco, 1993.MATH
22.
Zurück zum Zitat Choi, J., and Bakken, S., Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int. J. Med. Inform. 79(8):565–575, 2010.CrossRef Choi, J., and Bakken, S., Web-based education for low-literate parents in Neonatal Intensive Care Unit: development of a website and heuristic evaluation and usability testing. Int. J. Med. Inform. 79(8):565–575, 2010.CrossRef
23.
Zurück zum Zitat Edwards, P. J., Moloney, K. P., Jacko, J. A., and Sainfort, F., Evaluating usability of a commercial electronic health record: A case study. Int. J. Hum. Comput. Stud. 66(10):718–728, 2008.CrossRef Edwards, P. J., Moloney, K. P., Jacko, J. A., and Sainfort, F., Evaluating usability of a commercial electronic health record: A case study. Int. J. Hum. Comput. Stud. 66(10):718–728, 2008.CrossRef
24.
Zurück zum Zitat Pressler, T. R., Yen, P. Y., Ding, J., Liu, J., Embi, P. J., and Payne, P. R., Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools. BMC Med. Inform. Decis. Mak. 12:47, 2012.CrossRef Pressler, T. R., Yen, P. Y., Ding, J., Liu, J., Embi, P. J., and Payne, P. R., Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools. BMC Med. Inform. Decis. Mak. 12:47, 2012.CrossRef
25.
Zurück zum Zitat Su, K. W., and Liu, C. L., A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. J. Med. Syst. 36(3):1139–1153, 2012.CrossRef Su, K. W., and Liu, C. L., A mobile Nursing Information System based on human-computer interaction design for improving quality of nursing. J. Med. Syst. 36(3):1139–1153, 2012.CrossRef
26.
Zurück zum Zitat Nielsen J, Landauer TK A mathematical model of the finding of usability problems. In: Proceedings ACM/IFIP INTERCHI’93 Conference, Amsterdam, The Netherlands, April 24–29 1993. pp 206–213. Nielsen J, Landauer TK A mathematical model of the finding of usability problems. In: Proceedings ACM/IFIP INTERCHI’93 Conference, Amsterdam, The Netherlands, April 24–29 1993. pp 206–213.
Metadaten
Titel
Usability Evaluation of Laboratory and Radiology Information Systems Integrated into a Hospital Information System
verfasst von
Ehsan Nabovati
Hasan Vakili-Arki
Saeid Eslami
Reza Khajouei
Publikationsdatum
01.04.2014
Verlag
Springer US
Erschienen in
Journal of Medical Systems / Ausgabe 4/2014
Print ISSN: 0148-5598
Elektronische ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-014-0035-z

Weitere Artikel der Ausgabe 4/2014

Journal of Medical Systems 4/2014 Zur Ausgabe