Usability Evaluation of an Admission, Discharge, and Transfer Information System: A Heuristic Evaluation

Zahra Ebnehoseini; Mahmood Tara; Marziyhe Meraji; Kolsoum Deldar; Farnaz Khoshronezhad; Sanaz Khoshronezhad

doi:10.3889/oamjms.2018.392

Authors

Zahra Ebnehoseini Students Research Committee, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad
Mahmood Tara Department of Medical Informatics, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad
Marziyhe Meraji Department of Medical Records and Health Information Technology, Faculty of Paramedical Sciences, Mashhad University of Medical Sciences, Mashhad
Kolsoum Deldar Department of Health Information Technology, Shahroud University of Medical Sciences, Shahroud, Iran.
Farnaz Khoshronezhad Students Research Committee, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran.
Sanaz Khoshronezhad Students Research Committee, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran.

DOI:

https://doi.org/10.3889/oamjms.2018.392

Keywords:

Heuristic Evaluation, usability, Admission, Discharge and Transfer (ADT), hospital Information Systems, health information systems.

Abstract

BACKGROUND: Admission, discharge and, transfer (ADT) process is one of the most important hospital workflows. ADT system is a part of a hospital information system (HIS).

AIM: The objective of this study was to evaluate the usability of the ADT system.

METHODS: The study performed at Mashhad University of Medical Sciences (MUMS) hospitals. Data collection instrument was a validated checklist of Pierotti heuristic evaluation. To determine the severity of usability problems, a hybrid of Nielson and Tampere unit for computer-human interaction (TAUCHI) severity scaling algorithm was used. Usability problems were divided into five categories (major, severe, minor, cosmetic, and technical). Six experts evaluated the ADT system independently. According to TAUCHI severity scale, if a feature has not yet been implemented in the ADT system, evaluators considered it a technical usability problem. Therefore, usability problems due to non-design feature in the ADT system were identified. Finally, the mean severity of each usability problems was calculated.

RESULTS: A total of 186 usability problems were identified. The frequency of major, sever, minor and cosmetic usability problems were 2, 65, 69 and 50, respectively. A total of 55 usability problems by the evaluators were recognised as technical problems. The highest mismatch with usability principles was related to the â€œrecognition rather than recallâ€. The range of the mean severity of usability problems was between 0-2.31.

CONCLUSIONS: Our result showed that although implementation of IHIS on a large scale, it still suffered from unresolved usability problems. Identification of usability problems and evaluation of their level of severity, which was simultaneously performed in this study, can be used as a guide to evaluate the usability of other HISs.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Plum Analytics Artifact Widget Block

References

Ismail NI, Abdullah NH, Shamsuddin A. Adoption of Hospital Information System (HIS) in Malaysian Public Hospitals. Procedia - Social and Behavioral Sciences. 2015; 172:336-43. https://doi.org/10.1016/j.sbspro.2015.01.373

Horsky J, McColgan K, Pang JE, Melnikas AJ, Linder JA, Schnipper JL, Middleton, B. Complementary methods of system usability evaluation: surveys and observations during software design and development cycles. Journal of biomedical informatics. 2010; 43(5):782-90. https://doi.org/10.1016/j.jbi.2010.05.010 PMid:20546936

Ologeanu-Taddei R, Morquin D, Bourret R. Understanding the Perceived Usefulness and the Ease of Use of a Hospital Information System: the case of a French University Hospital. Studies in health technology and informatics. 2015; 210:531. PMid:25991204

Zheng K, Padman R, Johnson MP, Diamond HS. An interface-driven analysis of user interactions with an electronic health records system. Journal of the American Medical Informatics Association. 2009; 16(2):228-37. https://doi.org/10.1197/jamia.M2852 PMid:19074301 PMCid:PMC2649313

Azizi Aa, Safari S, Mohammadi A, Kheirollahi J, Shojaei baghini M. A survey on the satisfaction rate of users about the quality of hospital information system in hospitals associated with Kermanshah university of medical sciences. Health Information Management. 2011; 8(4):566-71.

Agharezaei Z, Khajouei R, Ahmadian L, Agharezaei L. Usability evaluation of a laboratory information system. Director General. 2013; 10(2):1-12.

Karahoca A, Bayraktar E, Tatoglu E, Karahoca D. Information system design for a hospital emergency department: A usability analysis of software prototypes. Journal of biomedical informatics. 2010; 43(2):224-32. https://doi.org/10.1016/j.jbi.2009.09.002 PMid:19755173

Baker K. Heuristic Evaluation. 1997. http://grouplab.cpsc.ucalgary.ca/saul/681/1997/kevin/home.html. Accessed January 13, 2018.

Khajouei R, Azizi A, Atashi A. Usability evaluation of an emergency information system: a heuristic evaluation. Journal of Health Administration. 2013; 16(52):61-72.

Jaspers MW. A comparison of usability methods for testing interactive health technologies: methodological aspects and empirical evidence. International journal of medical informatics. 2009; 78(5):340-53. https://doi.org/10.1016/j.ijmedinf.2008.10.002 PMid:19046928

Pierotti D. Usability techniques: heuristic evaluation a system checklist 1998. Available web.vu.lt/mif/k.lapin/files/2017/04/9_Heuristical_evaluation-2017.pdf. Accessed January 18, 2018.

Nielsen J. Severity ratings for usability problems. Papers and Essays. 1995; 54:1-2.

Li L, Helenius M. Usability evaluation of anti-phishing toolbars. Journal in Computer Virology. 2007; 3(2):163-84. https://doi.org/10.1007/s11416-007-0050-4

Nabovati E, Vakili-Arki H, Eslami S, Khajouei R. Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system. Journal of medical systems. 2014; 38(4):35. https://doi.org/10.1007/s10916-014-0035-z PMid:24682671

Rezaei-Hachesu P, Pesianian E, Mohammadian M. Evaluating Usability of Radiology Information Systems in Hospitals of Tabriz University of Medical Sciences. Acta Informatica Medica. 2016; 24(1):42. https://doi.org/10.5455/aim.2016.24.42-46 PMid:27041810 PMCid:PMC4789628

Abedi S, Khajouei R. Evaluating the Users' Interaction Problems with Physiotherapy Information System. Journal of Hospital. 2015; 14(3):83-92.

Thyvalikakath TP, Schleyer TK, Monaco V. Heuristic evaluation of clinical functions in four practice management systems: a pilot study. The Journal of the American Dental Association. 2007; 138(2):209-18. https://doi.org/10.14219/jada.archive.2007.0138 PMid:17272376

Van Engen-Verheul MM, Peute LW, de Keizer NF, Peek N, Jaspers MW. Optimizing the user interface of a data entry module for an electronic patient record for cardiac rehabilitation: A mixed method usability approach. International journal of medical informatics. 2016; 87:15-26. https://doi.org/10.1016/j.ijmedinf.2015.12.007 PMid:26806708

Sadoghi F, Shahi M, Davari dolatabadi N, Ebrahimi K. Hospital information systems interoperability in Iran. Bimonthly Journal of Hormozgan University of Medical Sciences. 2014; 18(3):235-41.

Meydani Z, Safdari R, Farshid far GR, Lak bala P. Comparative study of information management standards: an approach to implementing electronic health record. Medical Journal of Hormozgan University. 2006; 10(2):167-72.

Asadi F, Moghaddasi H, Rabiei R, Rahimi F, Mirshekarlou SJ. The Evaluation of SEPAS National Project Based on Electronic Health Record System (EHRS) Coordinates in Iran. Acta Informatica Medica. 2015; 23(6):369. https://doi.org/10.5455/aim.2015.23.369-373 PMid:26862248 PMCid:PMC4720822

Isfahani SS, Khajouei R, Jahanbakhsh M, Mirmohamadi M. The evaluation of hospital laboratory information management systems based on the standards of the American National Standard Institute. Journal of education and health promotion. 2014; 3(61). PMid:25077154 PMCid:PMC4113977

Kimiyafar K, Moradi G, Sadooghi F, Sarbaz M. Views of users towards the quality of hospital information system in training hospitals affiliated to Mashhad University of Medical Sciences-2006. Health Information Management. 2008; 4(1):43-50.