Determining Hospital Information System (HIS) Success Rate: Development of a New Instrument and Case Study
DOI:
https://doi.org/10.3889/oamjms.2019.294Keywords:
Hospital information systems, electronic health record, evaluation, information system success model, ISSM.Abstract
BACKGROUND: Hospital Information System (HIS) is a type of health information system which is widely used in clinical settings. Determining the success rate of HISs is an ongoing area of research since its implications are of interest for researchers, physicians and managers.
AIM: In the present study, we develop a novel instrument to measure HIS success rate based on users’ viewpoints in a teaching hospital.
METHODS: The study was conducted in Ebnesina and Dr Hejazi Psychiatric Hospital and education centre in Mashhad, Iran. The instrument for data collection was a self-administered structured questionnaire based on ISSM, covering seven dimensions, which includes system quality, information quality, service quality, system use, usefulness, satisfaction, and net benefits. The verification of content validity was carried out by an expert panel. The internal consistency of dimensions was measured by Cronbach’s alpha. Pearson’s correlation coefficient was calculated to evaluate the significance of associations between dimensions. The HIS success rate on users’ viewpoints was determined.
RESULTS: A total of 125 users participated in the study. The instrument was validated by an expert panel with the Content Validity Index (CVI): 0.85 and Content Validity Ratio (CVR): 0.86. The overall Cronbach’s alpha value of the instrument was 0.93. The Pearson correlation coefficient showed significant positive relationships among the investigated dimensions. On average, HIS success rate in the hospital under study was 65% (CI: 64%, 67%). The dimensions of “usefulnessâ€, “system qualityâ€, and “net benefits†showed the highest rates of success, respectively.
CONCLUSION: The instrument used in this study can be adopted for HIS evaluation in future studies. In the current study, a method was developed to determine the HIS success rate based on users’ viewpoints. This method allows for the comparison of HIS success rates in various hospitals. As well, our findings underscore the viewpoints of HIS users in a developing country.
Downloads
Metrics
Plum Analytics Artifact Widget Block
References
Chen RF, Hsiao JL. An investigation of physicians' acceptance of hospital information systems: a case study. International journal of medical informatics. 2012; 81(12):810-20. https://doi.org/10.1016/j.ijmedinf.2012.05.003 PMid:22652011
Iqbal U, Ho CH, Li YC, Nguyen PA, Jian WS, Wen HC. The relationship between usage intention and adoption of electronic health records at primary care clinics. Computer methods and programs in biomedicine. 2013; 112(3):731-7. https://doi.org/10.1016/j.cmpb.2013.09.001 PMid:24091088
Ojo AI. Validation of the DeLone and McLean information systems success model. Healthcare informatics research. 2017; 23(1):60-6. https://doi.org/10.4258/hir.2017.23.1.60 PMid:28261532
Tilahun B, Fritz F. Modeling antecedents of electronic medical record system implementation success in low-resource setting hospitals. BMC medical informatics and decision making. 2015; 15(1):61. https://doi.org/10.1186/s12911-015-0192-0
DeLone WH, McLean ER. Information systems success: The quest for the dependent variable. Information systems research. 1992; 3(1):60-95. https://doi.org/10.1287/isre.3.1.60
Delone WH, McLean ER. The DeLone and McLean model of information systems success: a ten-year update. Journal of management information systems. 2003; 19(4):9-30. https://doi.org/10.1080/07421222.2003.11045748
Otieno GO, Hinako T, Motohiro A, Daisuke K, Keiko N. Measuring effectiveness of electronic medical records systems: towards building a composite index for benchmarking hospitals. International journal of medical informatics. 2008; 77(10):657-69. https://doi.org/10.1016/j.ijmedinf.2008.01.002
Sicotte C, Paré G, Bini KK, Moreault MP, Laverdure G. Virtual organization of hospital medical imaging: a user satisfaction survey. Journal of digital imaging. 2010; 23(6):689-700. https://doi.org/10.1007/s10278-009-9220-x
Otieno OG, Toyama H, Asonuma M, Kanaiâ€Pak M, Naitoh K. Nurses' views on the use, quality and user satisfaction with electronic medical records: questionnaire development. Journal of Advanced Nursing. 2007; 60(2):209-19. https://doi.org/10.1111/j.1365-2648.2007.04384.x
Messeri P, Khan S, Millery M, Campbell A, Merrill J, Shih S, Kukafka R. An information systems model of the determinants of electronic health record use. Applied clinical informatics. 2013; 4(02):185-200. https://doi.org/10.4338/ACI-2013-01-RA-0005 PMCid:PMC3716425
Aggelidis VP, Chatzoglou PD. Hospital information systems: Measuring end user computing satisfaction (EUCS). Journal of biomedical informatics. 2012; 45(3):566-79. https://doi.org/10.1016/j.jbi.2012.02.009
Alharthi H, Youssef A, Radwan S, Al-Muallim S, Zainab AT. Physician satisfaction with electronic medical records in a major Saudi Government hospital. Journal of Taibah University Medical Sciences. 2014; 9(3):213-8. https://doi.org/10.1016/j.jtumed.2014.01.004
Wang JY, Ho HY, Chen JD, Chai S, Tai CJ, Chen YF. Attitudes toward inter-hospital electronic patient record exchange: discrepancies among physicians, medical record staff, and patients. BMC health services research. 2015; 15(1):264. https://doi.org/10.1186/s12913-015-0896-y PMCid:PMC4499194
Lu CH, Hsiao JL, Chen RF. Factors determining nurse acceptance of hospital information systems. CIN: Computers, Informatics, Nursing. 2012; 30(5):257-64. https://doi.org/10.1097/NCN.0b013e318224b4cf
Tavakoli N, Jahanbakhsh M, Shahin A, Mokhtari H, Rafiei M. Electronic medical record in central polyclinic of isfahan oil industry: a case study based on technology acceptance model. Acta Informatica Medica. 2013; 21(1):23-25. https://doi.org/10.5455/aim.2012.21.23-25
Abdekhoda M, Ahmadi M, Gohari M, Noruzi A. The effects of organizational contextual factors on physicians' attitude toward adoption of Electronic Medical Records. Journal of biomedical informatics. 2015; 53:174-9. https://doi.org/10.1016/j.jbi.2014.10.008
Saghaeiannejad-Isfahani S, Jahanbakhsh M, Habibi M, Mirzaeian R, Nasirian M, Rad JS. A Survey on the Users' Satisfaction with the Hospital Information Systems (HISs) based on DeLone and McLean's Model in the Medical-Teaching Hospitals in Isfahan City. Acta Informatica Medica. 2014; 22(3):179-82. https://doi.org/10.5455/aim.2014.22.179-182
Goodhue DL, Thompson RL. Task-technology fit and individual performance. MIS quarterly. 1995:213-36. https://doi.org/10.2307/249689
Garcia-Smith D, Effken JA. Development and initial evaluation of the clinical information systems success model (CISSM). International Journal of Medical Informatics. 2013; 82(6):539-52. https://doi.org/10.1016/j.ijmedinf.2013.01.011
Shackel B. Usability-context, framework, definition, design and evaluation. Human factors for informatics usability, 1991: 21-37.
Bailey JE, Pearson SW. Development of a tool for measuring and analyzing computer user satisfaction. Management science. 1983; 29(5):530-45. https://doi.org/10.1287/mnsc.29.5.530
Pitt LF, Watson RT, Kavan CB. Service quality: a measure of information systems effectiveness. MIS quarterly. 1995:173-87. https://doi.org/10.2307/249687
Venkatesh V, Bala H. Technology acceptance model 3 and a research agenda on interventions. Decision sciences. 2008; 39(2):273-315. https://doi.org/10.1111/j.1540-5915.2008.00192.x
Goodhue DL. Understanding user evaluations of information systems. Management science. 1995; 41(12):1827-44. https://doi.org/10.1287/mnsc.41.12.1827
Top M, Yilmaz A, Karabulut E, Otieno OG, Saylam M, Bakır S, Top S. Validation of a nurses' views on electronic medical record systems (EMR) questionnaire in Turkish health system. Journal of medical systems. 2015; 39(6):67. https://doi.org/10.1007/s10916-015-0250-2
Top M, Gider Ö. Nurses' views on electronic medical records (EMR) in Turkey: An analysis according to use, quality and user satisfaction. Journal of medical systems. 2012; 36(3):1979-88. https://doi.org/10.1007/s10916-011-9657-6
Bossen C, Jensen LG, Udsen FW. Evaluation of a comprehensive EHR based on the DeLone and McLean model for IS success: approach, results, and success factors. International journal of medical informatics. 2013; 82(10):940-53. https://doi.org/10.1016/j.ijmedinf.2013.05.010
Lambooij MS, Drewes HW, Koster F. Use of electronic medical records and quality of patient data: different reaction patterns of doctors and nurses to the hospital organization. BMC medical informatics and decision making. 2017; 17(1):1-11. https://doi.org/10.1186/s12911-017-0412-x
Calisir F, Altin Gumussoy C, Bayram A. Predicting the behavioral intention to use enterprise resource planning systems: An exploratory extension of the technology acceptance model. Management research news. 2009; 32(7):597-613. https://doi.org/10.1108/01409170910965215
Brown IT. Individual and technological factors affecting perceived ease of use of webâ€based learning technologies in a developing country. The Electronic Journal of Information Systems in Developing Countries. 2002; 9(1):1-5. https://doi.org/10.1002/j.1681-4835.2002.tb00055.x
Ebnehoseini Z, Tara M, Meraji M, Deldar K, Khoshronezhad F, Khoshronezhad S. Usability Evaluation of an Admission, Discharge, and Transfer Information System: A Heuristic Evaluation. Open access Macedonian journal of medical sciences. 2018; 6(11):1941-45. https://doi.org/10.3889/oamjms.2018.392
Asadi F, Moghaddasi H, Rabiei R, Rahimi F, Mirshekarlou SJ. The evaluation of SEPAS national project based on electronic health record system (EHRS) coordinates in Iran. Acta Informatica Medica. 2015; 23(6):369-373. https://doi.org/10.5455/aim.2015.23.369-373
Tubaishat A. Evaluation of electronic health record implementation in hospitals. CIN: Computers, Informatics, Nursing. 2017; 35(7):364-72. https://doi.org/10.1097/CIN.0000000000000328
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2019 Zahra Ebnehoseini, Hamed Tabesh, Kolsoum Deldar, Seyed Mostafa Mostafavi, Mahmood Tara
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
http://creativecommons.org/licenses/by-nc/4.0
