Hospital Information Management System (HIMS) Process Efficiency and Service Continuity Scale: A Validity and Reliability Study

Hastane Bilgi Yönetim Sistemi (HBYS) Süreç Etkinliği ve Hizmet Sürekliliği Ölçeği: Geçerlik ve Güvenirlik Çalışması

Authors

  • Mucize Sarıhan
https://doi.org/10.68234/jmedusci.173

The purpose of this study is to develop a valid and reliable measurement tool to evaluate the contribution of Hospital Information Management Systems (HIMS) to process efficiency and service continuity in healthcare based on employees’ experiences. Conducted as a quantitative and methodological scale development study, the research sample consisted of 247 medical secretaries working at a public hospital in Istanbul who actively use HIMS. During the scale development process, six conceptual content areas were identified in line with the relevant literature: service continuity, regularity of process flow, time efficiency, access to and continuity of information, error reduction and safety, and interdepartmental process alignment. An initial pool of 24 items was then created. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were used to examine construct validity, while Cronbach’s alpha coefficient and corrected item-total correlations were used to assess reliability. The EFA results indicated that the scale exhibited a dominant single-factor structure, and following the item reduction process, a final 12-item version was obtained. In the final model, the standardized factor loadings ranged from .70 to .94. The fit indices obtained from the CFA were χ²(54) = 179.86, χ²/df = 3.33, RMSEA = .06, NFI = .95, NNFI = .94, CFI = .95, IFI = .95, and SRMR = .035, indicating that the single-factor structure showed an acceptable level of fit with the data. The scale’s Cronbach’s alpha internal consistency coefficient was .972, while the corrected item-total correlations ranged from .688 to .919. The findings indicate that the 12-item HIMS Process Efficiency and Service Continuity Scale is a valid measurement tool with high internal consistency that can be used to assess employees’ perceptions of the contribution of HIMS to daily service processes.

Bu araştırmanın amacı, Hastane Bilgi Yönetim Sistemlerinin (HBYS) sağlık hizmetlerindeki süreç etkinliği ve hizmet sürekliliğine katkısını çalışanların deneyimleri üzerinden değerlendirmeye yönelik geçerli ve güvenilir bir ölçme aracı geliştirmektir. Nicel ve metodolojik ölçek geliştirme çalışması olarak yürütülen araştırmanın çalışma grubunu, İstanbul'da bir devlet hastanesinde görev yapan ve HBYS'yi aktif olarak kullanan 247 tıbbi sekreter oluşturmuştur. Ölçek geliştirme sürecinde ilgili literatür doğrultusunda hizmetin kesintisizliği, süreç akışının düzenliliği, zaman etkinliği, bilgiye erişim ve süreklilik, hata azaltma ve güvenlik ile birimler arası süreç uyumu olmak üzere altı kavramsal içerik alanı belirlenmiş ve başlangıçta 24 maddelik bir madde havuzu oluşturulmuştur. Yapı geçerliğinin incelenmesinde açımlayıcı faktör analizi (AFA) ve doğrulayıcı faktör analizi (DFA), güvenirliğin değerlendirilmesinde ise Cronbach alfa katsayısı ve düzeltilmiş madde-toplam korelasyonları kullanılmıştır. AFA sonucunda ölçeğin baskın tek faktörlü bir yapı gösterdiği belirlenmiş ve madde azaltma süreci sonunda 12 maddelik nihai forma ulaşılmıştır. Nihai modelde standartlaştırılmış faktör yükleri .70 ile .94 arasında değişmiştir. DFA sonucunda elde edilen uyum indeksleri χ²(54)=179.86, χ²/df=3.33, RMSEA=.06, NFI=.95, NNFI=.94, CFI=.95, IFI=.95 ve SRMR=.035 olarak bulunmuş ve tek faktörlü yapının veriyle kabul edilebilir düzeyde uyum gösterdiği belirlenmiştir. Ölçeğin Cronbach alfa iç tutarlılık katsayısı .972, düzeltilmiş madde-toplam korelasyonları ise .688–.919 arasında bulunmuştur. Bulgular, 12 maddelik HBYS Süreç Etkinliği ve Hizmet Sürekliliği Ölçeği'nin HBYS'nin günlük hizmet süreçlerine katkısına ilişkin çalışan algılarının değerlendirilmesinde kullanılabilecek geçerli ve yüksek iç tutarlılığa sahip bir ölçme aracı olduğunu göstermektedir.

Abdinnour-Helm, S., Chaparro, B. S., & Farmer, S. M. (2005). Using the end-user computing satisfaction (EUCS) instrument to measure satisfaction with a web site. Decision Sciences, 36(2), 341–364. https://doi.org/10.1111/j.1540-5414.2005.00076.x

Akhu-Zaheya, L., & Etoom, M. (2024). The relationship between intensive care unit’s nurses’ informatics competency and quality of patients’ electronic health record’s documentation. Jordan Journal of Nursing Research, 3(2). https://doi.org/10.14525/jjnr.v3i2.10

Alqahtani, N. (2025). Development and psychometric validation of the Patient Experience for Disease Management Scale (PEDMS) in outpatient settings in Najran, Saudi Arabia. Healthcare, 13(10), 1191. https://doi.org/10.3390/healthcare13101191

Bakken, S., Grullon-Figueroa, L., Izquierdo, R., Lee, N., Morin, P. C., Palmas, W., Teresi, J. A., Weinstock, R. S., Shea, S. A., & Starren, J. (2006). Development, validation, and use of English and Spanish versions of the Telemedicine Satisfaction and Usefulness Questionnaire. Journal of the American Medical Informatics Association, 13(6), 660–667. https://doi.org/10.1197/jamia.m2146

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: A primer. Frontiers in Public Health, 6, 149. https://doi.org/10.3389/fpubh.2018.00149

Brown, L., Pennings, J. S., Steckel, S., & Van Zyl, M. (2023). The organizational trauma resilience assessment: Methods and psychometric properties. Psychological Trauma: Theory, Research, Practice, and Policy, 15(Suppl. 2), S446–S455. https://doi.org/10.1037/tra0001184

Cid, L., Monteiro, D., Evmenenko, A., Andrade, A. J., Bento, T., Vitorino, A., Couto, N., & Rodrigues, F. (2022). Assessment in sport and exercise psychology: Considerations and recommendations for translation and validation of questionnaires. Frontiers in Psychology, 13, 806176. https://doi.org/10.3389/fpsyg.2022.806176

Cordoș, A., Ștefănigă, S.-A., Muntean, C., Vernic, C., & Bolboacă, S. D. (2024). ALSATION study protocol: Romanian translation of three health literacy surveys. Studies in Health Technology and Informatics. https://doi.org/10.3233/SHTI241052

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555

D’Agostino, F., Erba, I., Ammenwerth, E., Robinzon, V., Segal, G., Harel, N., Corvo, E., Barkan, R., Lewy, H., & Giannetta, N. (2026). Measurement properties of instruments assessing digital competence in nursing: A systematic review. Applied Clinical Informatics, 17(1), 1–18. https://doi.org/10.1055/a-2780-7093

DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications (5th ed.). SAGE Publications.

Escudero, J. P. S., Aguillón, D., Valencia, S., García-Barrera, M. A., Aguirre-Acevedo, D. C., & Trujillo, N. (2025). Digital ergonomics of NavegApp, a novel serious game for spatial cognition assessment: Content validity and usability study. JMIR Serious Games, 13, e66167. https://doi.org/10.2196/66167

Fadahunsi, K. P., Wark, P. A., Mastellos, N., Neves, A. L., Gallagher, J., Majeed, A., & Car, J. (2024). Validation of a novel framework to assess clinical information in digital health technologies: Structural equation modelling [Preprint]. https://doi.org/10.2196/preprints.58125

Farzandipour, M., Mohamadian, H., Akbari, H., Safari, S., & Sharif, R. (2021). Designing a national model for assessment of nursing informatics competency. BMC Medical Informatics and Decision Making, 21(1). https://doi.org/10.1186/s12911-021-01405-0

Filomeno, L., Forte, D., De Simone, E., Di Muzio, M., Tartaglini, D., Lommi, M., & Ivziku, D. (2024). Systematic review and psychometric properties analysis of first-, middle-, and top-level nurse manager’s core competencies instruments. Journal of Nursing Management, 2024, 1–15. https://doi.org/10.1155/2024/2655382

Fragkioudaki, C. A., Mechili, E. A., Galanis, P., Patelarou, E., Giakoumidakis, K., & Patelarou, A. (2026). Cultural adaptation, translation and psychometric validation of a technology and eHealth literacy questionnaire among Albanian undergraduate nursing students. Nursing Reports, 16(4), 139. https://doi.org/10.3390/nursrep16040139

Gagnon, J., Probst, S., Chartrand, J., & Lalonde, M. (2024). mHealth App Usability Questionnaire for stand-alone mHealth apps used by health care providers: Canadian French translation, cross-cultural adaptation, and validation (Part 1). JMIR Formative Research, 8, e50839. https://doi.org/10.2196/50839

Golz, C., Hahn, S., & Zwakhalen, S. (2024). Psychometric validation of the Digital Competence Questionnaire for Nurses. SAGE Open Nursing, 10. https://doi.org/10.1177/23779608241272641

Gunawan, J., Aungsuroch, Y., Fisher, M. L., & McDaniel, A. M. (2019). Development and psychometric properties of Managerial Competence Scale for first-line nurse managers in Indonesia. SAGE Open Nursing, 5. https://doi.org/10.1177/2377960819831468

Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

Hwang, J. (2015). Development and testing of a patient-centred care competency scale for hospital nurses. International Journal of Nursing Practice, 21(1), 43–51. https://doi.org/10.1111/ijn.12220

Jarva, E., Oikarinen, A., Andersson, J., Tomietto, M., Kääriäinen, M., & Mikkonen, K. (2023). Healthcare professionals’ digital health competence and its core factors: Development and psychometric testing of two instruments. International Journal of Medical Informatics, 171, 104995. https://doi.org/10.1016/j.ijmedinf.2023.104995

Jo, M. J., & Ha, Y. (2019). Development and validation of an instrument to measure nursing information literacy competency. Research in Community and Public Health Nursing, 30(1), 25–37. https://doi.org/10.12799/jkachn.2019.30.1.25

Liang, C., Su, W., Wang, Y., Xu, K., Cheng, J., Ma, Y., Zhu, Y., & Jiang, Z. (2025). Psychometric validation of the Chinese version of the nursing informatics competence scale and analysis of influencing factors. BMC Nursing, 24(1). https://doi.org/10.1186/s12912-025-03441-x

Lundgren-Nilsson, Å., Dencker, A., Palstam, A., Person, G., Horton, M., Escorpizo, R., Küçükdeveci, A. A., Kutlay, Ş., Elhan, A. H., Stucki, G., Tennant, A., & Conaghan, P. G. (2018). Patient-reported outcome measures in osteoarthritis: A systematic search and review of their use and psychometric properties. RMD Open, 4(2), e000715. https://doi.org/10.1136/rmdopen-2018-000715

Mirabootalebi, N., Meidani, Z., Akbari, H., Jeddi, F. R., Tagharrobi, Z., Swoboda, W., & Holl, F. (2024). Design and psychometric evaluation of Nurses’ Mobile Health Device Acceptance Scale (NMHDA-Scale): Application of the expectation-confirmation theory. JMIR Human Factors, 11, e55324. https://doi.org/10.2196/55324

Otieno, G., Toyama, H., Asonuma, M., Kanai-Pak, M., & Naitoh, K. (2007). Nurses’ views on the use, quality and user satisfaction with electronic medical records: Questionnaire development. Journal of Advanced Nursing, 60(2), 209–219. https://doi.org/10.1111/j.1365-2648.2007.04384.x

Park, J. E., & Hwang, J. (2021). Psychometric evaluation of the Korean version of the Student Evidence-Based Practice Questionnaire (S-EBPQ). Asian Nursing Research, 15(1), 47–52. https://doi.org/10.1016/j.anr.2020.10.003

Quilloy, K. P., Newman, A., & Pyman, A. (2025). Measuring the social impact of social enterprises: Scale development and validation. Business & Society, 64(7), 1269–1312. https://doi.org/10.1177/00076503241273275

Ruland, C. M., Bakken, S., & Røislien, J. (2007). Reliability and validity issues related to interactive tailored patient assessments: A case study. Journal of Medical Internet Research, 9(3), e22. https://doi.org/10.2196/jmir.9.3.e22

Safdari, R., Yu, P., Khenarinezhad, S., Savadkoohi, E. G., Javanmard, Z., Yousefi, A., & Barzegari, S. (2021). Validity and reliability of the Persian version of the Patient Readiness to Engage in Health Information Technology [Preprint]. https://doi.org/10.21203/rs.3.rs-930674/v1

Safdari, R., Yu, P., Khenarinezhad, S., Savadkoohi, E. G., Javanmard, Z., Yousefi, A., & Barzegari, S. (2022). Validity and reliability of the Persian version of the Patient Readiness to Engage in Health Information Technology (PRE-HIT) instrument. BMC Primary Care, 23(1). https://doi.org/10.1186/s12875-022-01665-3

Schnall, R., Cho, H., & Liu, J. (2018). Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: Validation study. JMIR mHealth and uHealth, 6(1), e4. https://doi.org/10.2196/mhealth.8851

Song, H., & Kim, Y. (2023). Quality factors that influence the continuance intention to use MOOCs. European Journal of Psychology Open, 82(3), 109–119. https://doi.org/10.1024/2673-8627/a000047

Vagharseyyedin, S. A., & Sabeghi, H. (2025). Informatics competency, attitudes toward evidence-based practice, and clinical decision-making skills in nurses. Health Informatics Journal, 31(3). https://doi.org/10.1177/14604582251381145

Wojcieszko, M., & Duplaga, M. (2026). Assessing nurses’ digital competence for public health systems: Validation of a brief instrument and factors associated with competence. Frontiers in Public Health, 14. https://doi.org/10.3389/fpubh.2026.1808439

Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127

Yaprom, C., Thungjaroenkul, P., Abhichattibutra, K., & Nantsupawat, A. (2024). Development and psychometric testing of the Thai-Patient Safety Competency Scale for new graduate nurses. Pacific Rim International Journal of Nursing Research, 28(1), 181–201. https://doi.org/10.60099/prijnr.2024.262749

Yaşar, Y. A. (2026). Validity and reliability study of the Nursing Informatics Competency Assessment Tool (NICAT). Applied Clinical Informatics. https://doi.org/10.1055/a-2943-3447

There are 39 references in total.

Downloads

Article Information

  • File Downloads 226
  • Abstract Views 667
  • Altmetrics
  • Share
Download data is not yet available.
Hospital Information Management System (HIMS) Process Efficiency and Service Continuity Scale: A Validity and Reliability Study. (2026). Journal of Management and Educational Sciences, 5(1), 45-61. https://doi.org/10.68234/jmedusci.173

You may also start an advanced similarity search for this article.