Design and Validation of an Instrument for Assessing the Preparedness of Hospital Emergency Departments in Response to Disasters and Emergencies: A Mixed-Method Qualitative Study

Document Type : Original Article

Authors

1 Health Services Management Research Center, Tabriz University of Medical Sciences, Tabriz, Iran

2 Prehospital Emergency Medicine Research Center, National Emergency Organization, Tehran, Iran

3 Master of Science in Community Health Nursing, National Emergency Organization, Tehran, Iran

4 Road Traffic Injury Research Center, Tabriz University of Medical Sciences, Tabriz, Iran

5 Bachelor of Science in Nursing, Emergency and Trauma Research Center, Tabriz University of Medical Sciences, Tabriz, Iran

6 Department of Health in Disaster and Emergencies, Tabriz University of Medical Sciences, Tabriz, Iran

Abstract
Introduction: Hospitals are among the critical infrastructures of society that must continue to provide services under all circumstances. Hospital safety is one of the essential components of disaster and emergency management, and its observance enhances hospital preparedness and maintains its structure and function during crises. To assess the level of readiness and performance of hospitals in dealing with disasters and emergencies, it is necessary to identify and extract the key indicators of hospital preparedness. Therefore, this study aimed to develop and validate a checklist for assessing the preparedness of hospital emergency departments in responding to disasters and emergencies.
Methods: This qualitative study was conducted using a mixed-method approach at Tabriz University of Medical Sciences in 2024–2025. In the first stage, articles related to hospital emergency preparedness in disasters were identified through searches in databases, including Science Direct, Google Scholar, Medline, Web of Science, EMBASE, PubMed, SID, and Magiran. Dimensions and criteria of the preparedness checklist were extracted from these studies. In the second stage, based on the findings from the literature review and expert opinions, a preparedness assessment checklist was developed. To verify content validity, the opinions of 22 experts in the field of disaster and emergency management were obtained and CVI (Content Validity Index) and CVR (Content Validity Ratio) were calculated. To determine reliability, the intraclass correlation coefficient (ICC) was used, and to determine internal consistency reliability, the Cronbach coefficient alpha (Cronbach’s alpha) was calculated for each factor and the entire instrument.
Results: Through qualitative content analysis, a total of 85 items were initially extracted. After reviewing overlaps and evaluating content validity, the number of items was reduced to 79. The results indicated that all items had acceptable CVR values, confirming their appropriateness. Moreover, the CVI values for all items were above 0.79, indicating satisfactory content validity. Reliability testing yielded a Cronbach’s alpha coefficient of 0.83 and an intra-class correlation coefficient (ICC) of 0.82 in the test–retest analysis, confirming the instrument’s internal consistency and stability.
Conclusion: The developed checklist is a valid and reliable tool for assessing the preparedness of hospital emergency departments in dealing with disasters and emergencies. Utilizing this instrument enables managers and policymakers to identify strengths and weaknesses within their emergency departments and take corrective measures to enhance preparedness. Furthermore, it provides a standardized tool for benchmarking and harmonizing hospital emergency preparedness at the national level.

Keywords

Subjects

1. Bissell RA, Pinet L, Nelson M, Levy M. Evidence of the effectiveness of health sector preparedness in disaster response: the example of four earthquakes. Fam Community Health 2004;27(3):193-203. doi:10.1097/00003727-200407000-00006
2. Nekoie-Moghadam M, Kurland L, Moosazadeh M, Ingrassia PL, Della Corte F, Djalali A. Tools and checklists used for the evaluation of hospital disaster preparedness: a systematic
review. Disaster Med Public Health Prep 2016;10(5):781-8. doi:10.1017/dmp.2016.30
3. Müller-Leonhardt A, Mitchell SG, Vogt J, Schürmann T. Critical Incident Stress Management (CISM) in complex systems: cultural adaptation and safety impacts in healthcare. Accid
Anal Prev 2014;68:172-80. doi:10.1016/j.aap.2013.12.018
4. Adhikari R, Tocher J, Smith P, Corcoran J, MacArthur J. A multi-disciplinary approach to medication safety and the implication for nursing education and practice. Nurse Educ
Today 2014;34(2):185-90. doi:10.1016/j.nedt.2013.10.008
5. Rahmanian F, Abbasi B, Bolvardi E, Maleki F, Habibzadeh SR, Foroughian M, et al. The level of disaster preparedness of Iranian hospitals; a systematic review. Iran J Emerg Med
2021;8(1):e13. doi:10.22037/ijem.v8i1.34424
6. Asefzadeh S, Rajaee R, Ghamari F, Kalhor R, Gholami S. Preparedness of Iranian hospitals against disasters. Biotechnol Health Sci 2016;3(3):e35073. doi:10.17795/bhs-35073
7. Abbasabadi-Arab M, Miadfar J, Yousefian S, Mobini A, Mehran Amin S. Assessing hospital safety index in the Iranian hospitals. Health Emerg Disasters Q 2023;8(4):235-44.
doi:10.32598/hdq.8.4.208.2
8. Ahangar A, Mohammadi F, Tehrani-Banihashemi SA, Joulani M, Safarani S, Nojomi M. The effects of COVID-19 on financial-economic and performance efficiency of hospitals.
Med J Islam Repub Iran 2023;37:43. doi:10.47176/mjiri.37.43
9. Samei B, Babaie J, Tabrizi JS, Sadeghi-Bazargani H, Azami Aghdash S, Derakhshani N, et al. Exploring hospitals’ functional preparedness effective factors in response to
disasters: a qualitative study in a lower middle-income country. BMC Health Serv Res 2024;24(1):197. doi:10.1186/s12913-024-10630-y
10. Janssen I, Shepard DS, Katzmarzyk PT, Roubenoff R. The healthcare costs of sarcopenia in the United States. J Am Geriatr Soc 2004;52(1):80-5. doi:10.1111/j.1532-
5415.2004.52014.x
11. Abbasabadi M, Khankeh HR, Mosadeghrad AM. Designing of disaster risk management accreditation standards in Iranians hospitals. Int J Qual Health Care 2018 Sep;30(Suppl 2):45-6.
doi:10.1093/intqhc/mzy167.67
12. Daneshmandi M, Nezamzadeh M, Zareiyan A. Assessment the preparedness of selected hospital to deal with disasters in Tehran. Mil Caring Sci 2014;1(1):28-35. doi:10.18869/acadpub.mcs.1.1.28
13. Abbasabadi M, Khankeh HR, Mosadeghrad AM, Biglarian A. Comprehensive disaster risk management standards for hospitals. Health Emerg Disasters Q 2023;8(2):95-106.
doi:http://dx.doi.org/10.32598/hdq.8.2.208.1
14. Basiri A, Abbasi Farajzadeh M, Belal M, Heidaranlu E. Improving the non-structural preparedness of the selected hospital based on the FOCUS-PDCA1 model: action research.
BMC Emerg Med 2024;24(1):109. doi:10.1186/s12873-024-01006-w
15. Parchami M, Mirzaei M, Kalatpour O. Identification and analysis of critical activities of fire department for residential fire scenarios using task and training requirements
analysis methodology. J Occup Hyg Eng 2020;7(1):41-50. doi:10.52547/johe.7.1.41
16. Nordstrom K, Zun LS, Wilson MP, Stiebel V, Ng AT, Bregman B, et al. Medical evaluation and triage of the agitated patient: consensus statement of the American Association
for Emergency Psychiatry Project BETA Medical Evaluation Workgroup. West J Emerg Med 2012;13(1):3-10. doi:10.5811/westjem.2011.9.6863
17. Waltz C, Strickland OL, Lenz E. Measurement in Nursing and Health Research. Springer Publishing Company; 2016.doi:10.1891/9780826170620
18. Boparai JK, Singh S, Kathuria P. How to design and validate a questionnaire: a guide. Curr Clin Pharmacol 2018;13(4):210-5. doi:10.2174/1574884713666180807151328
19. Lawshe CH. A quantitative approach to content validity. Pers Psychol 1975;28(4):563-75. doi:10.1111/j.1744-6570.1975.tb01393.x
20. Martin D. Statistical methods for health care research. Physiother Res Int 2004;9(1):55-6. doi:10.1002/pri.300
21. Tsagris M, Frangos C. Cronbach: Cronbach’s Alpha. CRAN: Contributed Packages. The R Foundation; 2020. doi:http://dx.doi.org/10.32614/CRAN.package.Cronbach
22. Martin D. Statistical methods for health care research. Physiother Res Int 2002;7(3):188-9. doi:http://dx.doi.org/10.1002/pri.255
23. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika 1951;16(3):297-334. doi:10.1007/BF02310555
24. Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford: Oxford University Press; 2024. doi:10.1093/med/9780199685219.001.0001
25. Sheikhbardsiri H, Raeisi AR, Nekoei-Moghadam M, Rezaei F. Surge capacity of hospitals in emergencies and disasters with a preparedness approach: a systematic review. Disaster
Med Public Health Prep 2017;11(5):612-20. doi:10.1017/dmp.2016.178
26. Faccincani R, Della Corte F, Sesana G, Stucchi R, Weinstein E, Ashkenazi I, et al. Hospital surge capacity during Expo 2015 in Milano, Italy. Prehosp Disaster Med 2018;33(5):459-65.
doi:10.1017/s1049023x18000742
27. Qassemi F, Khankeh HR, Delshad V, Hosseini M. The effects of implementing and activating the early warning system on the preparedness of Sari Imam Khomeini hospital (RH) in disasters
and incidents. Health Emerg Disasters Q 2016;2(1):19-24. doi:10.18869/nrip.hdq.2.1.19
28. Donohoe P. Hospitals are increasingly dangerous places. BMJ 2003;326(Suppl S6):0306178b. doi:10.1136/sbmj.0306178b
29. Alruwaili A, Islam S, Usher K. Disaster preparedness in hospitals in the Middle East: an integrative literature review. Disaster Med Public Health Prep 2019;13(4):806-16.doi:10.1017/dmp.2018.138
30. Hasan MK, Nasrullah SM, Quattrocchi A, Arcos González P, Castro-Delgado R. Hospital surge capacity preparedness in disasters and emergencies: a systematic review. Public Health
2023;225:12-21. doi:10.1016/j.puhe.2023.09.017
31. Ferreira MA, Meroni F, Azzaro R, Musacchio G, Rupakhety R, Bessason B, et al. What scientific information on the seismic risk to non-structural elements do people need to know?
Part 1: compiling an inventory on damage to non-structural elements. Ann Geophys 2021;64(3):SE321. doi:10.4401/ag-8412
32. Obando Zegarra R, Arévalo-Ipanaqué JM, Aliaga Sánchez RA, Cernuda Martínez JA, Delgado Echevarría JC, Arcos González P. Disaster preparedness and hospital safety in state hospitals
in Lima (Peru). Prehosp Disaster Med 2023;38(5):601-5. doi:10.1017/s1049023x23006179
33. Abualenain J, Alhajaji R, Alsulimani L. A systematic review of the efficacy of full-scale simulation exercises in enhancing hospital disaster preparedness. J Med Law Public Health
2024;4(3):419-46. doi:http://dx.doi.org/10.52609/jmlph.v4i3.133
34. Samsuddin NM, Takim R, Nawawi AH, Syed Alwee SN. Disaster preparedness attributes and hospital’s resilience in Malaysia. Procedia Eng 2018;212:371-8. doi:10.1016/j.proeng.2018.01.048
35. Bray J. Navigating the crisis: strategies for addressing healthcare staffing shortages. American Journal of Healthcare Strategy 2024;1(2):13-8. doi:10.61449/ajhcs.2024.3
Volume 11, Issue 1
January 2025
Pages 39-46

  • Receive Date 17 October 2025
  • Revise Date 17 May 2026
  • Accept Date 28 May 2026