Hazardous material and chemical, biological, radiological, and nuclear incident readiness among prehospital care professionals in the State of Qatar

ABSTRACT

This study aimed to determine whether the Hamad Medical Corporation Ambulance Service (HMCAS) personnel fulfil the pre-hospital readiness requirements for hazardous material and chemical, biological, radiological, and nuclear (HazMat-CBRN) incidents. This cross-sectional study performed an online assessment of non-specialist paramedics’ behaviour and knowledge about HazMat-CBRN incident management, followed by a ‘HazMat-CBRN incident management’ course with pre-and post-activity assessments. The validity and reliability of the knowledge assessment questions were also tested. The pre-and-post course assessement responses revealed certain deficiencies in staff knowledge. The multiple linear regression and paired groups t-test demonstrated that this was rectified after the training intervention. The results indicate that the implemented course helped HMCAS staff acquire a satisfactory level of knowledge to ensure their readiness for safe and effective responses to potential HazMat-CBRN incidents in Qatar.

KEYWORDS:

• Ambulance
• HazMat-CBRN
• exposure
• knowledge
• training

1 Background

Although hazardous materials and chemical, biological, radiological, and nuclear (HazMat- CBRN) incidents are rare, they can have catastrophic and irreversible effects, such as mass casualties, property losses, and environmental pollution. The explosion of a petrochemical plant in China in November of 2005 released 100 tonnes of benzene, resulting in six fatalities and 70 injuries (Qu et al., 2016). In Maidstone, England, 45 people were treated on the scene following carbon monoxide exposure during a chemical spill in November 2019 (Hou et al., 2020). Similarly, tonnes of ammonium nitrate – a self-reactive material commonly used as a fertiliser worldwide (Babrauskas, 2016) – were stored in the Beirut port, causing a massive blast when it ignited in August 2020. During the incident, the port was destroyed, and numerous surrounding buildings sustained severe damage; the blast resulted in 200 deaths and several thousand injuries (El Sayed, 2020). Several hospitals were damaged, and local emergency services were overwhelmed. Lebanon, therefore, needed an international health response from governmental and non-governmental humanitarian organisations (UN News, 2020). Healthcare providers, specifically pre-hospital medical responders, attended to the hazardous disaster site with unstable structures and the presence of ammonium nitrate.

After the Beirut incident, first responders faced difficult decisions concerning their safety and the public’s safety at large: Was this explosion an accident or intentional? What about inhalation or skin contact with the strange red cloud that spread for hours after the explosion? Would they develop delayed symptoms following exposure?

The successful management of such situations is significantly affected by political, technological, cultural, and financial factors involving risk-based planning that promote effective coordination and communication within and across organisations (Ozceylan & Coskun, 2008). Well-designed, consistent, and updated training are essential elements in emergency response preparedness.

Training is essential for knowledge and skills development (Thakur & Stainback, 2011). In the pre-hospital setting, research shows that first responders must be well equipped to recognise HazMat-CBRN incidents and have adequate resources to mitigate the health effects of exposure to toxic agents (Wapling & Sellwood, 2016). Emergency pre-hospital healthcare providers find themselves in situations that call for quick thinking and decision making to assess the situation and form a safe and effective action plan. If they lack the appropriate knowledge, it can lead to perilous situations. Pre-hospital healthcare providers may not feel prepared to respond to such incidents. Factors such as fear or concern have also been shown to adversely affect emergency responders’ readiness during a surge response (Stevens et al., 2010).

Qatar, one of the world’s largest producers of petroleum gas (Meza & Koç, 2020), has four major industrial cities involved in the refinement and liquefaction of gas, the production of chemicals, and the manufacturing of products (Dukhan Petroleum City, Ras Laffan Industrial City, Mesaieed Industrial City, and Doha Industrial Area). These industrial domains increase the risks of major HazMat-CBRN incidents.

The Hamad Medical Corporation Ambulance Service (HMCAS) is the frontline public healthcare service provider in the pre-hospital setting in Qatar. It includes HMCAS communication staff or Emergency Medical Dispatchers (EMDs; N = 111) who receive and process 999 emergency calls. These EMDs operate from the National Command Centre (NCC) of the State of Qatar. They use PROQA® (Program Question-Answer) software to process emergency calls. PROQA is an automated computer software version of the Medical Priority Dispatch System, used by the International Academies of Emergency Medical Dispatch, allowing for standardised processing, categorisation, and prioritisation of emergency calls.

Using PROQA, EMDs navigate through case entry and key questioning to determine the most appropriate code for each call received and then dispatch appropriate resources. In addition, EMDs deliver pre-arrival instructions to the caller, ensuring safety and providing assistance until the ambulance arrives (Clawson, 2018). At the time of this study, HMCAS PROQA® was using 36 protocols of the International Academy of Emergency Dispatch. In this system, each protocol is selected according to the chief complaint; protocol eight is used for managing HazMat-CBRN emergency calls, enabling the EMD to immediately dispatch the nearest pre-hospital medical response unit, following address identification (Morgan, 2003), then gather information on the number and health condition of the victims, spill volume, and status of CBRN agent signs (placard, NFPA [National Fire Protection Association] 704 diamond, and CBRN agent identification number). Meanwhile, the caller will be assisted until medical help arrives (90% of cases, within 10 minutes, if inside Doha; Wilson et al., 2017). The EMD will be able then to update the emergency response units with the information collected as they are dispatched.

HMCAS emergency section staff (N = 760) responds to emergency cases, mass casualty incidents, and disasters, including HazMat-CBRN incidents. In preparation for emergency calls, HMCAS operates eight hubs (where staff change shifts, replenish ambulances with equipment, and process administration papers) and 67 spokes (where ambulances remain on standby) distributed across Qatar (Wilson et al., 2017). The pre-hospital emergency response units include ‘alpha’ ambulances with two Ambulance Paramedics (APs), 4 × 4 ‘Charlie’ ambulances with a Critical Care Assistant (credentialed AP level) and a Critical Care Paramedic (CCPs), and other 4 × 4 ambulances with a distribution’s supervisor ‘delta’, credentialed at the AP level of clinical practice (Gangaram et al., 2017). The emergency section also includes Specialised Emergency Management (SEM) paramedics, operating major incident response truck containers and CBRN first response vehicles distributed across Qatar (Wilson et al., 2017).

In the case of a HazMat-CBRN incident, HMCAS healthcare providers are the first deployed and provide emergency medical care using specialised equipment for patients exposed to hazardous environments.

This study evaluated the cognitive readiness of HMCAS staff to face potential HazMat- CBRN incidents in Qatar and determined whether the training provided was sufficient to promote and maintain adequate knowledge levels about HazMat-CBRN incident management among paramedic staff not part of the SEM team.

2 Methods

This cross-sectional study was approved by the Hamad Medical Corporation-Medical Research Centre (MRC) as a quality improvement/audit project (Ref: MRC-01-20-372). The data were analysed using IBM® SPSS® V26.

(Figure 1) shows a process map designed by HMCAS for managing HazMat-CBRN incidents, illustrating the importance of highly skilled pre-hospital medical staff managing HazMat-CBRN incidents.

Figure 1. Process map of HazMat-CBRN incident management by HMCAS-Qatar.

2.1 Interventions

We conducted an online assessment of the staff’s baseline knowledge of HazMat-CBRN incident management. Based on the assessment results, we implemented a one-day course on the topic, repeated 19 times with different attendees (Appendix). The course was presented to APs, CCPs, and EMDs. Pre- and post-course tests were conducted to evaluate their knowledge acquisition and thereby determine the course’s educational effectiveness.

The baseline knowledge assessment was conducted from 17–23 March 2019. It was an anonymous online Google form assessment. A link was sent to the personal mobile phones of all HMCAS emergency staff and NCC staff. Each participant was given 15 minutes at the start of their shift to complete the assessment. It comprised seven Multiple Choices Questions (MCQs) about HazMat-CBRN incident responses, the allocated resources, and the HMCAS predesigned plan for such incidents. Two questions, Likert-scale, addressed their knowledge level regarding HazMat-CBRN basic definitions (Seung, 2017; Taherdoost, 2019), and one question inquired about their roles within HMCAS.

According to the literature, MCQs are widely used in medical education as they are objective, may incorporate several subject areas, can be completed in a short time, and can assess analytical thinking (Javaeed, 2018). MCQs allow comparisons of staff performance and can identify knowledge gaps (Burud et al., 2019). We included simple generalised knowledge assessment questions with 4 to 6 response options; one option was correct, whereas the rest were plausible distracting answers.

Based on the baseline knowledge assessment results, the ‘HazMat incident management’ training program was created in June 2019, under the umbrella of the Qatar Department of Health Professions’ (DHP) Accreditation Department, as a Continuous Professional Development (CPD) activity. It was presented on 19 occasions to a maximum of 15 staff members, from June 2019 to June 2020. It was developed using materials and guidelines approved by the HMCAS multidisciplinary management team and Qatar’s Ministry of Public Health DHP. The training package consisted of (Figure 2):

Figure 2. Study design.

1. A sixty seven–slide PowerPoint presentation explaining how to recognise HazMat-CBRN incidents, safety measures, and suggested response plans.

2. Six example scenarios for case discussions involving role play and group interaction in simulated potential HazMat-CBRN situations to address incident management and HMCAS staff safety challenges. Two scenarios were randomly selected for each session.

3. A 15–minute video demonstrating the initial safety steps to be taken by HMCAS staff during a HazMat-CBRN incident.

The materials were developed based on the observations of pre-hospital healthcare providers working on the HazMat-CBRN team and reviewed by disaster management experts within HMCAS. The activity objectives were as follows:

1. Introduce the HMCAS HazMat-CBRN incident management protocol to the pre-hospital medical staff.

2. Educate staff to identify CBRN agents for appropriate resources.

3. Introduce the resources available to HMCAS staff to manage a potential HazMat- CBRN incident according to its severity level.

4. Familiarise the staff with the HMCAS Emergency Response Guidebook to establish primary safety measures and formulate their response plan.(Gai et al., 2018)

5. Improve the coordination between HMCAS communication staff in the NCC and pre-hospital medical responders by encouraging EMDs and their supervisors to participate in this activity, especially role-play and case discussions.

2.2 Measures and analysis

Based on the results of the personnel knowledge assessment, a training activity package was implemented with pre- and post-course tests using the same MCQs (15 MCQ questions), prepared based on the learned points during the case discussion (Figure 2). These MCQs are different from the baseline knowledge assessment MCQs. They were prepared based on the learned points during the case discussions.

The two following hypotheses were proposed:

H₀: The implemented training has no effect on improving staff knowledge about HazMat-CBRN incident management.

H_a: The implemented training positively influenced staff knowledge about HazMat- CBRN incident management.

Before testing these hypotheses, the baseline knowledge assessment’s content validity and reliability were verified. The content validity was tested using Pearson’s product moment (Amron et al., 2020), which assesses the content validity of a questionnaire by measuring the correlation between the score of each item and the total score (Sangoseni et al., 2013). The Content validity is defined as the extent to which the items in a questionnaire are fairly representative of the entire domain that the test seeks to measure (Napitupulu et al., 2018). It showed that the assessment had sufficient content to assess the behavioural aspect in the answers provided.

The reliability test measured the questionnaire’s internal consistency (repeated tests of the same subject under identical conditions). Reliability coefficients range in value from zero (no reliability) to 1.00 (perfect reliability) and are measured using a Cronbach’s alpha coefficient (Amron et al., 2020), or the Kuder-Richardson₂₀ coefficient (KR₂₀) for binary data (e.g. MCQs; Maarefvand et al., 2019).

In addition, the quality of the questions was assessed using item statistics analysis based on a difficulty index, a discriminatory index, and distractor efficiency (Table 1; Burud et al., 2019).

Table 1. Baseline knowledge assessment: Items’ quality analysis

a. Item difficulty indexes:
Items (Q^a)		Q2	Q5	Q6	Q7	Q8	Q9	Q10	Total Mean
N	Valid	224	224	224	224	224	224	224
	Missing	0	0	0	0	0	0	0
Mean		0.68	0.39	0.34	0.21	0.94	0.34	0.5
Median		1	0	0	0	1	0	0
Sum		152	88	76	47	210	76	111
Difficulty Index		67.86%	39.29%	33.93%	20.98%	93.75%	33.93%	49.55%	48.47%
Interpretation^†		Average	Average	Average	Too Difficult	Too Easy	Average	Average	Average
b. Discrimination Index Analysis: Upper-lower quartile differences:
Items		Bottom Quartile Item Mean	Top Quartile Item Mean	Discrimination Index		Interpretation^††
				Upper-Lower Difference
Q2		0.45	0.93	0.48		The item is functioning satisfactorily
Q5		0.05	0.64	0.59		The item is functioning satisfactorily
Q6		0.09	0.64	0.55		The item is functioning satisfactorily
Q7		0.04	0.52	0.48		The item is functioning satisfactorily
Q8		0.79	1	0.21		The item is marginal and needs to be revised
Q9		0.07	0.71	0.64		The item is functioning satisfactorily
Q10		0.05	0.79	0.74		The item is functioning satisfactorily
c. Distractors Efficiency: Mean of distractors items between low and high-performance groups:
Items		Low-Performance Group		High-Performance Group		Interpretation^†††
Q2		0.55		0.07		Functioning Distractor
Q5		0.95		0.36		Functioning Distractor
Q6		0.91		0.36		Functioning Distractor
Q7		0.96		0.48		Functioning Distractor
Q8		0.21		0		Non-functioning Distractor
Q9		0.93		0.29		Functioning Distractor
Q10		0.95		0.21		Functioning Distractor

^aQ: question

(^†): Item difficulty index interpretation:

If Difficulty Index>70%, then the item is ‘Too easy’.

If 30% = <Difficulty Index = <70%, then the item is ‘Average’.

If Difficulty Index<30%, then the item is ‘Too Difficult’.

(^††): Item discrimination index interpretation: Discrimination index<0.2, then the item is poor and should be eliminated.

0.2 = <Discrimination index<0.3, then the item is fair but needs to be revised.

0.3 = <Discrimination index<0.4, then the item is acceptable.

Discrimination index≥0.4, then the item is functioning satisfactorily.

(^†††): Distractors efficiency interpretation:

A non-functioning distractor is defined as an option with either a response frequency of <5% of the chosen options in the lower performance group.

The item difficulty index measured whether an item was too easy or too difficult. A difficulty index item, ranges between 0 and 1. High values indicate the item was easy, whereas low values indicate it was difficult (Khairani & Shamsuddin, 2016). The item discriminatory index measured an item’s ability to differentiate between participants with more or less knowledge (University of Kansas, 2002). It showed the difference in the proportion of students with higher ability and those with a lower ability (Liu, 2019). Two groups were then selected: the high knowledge level group (a total score in the top 25%) and a low knowledge level group (a total score in the bottom 25%). Items with a discrimination value under 0.3 were discarded or revised (Onojakpor & de Kock, 2020).

Distractor efficiency determined whether lower-performing respondents tended to choose distractors. Staff tended to choose ‘none of the above’ or ‘all of the above’ when finding more than one option that might seem correct, which was not necessarily correct. Distractors ensure that staff is confident enough with their level of knowledge. A non-functioning distractor is defined as an option with a response frequency of < 5% of the chosen options (Kheyami et al., 2018).

For the training activity package, to test hypotheses H₀ and H_a, paired group t-test and multiple linear regression analyses were conducted for the pre-and post-course assessment results to evaluate the effect of the HazMat incident management course on attendees’ knowledge. Paired t-test was utilised to analyse the variations in knowledge before and after the training (Moon & Hyun, 2019). Regression analysis was used to study the cause and effect relationship.

2.3 Population

For the baseline knowledge assessment, the inclusion criteria were: (1) Clinical staff in the HMCAS emergency section handling pre-hospital emergency cases (P1 = (710 male and 50 female)), including major incidents and HazMat-CBRN incidents and (2) HMCAS communication staff in the NCC, handling emergency calls, including HazMat-CBRN incidents (P2 = (106 male and 05 female)).

Staff working in the SEM section (70) were excluded from this baseline knowledge assessment, as they had high knowledge regarding HazMat-CBRN responses, and their participation might bias the results. Staff who had already received training in HazMat-CBRN in the previous two years were also excluded.

Slovin’s formula was used to determine the required representative sample size (S) to undergo knowledge assessment (Adam, 2020):

$S=N/\left(1+N\times {\alpha }^2\right)$

• Where N = Total population and α = Error tolerance (α = 0.05).

Considering that the target population was N = P1+ P2 = 871, the minimum number of required responses was 274, for an error tolerance of α = 0.05. Recent research suggest that a maximum error tolerance of α = 0.1 would also be tolerable (Perneger et al., 2015; Riley et al., 2020). Accordingly, a minimum sample size of S = 89 would be acceptable to ensure an appropriately representative sample of the population with a 90% confidence interval (CI).

We aimed to deliver the HazMat incident management training activity package to all HMCAS staff working in the emergency section and the NCC. HMCAS staff not working in the emergency section were excluded.

3 Results

3.1 HMCAS staff knowledge assessment

Overall, 224 (25.71% of the population) HMCAS paramedics and EMDs completed the baseline online assessment. Of these, 75% (n = 168) were APs, 1.34% (n = 3) were CCPs, 15.63% (n = 35) were supervisors, 6.26% (n = 14) worked in the NCC, and 1.79% (n = 4) were managers and administrative staff (APs or CCPs in managerial and administrative roles). Most items had an average difficulty index (Table 1). Most items functioned satisfactorily in differentiating between the low-performance and high-performance groups, except one item that should be revised. (Table 1) Most items contained efficient distractors, except for one (Table 1).

The content validity was determined using the Pearson’s product-moment by measuring the correlation between the score of each item and the total score (Table 2). The results of the reliability test are presented in (Table 2), while (Table 3) summarises the themes that were explored in the knowledge assessment.

Table 2. Baseline Knowledge assessment: Validity and reliability tests

a.Content validity Analysis: Analysis of the results of the Pearson’s product moments of 9 assessment items (N = 249)^a:
Items (Q^b)	r	Association pattern with the total assessment’s score	p value		r square	r square percentage	Significance of r^2%
Q2	0.342**	0.2 < r < 0.4 ⇒ weak	0.000	Valid	0.117	11.70%	11.70% of the score variation explained by Q2
Q3	0.300**	0.2 < r < 0.4 ⇒ weak	0.000	Valid	0.09	9.00%	9% of the score variation explained by Q3
Q4	0.391**	0.2 < r < 0.4 ⇒ weak	0.000	Valid	0.153	15.29%	15.29% of the score variation explained by Q4
Q5	0.415**	0.4 < r < 0.6 ⇒ moderate	0.000	Valid	0.172	17.22%	17.22% of the score variation explained by Q5
Q6	0.410**	0.4 < r < 0.6 ⇒ moderate	0.000	Valid	0.168	16.81%	16.81% of the score variation explained by Q6
Q7	0.435**	0.4 < r < 0.6 ⇒ moderate	0.000	Valid	0.189	18.92%	18.92% of the score variation explained by Q7
Q8	0.401**	0.4 < r < 0.6 ⇒ moderate	0.000	Valid	0.161	16.08%	16.08% of the score variation explained by Q8
Q9	0.488**	0.4 < r < 0.6 ⇒ moderate	0.000	Valid	0.238	23.81%	23.81% of the score variation explained by Q9
Q10	0.474**	0.4 < r < 0.6 ⇒ moderate	0.000	Valid	0.225	22.47%	22.47% of the score variation explained by Q10
**. Correlation is significant at the 0.01 level (2-tailed). *. Correlation is significant at the 0.05 level (2-tailed).
b. Reliability Analysis:
Cronbach’s alpha^c		Cronbach’s Alpha Based on Standardised Items			Number of Items
0.566		0.611			2

^aN is 249 responses

^bQ: question

^cCronbach’ alpha or KR₂₀ for binary data

Table 3. Baseline knowledge assessment themes

Domain assessed in the baseline knowledge assessment	Items
1.Definition of HazMat CBRN incident	Q2, Q3
2.Identification of HazMat-CBRN threat and exposure risk, Safety measures in HazMat-CBRN incident in prehospital setting	Q6, Q8 and Q9 Q4
3.Surge capacity resources in HazMat-CBRN incident in prehospital setting	Q5, Q7
4.Medical clinical assessment of HazMat-CBRN agent	Q10

When staff were asked about the definition of HazMat incidence (Q2), 67.86% (n = 152) answered correctly, while 26.79% (n = 60) chose the distractors; however, when asked how familiar they were with this definition in the next question (Q3), only 22.32% (n = 50) reported that they were very familiar, and 68.75% (n = 154) said that they were fairly familiar with the definition. This shows that participants possessed a fundamental knowledge of the definition of HazMat incidents, as only about a quarter of them chose the distractors. Only 17.41% (n = 49) reported that they were familiar with the safety measures, whereas 52.23% (n = 117) were fairly familiar (Q4). When asked about one of the response components in the HMCAS preparedness plan and whether they could define it (Q5), 60.17% (n = 135) chose the distractors. Concerning their ability to identify a potential HazMat-CBRN agent, assessed in two questions (Q6 and Q9), only 33.93% (n = 76) answered the first question correctly, whereas 60.07% (n = 148) chose the distractors; 33.93% (n = 76) answered the second question correctly. Overall, 93.75% (n = 210) responded correctly when asked about exposure risks (Q8). Additionally, only 20.98% (n = 47) were able to answer correctly when asked about the number of HazMat-CBRN primary response units deployed around Qatar by the HMCAS, in preparation for a potential incident (Q7). Lastly, when staff were asked about HazMat-CBRN incident victims’ medical assessment and symptoms of exposure to chemical agents, 45.55% (n = 102) answered incorrectly (Q10).

Few participants had no correct answers (n = 3), and 122 participants scored below the average. This result indicates the need to improve HMCAS staff knowledge about the management of HazMat-CBRN incidents.

3.2 Pre-and post-course assessment scores

A total of 262 HMCAS staff members registered for one of the 19-course sessions. Of these, 72.14% (n = 195) were able to attend. A total of 5.82% (n = 11) of the attendees were female, 91% (n = 172) were pre-hospital responders (APs, CCPs, and supervisors), 2.5% (n = 5) were communication staff from the NCC (EMDs), and the rest were HMCAS managers and instructors. Four sessions were delivered separately to EMDs (106 males and five females) in the NCC, using the same presentation and the same video but with different scenarios, more adapted to the use of the PROQA® system.

The last three sessions served as refreshers for only SEM staff. Before each session, participants completed a test with 15 MCQs, and the same test was repeated at the end of every session.

The Kolmogorov–Smirnov test and Shapiro–Wilk test were performed to assess the suitability of parametric statistical analysis (Paired t-test) and measure the effectivenes of this course in improving the assessment scores. Their p-values (Table 4) indicate that the data are not normally distributed, despite transforming the values using logarithms (Atangana & Gómez-Aguilar, 2017).

Table 4. Pre- and post-course assessments hypothesis analysis

a.Normality tests:
Pre-Course Assessment Scores											Post-Course Assessment Scores
	Kolmogorov-Smirnov^†					Shapiro-Wilk					Kolmogorov-Smirnov^‡								Shapiro-Wilk
	Statistic	Df		Sig.		Statistic		Df	Sig.				Statistic				Df	Sig.	Statistic		Df	Sig.
Pre- course	0.255	186		0.000		0.785		186	0.000		Post- Course		0.194				185	0.000	0.908		185	0.000
^†Lilliefors Significance Correction											^‡Lilliefors Significance Correction
b.Paired t-test:
			Mean		Std. Deviation					95% Confidence Interval of the Difference											Sig.(2-tailed)
								Std. Error Mean		Lower					Upper			t		df
Pair 1: Pre-course -Post-course			−8.254		2.992			0.22		−8.688					−7.82			− 37.5		184	0.000
c. Multiple Linear Regression:
c1. Coefficients^†††:
Model									Standardise d Coefficients			T		Sig.				95.0% Confidence Interval for B
									Beta									Lower Bound			Upper Bound
1§	(Constant)					10.244		1.692				6.053		0.000				6.905			13.584
	Pre-test					0.028		0.052	0.04			0.534		0.594				−0.074			0.129
	Gender					0.779		0.564	0.103			1.382		0.169				−0.333			1.892
	Position					0.063		0.099	0.047			0.634		0.527				−0.133			0.258
	Status					0.748		0.786	0.071			0.952		0.343				−0.803			2.3
^†††Dependent Variable: Post-course assessment score
c2. Model Summary^††††:
Model	R	R square		Adjusted R square			Std. Error of the Estimate			Change Statistics
										R Squared Change						F Change		f1		df2	Sig. F Change
1	.139^§	0.019		−0.002			1.722			0.019						0.89		4		180	0.471
^††††Dependent Variable: Post-course assessment score
^§Predictors: (Constant), status, gender, position, and re-course assessment score

Owing to the pre-and post-tests assessment sample size (n = 261; Dwivedi et al., 2017), the t-test for paired groups was use d to assess the effectiveness of the ‘HazMat-CBRN Incident Management’ course in improving staff know ledge (Table 4).

The results of the multiple linear regression analysis in (Table 4) determined whether pre-course assessment scores, staff gender, staff role, and their attendance to the sessions (independently and in combination) affected the post-course assessment scores. The p-values >0.05 and the lower bounds of the CIs of all variables are negative. The coefficient of determination, R², is shown in (Table 4).

4 Discussion

The results show that the test questions were not difficult and that the distractors functioned well (Table 1). The content validity presented in (Table 2) show questions from Q2 to Q10 were valid (p < 0.05); however, Q2, Q3, and Q4 had weak content validity, whereas the remainder of the questions had average content validity. Existing research suggests four interval points for reliability. excellent (0.90 and above), high (0.70–0.90), moderate (0.50–0.70) and low (0.50 and below); (Maarefvand et al., 2019). Some research suggests that any question with reliability below 0.70 should not be retained (Amron et al., 2020). Nevertheless, researchers at the University of Quebec (Corbière & Larivière, 2014), explained that the KR₂₀ value should be judged not only by the items’ intercorrelations but also by the number of questions in the questionnaire. For example, a questionnaire with five strongly correlated items (r≥ 0.4) and with a Cronbach’s α = 0.65 would be acceptable. For this baseline knowledge assessment, a Cronbach’s α = 0.566 was obtained for a construct with only two items that were strongly correlated (r ≥ 0.4). Therefore, this Cronbach’s α (or KR₂₀) value (α = 0.566 with two strongly correlated items) is acceptable (Table 2).

Most assessment tools rely on approximately thirty questions; however, such long assessments are often discouraging for participants, who may not be motivated to complete them with the same degree of reliability or attention. When participants are challenged with a lengthy assessment of a rarely-discussed subject, they are discouraged from completing the assessment (Gogol et al., 2014).

We examined the staff knowledge assessment items’ quality, validity, and reliability, thereby demonstrating that an assessment with a small number of items of good quality were effective in measuring staff knowledge about HazMat-CBRN incident management. Using fewer items may present a challenge in demonstrating the validity and reliability of the questionnaire (Feng Yali & Jiaqi, 2021).

The baseline knowledge assessment responses showed that most HMCAS staff who participated in this MCQ assessment possessed a fundamental knowledge of the definition of HazMat-CBRN incidents, with only about a quarter of them choosing distractors. This can be explained by the multiple training courses provided by Hamad Medical Corporation through e-learning modules (a risk management course, environmental safety, fire safety, and disaster preparedness). Previous studies have demonstrated that distance learning can effectively optimise the pre-hospital health response to disasters (Dorigatti et al., 2018). Many related face-to-face training activities were also provided by HMCAS (the International course Major Incident Medical Management and Support [MIMMS] adopted by the Life Support Group UK major incident response triage).

In studies using MCQs, when participants cannot identify the correct answer, their first instinct is to look for something familiar among the available options, which might distract them (Burud et al., 2019). These distractors highlight the common mistakes that staff might make. In this baseline knowledge assessment, many of the staff chose the distractors and few correct answers were noted on the questions related to the following (Table 3):

1. Staff familiarity with safety and life-saving measures in HazMat-CBRN incident management.

2. The components of the HMCAS preparedness plan.

3. Their ability to identify a potential HazMat-CBRN agent.

4. Clinical assessment of HazMat-CBRN incident victims upon exposure to chemical incidents.

5. The primary response units deployed around Qatar by HMCAS as preparation for a potentially related incident.

These results indicate participants’ knowledge was limited and required improvement.

Medical responders in the pre-hospital setting need to skilfully manage HazMat-CBRN incidents (Farhat et al., 2021). Some researchers demonstrated that to ensure effective training for HazMat-CBRN incident management, medical staff in the pre-hospital setting need reinforcement, specifically in the following domains (Djalali et al., 2017):

1. Threat identification and risk analysis

2. Health effects of CBRN agents

3. Planning and organisation

4. Communication and information management

5. Safety, personal protective equipment, and Decontamination

6. Medical Management

7. Psychological supports

8. Ethical considerations

According to the t-test for paired groups (p < 0.05) and the multiple regression analysis (Table 3) of the pre-and post-course assessments results, the impact of the implemented course in empowering HMCAS staff with the appropriate knowledge, regardless of the gender and role (Fitrianti & Riyana, 2020), was confirmed; thus, H_a is accepted.

The HazMat incident management CPD activity targeted both HMCAS staff in the NCC and pre-hospital responders. It addressed issues related to communication and coordination. Communication and coordination have been evaluated in many studies as serious challenges in HazMat-CBRN incident management (Djalali et al., 2017).

At HMCAS, the management of HazMat-CBRN incidents depends on communication staff and pre-hospital responders, ensuring rapid dispatch of appropriate resources for optimal management of victims exposed to HazMat-CBRN agents (Figure 1).

This course’s effectiveness was supplemented by conducting additional periodic practical simulation-based exercises involving HMCAS NCC staff and pre-hospital responders. These periodic exercises addressed decontamination (wet and dry), use of the Powered Air Purifying Respiratory system, and donning/doffing, especially in cases of exposure to highly contagious diseases. The targeted SEM teams include a disaster support team and the HazMat-CBRN responder team.

5 Limitations

The participating staff in the knowledge assessment only represented 25.71% of the total number of staff working in HMCAS operations and in the NCC. This would not negate the results of this study due to the low difference (n = 43) between the number of staff who participated in this study and the required number (n = 267) with a 95% CI. The knowledge assessment encountered the following limitations:

1. Only a few items were included in the assessment.

2. The activity being accredited with CPD points was an extrinsic motivation for HMCAS staff to attend and contribute to maintaining their DHP licences.

3. The inability to control the environment during the pre-and post-tests. Staff could answer the MCQs while being distracted by their surrounding environment or getting support to select the correct answers.

6 Conclusions

This study identified and explored HMCAS staff’s knowledge related to the management of potential HazMat-CBRN incidents in Qatar and emphasised the importance of establishing a well-structured continuous training program. We measured the knowledge level of a sample of HMCAS staff concerning HazMat-CBRN victim management before and after an educational intervention, proving its effectiveness. HMCAS, the national pre-hospital healthcare service provider in the State of Qatar, is well-positioned to establish a wider, innovative disaster preparedness and management training program including HazMat-CBRN incident management as a core topic. This course could be delivered either face-to-face or online, or as a blended learning program.

Author contributions

Hassan Farhat conceived the idea, prepared the methodology, analysed the data and prepared the original draft.

Guillaume Alinier and James Laughton supervised and reviewed and edited the work.

Kawther El Aifa reviewed and edited and visualised the draft.

Padarath Gangaram and Ouissem Zaghouani validated the data.

Mohamed Chaker Khenissi provided the resources.

Imed Gargouri and Moncef Khadhraoui coordinated with the faculty of Medicine of Sfax, Tunisia administration for the paperwork and in reviewing the manuscript.

All authors have read and agreed to the published version of the manuscript.

Availability of data and materials

The anonymous data supporting the findings of this study are held by the primary author and available for review upon request.

Ethical approval and consent to participate

This study was approved by the Hamad Medical Corporation-Medical Research Committee as a quality improvement/audit project (Ref: MRC-01-20-372). The study was conducted according to the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of Hamad Medical Corporation (protocol Ref: MRC-01-20-372 on 30 June 2020).

Participation in the training activity and the pre- and post-course assessments were deemed as assent to collate responses for anonymized and aggregated analysis.

Acknowledgments

Open access funding provided by the Qatar National Library.

We wish to acknowledge all the executive and management teams in Hamad Medical Corporation-Ambulance Service, in particular Dr. Loua Al Shaikh, Mr. Brendon Morris, Dr. Nicholas Castle, Mr. Thomas Reiman and Mr. Ali Darwish, Mr. Naveen Pullian, Ms. Sonia Bounouh, and Mr. Mohamed Khnissi, for all their support and responses for assistance in undertaking the research. Thank you to HazMat First responder team in HMCAS for assisting in providing the training entitled “HazMat-CBRN Incident Management”.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This research was funded by Hamad Medical Corporation. The publication of this study was funded by Qatar National Library.

Notes on contributors

Hassan Farhat

Hassan Farhat: worked for four years as National Health Operations Coordinator in the Strategic Health Operations Center (SHOC Room) in the Ministry of Health in Tunisia. He handled the coordination between Pre-hospital response services and healthcare facilities in disasters with the Command centres of the Ministry of interior and the Ministry of defence. He is working now as an Acting/Operations Officer in Quality Improvement in healthcare at Hamad Medical Corporation Ambulance Service in Doha, Qatar. He was the team leader of the HazMat Response team and contributed to and led different improvement projects. He is a PhD candidate in Health Sciences in the faculty of Medicine of Sousse-Tunisia and a PhD candidate in Biology in the faculty of Sciences of Sfax-Tunisia. He holds a Master of Research degree in environmental public health, a Certificate of studies in Biostatistics Applied in Health Sciences, and enrolled in Master of Science in Data Analysis and Statistics Applied in Health science.

James Laughton

James Laughton: Senior consultant in Medicine, working as Hamad Medical Corporation Ambulance Service Group Head of Clinical Governance, Risk Management and Quality Improvement, Senior Consultant, Ministry of Public Health Covid-19 PPP Group-Performance Team Advisor, Improvement Advisor in the Institute for Healthcare Improvement, Team Kanban Practitioner & Kanban Management Professional, Team STEPPS Master Trainer. He is also involved in many improvements project in Hamad Medical Corporation Ambulance Service.

Padarath Gangaram

Padarath Gangaram: senior critical care paramedic consultant in Hamad Medical Corporation Ambulance Service and a research fellow at Durban University of Technology (South Africa). He holds a PhD degree in Emergency medicine.

Kawther El Aifa

Kawther El Aifa: She works in Hamad Medical Corporation Ambulance Service, in the communication section, as Quality Improvement Reviewer, holding a degree in Emergency Medicine, enrolled in Maser of Sciences in Project Management. She participated in many improvement projects. He is Hamad Medical Corporation Ambulance Service.

Mohamed Chaker Khenissi

Mohamed Chaker Khenissi: Senior Operations Manager in Hamad Medical Corporation Ambulance Service, with Ambulance Paramedic credentials. Major Incident Medical Management and instructor.

Moncef Khadhraoui

Moncef Khadhraoui: holding a PhD in Analytical Chemistry and Environmental Pollution, he is an Associate Professor in the Higher Institute of Biotechnology, Sfax university and in Research Laboratory ”Eco-technology and Environmental Engineering” in Tunisia.

Imed Gargouri

Imed Gargouri: Professor in Medicine in the Faculty of Medicine of Sfax, Tunisia. The director of Master of Research in Environmental Public Health ”Ifriqya”, director of the program of master in statistics and data analysis applied in health sciences, director of the certificate of in complementary studies in Biostatistics applied in health sciences.

Guillaume Alinier

Guillaume Alinier: works for Hamad Medical Corporation Ambulance Service (Qatar) as Director of Research. He holds several honorary positions, including Visiting Professor at the University of Hertfordshire, UK, Adjunct Professor of Education in Medicine for Weill Cornell Medicine - Qatar, and Visiting Fellow with Northumbria University. He is involved in a broad range of projects, including ECMO education, major incident preparedness, quality improvement initiatives, driving safety, clinical simulation educators' development, debriefing, and PhD student supervision. He serves on nine peer-reviewed journal editorial boards and is an active member of several learned societies internationally.

Appendix

HazMat-CBRN Incident Management Training Package

Table

All mentioned materials below were approved by the Ambulance Service Operations Management Team, Communication Management Team, and Training Department
PowerPoint Presentation Prepared by Hassan Farhat	Definition of HazMat and weapons of mass destruction. Health problems induced by Hazmat-CBRN risks. International system of HazMat identification by the 1^st responder who is a healthcare provider in case of related incident (manufacturer, on the road, or in a storage facility) or terrorist attack. Presentation of the call-taking system used by HMCAS Communication Directorate in the National Command Centre (NCC) to manage all emergency 999 calls related to HazMat-CBRN. HazMat-CBRN major incident medical management in a prehospital setting. Presentation of HazMat-CBRN first responder guidelines. Practice the use of the Emergency Response Guidebook (ERG) through HazMat-CBRN scenarios coordinated by the facilitators. Presentation of response guidelines and special cases.
Group discussion/Role play Prepared by Hassan Farhat Role play: Call taking of 999 HazMat CBRN emergency call. Prehospital setting first responder management Challenges	Scenario 1: Chemical terrorist attack in Al-Wakra Metro station. Scenario 2: ‘Is it a highly contagious communicable disease or food intoxication?’ Scenario 3: Chemical incident in industrial area. Scenario 4: RTA involving hazardous material. Scenario 5: Special case 1: Biological accident in hospital lab. Scenario 6: Special case 2: RTA involving HazMat and fire.
Video: (15 min) Editor: Hassan Farhat 15 mins: Initial first response steps Donning/Doffing (Applicable when responding to highly contagious communicable diseases)	Uploaded on ‘YouTube’: https://www.youtube.com/watch?v = oxAVCDO2zsM