Development and Validation of Questionnaires to Assess Workplace Violence Risk Factors (QAWRF): A Tripartite Perspective of Worksite-Specific Determinants in Healthcare Settings

Figures & data

Table 1 Inclusion and Exclusion Criteria for the Face Validation and Pilot Survey

Questionnaire	Inclusion Criteria	Exclusion Criteria
Administrator	Individuals who were involved in administrative work at a healthcare department, including head of departments, head of medical officers, head of nurses, and head of paramedics. Able to read, write, and understand the Malay language.	Individuals with working experience of fewer than six months at the healthcare department during sample recruitment. Individuals with past psychiatric history.
Worker	Individuals who were involved clinically with clients, including doctors, paramedics, and nurses. Able to read, write, and understand the Malay language.	Individuals with working experience of fewer than six months at the healthcare department during sample recruitment. Individuals with past psychiatric history.
Client	Patients, relatives, and/or individuals who accompanied a patient to a healthcare department and had completed the visit to the health department. Age 18 years old and above. Able to read, write and understand the Malay language.	Intoxicated at the time of study conduct Individuals with past psychiatric history. Individuals who came to the healthcare department but did not meet any clinical healthcare personnel during the visit (eg, came to renew medication).

Table 2 Summary of Literature Used for Items Generation

Literature Type	Number of Studies
Primary research
Quantitative	17^Citation2,Citation5,Citation15,Citation44–57
Qualitative	4^Citation58–61
Secondary research
Systematic review	3^Citation23,Citation24,Citation62
Meta-analysis	1^Citation8
Review Article	3^Citation22,Citation63,Citation64

Table 3 Content Validity Indices for QAWRF

Questionnaire	Domain	Number of Items		Number of Items Eliminated	Number of Items Revised	I-CVI Range	S-CVI/Ave*
		After Development	After Content Validation
QAWRF-Administrator	Client	12	10	2	4	0.667–1.000	0.920
	Worker	17	16	1	2	0.667–1.000
	Workplace	13	13	0	3	0.833–1.000
	Societal	6	6	0	0	0.833–1.000
	Total Item	48	45	3	9	0.667–1.000
QAWRF-Worker	Client	12	10	2	4	0.667–1.000	0.922
	Worker	17	16	1	2	0.667–1.000
	Workplace	12	12	0	3	0.833–1.000
	Societal	6	5	1	0	0.667–1.000
	Total Item	47	43	4	9	0.667–1.000
QAWRF-Client	Client	NA	NA	NA	NA	NA	0.917
	Worker	8	7	1	0	0.667–1.000
	Workplace	8	8	0	3	0.833–1.000
	Societal	6	0	6	0	0.833–1.000
	Total Item	22	15	7	3	0.667–1.000

Note: *Calculated based on average of total I-CVIs of all items in the questionnaire after development phase and six expert ratings.

Table 4 Face Validity Indices for QAWRF

Questionnaire	Domain	Number of Items		Number of Items Eliminated	Number of Items Revised	I-FVI Range	S-FVI/Ave*	S-FVI/UA**
		After Content Validation	After Face Validation
QAWRF-Administrator	Client	10	10	0	0	0.833–1.000	0.983	0.844
	Worker	16	16	0	0	0.917–1.000
	Workplace	13	13	0	0	0.833–1.000
	Societal	6	6	0	0	0.917–1.000
	Total Item	45	45	0	0	0.833–1.000
QAWRF-Worker	Client	10	10	0	0	0.917–1.000	0.981	0.837
	Worker	16	16	0	0	0.833–1.000
	Workplace	12	12	0	0	0.833–1.000
	Societal	5	5	0	0	0.917–1.000
	Total Item	43	43	0	0	0.833–1.000
QAWRF-Client	Client	NA	NA	NA	NA	NA	0.978	0.867
	Worker	7	7	0	1	0.833–1.000
	Workplace	8	8	0	0	0.833–1.000
	Societal	NA	NA	NA	NA	NA
	Total Item	15	15	0	0	0.833–1.000

Notes: *Calculated based on average of total I-FVIs of all items in the questionnaire after content validation phase and 12 ratings. **Calculated based on proportion of items with Universal Agreement by 12 raters in the questionnaire after content validation phase.

Table 5 Internal Consistency Reliability of QAWRF

Questionnaire	Domain	Initial Cronbach’s Alpha	Number of Items Eliminated	Final Cronbach’s Alpha*
Administrator	Client	0.898	0	0.898
	Worker	0.930	0	0.930
	Workplace	0.925	0	0.925
	Societal	0.809	0	0.809
Worker	Client	0.892	0	0.892
	Worker	0.949	0	0.949
	Workplace	0.935	0	0.935
	Societal	0.906	0	0.906
Client	Worker	0.653	1	0.866
	Workplace	0.770	0	0.770

Note: *Calculated after item elimination, if any.

Tian Y, Yue Y, Wang J, Luo T, Li Y, Zhou J. Workplace violence against hospital healthcare workers in China: a national WeChat-based survey. BMC Public Health. 2020;20(1):582. doi:10.1186/s12889-020-08708-3

 PubMed Web of Science ®Google Scholar

Ariffin AA. Workplace violence among healthcare workers in a health district and its predicting factors. Int J Public Health Clin Sci. 2020;7(5):65–80.

 Google Scholar

Hedayati Emam G, Alimohammadi H, Zolfaghari Sadrabad A, Hatamabadi H. Workplace violence against residents in emergency department and reasons for not reporting them; a cross sectional study. Emerg. 2018;6(1):e7.

 PubMed Web of Science ®Google Scholar

Raveel A, Schoenmakers B. Interventions to prevent aggression against doctors: a systematic review. BMJ Open. 2019;9(9):e028465. doi:10.1136/bmjopen-2018-028465

 PubMed Web of Science ®Google Scholar

Hossain MM, Sharma R, Tasnim S, Al Kibria GM, Sultana A, Saxena T. Prevalence, characteristics, and associated factors of workplace violence against healthcare professionals in India: a systematic review and meta-analysis. medRxiv. 2020;2020:1254.

 Google Scholar

Nowrouzi-Kia B, Chai E, Usuba K, Nowrouzi-Kia B, Casole J. Prevalence of type II and type III workplace violence against physicians: a systematic review and meta-analysis. Int J Occup Environ Med. 2019;10(3):99–110. doi:10.15171/ijoem.2019.1573

 PubMed Web of Science ®Google Scholar

Liu J, Gan Y, Jiang H, et al. Prevalence of workplace violence against healthcare workers: a systematic review and meta-analysis. Occup Environ Med. 2019;76(12):927. doi:10.1136/oemed-2019-105849

 PubMed Web of Science ®Google Scholar

Kumari A, Kaur T, Ranjan P, Chopra S, Sarkar S, Baitha U. Workplace violence against doctors: characteristics, risk factors, and mitigation strategies. J Postgrad Med. 2020;66(3):149–154.

 PubMed Web of Science ®Google Scholar

D’Ettorre G, Pellicani V, Mazzotta M, Vullo A. Preventing and managing workplace violence against healthcare workers in Emergency Departments. Acta Biomed. 2018;89(4–s):28–36. doi:10.23750/abm.v89i4-S.7113

 PubMedGoogle Scholar

Ahmad M, Al-Rimawi R, Masadeh A, Atoum M. Workplace violence by patients and their families against nurses: literature review. International Journal of Nursing and Health Science. 2015;2(4):46–55.

 Google Scholar