Quality measurement and benchmarking of HPV vaccination services

Figures & data

Table 1A. Stakeholders opinions related to the communicational efficiency of the HPV vaccination service delivery

HPV vaccination (HPVV) communicative efficiency (subjective data)
HPVV performance condition (in terms of events)		HPVV survey questions (in terms of conditional events)	Survey result (in terms of conditional probabilities)
			Parent	Nurse	Doctor	Woman	Expert P(E1|Hx)
H1	Information is provided through a brochure with the aid of a person in the waiting room during the HPVV providing	You* assert communicatively efficient the HPVV (i.e., E1), assuming H1 true	88.43%	88.18%	91.19%	77.70%	87.05%>
H2	Information is provided through a brochure with the aid of a person during the vaccination phase of the HPVV providing	You* assert communicatively efficient the HPVV, assuming H2 true	80.30%	78.18%	84.38%	74.97%	79.93%
H3	Information is provided through a brochure without the aid of a person at the time of the HPVV service direct	You* assert communicatively efficient the HPVV, assuming H3 true	59.79%	66.36%	53.75%	57.46%	59.16%
H4	Information is provided through a brochure without the aid of a person in the waiting room during the HPVV providing	You* assert communicatively efficient the HPVV, assuming H4 true	54.13%	65.45%	49.38%	50.16%	54.74%
H5	Information is provided through a brochure without the aid of a person during the vaccination phase of the HPVV providing	You* assert communicatively efficient the HPVV, assuming H5 true	46.13%	48.18%	34.06%	43.13%	42.42%
H6	Information is provided orally by a person in the waiting room during the HPVV providing	You* assert communicatively efficient the HPVV, assuming H6 true	75.80%	76.36%	77.5%	68.85%	75.06%
H7	Information is provided orally by a person during the vaccination phase of the HPVV providing	You* assert communicatively efficient the HPVV, assuming H7 true	71.49%	70.00%	76.25%	66.64%	71.57%
H8	Information is not provided	You* assert communicatively efficient the HPVV, assuming H8 true	7.44%	5.45%	3.75%	14.05%	7.16%

(*) “You” means a parent (P), a nurse (N), a doctor (D), a vaccinated woman (V), or an expert (i.e., a virtual stakeholder whose opinion is obtained as a weighted sum of those of P, N, D, and V, exactly as 0.25*P+0.25*N+0.30*D+0.20*V).

Table 1B. Stakeholders opinions related to the organizational efficiency of the HPV vaccination service delivery

HPV vaccination (HPVV) organizational efficiency (subjective data)
HPVV performance condition (in terms of events)		HPVV survey questions (in terms of conditional events)	Survey result (in terms of conditional probabilities)
			Parent	Nurse	Doctor	Woman	Expert P(E2|Hx)
H1	The waiting time is less than 10 min and vaccination time less than 10 min	You* assert organizationally efficient the HPVV (i.e., E2), assuming H1 true	86.49%	76.36%	85.33%	83.00%	82.91%
H2	The waiting time is between 10 and 20 min and the vaccination time is less than 10 min	You* assert organizationally efficient the HPVV, assuming H2 true	74.15%	72.27%	76.67%	68.92%	73.39%
H3	The waiting time is between 20 and 30 min and the vaccination time is less than 10 min	You* assert organizationally efficient the HPVV, assuming H3 true	57.80%	55.45%	61.67%	52.75%	57.36%
H4	The waiting time is greater than 30 min and the vaccination time is less than 10 min	You* assert organizationally efficient the HPVV, assuming H4 true	42.70%	38.18%	37.67%	40.51%	39.62%
H5	The waiting time is less than 10 min and the vaccination time is between 10 and 20 min	You* assert organizationally efficient the HPVV, assuming H5 true	69.33%	87.27%	79.00%	67.23%	76.30%
H6	The waiting time is between 10 and 20 min and the vaccination time is between 10 and 20 min	You* assert organizationally efficient the HPVV, assuming H6 true	61.46%	81.36%	72.67%	62.69%	70.04%
H7	The waiting time is between 20 and 30 min and the vaccination time is between 10 and 20 min	You* assert organizationally efficient the HPVV, assuming H7 true	48.82%	57.73%	51.87%	48.77%	51.95%
H8	The waiting time is greater than 30 min and the vaccination time is between 10 and 20 min	You* assert organizationally efficient the HPVV, assuming H8 true	37.25%	42.27%	34.33%	37.75%	37.73%
H9	The waiting time is less than 10 min and the vaccination time is between 20 and 30 min	You* assert organizationally efficient the HPVV, assuming H9 true	64.91%	63.82%	53.44%	55.94%	59.40%
H10	The waiting time is between 10 and 20 min and the vaccination time is between 20 and 30 min	You* assert organizationally efficient the HPVV, assuming H10 true	55.52%	48.64%	41.88%	49.20%	48.44%
H11	The waiting time is between 20 and 30 min and the vaccination time is between 20 and 30 min	You* assert organizationally efficient the HPVV, assuming H11 true	48.16%	41.18%	31.56%	41.25%	40.05%
H12	The waiting time is greater than 30 min and the vaccination time is between 20 and 30 min	You* assert organizationally efficient the HPVV, assuming H12 true	37.08%	33.00%	22.00%	36.33%	31.38%
H13	The waiting time is less than 10 min and the vaccination time is greater than 30 min	You* assert organizationally efficient the HPVV, assuming H13 true	53.98%	48.33%	39.67%	48.75%	47.23%
H14	The waiting time is between 10 and 20 min and the vaccination time is greater than 30 min	You* assert organizationally efficient the HPVV, assuming H14 true	47.64%	41.11%	32.67%	43.59%	40.71%
H15	The waiting time is between 20 and 30 min and the vaccination time is greater than 30 min	You* assert organizationally efficient the HPVV, assuming H15 true	40.02%	20.89%	24.67%	36.42%	29.91%
H16	The waiting time is greater than 30 min and the vaccination time is greater than 30 min	You* assert organizationally efficient the HPVV, assuming H16 true	32.53%	14.44%	14.67%	30.04%	22.15%

(*) “You” means a parent (P), a nurse (N), a doctor (D), a vaccinated woman (V), or an expert (i.e., a virtual stakeholder whose opinion is obtained as a weighted sum of those of P, N, D, and V, exactly as 0.25*P+0.25*N+0.30*D+0.20*V).

Table 1C. Stakeholders opinions related to the comfort of the HPV vaccination service delivery

HPV vaccination (HPVV) comfort (subjective data)
HPVV performance condition (in terms of events)		HPVV survey questions (in terms of conditional events)	Survey result (in terms of conditional probabilities)
			Parent	Nurse	Doctor	Woman	Expert P(E3|Hx)
H1	The service is open only in the morning and magazines are available	You* assert comfortable efficient the HPVV (i.e., E3), assuming H1 true	47.99%	55.00%	56.50%	51.48%	52.99%
H2	The service is open only in the morning and no magazine is available	You* assert comfortable efficient the HPVV, assuming H2 true	54.09%	61.82%	60.81%	54.25%	58.07%
H3	The service is open both morning and afternoon and no magazine is available	You* assert comfortable efficient the HPVV, assuming H3 true	78.31%	78.18%	88.38%	70.23%	79.68%
H4	The service is open both morning and afternoon and magazines are available	You* assert comfortable efficient the HPVV, assuming H4 true	88.32%	91.82%	91.56%	80.08%	88.52%

(*) “You” means a parent (P), a nurse (N), a doctor (D), a vaccinated woman (V), or an expert (i.e., a virtual stakeholder whose opinion is obtained as a weighted sum of those of P, N, D, and V, exactly as 0.25*P+0.25*N+0.30*D+0.20*V).

Table 2A. Performance related to the communicative efficiency of the HPV vaccination service delivery

HPV vaccination (HPVV) communicative efficiency (objective data)
HPVV performance conditions (in terms of events)	Results (in terms of probabilities)
	ASL 1	ASL 2	ASL 3
H1 of Table 1A	0%	0%	0%
H2 of Table 1A	0%	0%	0%
H3 of Table 1A	0%	0%	38.50%
H4 of Table 1A	0%	0%	0%
H5 of Table 1A	0%	0%	0%
H6 of Table 1A	0%	0%	23.00%
H7 of Table 1A	100%	100%	38.50%
H8 of Table 1A	0%	0%	0%

Table 2B. Performance related to the organizational efficiency of the HPV vaccination service delivery

HPV vaccination (HPVV) organizational efficiency (objective data)
HPVV performance conditions (in terms of events)	Results (in terms of probabilities)
	ASL 1	ASL 2	ASL 3
H1 of Table 1B	54.10%	29.20%	25.00%
H2 of Table 1B	8.30%	37.50%	33.00%
H3 of Table 1B	0%	20.80%	17.00%
H4 of Table 1B	16.70%	8.30%	25.00%
H5 of Table 1B	8.30%	0%	0%
H6 of Table 1B	0%	0%	0%
H7 of Table 1B	0%	4.20%	0%
H8 of Table 1B	4.20%	0%	0%
H9 of Table 1B	0%	0%	0%
H10 of Table 1B	0%	0%	0%
H11 of Table 1B	0%	0%	0%
H12 of Table 1B	4.20%	0%	0%
H13 of Table 1B	0%	0%	0%
H14 of Table 1B	0%	0%	0%
H15 of Table 1B	0%	0%	0%
H16 of Table 1B	4.20%	0%	0%

Table 2C. Performance related to the comfort of the HPV vaccine service delivery

HPV vaccination (HPVV) comfort (objective data)
HPVV performance conditions (in terms of events)	Results (in terms of probabilities)
	ASL 1	ASL 2	ASL 3
H1 of Table 1C	0%	17.00%	33.00%
H2 of Table 1C	0%	0%	0%
H3 of Table 1C	0%	83.00%	42.00%
H4 of Table 1C	100%	0%	25.00%

Table 3. Main events under evaluation and their probabilities of being true from an expert’s point of view

HPV vaccination (HPVV) Quality Scorecard
Quality facts (in terms of events)		Scores (in terms of probabilities)
		Results			Reference values
		ASL1	ASL2	ASL3	Min	Max
E1	An expert asserts communicatively efficient the HPVV service delivery	71.57%	71.57%	67.60%	7.16%	87.05%
E2	An expert asserts organizationally efficient the HPVV service delivery	67.79%	69.12%	64.66%	22.15%	82.91%
E3	An expert asserts comfortable the HPVV service delivery	88.52%	75.23%	73.00%	52.99%	88.52%
Overall quality scores		73.07%	71.08%	67.21%	20.82%	86.10%

The probabilities in this table were obtained combining probabilities shown in the previous Tables by means of Equation 2 in the mathematical appendix in Supplemental Material. The last row is obtained as the sum of the expected value of the overall quality of services scores by means of Equation 3.