Development of a contextually appropriate, reliable and valid basic Wheelchair Service Provision Test

Figures & data

Table 1. Participant demographics.

Years of experience: Test C	Frequency	Percent of total
1 year or less	23	26
2–3 years’ experience	22	24
4–7 years’ experience	18	20
8 or more years’ experience	27	30
Total	90	100

Figure 1. Instructions given to participants. Test-takers were shown these instructions before beginning the test. The instructions were also translated into Albanian, for participants whose first language was Albanian.

Table 2. Items by domain for each test and in item pool.

Test section	Items in test by domain	Items in the pool
Assessment: Domain 1	15	39
Prescription: Domain 2	10	30
Fitting: Domain 3	8	20
Production: Domain 4	5	10
User Training: Domain 5	12	32
Process: Domain 6	8	22
Follow-up & Maintenance: Domain 7	3	9
Total	61	162

Figure 2. Interpreting the results of the item analysis. The items analysis indicated the correct answer, how many participants chose the correct answer, and the percent of participants who answered correctly. If the correct answer was not selected at least 70% of the time, the question was eliminated.

Table 3. LMG Beta A including Alpha: descriptive statistics.

Test section	Items in section	Respondents	Minimum score	Maximum score	Mean	SD
Assessment: Domain 1	15	15	8.00	15.00	11.4000	1.95667
Prescription: Domain 2	10	15	3.00	10.00	7.1333	2.26358
Process: Domain 6	8	15	2.00	8.00	5.4667	1.88478
Production: Domain 4	5	15	0.00	4.00	2.6000	1.29835
Fitting: Domain 3	8	15	0.00	7.00	3.9333	2.18654
Follow-up & Maintenance: Domain 7	3	15	0.00	3.00	1.9333	1.03280
User Training: Domain 5	12	15	0.00	10.00	6.6667	3.03942
Total	61	15	19.00	54.00	39.1333	10.88818

Table 4. LMG Beta C: descriptive statistics.

Test section	Items in section	Respondents	Minimum score	Maximum score	Mean	SD
Assessment	15	9	7.00	14.00	12.0000	2.34521
Prescription	10	9	2.00	10.00	7.3333	2.73861
Process	8	9	5.00	8.00	6.7778	0.97183
Production	5	9	2.00	4.00	3.1111	0.60093
Fitting	8	9	1.00	6.00	3.6667	1.65831
Follow-up & Maintenance	3	9	1.00	3.00	2.1111	0.78174
User Training	12	9	1.00	11.00	6.0000	2.64575
Total	61	9	24.00	53.00	41.0000	8.76071

Table 5. Mean scores by test and by experience level.

	Test A	A – Exp Group	Test B^a	B – Exp Group	Test C	C – Exp Group
Number completing test	37		28		25
Difficulty level: % getting correct
Mean % for test	67.3%		66.8%		75.3%
Mean % for experience = 0–1 year	67.7%	10	60.2%	7	73.0%	6
Mean % for Experience = 2–3 years	64.7%	9	68.0%	8	77.7%	5
Mean % for experience = 4–7 years	70.7%	8	74.2%	3	78.0%	7
Mean % for experience = 8 or more years	71.4%	10	67.1%	10	72.4%	7
High score for test	88.5		90.2		90.2
Low score for test	17.0		49.2		49.2
Passing at 70% or higher	22		14		20
Passing at Mean or higher	26		18		15^b

a Test B includes 2 test-takers from Pilot B, which had one less question; however, both passed with high scores.

b Test C had a mean score significantly higher than 70% and the mean scores of the other two tests.

Table 6. Analysis of mean score by language ability.

Language ability	Average score: overall	SD	N
English spoken at home	76	9.7	15
English fluency (not spoken at home)	70	10.8	57
No English fluency reported	61	13.7	18
ANOVA			p = 0.001

Table 7. Analysis of mean score by experience level.

Experience level	Average score: overall	SD	N
1 year or less	67	9.36	23
2–3 years	69	11.62	22
4–7 years	74	10.89	18
8 or more years	70	14.61	26
ANOVA			p = 0.448

Table A1. Blueprint.

Domains	Subdomains	Single	Domain total	Percent of total
Assess (gathering information in order to prescribe)	Client goals	2	16	28
	Lifestyle and environment (2)
	>Lifestyle	2
	>Environment	2
	Support systems	2
	Physical assessment (3)
	>Pressure risk	2
	>Size (measurement)	2
	>Posture	2
	Functional abilities	2
Fitting	Posture	2	8	14
	Pressure	3
	Size and adjustment	2
	Mobility	1
Follow-up (Maintenance & Repair)	Follow-up (2)		2	3
	>Timing	0.5
	>Reason for	0.5
	Maintenance and repair	1
Prescription	Size	3	9	16
	Type and features	3
	Cushions	3
Process	Documentation	3	7	12
	Service steps (2)
	>WHO guidelines	1
	>Proper equipment and facilities	1
	Professionalism	1
	Confidentiality	1
Product Preparation	Assembly and adjustments	1	5	9
	Safe and ready	1
	Basic modifications	2
	Cushion	1
User Training	Wheelchair skills (5)		11	19
	>Handling (folding, set-up, etc.)	1
	>Propel	1
	>Slope	1
	>Barriers	1
	>Transfer	1
	Maintenance	2
	Basic health	2
	Troubleshooting	1
	Caregiver skills	1
Total		58	58	100

Table A1 shows the number of questions per domain on each version of the test (A, B or C) along with the weight given to each domain in terms of the percentage of the total questions. The symbol “>” is used to designate categories in a subdomain. See Table 2 for the available number of questions per domain and domain number designations.

Table B1. Participant demographics: language ability.

Language ability	Frequency	Percent of total
Test A
English spoken at home	4	11
English fluency (not spoken at home)	27	73
No English fluency reported	6	16
Total	37	100
Test B
English spoken at home	6	21
English fluency (not spoken at home)	13	47
No English fluency reported	9	32
Total	28	100
Test C
English spoken at home	5	20
English fluency (not spoken at home)	17	68
No English fluency reported	3	12
Total	25	100

Table B2. Participant demographics: experience level.

Years of experience	Frequency	Percent of total
Test A
1 year or less	10	27
2–3 years	9	24
4–7 years	8	22
8 or more years	10	27
Total	37	100
Test B
1 year or less	7	25
2–3 years	8	28
4–7 years	3	11
8 or more years	10	36
Total	28	100
Test C
1 year or less	6	24
2–3 years	5	20
4–7 years	7	28
8 or more years	7	28
Total	25	100

Table B3. Participant demographics: average age by test.

Test	Average age
A	33.75 years
B	36.5 years
C	36 years

Table B4. Participant demographics: gender distribution by test.

Gender	Test A	Test B	Test C	Pilot B	Total
Male	25	9	10	1	45
Female	12	19	15		46
Total	37	28	25		91