Development of a contextually appropriate, reliable and valid basic Wheelchair Service Provision Test

Abstract

Purpose: Currently, there is no internationally accepted way to measure the competency of wheelchair service professionals. The International Society of Wheelchair Professionals aims to develop a Wheelchair Service Provision – Basic Test as a preliminary step towards establishing a certification process. Method: A team of wheelchair service provision experts developed test questions and conducted alpha and beta testing in order to validate them. Low-performing test items were eliminated. A pilot test was then conducted, which focused on developing a pass score, determining language barriers and validating the test as a measure of competency. Results: 90 participants completed one of three versions of the Wheelchair Service Provision – Basic Test. A pass score of 70% was established and 135 questions were accepted for the final test. Analysis of variance indicated there was a difference in scores based on language (p = 0.001), but not based on experience level. This result motivated translation in to the United Nations’ official languages. Conclusions: The results indicate that the Wheelchair Service Provision – Basic Test is a valid method for measuring basic competency of wheelchair professionals. Additionally, researchers recommend a skills assessment to help to ensure only qualified wheelchair professionals receive the certificate.

Implications for Rehabilitation

• Identify key steps in contextually appropriate test development.

• Describe the components of a contextually appropriate, reliable, and valid test for basic wheelchair service provision.

• Identify methods used for contextually appropriate test validation.

Keywords:

• Clinician
• cultural competence
• knowledge test
• psychometrics
• service provision
• test item construction
• wheelchair

Acknowledgements

The authors thank USAID; Advancing Partners & Communities; JSI Research & Training Institute, Inc.; Leadership, Management, and Governance Project at Management Sciences for Health; The Institute for Performance Improvement.

Disclosure statement

The authors report no declarations of interest beyond the grant award received.

Funding information

Funding for the International Society of Wheelchair Professionals (ISWP) was provided by USAID (Agreement No.: AIDOAA-A-12-00047, Subaward No.: APC-GM-0068).