An initial reliability and validity study of the Interaction, Communication, and Literacy Skills Audit

Abstract

Early childhood educators (ECEs) have an important role in promoting positive outcomes for children's language and literacy development. This paper reports the development of a new tool, The Interaction Communication and Literacy (ICL) Skills Audit, and pilots its reliability and validity. Intra- and inter-rater reliability was examined by three speech-language pathologists (SLPs). Five skill areas relating to ECE language and literacy practice were rated. The face and content validity of the ICL Skills Audit was examined by expert SLPs (n = 8) and expert ECEs (n = 4) via questionnaire. The overall intra-rater reliability for the ICL Skills Audit was excellent with percentage close agreement (PCA) of 91–94. Inter-rater agreement was PCA 68–80. Expert SLPs and ECEs agreed that the content was comprehensive and practical. Based on this preliminary study, the ICL Skills Audit appears to be a promising tool that can be used by SLPs and ECEs in collaboration to measure the skills of ECEs in the areas of language and literacy support. Future psychometric and outcome research on the revised ICL Skills Audit is warranted.

Keywords::

• Early childhood professionals
• measurement tools
• validity
• reliability
• professional development
• language development
• literacy

Acknowledgements

Rebecca Galea, Executive Officer of Bankstown Community Resource Group, was instrumental in initiating and supporting this research and the authors would like to acknowledge her contributions to the project and to our understanding of both action research and to collaborative partnerships between communities and professionals. Rebecca passed away on 16 October, 2013. She is sorely missed.

Declaration of interest: The authors report no conflicts of interest. The authors alone are responsible for the content and writing of the paper.