Development and initial validation of Digital Age Teaching Scale (DATS) to assess application of ISTE Standards for Educators in K–12 education classrooms

Abstract

This study presents the methodological and procedural development process of the Digital Age Teaching Scale (DATS), a summative assessment tool designed to measure application of the ISTE Standards for Educators in K–12 classrooms. The theoretical framework of the ISTE Standards for Educators informed the development of DATS, and an 8-step process of applied theory validated 36 items across 7 framework dimensions. The responses of 642 in-service teachers in K–12 and career and technical education informed and validated the instrument. Two-correlation matrix analysis (inter-item and item-scale correlations) showed statistical inter-item and item-scale correlation; two-dimensionality analysis (exploratory factor analysis and confirmatory factor analysis) revealed seven factors for exploratory factor analysis and indicated an acceptable model fit in confirmatory factor analysis; and reliability analysis points to strong overall internal consistencies. All analysis showed adequate psychometric properties, and future studies should focus on shortening the scale.

Keywords:

• ISTE educator standards
• scale development
• technology assessment
• teacher evaluation

Acknowledgments

The author would like to thank the editors and the anonymous reviewers for the useful and insightful comments in earlier drafts of this paper.

Additional information

Notes on contributors

Indrit Vucaj

Indrit Vucaj, Ph.D. is a Program Evaluator at the Oklahoma City Public Schools. His research examines the role of technology in skill formation, and its transferability to the labor market. He has developed, led, and evaluated the development of multiple STEAM labs in elementary, middle, and high schools, including Cisco and AWS technologies. Follow him on Twitter @indritvucaj