An Empirical Examination of a Modified Matrix Sampling Procedure as an Evaluation Tool for Grades 7 to 12 in a Midwestern School District

Abstract

Multiple matrix sampling is a data collection technique that ensures accuracy and efficiency in group performance. It has been widely used in large-scale curriculum evaluation since the 1980s. However, the design does not always fully embrace the dynamics of local evaluation demands. The purpose of this study is to introduce a modified matrix sampling design to meet the specific need of a local school district to collect evaluation data. The most salient difference of the modified matrix sampling method in the present study lay in the incorporation of core items, while dividing the remainder of the items in the entire item pool into two instruments. The results from empirical examination of the modified matrix sampling design indicated that the approach is efficient at no extra cost for accuracy.

Keywords:

• multiple matrix sampling
• modified approach
• item population
• examinee population
• core items
• large-scale evaluation data