The development and validation of the Mutation Criterion Referenced Assessment (MuCRA)

ABSTRACT

Most biology undergraduates learn about mutations in multiple classrooms throughout their college career. Understanding personalised genome test results, genome editing controversies, and the appearance of new variants of viruses or antibiotic resistant bacteria all require foundational knowledge about mutations. However, the abstract nature of molecular processes surrounding mutations makes them one of the more difficult topics for students to understand and apply. Instructors need valid assessment tools to document student understanding and tailor their instructional methods to address student knowledge gaps. We describe here the development and validation of the Mutations Criterion Referenced Assessment (MuCRA). This formative assessment was developed through an iterative process involving expert feedback and student responses to both open-ended and multiple-choice questions. The final MuCRA is composed of 10 multiple-choice questions aligned with three learning objectives. The item difficulty for each question was between 0.32–0.65, while the discrimination index ranged from 0.31–0.75 and the reliability (KR20) for the MuCRA was 0.69. The congruence analyses demonstrated distractors are capturing student misconceptions in 9/10 questions. These data indicate that the MuCRA can be used to reliably assess student learning and common misconceptions about mutations.

KEYWORDS:

• Mutations
• assessment
• undergraduate
• genetics
• concept inventory

Acknowledgments

The authors would like to thank the faculty and universities participating in MuCRA testing.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplementary material

Supplemental data for this article can be accessed online at https://doi.org/10.1080/00219266.2022.2100451

Additional information

Funding

This work was supported by the NSF [DUE 1710262,NSF: DUE 1710262]; National Institute of Food and Agriculture [IOW04008, Accession # 1010715].