Advanced search
Publication Cover
Applied Measurement in Education Volume 24, 2011 - Issue 2
Submit an article Journal homepage
2,027
Views
78
CrossRef citations to date
0
Altmetric
Research Articles

Validating Measurement of Knowledge Integration in Science Using Multiple-Choice and Explanation Items

Hee-Sun Lee Tufts University and University of California, BerkeleyCorrespondence[email protected]
,
Ou Lydia Liu Educational Testing Service
&
Marcia C. Linn University of California, Berkeley
Pages 115-136 | Published online: 26 Mar 2011

Citations (78)

Keep up to date with the latest research on this topic with citation updates for this article.

Subscribe to citation updates

Read on this site (9)

Stephanie J. Shedrow & Lindsay M. Stoetzel. (2023) Making the transfer: preservice teachers’ technical and pedagogical knowledge of phonics instruction. Teaching Education 0:0, pages 1-22.
Read now
Ying Nie, Yang Xiao, Joseph C. Fritchman, Qiaoyi Liu, Jing Han, Jianwen Xiong & Lei Bao. (2019) Teaching towards knowledge integration in learning force and motion. International Journal of Science Education 41:16, pages 2271-2295.
Read now
C. Aaron Price & A. Chiu. (2018) An experimental study of a museum-based, science PD programme’s impact on teachers and their students. International Journal of Science Education 40:9, pages 941-960.
Read now
Mengxiao Zhu, Hee-Sun Lee, Ting Wang, Ou Lydia Liu, Vinetha Belur & Amy Pallant. (2017) Investigating the impact of automated feedback on students’ scientific argumentation. International Journal of Science Education 39:12, pages 1648-1668.
Read now
Che-Yu Kuo, Hsin-Kai Wu, Tsung-Hau Jen & Ying-Shao Hsu. (2015) Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities. International Journal of Science Education 37:14, pages 2326-2357.
Read now
Kihyun Ryoo & Marcia C. Linn. (2015) Designing and Validating Assessments of Complex Thinking in Science. Theory Into Practice 54:3, pages 238-254.
Read now
Lydia Schaap, Peter Verkoeijen & Henk Schmidt. (2014) Effects of different types of true–false questions on memory awareness and long-term retention. Assessment & Evaluation in Higher Education 39:5, pages 625-640.
Read now
Zhihui Helen Zhang & Marcia C. Linn. (2013) Learning from Chemical Visualizations: Comparing generation and selection. International Journal of Science Education 35:13, pages 2174-2197.
Read now
Sultan Turkan & Ou Lydia Liu. (2012) Differential Performance by English Language Learners on an Inquiry-Based Science Assessment. International Journal of Science Education 34:15, pages 2343-2369.
Read now

Articles from other publishers (69)

Wangyi Xu, Yonggui Jiang, Lan Yang & Lei Bao. (2023) Conceptual framework based instruction for promoting knowledge integration in learning momentum. Physical Review Physics Education Research 19:2.
Crossref
Sinem DEMİRKOL & Merve AYVALLI. (2023) PISA 2015 Okuma Becerisi Maddelerinin Güçlük İndeksini Etkileyen Madde Özelliklerinin İncelenmesiInvestigation of Item Properties Affecting the Difficulty Index of PISA 2015 Reading Literacy Items. Ana Dili Eğitimi Dergisi, pages 567-579.
Crossref
Guanxue Shi & Hualin Bi. (2023) A systematic review of learning progressions for the concept of matter in science education. Chemistry Education Research and Practice 24:3, pages 793-806.
Crossref
Paul P. Martin & Nicole Graulich. (2023) When a machine detects student reasoning: a review of machine learning-based formative assessment of mechanistic reasoning. Chemistry Education Research and Practice 24:2, pages 407-427.
Crossref
Camillia Matuk & Marcia C. Linn. (2023) Students’ perceptions of the impacts of peer ideas in inquiry learning. Instructional Science 51:1, pages 65-102.
Crossref
Karen D. Wang, Jade Maï Cock, Tanja Käser & Engin Bumbacher. (2022) A systematic review of empirical studies using log data from open‐ended learning environments to measure science and engineering practices. British Journal of Educational Technology 54:1, pages 192-221.
Crossref
Okan Sıbıç, Behiye AKÇAY & Merve ARIK. (2022) Review of Two-tier Tests in the Studies: Creating a New Pathway for Development of Two-tier Tests. International Journal of Contemporary Educational Research 7:2, pages 81-98.
Crossref
Jochen Roeper, Jasmin Reichert-Schlax, Olga Zlatkin-Troitschanskaia, Verena Klose, Maruschka Weber & Marie-Theres Nagel. (2022) Patterns of Domain-Specific Learning Among Medical Undergraduate Students in Relation to Confidence in Their Physiology Knowledge: Insights From a Pre–post Study. Frontiers in Psychology 12.
Crossref
Gülden Kaya Uyanik & Levent Ertuna. (2022) Examination of Testlet Effect in Open-Ended Items. SAGE Open 12:1, pages 215824402210798.
Crossref
Melanie M. Cooper & Michael W. Klymkowsky. 2022. Technologies in Biomedical and Life Sciences Education. Technologies in Biomedical and Life Sciences Education 241 257 .
Lei Bao & Joseph C. Fritchman. (2021) Knowledge integration in student learning of Newton’s third law: Addressing the action-reaction language and the implied causality. Physical Review Physics Education Research 17:2.
Crossref
Wm. Matthew Reynolds & Soonhye Park. (2020) Examining the relationship between the Educative Teacher Performance Assessment and preservice teachers' pedagogical content knowledge. Journal of Research in Science Teaching 58:5, pages 721-748.
Crossref
Cong Wang, Xiufeng Liu, Lei Wang, Ying Sun & Hongyan Zhang. (2020) Automated Scoring of Chinese Grades 7–9 Students’ Competence in Interpreting and Arguing from Evidence. Journal of Science Education and Technology 30:2, pages 269-282.
Crossref
Jessica R. VandenPlas, Deborah G. Herrington, Alec D. Shrode & Ryan D. Sweeder. (2021) Use of Simulations and Screencasts to Increase Student Understanding of Energy Concepts in Bonding. Journal of Chemical Education 98:3, pages 730-744.
Crossref
Keenan Noyes, Robert L. McKay, Matthew Neumann, Kevin C. Haudek & Melanie M. Cooper. (2020) Developing Computer Resources to Automate Analysis of Students’ Explanations of London Dispersion Forces. Journal of Chemical Education 97:11, pages 3923-3936.
Crossref
Qingwei Chen, Guangtian Zhu, Qiaoyi Liu, Jing Han, Zhao Fu & Lei Bao. (2020) Development of a multiple-choice problem-solving categorization test for assessment of student knowledge structure. Physical Review Physics Education Research 16:2.
Crossref
Yang Xiao, Guiqing Xu, Jing Han, Hua Xiao, Jianwen Xiong & Lei Bao. (2020) Assessing the longitudinal measurement invariance of the Force Concept Inventory and the Conceptual Survey of Electricity and Magnetism. Physical Review Physics Education Research 16:2.
Crossref
Fernando Flores-Camacho, Leticia Gallegos-Cázares & Cynthia Lima González. (2020) Representaciones en Física: construcción y validación de un cuestionario para la Enseñanza Media Superior. Revista Electrónica de Investigación Educativa 22, pages 1-17.
Crossref
Wangyi Xu, Qiaoyi Liu, Kathleen Koenig, Joseph Fritchman, Jing Han, Sudong Pan & Lei Bao. (2020) Assessment of knowledge integration in student learning of momentum. Physical Review Physics Education Research 16:1.
Crossref
Norda S. Stephenson, Erin M. Duffy, Elizabeth L. Day, Kira Padilla, Deborah G. Herrington, Melanie M. Cooper & Justin H. Carmel. (2020) Development and Validation of Scientific Practices Assessment Tasks for the General Chemistry Laboratory. Journal of Chemical Education 97:4, pages 884-893.
Crossref
Beste Ulus & Diler Oner. (2020) Fostering Middle School Students’ Knowledge Integration Using the Web-Based Inquiry Science Environment (WISE). Journal of Science Education and Technology 29:2, pages 242-256.
Crossref
Dermot Francis Donnelly-Hermosillo, Libby F. Gerard & Marcia C. Linn. (2020) Impact of graph technologies in K-12 science and mathematics education. Computers & Education 146, pages 103748.
Crossref
Olivia M. Crandell, Macy A. Lockhart & Melanie M. Cooper. (2020) Arrows on the Page Are Not a Good Gauge: Evidence for the Importance of Causal Mechanistic Explanations about Nucleophilic Substitution in Organic Chemistry. Journal of Chemical Education 97:2, pages 313-327.
Crossref
Mengxiao Zhu, Ou Lydia Liu & Hee-Sun Lee. (2020) The effect of automated feedback on revision behavior and learning gains in formative assessment of scientific argument writing. Computers & Education 143, pages 103668.
Crossref
Richard Tong, Shuai Wang, Elizabeth McBride, Hannah Kelly & Wei Cui. 2020. Radical Solutions and Learning Analytics. Radical Solutions and Learning Analytics 17 35 .
Lei Bao & Kathleen Koenig. (2019) Physics education research for 21st century learning. Disciplinary and Interdisciplinary Science Education Research 1:1.
Crossref
William R. Penuel, Michael L. Turner, Jennifer K. Jacobs, Katie Van Horne & Tamara Sumner. (2019) Developing tasks to assess phenomenon‐based science learning: Challenges and lessons learned from building proximal transfer tasks. Science Education 103:6, pages 1367-1395.
Crossref
Fernando Flores-Camacho, Leticia Gallegos-Cázares, Beatriz-Eugenia García-Rivera & Araceli Báez-Islas. (2019) Efectos de los laboratorios de ciencias con TIC en la comprensión y representación de los conocimientos científicos en estudiantes del bachillerato en un contexto escolar cotidiano. Revista Iberoamericana de Educación Superior 10:29, pages 124-142.
Crossref
Rui Dai, Joseph C. Fritchman, Qiaoyi Liu, Yang Xiao, Haibo Yu & Lei Bao. (2019) Assessment of student understanding on light interference. Physical Review Physics Education Research 15:2.
Crossref
Jose Manuel Azevedo, Ema P. Oliveira & Patrícia Damas Beites. (2019) Using Learning Analytics to evaluate the quality of multiple-choice questions. The International Journal of Information and Learning Technology 36:4, pages 322-341.
Crossref
Marcus Kubsch, Jeffrey Nordine, Knut Neumann, David Fortus & Joseph Krajcik. (2019) Probing the Relation between Students’ Integrated Knowledge and Knowledge-in-Use about Energy using Network Analysis. EURASIA Journal of Mathematics, Science and Technology Education 15:8.
Crossref
Kihyun Ryoo & Kristin Bedell. (2018) Supporting linguistically diverse students' science learning with dynamic visualizations through discourse‐rich practices. Journal of Research in Science Teaching 56:3, pages 270-301.
Crossref
Rebecca L. Matz, Cori L. Fata-Hartley, Lynmarie A. Posey, James T. Laverty, Sonia M. Underwood, Justin H. Carmel, Deborah G. Herrington, Ryan L. Stowe, Marcos D. Caballero, Diane Ebert-MayMelanie M. Cooper. (2018) Evaluating the extent of a large-scale transformation in gateway science courses. Science Advances 4:10.
Crossref
José Azevedo, Ema Patrícia Oliveira & Patrícia Damas Beites. 2018. Handbook of Research on E-Assessment in Higher Education. Handbook of Research on E-Assessment in Higher Education 1 27 .
Lei Bao, Yang Xiao, Kathleen Koenig & Jing Han. (2018) Validity evaluation of the Lawson classroom test of scientific reasoning. Physical Review Physics Education Research 14:2.
Crossref
Johannes Schult & Jörn R. Sparfeldt. (2018) Reliability and Validity of PIRLS and TIMSS. European Journal of Psychological Assessment 34:4, pages 258-269.
Crossref
Melanie M. Cooper & Ryan L. Stowe. (2018) Chemistry Education Research—From Personal Empiricism to Evidence, Theory, and Informed Practice. Chemical Reviews 118:12, pages 6053-6087.
Crossref
Soonhye Park, Jeekyung Suh & Kyungwoon Seo. (2017) Development and Validation of Measures of Secondary Science Teachers’ PCK for Teaching Photosynthesis. Research in Science Education 48:3, pages 549-573.
Crossref
Johannes Schult & Marlit A. Lindner. (2018) Diagnosegenauigkeit von Deutschlehrkräften in der Grundschule: Eine Frage des Antwortformats?. Zeitschrift für Pädagogische Psychologie 32:1-2, pages 75-87.
Crossref
Sonia M. Underwood, Lynmarie A. Posey, Deborah G. Herrington, Justin H. Carmel & Melanie M. Cooper. (2017) Adapting Assessment Tasks To Support Three-Dimensional Learning. Journal of Chemical Education 95:2, pages 207-217.
Crossref
Fernando Flores-Camacho, Beatriz Eugenia García-Rivera, Araceli Báez-Islas & Leticia Gallegos-Cázares. (2017) Diseño y Validación de un Instrumento para Analizar las Representaciones Externas de Estudiantes de Bachillerato sobre Genética. Revista Iberoamericana de Evaluación Educativa 10.2:2017.
Crossref
Michael W. Klymkowsky, Jeremy D. Rentsch, Emina Begovic & Melanie M. Cooper. (2016) The Design and Transformation of Biofundamentals: A Nonsurvey Introductory Evolutionary and Molecular Biology Course. CBE—Life Sciences Education 15:4, pages ar70.
Crossref
Melanie M. Cooper, Hovig Kouyoumdjian & Sonia M. Underwood. (2016) Investigating Students’ Reasoning about Acid–Base Reactions. Journal of Chemical Education 93:10, pages 1703-1712.
Crossref
Denise M. Bressler & Alec M. Bodzin. (2016) Investigating Flow Experience and Scientific Practices During a Mobile Serious Educational Game. Journal of Science Education and Technology 25:5, pages 795-805.
Crossref
Siti Fatimah Petra, Jainatul Halida Jaidin, JSH Quintus Perera & Marcia Linn. (2016) Supporting students to become autonomous learners: the role of web-based learning. The International Journal of Information and Learning Technology 33:4, pages 263-275.
Crossref
. (2016) The Influence of Item Formats when Locating a Student on a Learning Progression in Science. International Journal of Assessment Tools in Education, pages 101-122.
Crossref
Meghan Rector Federer, Ross H. Nehm & Dennis K. Pearl. (2016) Examining Gender Differences in Written Assessment Tasks in Biology: A Case Study of Evolutionary Explanations. CBE—Life Sciences Education 15:1, pages ar2.
Crossref
Mengxiao Zhu, Ou Lydia Liu, Liyang Mao & Amy Pallant. (2016) Use of automated scoring and feedback in online interactive earth science tasks. Use of automated scoring and feedback in online interactive earth science tasks.
C. Aaron Price, Katherine Gean, Claire G. Christensen, Elham Beheshti, Bryn Pernot, Gloria Segovia, Halcyon Person, Steven Beasley & Patricia Ward. (2015) Casual Games and Casual Learning About Human Biological Systems. Journal of Science Education and Technology 25:1, pages 111-126.
Crossref
Ou Lydia Liu, Joseph A. Rios, Michael Heilman, Libby Gerard & Marcia C. Linn. (2016) Validation of automated scoring of science assessments. Journal of Research in Science Teaching 53:2, pages 215-233.
Crossref
Leah C. Williams, Sonia M. Underwood, Michael W. Klymkowsky & Melanie M. Cooper. (2015) Are Noncovalent Interactions an Achilles Heel in Chemistry Education? A Comparison of Instructional Approaches. Journal of Chemical Education 92:12, pages 1979-1987.
Crossref
Robert B. Marsteller & Alec M. Bodzin. (2015) The Effectiveness of an Online Curriculum on High School Students’ Understanding of Biological Evolution. Journal of Science Education and Technology 24:6, pages 803-817.
Crossref
Marlit A. Lindner, Benjamin Strobel & Olaf Köller. (2015) Multiple-Choice-Prüfungen an Hochschulen?. Zeitschrift für Pädagogische Psychologie 29:3-4, pages 133-149.
Crossref
Melanie M. Cooper. (2015) Why Ask Why?. Journal of Chemical Education 92:8, pages 1273-1279.
Crossref
Melanie M. Cooper, Leah C. Williams & Sonia M. Underwood. (2015) Student Understanding of Intermolecular Forces: A Multimodal Study. Journal of Chemical Education 92:8, pages 1288-1298.
Crossref
Meghan Rector Federer, Ross H. Nehm, John E. Opfer & Dennis Pearl. (2014) Using a Constructed-Response Instrument to Explore the Effects of Item Position and Item Features on the Assessment of Students’ Written Scientific Explanations. Research in Science Education 45:4, pages 527-553.
Crossref
Krithika Randhawa & Moira Scerri. 2015. The Handbook of Service Innovation. The Handbook of Service Innovation 27 51 .
Richard J Hift. (2014) Should essays and other “open-ended”-type questions retain a place in written summative assessment in clinical medicine?. BMC Medical Education 14:1.
Crossref
Evgeny A. Eremin. (2014) New proposals about evaluation of complete e-learning course digestion. New proposals about evaluation of complete e-learning course digestion.
Hsin-Yi Chang, Zhihui H. Zhang & Shu-Yuan Chang. (2013) Adaptation of an Inquiry Visualization Curriculum and its Impact on Chemistry Learning. The Asia-Pacific Education Researcher 23:3, pages 605-619.
Crossref
Michelle M. Wooten, Adrienne M. Cool, Edward E. Prather & Kimberly D. Tanner. (2014) Comparison of performance on multiple-choice questions and open-ended questions in an introductory astronomy laboratory. Physical Review Special Topics - Physics Education Research 10:2.
Crossref
Ou Lydia Liu, Lois Frankel & Katrina Crotts Roohr. (2014) Assessing Critical Thinking in Higher Education: Current State and Directions for Next-Generation Assessment. ETS Research Report Series 2014:1, pages 1-23.
Crossref
Hee-Sun Lee, Ou Lydia Liu, Amy Pallant, Katrina Crotts Roohr, Sarah Pryputniewicz & Zoë E. Buck. (2014) Assessment of uncertainty-infused scientific argumentation. Journal of Research in Science Teaching 51:5, pages 581-605.
Crossref
Theodoros Vachliotis, Katerina Salta & Chryssa Tzougraki. (2013) Meaningful Understanding and Systems Thinking in Organic Chemistry: Validating Measurement and Exploring Relationships. Research in Science Education 44:2, pages 239-266.
Crossref
Emily Saxton, Robin Burns, Susan Holveck, Sybil Kelley, Daniel Prince, Nicole Rigelman & Ellen A. Skinner. (2014) A Common Measurement System for K-12 STEM education: Adopting an educational evaluation methodology that elevates theoretical foundations and systems thinking. Studies in Educational Evaluation 40, pages 18-35.
Crossref
Jennifer L. Chiu, Peter T. Malcolm, Deborah Hecht, Crystal J. DeJaegher, Edward A. Pan, Michael Bradley & M. David Burghardt. (2013) WISEngineering: Supporting precollege engineering design and mathematical understanding. Computers & Education 67, pages 142-155.
Crossref
Hsin-Yi Chang. (2012) Teacher guidance to mediate student inquiry through interactive dynamic visualizations. Instructional Science 41:5, pages 895-920.
Crossref
Hsin-Yi Chang & Marcia C. Linn. (2013) Scaffolding learning from molecular visualizations. Journal of Research in Science Teaching 50:7, pages 858-886.
Crossref
Ou Lydia Liu, Hee‐Sun Lee & Marcia C. Linn. (2011) Measuring knowledge integration: Validation of four‐year assessments. Journal of Research in Science Teaching 48:9, pages 1079-1107.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.