2,318
Views
84
CrossRef citations to date
0
Altmetric
Research Reports

Evaluating Instrument Quality in Science Education: Rasch‐based analyses of a Nature of Science test

, &
Pages 1373-1405 | Published online: 29 Oct 2010

Keep up to date with the latest research on this topic with citation updates for this article.

Read on this site (21)

Sarah Zoechling, Martin Hopf, Julia Woithe & Sascha Schmeling. (2022) Students’ interest in particle physics: conceptualisation, instrument development, and evaluation using Rasch theory and analysis. International Journal of Science Education 44:15, pages 2353-2380.
Read now
Yustika Sya’bandari, Arif Rachmatullah & Minsu Ha. (2021) Psychometric properties of MATE: A study focused on testing the generalizability of the measure of acceptance of the theory of evolution. International Journal of Science Education 43:18, pages 2936-2955.
Read now
Mihwa Park & Raymond Flores. (2021) Developing a questionnaire to measure preservice elementary teachers’ emotions for teaching science and mathematics. International Journal of Science Education 43:18, pages 2911-2935.
Read now
Ai Nurlaelasari Rusmana, Yustika Sya’bandari, Rahmi Qurota Aini, Arif Rachmatullah & Minsu Ha. (2021) Teaching Korean science for Indonesian middle school students: promoting Indonesian students’ attitude towards science through the global science exchange programme. International Journal of Science Education 43:11, pages 1837-1859.
Read now
Xiaoming Zhai & Min Li. (2021) Validating a partial-credit scoring approach for multiple-choice science items: an application of fundamental ideas in science. International Journal of Science Education 43:10, pages 1640-1666.
Read now
Heleen Bourdeaud’Hui, Koen Aesaert & Johan van Braak. (2021) Exploring the Validity of a Comprehensive Listening Test to Identify Differences in Primary School Students’ Listening Skills. Language Assessment Quarterly 18:3, pages 228-252.
Read now
Moritz Krell, Sabrina Mathesius, Jan van Driel, Claudia Vergara & Dirk Krüger. (2020) Assessing scientific reasoning competencies of pre-service science teachers: translating a German multiple-choice instrument into English and Spanish. International Journal of Science Education 42:17, pages 2819-2841.
Read now
Malte Ring, Taiga Brahm & Christoph Randler. (2019) Do difficulty levels matter for graphical literacy? A performance assessment study with authentic graphs. International Journal of Science Education 41:13, pages 1787-1804.
Read now
Minsu Ha, Xin Wei, Jian Wang, Dan Hou & Ross H. Nehm. (2019) Chinese pre-service biology teachers’ evolutionary knowledge, reasoning patterns, and acceptance levels. International Journal of Science Education 41:5, pages 628-651.
Read now
Jane Robertson Evia, Karen Peterman, Emily Cloyd & John Besley. (2018) Validating a scale that measures scientists’ self-efficacy for public engagement with science. International Journal of Science Education, Part B 8:1, pages 40-52.
Read now
Jian-Xin Yao, Yu-Ying Guo & Knut Neumann. (2017) Refining a learning progression of energy. International Journal of Science Education 39:17, pages 2361-2381.
Read now
Pey-Tee Oon & Xitao Fan. (2017) Rasch analysis for psychometric improvement of science attitude rating scales. International Journal of Science Education 39:6, pages 683-700.
Read now
Silke Rönnebeck, Sascha Bernholt & Mathias Ropohl. (2016) Searching for a common ground – A literature review of empirical research on scientific inquiry activities. Studies in Science Education 52:2, pages 161-197.
Read now
Moritz Krell, Johannes Koska, Fenna Penning & Dirk Krüger. (2015) Fostering pre-service teachers’ views about nature of science: evaluation of a new STEM curriculum. Research in Science & Technological Education 33:3, pages 344-365.
Read now
Irene Neumann, Bettina Rösken-Winter, Malte Lehmann, Christoph Duchhardt, Aiso Heinze & Reinhold Nickolaus. (2015) Measuring Mathematical Competences of Engineering Students at the Beginning of Their Studies. Peabody Journal of Education 90:4, pages 465-476.
Read now
George M. Harrison, Kanesa Duncan Seraphin, Joanna Philippoff, Lisa M. Vallin & Paul R. Brandon. (2015) Comparing Models of Nature of Science Dimensionality Based on the Next Generation Science Standards. International Journal of Science Education 37:8, pages 1321-1342.
Read now
Cornelia Geller, Knut Neumann, William J. Boone & Hans E. Fischer. (2014) What Makes the Finnish Different in Science? Assessing and Comparing Students' Science Learning in Three Countries. International Journal of Science Education 36:18, pages 3042-3066.
Read now
Liezel Retief, Marietjie Potgieter & Marietjie Lutz. (2013) The Usefulness of the Rasch Model for the Refinement of Likert Scale Questionnaires. African Journal of Research in Mathematics, Science and Technology Education 17:1-2, pages 126-138.
Read now
Jørgen Sjaastad. (2013) Measuring the Ways Significant Persons Influence Attitudes Towards Science and Mathematics. International Journal of Science Education 35:2, pages 192-212.
Read now
Laura R. Novick & Kefyn M. Catley. (2012) Assessing Students' Understanding of Macroevolution: Concerns regarding the validity of the MUM. International Journal of Science Education 34:17, pages 2679-2703.
Read now
Louis S. Nadelson & Sherry Southerland. (2012) A More Fine-Grained Measure of Students' Acceptance of Evolution: Development of the Inventory of Student Evolution Acceptance—I-SEA. International Journal of Science Education 34:11, pages 1637-1666.
Read now

Articles from other publishers (63)

Erdem ÇEKMEZ & Rümeysa CEVAHİR. (2023) Sembolik ve Sözel Biçimi Kullanma Öz Yeterlik Ölçeğinin Psikometrik Özelliklerinin Rasch Modeli ile İncelenmesiInvestigation of Psychometric Properties of Using Symbolic and Verbal Forms Self-Efficacy Scale with Rasch Model. Abant İzzet Baysal Üniversitesi Eğitim Fakültesi Dergisi.
Crossref
Anna Beniermann, Alexandra Moormann & Daniela Fiedler. (2022) Validity aspects in measuring evolution acceptance: Evidence from surveys of preservice biology teachers and creationists. Journal of Research in Science Teaching 60:6, pages 1223-1265.
Crossref
Jose M. Oliva & Ángel Blanco. (2023) Rasch analysis and validity of the construct understanding of the nature of models in Spanish-speaking students. European Journal of Science and Mathematics Education 11:2, pages 344-359.
Crossref
Reut Stahi-Hitin & Anat Yarden. (2022) Evolution education in light of religious science teachers’ and scientists’ conceptions of evolution and religion. Evolution: Education and Outreach 15:1.
Crossref
Macarena Larrain & Gabriele Kaiser. (2022) Interpretation of Students’ Errors as Part of the Diagnostic Competence of Pre-Service Primary School TeachersInterpretation von Fehlern der Schülerinnen und Schüler als Teil der diagnostischen Kompetenz von Lehramtsstudierenden für die Grundschule. Journal für Mathematik-Didaktik 43:1, pages 39-66.
Crossref
In Hye Park, Yustika Sya’bandari & Yang Liu. (2021) Item bias on the geriatric depression scale (GDS): investigating the quality and generalizability of GDS on Chinese and Korean community-dwelling elderly population. BMC Geriatrics 21:1.
Crossref
Nathan Anderson Quarderer, Gavin W. Fulmer, Brian Hand & Ted A. Neal. (2021) Unpacking the connections between 8th graders' climate literacy and epistemic cognition. Journal of Research in Science Teaching 58:10, pages 1527-1556.
Crossref
Manuel Bächtold, David Cross & Valérie Munier. (2019) How to Assess and Categorize Teachers’ Views of Science? Two Methodological Issues. Research in Science Education 51:5, pages 1423-1435.
Crossref
Daniela Mahler, Denise Bock & Till Bruckermann. (2021) Preservice Biology Teachers’ Scientific Reasoning Skills and Beliefs about Nature of Science: How Do They Develop and Is There a Mutual Relationship during the Development?. Education Sciences 11:9, pages 558.
Crossref
Yejun Bae, Gavin W. Fulmer & Brian M. Hand. (2021) Developing latent constructs of dialogic interaction to examine the epistemic climate: Rasch modeling. School Science and Mathematics 121:3, pages 164-174.
Crossref
Purwo SUSONGKO, Mobinta KUSUMA, Yuni ARFİANİ, Achmad SAMSUDİN & Adam AMINUDIN. (2020) Revising of the Integrating Scientific Literacy Skills Scale (ISLS) with Rasch Model Analysis. Journal for the Education of Gifted Young Scientists 8:4, pages 1583-1602.
Crossref
Tim Billion-Kramer, Hendrik Lohse-Bossenz, Tobias Dörfler & Markus Rehm. (2020) Professionswissen angehender Lehrkräfte zum Konstrukt Nature of Science (NOS): Entwicklung und Validierung eines Vignettentests (EKoL-NOS)Prospective Teachers’ Professional Knowledge About Nature of Science (NOS)—Development and Validation of a Vignette Test (EKoL-NOS). Zeitschrift für Didaktik der Naturwissenschaften 26:1, pages 53-72.
Crossref
Robyn E. Tornabene, Gena C. Sbeglia & Ross H. Nehm. (2020) Measuring Belief in Genetic Determinism: A Psychometric Evaluation of the PUGGS Instrument. Science & Education 29:6, pages 1621-1657.
Crossref
Friederike Vogt & Philipp Schmiemann. (2020) Assessing Biology Pre-Service Teachers’ Professional Vision of Teaching Scientific Inquiry. Education Sciences 10:11, pages 332.
Crossref
Lukman Abdul Rauf Laliyo, Julhim S. Tangio, Bambang Sumintono, Mohamad Jahja & Citra Panigooro. (2020) ANALYTIC APPROACH OF RESPONSE PATTERN OF DIAGNOSTIC TEST ITEMS IN EVALUATING STUDENTS’ CONCEPTUAL UNDERSTANDING OF CHARACTERISTICS OF PARTICLE OF MATTER. Journal of Baltic Science Education 19:5, pages 824-841.
Crossref
Nanloh S. Jimam, Nahlah E. Ismail & Wetkos D. Dayom. (2020) Evaluation of Psychometric Quality of EQ-5D-5L Scale for Assessing Health-Related Quality of Life of Malaria Patients. Value in Health Regional Issues 22, pages 15-22.
Crossref
I Damopolii, J H Nunaki, E Nusantari & N Y Kandowangko. (2020) The effectiveness of Inquiry-based learning to train students’ thinking skill based on SOLO taxonomy. Journal of Physics: Conference Series 1567:4, pages 042025.
Crossref
Fernando Flores-Camacho, Leticia Gallegos-Cázares & Cynthia Lima González. (2020) Representaciones en Física: construcción y validación de un cuestionario para la Enseñanza Media Superior. Revista Electrónica de Investigación Educativa 22, pages 1-17.
Crossref
Andreas Nehring. (2019) Naïve and informed views on the nature of scientific inquiry in large‐scale assessments: Two sides of the same coin or different currencies?. Journal of Research in Science Teaching 57:4, pages 510-535.
Crossref
Italo Testa, Giuliana Capasso, Arturo Colantonio, Silvia Galano, Irene Marzoli, Umberto Scotti di Uccio & Gaspare Serroni. 2020. Rasch Measurement. Rasch Measurement 99 124 .
Ross H. Nehm. (2019) Biology education research: building integrative frameworks for teaching and learning about living systems. Disciplinary and Interdisciplinary Science Education Research 1:1.
Crossref
Samia Khan & Moritz Krell. (2019) Scientific Reasoning Competencies: a Case of Preservice Teacher Education. Canadian Journal of Science, Mathematics and Technology Education 19:4, pages 446-464.
Crossref
Torsten Binder, Philipp Schmiemann & Heike Theyssen. (2019) Knowledge Acquisition of Biology and Physics University Students—the Role of Prior Knowledge. Education Sciences 9:4, pages 281.
Crossref
Daniela Fiedler, Gena C. Sbeglia, Ross H. Nehm & Ute Harms. (2019) How strongly does statistical reasoning influence knowledge and acceptance of evolution?. Journal of Research in Science Teaching 56:9, pages 1183-1206.
Crossref
E Murniarti, S Solihatun & I B Rangka. (2019) Assessing competency levels of students on learning of energy and weather concepts using partial credit model. Journal of Physics: Conference Series 1318:1, pages 012086.
Crossref
Maja Planinic, William J. Boone, Ana Susac & Lana Ivanjek. (2019) Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research 15:2.
Crossref
Jack A. Cerchiara, Kerry J. Kim, Eli Meir, Mary Pat Wenderoth & Jennifer H. Doherty. (2019) A new assessment to monitor student performance in introductory neurophysiology: Electrochemical Gradients Assessment Device. Advances in Physiology Education 43:2, pages 211-220.
Crossref
Gena C. Sbeglia & Ross H. Nehm. (2019) Do you see what I‐SEA? A Rasch analysis of the psychometric properties of the Inventory of Student Evolution Acceptance. Science Education 103:2, pages 287-316.
Crossref
Jacob C. Lutter, Lillian V. A. Hale & Ginger V. Shultz. (2019) Unpacking graduate students’ knowledge for teaching solution chemistry concepts. Chemistry Education Research and Practice 20:1, pages 258-269.
Crossref
Gwendolyn A. Lawrie, Madeleine Schultz & Anthony H. Wright. (2017) Insights and Teacher Perceptions Regarding Students’ Conceptions as They Enter Tertiary Chemistry Studies: a Comparative Study. International Journal of Science and Mathematics Education 17:1, pages 43-65.
Crossref
Robyn E. Tornabene, Erik Lavington & Ross H. Nehm. (2018) Testing validity inferences for Genetic Drift Inventory scores using Rasch modeling and item order analyses. Evolution: Education and Outreach 11:1.
Crossref
Eun-Jung Lee & Mimi Park. (2018) Exploring Prospective Elementary Teachers’ Ability to Notice. Journal of Educational Research in Mathematics 28:4, pages 417-435.
Crossref
Silvia Wen-Yu Lee. (2017) Identifying the Item Hierarchy and Charting the Progression across Grade Levels: Surveying Taiwanese Students’ Understanding of Scientific Models and Modeling. International Journal of Science and Mathematics Education 16:8, pages 1409-1430.
Crossref
P R Murti, N S Aminah & Harjana. (2018) The Analysis of High School Students’ Science Literacy Based on Nature of Science Literacy Test (NOSLiT). Journal of Physics: Conference Series 1097, pages 012003.
Crossref
Till Bruckermann, Fridtjof Ochsen & Daniela Mahler. (2018) Learning Opportunities in Biology Teacher Education Contribute to Understanding of Nature of Science. Education Sciences 8:3, pages 103.
Crossref
Nathália Helena Azevedo & Daniela Lopes Scarpa. 2018. Teaching Science with Context. Teaching Science with Context 17 30 .
G. Leblebicioglu, D. Metin, E. Capkinoglu, P. S. Cetin, E. Eroglu Dogan & R. Schwartz. (2017) Changes in Students’ Views about Nature of Scientific Inquiry at a Science Camp. Science & Education 26:7-9, pages 889-917.
Crossref
Minsu Ha. (2017) 미국 대학생과 비교한 한국 예비과학교사의 진화론의 실용성에 대한 인식과 진화 수용. BIOLOGY EDUCATION 45:3, pages 427-436.
Crossref
이고은 & Minsu Ha. (2017) 공업계 특성화고 학생의 진화 및 유전 개념 분석. BIOLOGY EDUCATION 45:2, pages 286-294.
Crossref
Patrícia Martinková, Adéla Drabinová, Yuan-Ling Liaw, Elizabeth A. Sanders, Jenny L. McFarland & Rebecca M. Price. (2017) Checking Equity: Why Differential Item Functioning Analysis Should Be a Routine Part of Developing Conceptual Assessments. CBE—Life Sciences Education 16:2, pages rm2.
Crossref
Jenny L. McFarland, Rebecca M. Price, Mary Pat Wenderoth, Patrícia Martinková, William Cliff, Joel Michael, Harold Modell & Ann Wright. (2017) Development and Validation of the Homeostasis Concept Inventory. CBE—Life Sciences Education 16:2, pages ar35.
Crossref
A Rachmatullah, R P Octavianda, M Ha, N Y Rustaman & S Diana. (2017) Construct Validity of Science Motivation and Beliefs Instrument (SLA-MB): A Case study in Sumedang, Indonesia. Journal of Physics: Conference Series 812, pages 012009.
Crossref
Fernando Flores-Camacho, Beatriz Eugenia García-Rivera, Araceli Báez-Islas & Leticia Gallegos-Cázares. (2017) Diseño y Validación de un Instrumento para Analizar las Representaciones Externas de Estudiantes de Bachillerato sobre Genética. Revista Iberoamericana de Evaluación Educativa 10.2:2017.
Crossref
Stefan Korte, Roland Berger, Christian Imwalle & Martin Hänze. (2017) Entwicklung und erste Validierung eines Fragebogens zur Erfassung von Szientismus. Diagnostica 63:1, pages 42-54.
Crossref
Sein Shin, Arif Rachmatullah, Minsu Ha & Jun-Ki Lee. (2016) A Longitudinal Study of Science Core School Students' STEM Career Motivation. Journal of The Korean Association For Science Education 36:6, pages 835-849.
Crossref
Mike U. Smith, Scott W. Snyder & Randolph S. Devereaux. (2016) The GAENE-Generalized Acceptance of EvolutioN Evaluation: Development of a new measure of evolution acceptance. Journal of Research in Science Teaching 53:9, pages 1289-1315.
Crossref
Minsu Ha. (2016) Examining the Validity of History-of-Science-Based Evolution Concept Assessment and Exploring Conceptual Progressions by Contexts. Journal of The Korean Association For Science Education 36:3, pages 509-517.
Crossref
Minsu Ha. (2016) Exploring Development of Pre-Service Science Teachers’Natural Selection Concepts according to Ecology and Genetics Concepts. BIOLOGY EDUCATION 44:2, pages 300-311.
Crossref
Jan Christoph Hadenfeldt, Knut Neumann, Sascha Bernholt, Xiufeng Liu & Ilka Parchmann. (2016) Students’ progression in understanding the matter concept. Journal of Research in Science Teaching 53:5, pages 683-708.
Crossref
WILLIAM J. BOONE, J. SCOTT TOWNSEND & JOHN R. STAVER. (2016) Utilizing Multifaceted Rasch Measurement Through FACETS to Evaluate Science Education Data Sets Composed of Judges, Respondents, and Rating Scale Items: An Exemplar Utilizing the Elementary Science Teaching Analysis Matrix Instrument. Science Education 100:2, pages 221-238.
Crossref
Gavin W. Fulmer, Hye-Eun Chu, David F. Treagust & Knut Neumann. (2015) Is it harder to know or to reason? Analyzing two-tier science assessment items using the Rasch measurement model. Asia-Pacific Science Education 1:1.
Crossref
Minsu Ha, Brian C Baldwin & Ross H Nehm. (2015) The Long-Term Impacts of Short-Term Professional Development: Science Teachers and Evolution. Evolution: Education and Outreach 8:1.
Crossref
Florian Buchwald, Jens Fleischer & Detlev Leutner. (2015) A field experimental study of analytical problem solving competence—Investigating effects of training and transfer. Thinking Skills and Creativity 18, pages 18-31.
Crossref
Ronny Scherer, Jenny Meßinger-Koppelt & Rüdiger Tiemann. (2014) Developing a computer-based assessment of complex problem solving in Chemistry. International Journal of STEM Education 1:1.
Crossref
Lin Ding. (2014) Seeking missing pieces in science concept assessments: Reevaluating the Brief Electricity and Magnetism Assessment through Rasch analysis. Physical Review Special Topics - Physics Education Research 10:1.
Crossref
Daniela Mayer, Beate Sodian, Susanne Koerber & Knut Schwippert. (2014) Scientific reasoning in elementary school children: Assessment and relations with cognitive abilities. Learning and Instruction 29, pages 43-55.
Crossref
Elizabeth P. Beggrow, Minsu Ha, Ross H. Nehm, Dennis Pearl & William J. Boone. (2013) Assessing Scientific Practices Using Machine-Learning Methods: How Closely Do They Match Clinical Interview Performance?. Journal of Science Education and Technology 23:1, pages 160-182.
Crossref
Ross H. Nehm & Kostas Kampourakis. 2014. International Handbook of Research in History, Philosophy and Science Teaching. International Handbook of Research in History, Philosophy and Science Teaching 401 421 .
Knut Neumann, Tobias Viering, William J. Boone & Hans E. Fischer. (2012) Towards a learning progression of energy. Journal of Research in Science Teaching 50:2, pages 162-188.
Crossref
Shawn M. Glynn. (2012) International assessment: A Rasch model and teachers' evaluation of TIMSS science achievement items. Journal of Research in Science Teaching 49:10, pages 1321-1344.
Crossref
Elizabeth P. Beggrow & Ross H. Nehm. (2012) Students’ Mental Models of Evolutionary Causation: Natural Selection and Genetic Drift. Evolution: Education and Outreach 5:3, pages 429-444.
Crossref
Minsu Ha, David L. Haury & Ross H. Nehm. (2011) Feeling of certainty: Uncovering a missing link between knowledge and acceptance of evolution. Journal of Research in Science Teaching 49:1, pages 95-121.
Crossref
Minsu Ha, Ross H. Nehm, Mark Urban-Lurain & John E. Merrill. (2011) Applying Computerized-Scoring Models of Written Biological Explanations across Courses and Colleges: Prospects and Limitations. CBE—Life Sciences Education 10:4, pages 379-393.
Crossref

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.