A systematic review of studies investigating science teaching and learning: over two decades of TIMSS and PISA

References

• Aditomo, A., & Klieme, E. (2020). Forms of inquiry-based science instruction and their relations with learning outcomes: Evidence from high and low-performing education systems. International Journal of Science Education, 42(4), 504–525. https://doi.org/10.1080/09500693.2020.1716093
   Web of Science ®Google Scholar
• Areepattamannil, S. (2012). Effects of inquiry-based science instruction on science achievement and interest in science: Evidence from Qatar. The Journal of Educational Research, 105(2), 134–146. https://doi.org/10.1080/00220671.2010.533717
   Web of Science ®Google Scholar
• Areepattamannil, S., Cairns, D., & Dickson, M. (2020). Teacher-directed versus inquiry-based science instruction: Investigating links to adolescent students’ science dispositions across 66 countries. Journal of Research in Science Teacher, 31(6), 675–704. https://doi-org./10.1007/s11165-021-10002-0
   Google Scholar
• Blanchard, M. R., Southerland, S. A., Osborne, J. W., Sampson, V. D., Annetta, L. A., & Granger, E. M. (2010). Is inquiry possible in light of accountability?: A quantitative comparison of the relative effectiveness of guided inquiry and verification laboratory instruction. Science Education, 94(4), 577–616. https://doi.org/10.1002/sce.20390
   Web of Science ®Google Scholar
• Cairns, D. (2019). Investigating the relationship between instructional practices and science achievement in an inquiry-based learning environment. International Journal of Science Education, 41(15), 2113–2135. https://doi.org/10.1080/09500693.2019.1660927
   Web of Science ®Google Scholar
• Ceylan, E., & Akerson, V. (2014). Comparing the low-and high-performing schools based on the TIMSS in the United States. Egitim ve Bilim, 39(173), 299–309. http://egitimvebilim.ted.org.tr/index.php/EB/article/viewFile/2594/705
   Web of Science ®Google Scholar
• Chi, S., Liu, X., Wang, Z., & Won Han, S. (2018). Moderation of the effects of scientific inquiry activities on low ses students’ PISA 2015 science achievement by school teacher support and disciplinary climate in science classroom across gender. International Journal of Science Education, 40(11), 1284–1304. https://doi.org/10.1080/09500693.2018.1476742
   Web of Science ®Google Scholar
• Chi, S., Wang, Z., & Liu, X. (2021). Moderating effects of teacher feedback on the associations among inquiry-based science practices and students’ science-related attitudes and beliefs. International Journal of Science Education, 43(14), 2426–2456. https://doi.org/10.1080/09500693.2021.1968532
   Web of Science ®Google Scholar
• Chichekian, T., & Shore, B. M. (2016). Preservice and practicing teachers’ self-efficacy for inquiry-based instruction. Cogent Education, 3(1), 1236872. https://doi.org/10.1080/2331186X.2016.1236872
   Web of Science ®Google Scholar
• Coertjens, L., Boeve-de Pauw, J., De Maeyer, S., & Van Petegem, P. (2010). Do schools make a difference in their students’ environmental attitudes and awareness? Evidence from PISA 2006. International Journal of Science and Mathematics Education, 8(3), 497–522. https://doi.org/10.1007/s10763-010-9200-0
   Web of Science ®Google Scholar
• Creemers, B., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. Routledge.
   Google Scholar
• Estrella, G., Au, J., Jaeggi, S. M., & Collins, P. (2018). Is inquiry science instruction effective for English language learners? A meta-analytic review. AERA Open, 4(2), 233285841876740–23. https://doi.org/10.1177/2332858418767402
   Web of Science ®Google Scholar
• European Commission. (2015). Science education for responsible citizenship: Report to the European Commission of the expert group on science education. Directorate-General for Research Innovation.
   Google Scholar
• Forbes, C. T., Neumann, K., & Schiepe-Tiska, A. (2020). Patterns of inquiry-based science instruction and student science achievement in PISA 2015. International Journal of Science Education, 42(5), 783–806. https://doi.org/10.1080/09500693.2020.1730017
   Web of Science ®Google Scholar
• Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012). Experimental and quasi-experimental studies of inquiry-based science teaching. Review of Educational Research, 82(3), 300–329. https://doi.org/10.3102/0034654312457206
   Web of Science ®Google Scholar
• Givvin, K. B., Hiebert, J., Jacobs, J. K., Hollingsworth, H., & Gallimore, R. (2005). Are there national patterns of teaching? Evidence from the TIMSS 1999 video study. Comparative Education Review, 49(3), 311–342. https://doi.org/10.1086/430260
   Web of Science ®Google Scholar
• Gough, D., Oliver, S., & Thomas, J. (2017). An introduction to systematic reviews. Sage.
   Google Scholar
• Guenole, N., & Brown, A. (2014). The consequences of ignoring measurement invariance for path coefficients in structural equation models. Frontiers in Psychology, 5, 980. https://doi.org/10.3389/fpsyg.2014.00980
   PubMed Web of Science ®Google Scholar
• Gustafsson, J.-E., & Nilsen, T. (2020). Methods of causal analysis with ILSA data. In T. Nilsen, A. Stancel-Piątak, & J.-E. Gustafsson (Eds.), International handbook of comparative large-scale studies in education: Perspectives, methods and findings (pp. 1–28). Springer International Publishing.
   Google Scholar
• Hopfenbeck, T. N., Lenkeit, J., El Masri, Y., Cantrell, K., Ryan, J., & Baird, J.-A. (2018). Lessons learned from PISA: A systematic review of peer-reviewed articles on the programme for international student assessment. Scandinavian Journal of Educational Research, 62(3), 333–353. https://doi.org/10.1080/00313831.2016.1258726
   Web of Science ®Google Scholar
• Hwang, J., Choi, K. M., Bae, Y., & Shin, D. H. (2018). Do teachers’ instructional practices moderate equity in mathematical and scientific literacy?: An investigation of the PISA 2012 and 2015. International Journal of Science and Mathematics Education, 16(S1), 25–45. https://doi.org/10.1007/s10763-018-9909-8
   Google Scholar
• Jerrim, J., Oliver, M., & Sims, S. (2019). The relationship between inquiry-based teaching and students’ achievement. New evidence from a longitudinal PISA study in England. Learning and Instruction, 61, 35–44. https://doi.org/10.1016/j.learninstruc.2018.12.004
   Web of Science ®Google Scholar
• Jiang, F., & McComas, W. F. (2015). The effects of inquiry teaching on student science achievement and attitudes: Evidence from propensity score analysis of PISA data. International Journal of Science Education, 37(3), 554–576. https://doi.org/10.1080/09500693.2014.1000426
   Web of Science ®Google Scholar
• Kang, J., & Keinonen, T. (2016). Examining factors affecting implementation of inquiry-based learning in Finland and South Korea. Problems of Education in the 21st Century, 74(1), 31–47. https://doi.org/10.33225/pec/16.74.34
   Google Scholar
• Klieme, E., Pauli, C., & Reusser, K. (2009). The pythagoras study— investigating effects of teaching and learning in Swiss and German mathematics classrooms. In T. Janik, & T. Seidel (Eds.), The power of video studies in investigating teaching and learning in the classroom (pp. 137–160). Waxmann.
   Google Scholar
• Lau, K.-C., & Ho, S.-C. E. (2022). Attitudes towards science, teaching practices, and science performance in PISA 2015: Multilevel analysis of the Chinese and Western top performers. Research in Science Education, 52(2), 415–426. https://doi.org/10.1007/s11165-020-09954-6
   Web of Science ®Google Scholar
• Lau, K.-C., & Lam, T. Y.-P. (2017). Instructional practices and science performance of 10 top-performing regions in PISA 2015. International Journal of Science Education, 39(15), 2128–2149. https://doi.org/10.1080/09500693.2017.1387947
   Web of Science ®Google Scholar
• Lavonen, J., & Laaksonen, S. (2009). Context of teaching and learning school science in Finland: Reflections on PISA 2006 results. Journal of Research in Science Teaching, 46(8), 922–944. https://doi.org/10.1002/tea.20339
   Web of Science ®Google Scholar
• Lederman, N. G. (2019). Contextualizing the relationship between nature of scientific knowledge and scientific inquiry. Science & Education, 28(3-5), 249–267. https://doi.org/10.1007/s11191-019-00030-8
   Web of Science ®Google Scholar
• Li, S., Liu, X., Yang, Y., & Tripp, J. (2022). Effects of teacher professional development and science classroom learning environment on students’ science achievement. Research in Science Education, 52, 415–426. https://doi-org./10.1007/s11165-020-09979-x
   Web of Science ®Google Scholar
• Lin, T.-J., Lin, T.-C., Potvin, P., & Tsai, C.-C. (2019). Research trends in science education from 2013 to 2017: A systematic content analysis of publications in selected journals. International Journal of Science Education, 41(3), 367–387. https://doi.org/10.1080/09500693.2018.1550274
   Web of Science ®Google Scholar
• Liou, P. Y. (2021). Students’ attitudes toward science and science achievement: An analysis of the differential effects of science instructional practices. Journal of Research in Science Teaching, 58(3), 310–334. https://doi.org/10.1002/tea.21643
   Web of Science ®Google Scholar
• Liou, P.-Y., & Jessie Ho, H.-N. (2018). Relationships among instructional practices, students’ motivational beliefs and science achievement in Taiwan using hierarchical linear modelling. Research Papers in Education, 33(1), 73–88. https://doi.org/10.1080/02671522.2016.1236832
   Web of Science ®Google Scholar
• Marsh, H. W., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Köller, O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47(2), 106–124. https://doi.org/10.1080/00461520.2012.670488
   Web of Science ®Google Scholar
• Mullis, I. V. S., & Martin, M. O. (Eds.) (2017). TIMSS 2019 Context Questionnaire Framework. TIMSS & PIRLS International Study Center. http://timssandpirls.bc.edu/timss2019/frameworks/framework-chapters/science-framework/.
   Google Scholar
• Mullis, I. V. S., Martin, M. O., Foy, P., Kelly, D. L., & Fishbein, B. (2020). TIMSS 2019 International Results in Mathematics and Science. TIMSS & PIRLS International Study Center. https://timssandpirls.bc.edu/timss2019/international-results/.
   Google Scholar
• National Research Council. (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. National Academies Press.
   Google Scholar
• OECD. (2016a). PISA 2015. Assessment and analytical framework. OECD Publishing.
   Google Scholar
• OECD. (2016b). PISA 2015 results. Policies and practices for successful schools. OECD Publishing.
   Google Scholar
• Oliver, M., McConney, A., & Woods-McConney, A. (2021). The efficacy of inquiry-based instruction in science: A comparative analysis of six countries using PISA 2015. Research in Science Education, 51(S2), 595–616. https://doi.org/10.1007/s11165-019-09901-0
   Google Scholar
• Osborne, J., & Dillon, J. (2010). Good practice in science teaching: What research has to say (2nd edition). McGraw-Hill Education.
   Google Scholar
• Pepper, D., Hodgen, J., Lamesoo, K., Kõiv, P., & Tolboom, J. (2018). Think aloud: Using cognitive interviewing to validate the PISA assessment of student self-efficacy in mathematics. International Journal of Research & Method in Education, 41(1), 3–16. https://doi.org/10.1080/1743727X.2016.1238891
   Web of Science ®Google Scholar
• Perera, H. N., Maghsoudlou, A., Miller, C. J., McIlveen, P., Barber, D., Part, R., & Reyes, A. L. (2022). Relations of science teaching self-efficacy with instructional practices, student achievement and support, and teacher job satisfaction. Contemporary Educational Psychology, 69, 1–11. https://doi.org/10.1016/j.cedpsych.2021.102041.
   Web of Science ®Google Scholar
• Pongsophon, P., & Herman, B. C. (2017). A theory of planned behaviour-based analysis of TIMSS 2011 to determine factors influencing inquiry teaching practices in high-performing countries. International Journal of Science Education, 39(10), 1304–1325. https://doi.org/10.1080/09500693.2017.1328620
   Web of Science ®Google Scholar
• Rocard, M., Csermely, P., Jorde, D., Dieter Lenzen, W.-H. H., & Hemmo, V. (2007). Science education now: A renewed pedagogy for the future of Europe. European Commission. https://www.eesc.europa.eu/sites/default/files/resources/docs/rapportrocardfinal.pdf.
   Google Scholar
• Rönnebeck, S., Bernholt, S., & Ropohl, M. (2016). Searching for a common ground – A literature review of empirical research on scientific inquiry activities. Studies in Science Education, 52(2), 161–197. https://doi.org/10.1080/03057267.2016.1206351
   Web of Science ®Google Scholar
• Roth, K., & Garnier, H. (2007). What science teaching looks like: An international perspective. Educational Leadership, 64(4), 16–23. https://www.ascd.org/el/articles/what-science-teaching-looks-like-aninternational-perspective
   Web of Science ®Google Scholar
• Roth, K., & Givvin, K. B. (2008). Implications for math and science instruction from the TIMSS 1999 video study. Principal Leadership, 8(9), 22–27. https://doi.org/10.1086/430260
   Google Scholar
• Rutkowski, L., Gonzalez, E., Joncas, M., & von Davier, M. (2010). International Large-Scale assessment data. Educational Researcher, 39(2), 142–151. https://doi.org/10.3102/0013189X10363170
   Web of Science ®Google Scholar
• Rutkowski, L., & Svetina, D. (2014). Assessing the hypothesis of measurement invariance in the context of large-scale international surveys. Educational and Psychological Measurement, 74(1), 31–57. https://doi.org/10.1177/0013164413498257
   Web of Science ®Google Scholar
• Stapleton, L. (2013). Incorporating sampling weights into single-and multilevel analyses. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), Handbook of international large-scale assessment: Background, technical issues, and methods of data analysis (pp. 363–388). CRC Press.
   Google Scholar
• Tai, R. H., Taylor, J. A., Reddy, V., & Banilower, E. R. (2022). The contribution of large educational surveys to science teacher education research. In J. A. Luft, & G. M. Jones (Eds.), Handbook of research on science teacher education (pp. 16–27). Routledge.
   Google Scholar
• Tang, H., Qiu, C., Meng, L., Li, Y., & Zhang, J. (2020). Factors predicting inquiry-based teaching in science across one belt one road countries and regions: A multilevel analysis. SAGE Open, 10(2). https://doi.org/10.1177/2158244020932511.
   Google Scholar
• Tang, N.-E., Tsai, C.-L., Barrow, L., & Romine, W. (2019). Impacts of enquiry-based science teaching on achievement gap between high-and-low SES students: Findings from PISA 2015. International Journal of Science Education, 41(4), 448–470. https://doi.org/10.1080/09500693.2018.1555726
   Web of Science ®Google Scholar
• Teig, N. (2019). Scientific inquiry in TIMSS and PISA 2015: Inquiry as an instructional approach and the assessment of inquiry as an instructional outcome in science [Dissertation, University of Oslo]. Norway.
   Google Scholar
• Teig, N. (2022). Inquiry in science education. In T. Nilsen, A. Stancel-Piątak, & J.-E. Gustafsson (eds.), International handbook of comparative large-scale studies in education: Perspectives, methods, and findings (Vol. 88, pp. 1–31). Springer International Publishing. https://doi.org/10.1007/978-3-030-38298-8_62-1.
   Google Scholar
• Teig, N., Bergem, O. K., Nilsen, T., & Senden, B. (2021). Gir utforskende arbeidsmåter i naturfag bedre læringsutbytte? [does inquiry-based teaching practice in science provide better learning outcomes?]. In T. Nilsen, & H. Kaarstein (Eds.), Med blikket mot naturfag [A view towards science] (pp. 46–72). Universitetsforlaget.
   Google Scholar
• Teig, N., Scherer, R., & Kjærnsli, M. (2020). Identifying patterns of students' performance on simulated inquiry tasks usingPISA2015 log-file data. Journal of Research in Science Teaching, 57(9), 1400–1429. https://doi.org/10.1002/tea.21657
   Web of Science ®Google Scholar
• Teig, N., Scherer, R., & Nilsen, T. (2018). More isn't always better: The curvilinear relationship between inquiry-based teaching and student achievement in science. Learning and Instruction, 56, 20–29. https://doi.org/10.1016/j.learninstruc.2018.02.006
   Web of Science ®Google Scholar
• Teig, N., Scherer, R., & Nilsen, T. (2019). I know I can, but do I have the time? The role of teachers’ self-efficacy and perceived time constraints in implementing cognitive-activation strategies in science. Frontiers in Psychology, 10(July), 1697. Article 1697. https://doi.org/10.3389/fpsyg.2019.01697
   PubMedGoogle Scholar
• von Davier, M., Gonzalez, E., & Mislevy, R. (2009). What are plausible values and why are they useful. IERI Monograph Series, 2(1), 9–36. https://www.ierinstitute.org/fileadmin/Documents/IERI_Monograph/IERI_Monograph_Volume_02_Chapter_01.pdf
   Google Scholar
• Vorholzer, A., & von Aufschnaiter, C. (2019). Guidance in inquiry-based instruction – an attempt to disentangle a manifold construct. International Journal of Science Education, 41(11), 1562–1577. https://doi.org/10.1080/09500693.2019.1616124
   Web of Science ®Google Scholar
• Wang, H.-H., Lin, H.-S., Chen, Y.-C., Pan, Y.-T., & Hong, Z.-R. (2021). Modelling relationships among students’ inquiry-related learning activities, enjoyment of learning, and their intended choice of a future STEM career. International Journal of Science Education, 43(1), 157–178. https://doi.org/10.1080/09500693.2020.1860266
   Web of Science ®Google Scholar
• Zhang, F., & Bae, C. L. (2020). Motivational factors that influence student science achievement: A systematic literature review of TIMSS studies. International Journal of Science Education, 42(17), 2921–2944. https://doi.org/10.1080/09500693.2020.1843083
   Web of Science ®Google Scholar
• Zhang, F., Bae, C. L., & Broda, M. (2022). Science self-concept, relatedness, and teaching quality: A multilevel approach to examining factors that predict science achievement. International Journal of Science and Mathematics Education, 20(3), 503–529. https://doi.org/10.1007/s10763-021-10165-2
   Web of Science ®Google Scholar