The impact of realistic mathematics education on secondary school students’ problem-solving skills: a comparative evaluation study

References

• Ahmed, A., & Pollitt, A. (2011). Improving marking quality through a taxonomy of mark schemes. Assessment in Education: Principles, Policy & Practice, 18(3), 259–278. https://doi.org/10.1080/0969594X.2010.546775
   Google Scholar
• Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics, 14(2), 115–129. https://doi.org/10.1093/applin/14.2.115
   Web of Science ®Google Scholar
• Arzarello, F., Garuti, R., & Ricci, R. (2015). The impact of PISA studies on the Italian national assessment system. In K. Stacey, & R. Turner (Eds.), Assessing mathematical literacy (pp. 249–260). Springer. https://doi.org/10.1007/978-3-319-10121-7_13
   Google Scholar
• Australian Council for Educational Research, cApStAn Linguistic Quality Control, Deutsches Institut für Internationale Pädagogische Forschung, Educational Testing Service, Institutt for Lærerutdanning og Skoleutvikling, Leibniz - Institute for Science and Mathematics Education, National Institute for Educational Policy Research, The Tao Initiative: CRP - Henri Tudor and Université de Luxembourg - EMACS, Unité d’ analyse des systèmes et des pratiques d’ enseignement, & Westat. (2013). PISA 2012 released mathematics items. OECD Publishing.
   Google Scholar
• Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J., Fastenau, P. S., & Siemers, E. R. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20(4), 517–529. https://doi.org/10.1016/j.acn.2004.12.003
   PubMed Web of Science ®Google Scholar
• Blum, W., & Niss, M. (1991). Applied mathematical problem solving, modelling, applications, and links to other subjects — state, trends and issues in mathematics instruction. Educational Studies in Mathematics, 22(1), 37–68. https://doi.org/10.1007/BF00302716
   Google Scholar
• Bokhove, C., & Jones, K. (2018). Stimulating mathematical creativity through constraints in problem-solving. In N. Amado, S. Carreira, & K. Jones (Εds.), Broadening the scope of research on mathematical problem solving: A focus on technology, creativity and affect (pp. 301-319). Springer. https://doi.org/10.1007/978-3-319-99861-9_13
   Google Scholar
• Bokhove, C., Miyazaki, M., Komatsu, K., Chino, K., Leung, A., & Mok, I. A. C. (2019). The role of “opportunity to learn” in the geometry curriculum: A multilevel comparison of six countries. Frontiers in Education, 4, 1–12. https://doi.org/10.3389/feduc.2019.00063
   Google Scholar
• Bostic, J. D., Pape, S. J., & Jacobbe, T. (2016). Encouraging sixth-grade students’ problem-solving performance by teaching through problem solving. Investigations in Mathematics Learning, 8(3), 30–58. https://doi.org/10.1080/24727466.2016.11790353
   Google Scholar
• Briggs, N. (2019). Analysis of pretest-posttest data: It’s not as straightforward as you might think!. Stats Central.
   Google Scholar
• Bryman, A. (2016). Social research methods (5th ed.). Oxford University Press.
   Google Scholar
• Cai, J. (2003). Investigating parental roles in students’ learning of mathematics from a cross-national perspective. Mathematics Education Research Journal, 15(2), 87–106. https://doi.org/10.1007/BF03217372
   Google Scholar
• Council of Chief State School Officers. (2009). Common core state standards for mathematics. Common Core Standards Initiative.
   Google Scholar
• Demack, S., Culliney, M., Boylan, M., & Wolstenholme, C. (2022). Realistic maths education: Evaluation report. Education Endowment Foundation.
   Google Scholar
• Dixson, D. D., & Worrell, F. C. (2016). Formative and summative assessment in the classroom. Theory Into Practice, 55(2), 153–159. https://doi.org/10.1080/00405841.2016.1148989
   Web of Science ®Google Scholar
• Doerr, H. M., & Lesh, R. (2011). Models and modelling perspectives on teaching and learning mathematics in the twenty-first century. In G. Kaiser, W. Blum, R. B. Ferri, & G. Stillman (Eds.), Trends in teaching and learning of mathematical modelling (pp. 247–268). Springer. https://doi.org/10.1007/978-94-007-0910-2_26
   Google Scholar
• Doorman, M., Drijvers, P., Dekker, T., van den Heuvel-Panhuizen, M., de Lange, J., & Wijers, M. (2007). Problem solving as a challenge for mathematics education in The Netherlands. ZDM–Mathematics Education, 39(5-6), 405–418. https://doi.org/10.1007/s11858-007-0043-2
   Google Scholar
• Ellison, J. G. (2009). Increasing problem solving skills in fifth grade advanced mathematics students. Journal of Curriculum and Instruction, 3(1), 15–31. https://doi.org/10.3776/joci.2009.v3n1p15
   Google Scholar
• English, L., & Sriraman, B. (2010). Problem solving for the 21st century. Theories of Mathematics Education: Seeking New Frontiers, 1, 263–290. https://doi.org/10.1007/978-3-642-00742-2_27
   Google Scholar
• Flake, J. K., Pek, J., & Hehman, E. (2017). Construct validation in social and personality research: Current practice and recommendations. Social Psychological and Personality Science, 8(4), 370–378. https://doi.org/10.1177/1948550617693063
   Web of Science ®Google Scholar
• Fowler, K., Windschitl, M., & Richards, J. (2019). Exit tickets. The Science Teacher, 86(8), 18–26. https://doi.org/10.1080/00368555.2019.12293416
   Google Scholar
• Green, A. (2013). Washback in language assessment. International Journal of English Studies, 13(2), 39–51. https://doi.org/10.6018/ijes.13.2.185891
   Google Scholar
• Hasibuan, A. M., Saragih, S., & Amry, Z. (2019). Development of learning materials based on realistic mathematics education to improve problem solving ability and student learning independence. International Electronic Journal of Mathematics Education, 14(1), 243–252. https://doi.org/10.29333/iejme/4000
   Google Scholar
• Hirza, B., Kusumah, Y. S., Darhim, D., & Zulkardi, Z. (2014). Improving intuition skills with realistic mathematics education. Indonesian Mathematical Society Journal on Mathematics Education, 5(1), 27–34.
   Google Scholar
• Hoosain, E. (2004). What are mathematical problems? Humanistic Mathematics Network Journal, 1(27), Article 12. https://doi.org/10.5642/hmnj.200401.27.12
   Google Scholar
• Ingram, J., & Riser, P. A. (2019). Experiences of problem solving in whole class interactions. Avances de Investigación en Educación Matemática, 16(16), 5–21. https://doi.org/10.35763/aiem.v0i16.279
   Google Scholar
• Institute of Educational Policy. (2019). Θέματα Μαθηματικών PISA. [PISA Mathematics Assessment Items]. Retrieved August 24, 2023, from http://www.iep.edu.gr/pisa/index.php/examples/themata-mathimatikon
   Google Scholar
• Kantowski, M. G. (1997). Processes involved in mathematical problem solving. Journal for Research in Mathematics Education, 8(3), 163–180. https://doi.org/10.2307/748518
   Google Scholar
• Kaur, B. (2021). A look at Singapore mathematics Singapore mathematics education through the PISA and TIMSS lenses. In O. S. Tan, E. L. Low, E. G. Tay, & Y. K. Yan (Eds.), Singapore math and science education innovation: Beyond PISA (pp. 61–73). Springer.
   Google Scholar
• Kim, A., & Lim, E. Y. (1999, April 19-23). How Critical Is Back Translation in Cross-Cultural Adaptation of Attitude Measures? [Paper presented]. Annual Meeting of the American Educational Research Association, Montreal, Quebec, Canada. https://eric.ed.gov/?id=ED430014
   Google Scholar
• Kirschner, P. A., Sweller, J., & Clark, R. E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86. https://doi.org/10.1207/s15326985ep4102_1
   Web of Science ®Google Scholar
• Kirzner, R. S., Alter, T., & Hughes, C. A. (2021). Online quiz as exit ticket: Using technology to reinforce learning in face to face classes. Journal of Teaching in Social Work, 41(2), 151–171. https://doi.org/10.1080/08841233.2021.1898521
   Web of Science ®Google Scholar
• Koichu, B. (2019). A discursively oriented conceptualization of mathematical problem solving. In P. Felmer, P. Liljedahl, & B. Koichu (Eds.), Problem solving in mathematics instruction and teacher professional development (pp. 43–66). Springer. https://doi.org/10.1007/978-3-030-29215-7_3
   Google Scholar
• Koichu, B., Parasha, R., & Tabach, M. (2021). Who-Is-Right tasks as a means for supporting collective looking-back practices. ZDM–Mathematics Education, 53, 831–846. https://doi.org/10.1007/s11858-021-01264-z
   Web of Science ®Google Scholar
• Kosheleva, O., & Villaverde, K. (2018). Spiral curriculum: Towards mathematical foundations. In How interval and fuzzy techniques can improve teaching: Processing educational data: From traditional statistical techniques to an appropriate combination of probabilistic, interval, and fuzzy approaches (Vol 750, pp. 135–145). Springer. https://doi.org/10.1007/978-3-662-55993-2_15
   Google Scholar
• Koutrouba, K. (2012). A profile of the effective teacher: Greek secondary education teachers’ perceptions. European Journal of Teacher Education, 35(3), 359–374. https://doi.org/10.1080/02619768.2011.654332
   Web of Science ®Google Scholar
• Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. https://doi.org/10.3102/0013189X20912798
   Web of Science ®Google Scholar
• Krkovic, K., Mustafic, M., Wüstenberg, S., & Greiff, S. (2018). Shifts in the assessment of problem solving. In E. Care, P. Griffin, & M. Wilson (Eds.), Assessment and teaching of 21st century skills (pp. 51–73). Springer.
   Google Scholar
• Lesh, R., & Harel, G. (2003). Problem solving, modeling, and local conceptual development. Mathematical Thinking and Learning, 5(2-3), 157–189. https://doi.org/10.1080/10986065.2003.9679998
   Google Scholar
• Lesh, R., & Zawojewski, J. S. (2007). Problem solving and modelling. In F. Lester (Ed.), Second handbook of research on mathematics teaching and learning (pp. 763–804). Information Age Publishing.
   Google Scholar
• Lester, F. K., & Kehle, P. (2003). From problem solving to modeling: The evolution of thinking about research on complex mathematical activity. In R. Lesh, & H. M. Doerr (Eds.), Beyond constructivism: Models and modeling perspectives on mathematics problem solving, learning, and teaching (pp. 501–517). Routledge.
   Google Scholar
• Lester Jr, F. K. (2013). Thoughts about research on mathematical problem-solving instruction. The Mathematics Enthusiast, 10(1), 245–278. https://doi.org/10.54870/1551-3440.1267
   Google Scholar
• Lind Pantzare, A. (2015). Interrater reliability in large-scale assessments–Can teachers score national tests reliably without external controls? Practical Assessment, Research, and Evaluation, 20(1), Article 9. https://doi.org/10.7275/y2en-zm89
   Google Scholar
• Mavrikaki, E., Koumparou, H., Kyriakoudi, M., Papacharalampous, I., & Trimandili, M. (2012). Greek secondary school students’ views about biology. International Journal of Environmental and Science Education, 7(2), 217–232.
   Google Scholar
• McDermott, R. (2011). Internal and external validity. In J. N. Druckman, D. P. Greene, J. H. Kuklinski, & A. Lupia (Εds.), Cambridge handbook of experimental political science (pp. 27–40). Cambridge University Press.
   Google Scholar
• Mikroni, E., Zacharos, K., & Komis, V. (2007). Απο τα ρϵαλιστικά πλαίσια στα μαθηματικά μοντέλα. Η πϵρίπτωση των γραμμικών συναρτήσϵων στην Α’ Λυκϵίου. [From realistic contexts to mathematical models: The case of linear functions in 1st year of Lyceum]. Research in Mathematics Education, 1, 40–62. https://doi.org/10.12681/enedim.18763
   Google Scholar
• Morris, S. B. (2008). Estimating effect sizes from pretest-posttest-control group designs. Organizational Research Methods, 11(2), 364–386. https://doi.org/10.1177/1094428106291059
   Web of Science ®Google Scholar
• Nolka, E., & Sofianopoulou, C. (2021). Greek and Portuguese mathematics education and performance, through the prism of PISA. In M. Carmo (Ed.), Proceedings of the international conference on education and new developments (pp. 116–120). inScience Press. https://doi.org/10.36315/2021end025.
   Google Scholar
• OECD. (2013). PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. OECD Publishing. https://doi.org/10.1787/9789264190511-en
   Google Scholar
• OECD. (2014). PISA 2012 results: Creative problem solving: Students’ skills in tackling real-life problems (Volume V). OECD Publishing. https://doi.org/10.1787/9789264208070-en
   Google Scholar
• OECD. (2018). PISA 2022 mathematics framework draft. OECD Publishing.
   Google Scholar
• OECD. (2023a). Education GPS: Greece student performance (PISA 2018). Retrieved March 10, 2023, from https://gpseducation.oecd.org/CountryProfile?primaryCountry=GRC&treshold=10&topic=PI
   Google Scholar
• OECD. (2023b). Mathematics performance (PISA) (indicator). Retrieved August 24, 2023, from https://doi.org/10.1787/04711c74-en
   Google Scholar
• Özkaya, A., & Yetim, K. (2017). The effects of Realistic Mathematics Education on students’ achievements and attitudes in fifth grades mathematics courses. International Online Journal of Education and Teaching (IOJET), 4(2), 185–197.
   Google Scholar
• Papadakis, S., Kalogiannakis, M., & Zaranis, N. (2017). Improving mathematics teaching in kindergarten with realistic mathematical education. Early Childhood Education Journal, 45(3), 369–378. https://doi.org/10.1007/s10643-015-0768-4
   Web of Science ®Google Scholar
• Papadopoulos, I., & Ventistas, G. (2023). Collaborative geometry problem solving in secondary education: The issue of control strategies. In P. Drijvers, C. Csapodi, H. Palmér, K. Gosztonyi, & E. Kónya (Eds.), Proceedings of the Thirteenth Congress of the European Society for Research in Mathematics Education (CERME13) (pp. 781-788). Alfréd Rényi Institute of Mathematics and ERME.
   Google Scholar
• Penny, J., Johnson, R. L., & Gordon, B. (2000). The effect of rating augmentation on inter-rater reliability: An empirical study of a holistic rubric. Assessing Writing, 7(2), 143–164. https://doi.org/10.1016/S1075-2935(00)00012-X
   Google Scholar
• Pólya, G. (2004). How to solve it: A new aspect of mathematical method (expanded Princeton science library). Princeton University Press.
   Google Scholar
• R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
   Google Scholar
• Rubin, M. (2021). When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing. Synthese, 199(3-4), 10969–11000. https://doi.org/10.1007/s11229-021-03276-4
   Web of Science ®Google Scholar
• Russo, J., Minas, M., Hewish, T., & McCosh, J. (2020). Using prompts to empower learners: Exploring primary students’ attitudes towards enabling prompts when learning mathematics through problem solving. Mathematics Teacher Education and Development, 22(1), 48–67.
   Google Scholar
• Safrudiannur, S., & Rott, B. (2019). The different mathematics performances in PISA 2012 and a curricula comparison: Enriching the comparison by an analysis of the role of problem solving in intended learning processes. Mathematics Education Research Journal, 31(2), 175–195. https://doi.org/10.1007/s13394-018-0248-4
   Web of Science ®Google Scholar
• Schoenfeld, H. A. (1985). Mathematical problem solving. Academic Press, Inc.
   Google Scholar
• Selmer, S., & Kale, U. (2013). Teaching mathematics through problem solving. Innovación Educativa, 13(62), 45–59.
   Google Scholar
• Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin Company.
   Google Scholar
• Siddiqui, N., & Ventista, O. M. (2018). A review of school-based interventions for the improvement of social emotional skills and wider outcomes of education. International Journal of Educational Research, 90, 117–132. https://doi.org/10.1016/j.ijer.2018.06.003
   Web of Science ®Google Scholar
• Sjøberg, S., & Jenkins, E. (2022). PISA: A political project and a research agenda. Studies in Science Education, 58(1), 1–14. https://doi.org/10.1080/03057267.2020.1824473
   Web of Science ®Google Scholar
• Slavin, R. E., & Smith, D. (2008). Effects of sample size on effect size in systematic reviews in education [Paper presentation]. Society for Research on Effective Education annual meeting, Crystal City, Virginia, United States of America.
   Google Scholar
• Stemler, S. E. (2004). A comparison of consensus, consistency, and measurement approaches to estimating interrater reliability. Practical Assessment, Research, and Evaluation, 9(1), Article 4. https://doi.org/10.7275/96jp-xz07
   Google Scholar
• Su, C. T., & Parham, L. D. (2002). Generating a valid questionnaire translation for cross-cultural use. The American Journal of Occupational Therapy, 56(5), 581–585. https://doi.org/10.5014/ajot.56.5.581
   PubMed Web of Science ®Google Scholar
• Sullivan, G. M., & Feinn, R. (2012). Using effect size—or why the P value is not enough. Journal of Graduate Medical Education, 4(3), 279–282. https://doi.org/10.4300/JGME-D-12-00156.1
   PubMedGoogle Scholar
• Sumirattana, S., Makanong, A., & Thipkong, S. (2017). Using realistic mathematics education and the DAPIC problem-solving process to enhance secondary school students’ mathematical literacy. Kasetsart Journal of Social Sciences, 38(3), 307–315. https://doi.org/10.1016/j.kjss.2016.06.001
   Google Scholar
• Tienken, C. H. (2010). Common core state standards: I wonder? Kappa Delta Pi Record, 47(1), 14–17. https://doi.org/10.1080/00228958.2010.10516554
   Google Scholar
• Uyen, B. P., Tong, D. H., Loc, N. P., & Thanh, L. N. P. (2021). The effectiveness of applying realistic mathematics education approach in teaching statistics in grade 7 to students’ mathematical skills. Journal of Education and E-Learning Research, 8(2), 185–197. https://doi.org/10.20448/journal.509.2021.82.185.197
   Google Scholar
• Van den Heuvel-Panhuizen, M. (1996). Assessment and realistic mathematics education [Doctoral dissertation, Utrecht University]. Utrecht University Repository. https://dspace.library.uu.nl/handle/1874/1705
   Google Scholar
• Van den Heuvel-Panhuizen, M., & Drijvers, P. (2020). Realistic mathematics education. In S. Lerman (Ed.), Encyclopedia of mathematics education (pp. 713–717). Springer. https://doi.org/10.1007/978-3-030-15789-0_170
   Google Scholar
• Ventista, Ο. Μ. (2018). A literature review of empirical evidence on the effectiveness of philosophy for children. In E. Duthie, F. G. Moriyón, & R. Robles Loro (Eds.), Family resemblances: Current trends in philosophy for children (pp. 448–469). Anaya.
   Google Scholar
• Ventista, O. M. (2021). How to evaluate the effectiveness of a school-based intervention: Evaluating the impact of the philosophy for children programme on students’ skills. Emerald.
   Google Scholar
• Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L. D., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., Kuhn, M., Pedersen, T. L., Miller, E., Bache, S. M., Müller, K., Ooms, J., Robinson, D., Seidel, D. P., Spinu, V., … Yutani, H. (2019). Welcome to the tidyverse. Journal of Open Source Software, 4(43), Article 1686. https://doi.org/10.21105/joss.01686
   Google Scholar
• Wu, M. (2004). The impact of PISA in mathematics education: Linking mathematics and the real world. Education Journal, 32(1), 121–140.
   Google Scholar
• Wu, M. (2006). A comparison of mathematics performance between East and West: What PISA and TIMSS can tell Us. In F. K. S. Leung, K. D. Graf, & F. J. Lopez-Real (Eds.), Mathematics education in different cultural traditions-A comparative study of East Asia and the West (pp. 239–259). Springer. https://doi.org/10.1007/0-387-29723-5_15
   Google Scholar
• Yuanita, P., Zulnaidi, H., & Zakaria, E. (2018). The effectiveness of realistic mathematics education approach: The role of mathematical representation as mediator between mathematical belief and problem solving. PLoS ONE, 13(9), Article e0204847. https://doi.org/10.1371/journal.pone.0204847
   PubMed Web of Science ®Google Scholar
• Zakaria, E., & Syamaun, M. (2017). The effect of realistic mathematics education approach on students’ achievement and attitudes towards mathematics. Mathematics Education Trends and Research, 1(1), 32–40. https://doi.org/10.5899/2017/metr-00093
   Google Scholar
• Zhao, Y. (2020). Two decades of havoc: A synthesis of criticism against PISA. Journal of Educational Change, 21(2), 245–266. https://doi.org/10.1007/s10833-019-09367-x
   Web of Science ®Google Scholar