144
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Using student ratings and external observations to detect the effects of quality of teaching on student learning outcomes: a longitudinal study in the Maldives

ORCID Icon & ORCID Icon
Received 12 Apr 2022, Accepted 06 Sep 2023, Published online: 05 Oct 2023

References

  • Abrami, P.C., d’Apollonia, S., & Cohen, P.A. (1990). Validity of student ratings of instruction: What we know and what we do not. Journal of Educational Psychology, 82(2), 219–231. https://doi.org/10.1037/0022-0663.82.2.219
  • Abrami, P.C., d’Apollonia, S., & Rosenfield, S. (2007). The dimensionality of student ratings of instruction: What we know and what we do not. In The scholarship of teaching and learning in higher education: An evidence-based perspective (pp. 385–456). Springer Netherlands. https://doi.org/10.1007/1-4020-5742-3_10
  • Andrich, D. (1988). The application of an unfolding model of the PIRT type to the measurement of attitude. Applied Psychological Measurement, 12(1), 33–51. https://doi.org/10.1177/014662168801200105
  • Azigwe, J.B., Kyriakides, L., Panayiotou, A., & Creemers, B.P.M. (2016). The impact of effective teaching characteristics in promoting student achievement in Ghana. International Journal of Educational Development, 51, 51–61. https://doi.org/10.1016/j.ijedudev.2016.07.004
  • Bardach, L., & Klassen, R.M. (2020). Smart teachers, successful students? A systematic review of the literature on teachers’ cognitive abilities and teacher effectiveness. Educational Research Review, 30, 100312. https://doi.org/10.1016/j.edurev.2020.100312
  • Brophy, J., & Good, T.L. (1986). Teacher behaviour and student achievement. In M.C. Wittrock (Ed.), Handbook of research on teaching (pp. 328–375). Macmillan.
  • Bryk, A.S., & Raudenbush, S.W. (1992). Hierarchical linear models. Sage.
  • Centra, J.A. (1993). Reflective faculty evaluation. Jossey-Bass.
  • Chapman, C., Muijs, D., Reynolds, D., Sammons, P., & Teddlie, C. (Eds.). (2016). The Routledge international handbook of educational effectiveness and improvement. Routledge. https://doi.org/10.4324/9781315679488
  • Creemers, B.P., & Kyriakides, L. (2006). Critical analysis of the current approaches to modelling educational effectiveness: The importance of establishing a dynamic model. School Effectiveness and School Improvement, 17(3), 347–366. https://doi.org/10.1080/09243450600697242
  • Creemers, B.P.M., & Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. Routledge. https://doi.org/10.4324/9780203939185
  • Creemers, B.P.M., & Kyriakides, L. (2012). Improving quality in Education: Dynamic approaches to school improvement. Routledge.
  • Creemers, B.P.M., Kyriakides, L., & Sammons, P. (2010). Methodological advances in educational effectiveness research. Routledge. https://doi.org/10.4324/9780203851005
  • Darling-Hammond, L. (2000). How teacher education matters. Journal of Teacher Education, 51(3), 166–173. https://doi.org/10.1177/0022487100051003002
  • De Jong, R., & Westerhof, K. (2001). The quality of student ratings of teacher behaviour learning Environments research. Learning Environments Research, 4(1), 51–85. https://doi.org/10.1023/a:1011402608575
  • Den Brok, P. (2001). Teaching and student outcomes: A study on teachers’ thoughts and actions from an interpersonal and a learning activities perspective. W.C.C.
  • DiBiase, R. (2019). Enabling pedagogic reform in the Maldives: Implications for translating policy into teacher practice. Asia Pacific Journal of Education, 39(3), 372–390. https://doi.org/10.1080/02188791.2019.1603101
  • Dimosthenous, A., Kyriakides, L., & Panayiotou, A. (2020). Short- and long-term effects of the home learning environment and teachers on student achievement in mathematics: A longitudinal study. School Effectiveness and School Improvement, 31(1), 50–79. https://doi.org/10.1080/09243453.2019.1642212
  • Driscoll, A., Peterson, K., Crow, H., & Larson, B. (1985). Student reports for primary teacher evaluation. Educational Research Quarterly, 9(3), 43–50. https://eric.ed.gov/?id=EJ324656
  • Durrani, N., & Nawani, D. (2020). Global Education Systems. Handbook of Education Systems in South Asia, 1–31. Springer Singapore. https://research.nu.edu.kz/en/publications/knowledge-and-curriculum-landscapes-in-south-asia-an-introduction
  • Elboj, C., & Niemelä, R. (2010). Sub-communities of mutual learners in the classroom: The case of interactive groups. Revista de Psicodidáctica, 15(2), 177–189. https://doi.org/10.1387/RevPsicodidact.810
  • Elliot, K., & Sammons, P. (2004). Exploring the use of effect sizes to evaluate the impact of different influences on child outcomes: Possibilities and limitations. In I. Schagen & K. Elliott (Eds.), But what does it mean? The use of effect sizes in educational research (pp. 6–24). National Foundation for Educational Research.
  • Emmer, E.T., & Stough, L.M. (2001). Classroom management: A critical part of educational psychology, with implications for teacher education. Educational Psychologist, 36(2), 103–112. https://doi.org/10.1207/S15326985EP3602_5
  • Feldman, K.A. (1997). Identifying exemplary teachers and teaching: Evidence from student ratings. In R.P. Perry & J.C. Smart (Eds.), Effective teaching in higher education: Research and practice (pp. 368–395). Agathon Press.
  • Fraser, B.J. (1991). Two decades of classroom environment research. In B.J. Fraser & H.J. Walberg (Eds.), Educational environments: Evaluation, antecedents and consequences (pp. 3–27). Pergamon Press.
  • Fraser, B.J. (2012). Classroom learning Environments: Retrospect, context and prospect. In B.J. Fraser, K.G. Tobin, & C.J. McRobbie (Eds.), The Second international handbook of science education (pp. 1191–1239). Springer. https://doi.org/10.1007/978-1-4020-9041-7_79
  • Fraser, B.J., Walberg, H.J., Welch, W.W., & Hattie, J.A. (1987). Syntheses of educational productivity research. International Journal of Educational Research, 11(2), 147–252. https://doi.org/10.1016/0883-0355(87)90035-8
  • Gallagher, C., Rabinowitz, S., & Yeagley, P. (2011). Key considerations when measuring teacher effectiveness: A framework for validating teachers’ professional practices. (AACC Report). Assessment and Accountability Comprehensive Center.
  • Goldstein, H. (2001). Using pupil performance data for judging schools and teachers: Scope and limitations. British Educational Research Journal, 27(4), 433–442. https://doi.org/10.1080/01411920120071443
  • Goldstein, H. (2003). Multilevel statistical models (3rd ed.). Edward Arnold.
  • Gopalan, V., Bakar, J.A.A., Zulkifli, A.N., Alwi, A., & Mat, R.C. (2017, October). A review of the motivation theories in learning. AIP Conference Proceedings, 1891(1), 20043. https://pubs.aip.org/aip/acp/article/1891/1/020043/887560/A-review-of-the-motivation-theories-in-learning
  • Gray, J., Goldstein, H., & Thomas, S. (2001). Predicting the future: The role of past performance in determining trends in institutional effectiveness at a level. British Educational Research Journal, 27(4), 391–405. https://doi.org/10.1080/01411920125622
  • Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses related to achievement. Routledge. https://apprendre.auf.org/wp-content/opera/13-BF-References-et-biblio-RPT-2014/Visible%20Learning_A%20synthesis%20or%20over%20800%20Meta-analyses%20Relating%20to%20Achievement_Hattie%20J%202009%20.pdf
  • Joyce, B., Weil, M., & Calhoun, E. (2000). Models of teaching. Allyn and Bacon. https://niepid.nic.in/MODELS%20OF%20TEACHING.pdf
  • Keeves, J.P., & Alagumalai, S. (1999). New approaches to measurement. In G.N. Masters & J.P. Keeves (Eds.), Advances in measurement in educational research and assessment (pp. 23–42). Pergamon. https://doi.org/10.1016/B978-008043348-6/50002-4
  • Kitsantas, A., & Zimmerman, B.J. (2009). College students’ homework and academic achievement: The mediating role of self-regulatory beliefs. Metacognition and Learning. Metacognition and Learning, 4, 97–110. https://doi.org/10.1007/s11409-008-9028-y
  • Kyriakides, L. (2005). Drawing from teacher effectiveness research and research into teacher interpersonal behaviour to establish a teacher evaluation system: A study on the use of student ratings to evaluate teacher behaviour. The Journal of Classroom Interaction 40(2), 44–66. https://files.eric.ed.gov/fulltext/EJ768695.pdf.
  • Kyriakides, L., Anthimou, M., & Panayiotou, A. (2020). Searching for the impact of teacher behavior on promoting students’ cognitive and metacognitive skills. Studies in Educational Evaluation, 64, 100810. https://doi.org/10.1016/j.stueduc.2019.100810
  • Kyriakides, L., Christoforou, C., & Charalambous, C.Y. (2013). What matters for student learning outcomes: A meta-analysis of studies exploring factors of effective teaching. Teaching and Teacher Education, 36, 143–152. https://doi.org/10.1016/j.tate.2013.07.010
  • Kyriakides, L., & Creemers, B.P.M. (2008). A longitudinal study on the stability over time of school and teacher effects on student learning outcomes. Oxford Review of Education, 34(5), 521–545. https://doi.org/10.1080/03054980701782064
  • Kyriakides, L., Creemers, B.P.M., Panayiotou, A., & Charalambous, E. (2020). Quality and equity in Education: Revisiting theory and research on educational effectiveness and improvement. Routledge.
  • Kyriakides, L., Creemers, B.P., Panayiotou, A., Vanlaar, G., Pfeifer, M., Cankar, G., & McMahon, L. (2014). Using student ratings to measure quality of teaching in six European countries. European Journal of Teacher Education, 37(2), 125–143. https://doi.org/10.1080/02619768.2014.882311
  • Lasagabaster, D. (2011). English achievement and student motivation in CLIL and EFL settings. Innovation in Language Learning and Teaching, 5(1), 3–18. https://doi.org/10.1080/17501229.2010.519030
  • Lawrenz, F., & Huffman, D. (2003). How can multi-site evaluations be participatory? American Journal of Evaluation, 24(4), 471–482. https://doi.org/10.1016/j.ameval.2003.09.003
  • Marsh, H., & Roche, L. (1997). Making students’ evaluations of teaching effectiveness effective: The critical issues of validity, bias, and utility. American Psychologist, 52(11), 1187–1197. https://doi.org/10.1037/0003-066x.52.11.1187
  • Maulana, R., Opdenakker, M.-C., Stroet, K., & Bosker, R. (2012). Observed lesson structure during the first year of secondary education: Exploration of change and link with academic engagement. Teaching & Teacher Education, 28(6), 835–850. https://doi.org/10.1016/j.tate.2012.03.005
  • McClelland, D.C. (1958). Methods of measuring human motivation. In J.W. Atkinson (Ed.), Motives in fantasy, action, and society (pp. 7–42). D. Van Nostrand Company, Inc.
  • McCutcheon, G. (1981). On the interpretation of classroom observations. Educational Researcher, 10(5), 5–10. https://doi.org/10.3102/0013189X010005005
  • Ministry of Education (MoE). (2016). Brief study into the implementation of the National curriculum. MoE.
  • Muijs, D., Kyriakides, L., Van der Werf, G., Creemers, B., Timperley, H., & Earl, L. (2014). State of the art–teacher effectiveness and professional learning. School Effectiveness and School Improvement, 25(2), 231–256. https://doi.org/10.1080/09243453.2014.885451
  • Musthafa, H.S. (2021a). A longitudinal study on the impact of instructional quality on student learning in primary schools of Maldives (Publication No. 64874). [ Doctoral dissertation, University of Cyprus]. Gnosis Library. https://gnosis.library.ucy.ac.cy/handle/7/64874.
  • Musthafa, H.S. (2021b). Using the dynamic model of educational effectiveness to detect effective teaching characteristics in the Maldives. The Maldives National Journal of Research, 9(2), 7–24. http://202.1.196.72/jspui/bitstream/123456789/13569/1/Using%20the%20dynamic%20model%20of%20educational.pdf
  • National Bureau of Statistics. (2018). Statistical Pocketbook of Maldives 2018. http://statisticsmaldives.gov.mv/nbs/wp-content/uploads/2019/01/Statistical-Pocketbook-of-Maldives-2018-Printing.pd.
  • NIE. (2011). The national curriculum framework. National Institute of Education: National Institute of Education, Ministry of Education.
  • Paas, F., Renkl, A., & Sweller, J. (2003). Cognitive load theory and instructional design: Recent developments. Educational Psychologist, 38(1), 1–4. https://doi.org/10.1207/S15326985EP3801_1
  • Panayiotou, A., Kyriakides, L., Creemers, B.P., McMahon, L., Vanlaar, G., Pfeifer, M., Bren, M., & Bren, M. (2014). Teacher behavior and student outcomes: Results of a European study. Educational Assessment, Evaluation and Accountability, 26(1), 73–93. https://doi.org/10.1007/s11092-013-9182-x
  • Peterson, K., & Stevens, D. (1988). Student reports for school teacher evaluation. Journal of Personnel Evaluation in Education, 2(1), 19–31. https://doi.org/10.1007/BF00124963
  • Preacher, K.J., Zhang, Z., & Zyphur, M.J. (2011). Alternative methods for assessing mediation in multilevel data: The advantages of multilevel SEM. Structural Equation Modeling, 18(2), 161–182. https://doi.org/10.1080/10705511.2011.557329
  • Reynolds, D. (2006). World class schools: Some methodological and substantive findings and implications of the International school effectiveness research project (ISERP). Educational Research & Evaluation, 12(6), 535–560. https://doi.org/10.1080/13803610600874026
  • Rosenshine, B., & Stevens, R. (1986). Teaching functions. Handbook of Research on Teaching, 3(1), 376–391. https://www.formapex.com/telechargementpublic/rosenshine1986a.pdf
  • Scheerens, J. (2013). The use of theory in school effectiveness research revisited. School Effectiveness and School Improvement, 24(1), 1–38. https://doi.org/10.1080/09243453.2012.691100
  • Scheerens, J. (2016). Educational effectiveness and ineffectiveness. A critical review of the knowledge base. Springer Nature Switzerland. https://doi.org/10.1007/978-94-017-7459-8_11
  • Schneider, M., & Preckel, F. (2017). Variables associated with achievement in higher education: A systematic review of meta-analyses. Psychological Bulletin, 143(6), 565. https://doi.org/10.1037/bul0000098
  • Schoenfeld, A.H. (1998). Toward a theory of teaching in context. Issues in Education, 4(1), 1–94. https://doi.org/10.1016/S1080-9724(99)80076-7
  • Scriven, M. (1994). Student Ratings Offer Useful Input to Teacher Evaluations. Practical Assessment, Research, and Evaluation, 4(7), 3–6. https://doi.org/10.7275/1jfr-et33
  • Seidel, T., & Shavelson, R.J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. https://doi.org/10.3102/0034654307310317
  • Shareefa, M. (2021). Using differentiated instruction in multigrade classes: A case of a small school. Asia Pacific Journal of Education, 41(1), 167–181. https://doi.org/10.1080/02188791.2020.1749559
  • Slavin, R.E. (1983). When does cooperative learning increase student achievement? Psychological Bulletin, 94(3), 429. https://doi.org/10.1037/0033-2909.94.3.429
  • Slavin, R.E., & Cooper, R. (1999). Improving intergroup relations: Lessons learned from cooperative learning programs. Journal of Social Issues, 55(4), 647–663. https://doi.org/10.1111/0022-4537.00140
  • Snijders, T.A., & Bosker, R.J. (2011). Multilevel analysis: An introduction to basic and advanced multilevel modeling. sage publications ltd.
  • Spooren, P., Mortelmans, D., & Thijssen, P. (2012). ‘Content’ versus ‘style’: Acquiescence in student evaluation of teaching? British Educational Research Journal, 38(1), 3–21. https://doi.org/10.1080/01411926.2010.523453
  • Taba, H., Tylor, R., & Smith, B.O. (1998). The predictive validity of student evaluations in the identification of meritorious teachers. Research Report. John Jones School District.
  • Watkins, D. (1994). Student evaluations of teaching effectiveness: A cross-cultural perspective. Research in Higher Education, 35(2), 251–266. https://doi.org/10.1007/BF02496704
  • Williams, M. (1989). A developmental view of classroom observations. ELT journal, 43(2), 85–91. https://doi.org/10.1093/elt/43.2.85
  • Wisniewski, B., Röhl, S., & Fauth, B. (2022). The perception problem: A comparison of teachers’ self-perceptions and students’ perceptions of instructional quality. Learning Environments Research, 25(3), 775–802. https://doi.org/10.1007/s10984-021-09397-4
  • Wright, B.D. (1985). Additivity in psychological measurement. Measurement and Personality Assessment 2(2) , 101–112. https://www.rasch.org/memo33b.pdf

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.