The relationship between the psychometric and performance properties of teacher-made tests and students’ academic performance in Ethiopian public universities: a baseline survey study

References

• Adom, D., Adu Mensah, J., & Dake, D. A. (2020). Test, measurement, and evaluation: Understanding and use of the concepts in education. International Journal of Evaluation and Research in Education (IJERE), 9(1), 109–119. https://doi.org/10.11591/ijere.v9i1.20457
   Google Scholar
• Akinleke, W. O. (2017). Impact of family structure on the academic performance of secondary school students in Yewa local government area of Ogun State. Nigeria. International Journal of Sociology and Anthropology Research, 3(1), 1–10.
   Google Scholar
• Alebachew, M. G., & Minda, M. H. (2019). Washback Effect of EFL Teacher-Made Test on Teaching-Learning Process of Communicative English Skills Course at Ambo University. IJOHMN (International Journal Online of Humanities), 5(6), 29. ISSN: 2395-5155. https://doi.org/10.24113/ijohmn.v5i6.146
   Google Scholar
• Alghadri, A. M. A. (2019). Students’ Academic Performance Compared With Their Entry Level Academic Results: A Case Of Islamic University Of Technology (IUT [M.SC.TE dissertation]. Department of Technical and Vocational Education (TVE), Islamic University of Technology.
   Google Scholar
• Ayang, E. E. (2019). A comparative analysis of variability of item difficulty indices between classical test theory and item response theory using WAEC chemistry 2013.
   Google Scholar
• Ayenew, E., & Yohannes, A. G. (2022). Assessing higher education exit exam in ethiopia: practices, challenges and prospects. Science Journal of Education, 10(2), 79–86. https://doi.org/10.11648/j.sjedu.20221002.15
   Google Scholar
• Bausell, S. B., & Glazier, J. A. (2018). New teacher socialization and the testing apparatus. Harvard Educational Review, 88(3), 308–333. https://doi.org/10.17763/1943-5045-88.3.308
   Web of Science ®Google Scholar
• Berhanu Nigussie Worku. (2020). Module for advanced statistical methods.
   Google Scholar
• Bichi, A. A., & Embong, R. (2018). Evaluating the quality of Islamic civilization and Asian civilizations examination questions. Asian People Journal, 1(1), 93–109.
   Google Scholar
• Bijlsma, H., van der Lans, R., Mainhard, T., & den Brok, P. (2021a). Student feedback on teaching in schools. International Journal Springer.
   Google Scholar
• Bijlsma, R. van der Lans, R., Mainhard, T., & den Brok, P. (2021b). A reflection on student perceptions of teaching quality from three psychometric perspectives: CCT, IRT and GT. https://doi.org/10.1007/978-3-030-75150-0_2
   Google Scholar
• Borden, K., & Abbott, B. B. (2018). Research design and methods: A process approach (10th ed.). McGraw-Hill Education.
   Google Scholar
• Butakor, P. K. (2022). Using classical test and item response theories to evaluate psychometric quality of teacher-made Test in Ghana. European Scientific Journal, ESJ, 18(1), 139. https://doi.org/10.19044/esj.2022.v18n1p139
   Google Scholar
• Campos Martinez, J., Falabella, A., Holloway, J., & Santori, D. (2022). Antistandardization and testing opt-out movements in education: Resistance, disputes and transformation. Education Policy Analysis Archives, 30(132) https://doi.org/10.14507/epaa.30.7506
   Google Scholar
• Cecilia, P., R. (2021). Mixed-method research protocol: Development and evaluation of a nursing intervention in patients discharged from the intensive care unit. Nursing Open, 8(6), 36666–33676.
   Web of Science ®Google Scholar
• Chala, L., & Agago, M, Corresponding author, College of Education, Department of Teacher Education, Hawassa Univesity, Ethiopia, [email protected]. (2022). Exploring national examination malpractice mechanisms and countermeasures: An Ethiopian perspective. International Journal of Instruction, 15(3), 413–428. https://doi.org/10.29333/iji.2022.15323a
   Web of Science ®Google Scholar
• Chamo, W. (2018). Evaluation of the Psychometric Quality and Validity of a Student Survey of Instruction in. Bangkok University.
   Google Scholar
• Clayton, G., Bingham, A. J., & Ecks, G. B. (2019). Characteristics of the opt-out movement: Early evidence for Colorado. Education Policy Analysis Archives, 27(33), 33. https://doi.org/10.14507/epaa.27.4126
   Google Scholar
• Cordova, C., & Tan, D. A. (2018). Mathematics Proficiency, Attitude and Performance of Grade 9 Students in Private High School in Bukidnon, Philippines‖. Asian Academic Research. Research Journal of Social Sciences and Humanities, 5(2), 103–116.
   Google Scholar
• Creswell, J. W., & Plano Clark, V. L. (2018). Designing and conducting mixed methods research (3rd ed.). SAGE Publications, Inc.
   Google Scholar
• Daud, K. A. M., Khidzir, N. Z., Ismail, A. R., & Abdullah, F. A. (2018). Validity and reliability of instrument to measure social media skills among small and medium entrepreneurs at Pengkalan Datu River. International Journal of Development and Sustainabilty, 7(3), 1026–1037.
   Google Scholar
• Demissie, M. M., Herut, A. H., Yimer, B. M., Bareke, M. L., Agezew, B. H., Dedho, N. H., & Lebeta, M. F. (2021). Graduates’ Unemployment and Associated Factors in Ethiopia: Analysis of Higher Education Graduates’ Perspectives. Education Research International, 2021, 1–9. https://doi.org/10.1155/2021/4638264
   Web of Science ®Google Scholar
• Duy, P. (2019). Bringing Learning Back In: Examining Three Psychometric Models Bringing Learning Back. In: Examining Three Psychometric Models for Evaluating Learning Progression Theories.
   Google Scholar
• Ehsan, N., Vida, S., & Mehdi, N. (2019). The impact of cooperative learning on developing speaking ability and motivation toward learning English. Journal of Language and Education, 5(3), 83–101.
   Web of Science ®Google Scholar
• Espinoza Molina, F. E., Arenas Ramirez, B. D. V., Aparicio Izquierdo, F., & Zúñiga Ortega, D. C. (2021). Road safety perception questionnaire (RSPQ) in Latin America: a development and validation study. International Journal of Environmental Research and Public Health, 18(5), 2433. https://doi.org/10.3390/ijerph18052433
   PubMed Web of Science ®Google Scholar
• Ferede, B., et al. (2021). Determinants of instructors’ educational ICT use in Ethiopian higher education. Springer Science.
   Google Scholar
• Gashaye, S., & Degwale, Y. (2019). The Content Validity of High School English Language Teacher Made Tests: The Case of Debre Work Preparatory School, East Gojjam, Ethiopia. International Journal of Research in Engineering, IT and Social Sciences, 9(11), 41–50.
   Google Scholar
• Georgia Department of Education. (2017). An assessment & accountability brief: 2016-2017 Georgia milestones validity and reliability.
   Google Scholar
• Görkem E., & Enisa, M. (2021). Evaluating an english preparatory program using CIPP model and exploring the motivational beliefs for learning. Journal of Education and Educational Development8(1), 53–76. https://doi.org/10.22555/joeed.v8i1.109
   Google Scholar
• Hakim, L., & Irhamsyah, I. (2020). The analysis of the teacher-made test for senior high school at state senior high Hchool Kutacane, Aceh Tenggara. JURNAL ILMIAH DIDAKTIKA: Media Ilmiah Pendidikan Dan Pengajaran, 21(1), 10–20. https://doi.org/10.22373/jid.v21i1.4120
   Google Scholar
• Hariharasudan, A., & Kot, S. (2018). A scoping review on digital english and education 4.0 for industry 4.0. Social Sciences, 7(11), 227. https://doi.org/10.3390/socsci7110227
   Google Scholar
• Kirkland, M. C. (2016). The effects of tests on students and schools. Review of Educational Research, 41(4), 303–350.
   Google Scholar
• Kivunja, C. (2018). Distinguishing between Theory, Theoretical Framework, and Conceptual Framework: A Systematic Review of Lessons from the Field. International Journal of Higher Education, 7(6), 44. https://doi.org/10.5430/ijhe.v7n6p44
   Google Scholar
• Kivunja, C., & Kuyini, A. B. (2017). Understanding and applying research paradigms in educational contexts. International Journal of Higher Education, 6(5), 26–41. https://doi.org/10.5430/ijhe.v6n5p26
   Google Scholar
• Kowash, M., Hussein, I., Halabi, & M., Al. (2019). Evaluating the quality of multiple choice question in paediatric denistry postgraduate examinations. Sultan Qaboos University Medical Journal [SQUMJ], 19(2), 135–141. https://doi.org/10.18295/squmj.2019.19.02.009
   Google Scholar
• Kumar, S., Agarwal, M., & Agarwal, N. (2021). Defining And Measuring Academic Performance of Hei StudentsA Critical Review. Turkish Journal of Computer and Mathematics Education, 12(6), 3091–3105.
   Google Scholar
• Loeb, S., & Byun, E. (2019). Testing, accountability, and school improvement. The ANNALS of the American Academy of Political and Social Science, 683(1), 94–109. https://doi.org/10.1177/0002716219839929
   Web of Science ®Google Scholar
• Malloy, T. E. (2018). Social relations modeling of behavior in dyads and groups. Academic Press.
   Google Scholar
• Marsevani, M. (2022). Item analysis of multiple-choice questions: An assessment of young learners. English Review: Journal of English Education, 10(2), 401–408. https://doi.org/10.25134/erjee.v10i2.6241
   Google Scholar
• Montero, L., Cabalin, C., & Brossi, L. (2018). Alto al Simce: The campaign against standardized testing in Chile. Postcolonial Directions in Education, 7(2), 174–175.
   Google Scholar
• Motuma Hirpassa, M. (2019). Content Validity of EFL Teacher-Made Assessment: The Case of Communicative English Skills Course at Ambo University. East African Journal of Social Sciences and Humanities, 3(1), 41–62.
   Google Scholar
• Narad, A., & Abdullah, B, Lovely Professional University, Phagwara. (2016). Academic performance of senior secondary school students: Influence of parental encouragement and school environment. Rupkatha Journal on Interdisciplinary Studies in Humanities, 8(2), 12–19. https://doi.org/10.21659/rupkatha.v8n2.02
   Google Scholar
• Naumann, A., Rieser, S., Musow, S., Hochweber, J., & Hartig, J. (2019). Sensitivity of test items to teaching quality. Learning and Instruction, 60(2019), 41–53. https://doi.org/10.1016/j.learninstruc.2018.11.002
   Google Scholar
• Nodoushan, M. A. S. (2022). Psychometrics revisited: Recapitulation of the major trends in TESOL.
   Google Scholar
• Obilor, E. I., & Miwari, G. U. (2022). Content Validity in Educational Assessment. International Journal of Innovative Education Research, 10(2), 57–69.
   Google Scholar
• Obon, A. M., & Rey, K. (2019). Analysis of multiple-choice questions (MCQs): Item and test statistics from the 2nd year nursing qualifying exam in a university in Cavite, Philippines. Abstract Proceedings International Scholars Conference, 7(1), 499–511. https://doi.org/10.35974/isc.v7i1.1128
   Google Scholar
• Olugboyega, O. (2022). Confirmatory sequential research design for theory building and testing: proposal for construction management research’s paradigm and methodology. Obafemi Awolowo University, Ile-Ife.
   Google Scholar
• Perez, A. (2019). Assessing quality in mixed methods research: A case study operationalizing the legitimation typology.
   Google Scholar
• Pietromonaco. (2021). The effects of standardized testing on students.
   Google Scholar
• Polat, M. (2020). Analysis of multiple-choice versus open-ended questions in language tests according to different cognitive domain levels. Novitas ROYAL (Research on Youth and Language), 14(2), 76–96.
   Google Scholar
• Polat, M. (2022). Comparison of performance measures obtained from foreign language tests according to item response theory vs classical test theory. International Online Journal of Education and Teaching (IOJET), 9(1), 471–485.
   Google Scholar
• Polikoff, M. S. (2010). Instructional sensitivity as a psychometric property of assessments. Educational Measurement: Issues and Practice, 29(4), 3–14. https://doi.org/10.1111/j.1745-3992.2010.00189.x
   Google Scholar
• Purwoko, M., & Mundijo, T. (2018). Evaluating the use of MCQ as an assessment method in a medical school for assessing medical students in the competence-based curriculum. Jurnal Pendidikan Kedokteran Indonesia: The Indonesian Journal of Medical Education, 7(1), 54. https://doi.org/10.22146/jpki.35544
   Google Scholar
• Quansah, F., Amoako, I., & Ankomah, F. (2019). Teachers’ test construction skills in Senior High Schools in Ghana: Document Analysis. International Journal of Assessment Tools in Education, 6(1), 1–8. https://doi.org/10.21449/ijate.481164
   Web of Science ®Google Scholar
• Razmi, M. H., Khabir, M., & Tilwani, S. A. (2021). A meta-analysis on the predictive validity of Graduate Record Examination (GRE) General Test. Tabaran Institute of Higher Education. International Journal of Language Testing, 11(2)
   Google Scholar
• Rehman, A., Aslam, A., & Hassan, S. H. (2018). Item analysis of multiple choice questions in pharmacology. Pakistan Oral & Dental Journal, 38(2), 291–293. https://doi.org/10.52206/jsmc.2020.10.2.320
   Google Scholar
• Salmani Nodoushan, M. A. (2021). Wash back or backwash? Revisiting the status quo of wash back and test impact in EFL contexts. Studies in English Language and Education, 8(3), 869–884. https://doi.org/10.24815/siele.v8i3.21406
   Google Scholar
• Shimekit, T., & Oumer, J. (2021). Ethiopian Public Universities Graduates Employability Enhancement at the Labor Market: Policies, Strategies, and Actions in Place. Academy of Educational Leadership Journal, 25(7), 1–18.
   Google Scholar
• Singh, C. K. S., Singh, H. K. J., Singh, T. S. M., Moneyam, S., Abdullah, N. Y., & Zaini, M. F. (2022). ESL teachers’ assessment literacy in classroom: A review of past studies. Journal of Language and Linguistic Studies, 18(1), 01–17.
   Google Scholar
• Singh, S. P., Malik, S., & Singh, P. (2016). Research paper factors affecting academic performance of students. Indian Journal of Research, 5(4), 176–178.
   Google Scholar
• Subali, B., Kumaidi, K., & Aminah, N. S. Prof., Universitas Negeri Yogyakarta, Indonesia, [email protected]. (2021). The Comparison of item test characteristics viewed from classic and modern test theory. International Journal of Instruction, 14(1), 647–660. https://doi.org/10.29333/iji.2021.14139a
   Web of Science ®Google Scholar
• Sukarno, S. (2020). Enhancing English language teaching and learning in Industrial Revolution 4.0 Era. Methods, Strategies and Assessments.
   Google Scholar
• Suppiah Shanmugam, S. K., Wong, V., & Rajoo, M. (2020). Examining the quality of English test items using psychometric and linguistic characteristics among grade six pupils. Malaysian Journal of Learning and Instruction, 17(2), 63–101. https://doi.org/10.32890/mjli2020.17.2.3
   Web of Science ®Google Scholar
• Tan, D. A., & Cordova, C. C. (2019). Development of Valid and Reliable Teacher-Made Tests for Grade 10 Mathematics. International Journal of English and Education, 8(1)
   Google Scholar
• Tekle, E. (2018). Teachers induction practices in secondary schools of Ethiopia.
   Google Scholar
• Ugwu, N.-G. (2019). Ensuring Quality in Education: Validity of Teacher-made Language Tests in Secondary Schools in Ebonyi State. American Journal of Educational Research, 7(7), 518–523.
   Google Scholar
• Yibrah, M. (2017). Assessing Content Validity of the EGSEC English Examinations. Haramaya University.
   Google Scholar
• York, T. T., Gibson, C., & Rankin, S. (2015). Defining and measuring academic success. Practical Assessment, Research, and Evaluation, 20(1), 5.
   Google Scholar
• Yousuf, M. I., Imran, M., Sarwar, M., & Ranjha, A. N. (2011). A study of non-cognitive variables of academic achievement at higher education: Nominal group study. Asian Social Science, 7(7), 53. https://doi.org/10.5539/ass.v7n7p53
   Google Scholar
• Yusoff, M. S. B, Department of Medical Education, School of Medical Sciences, Universiti Sains Malaysia, MALAYSIA. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
   Google Scholar
• Zatul, T. (2020). Investigating reliability and validity of student performance assessment in Higher Education using Rasch Model. Journal of Physics: Conference Series, 1529, 042088.
   Google Scholar