Psychometric validation and gender invariance analysis of a revised version of the attitudes towards research scale (EACIN-23) in a Chilean university student sample

References

• Abad, F. J., Olea, J., Ponsoda, V., & García, C. (2011). Medición en ciencias sociales y de la salud. Síntesis. https://dialnet.unirioja.es/servlet/libro?codigo=552272
   Google Scholar
• Aldana, G., Babativa Novoa, D., & Caraballo, G. (2016). Escala para medir actitudes hacia la investigación (eacin): validación de contenido y confiabilidad. Aletheia Revista de Desarrollo Humano, Educativo y Social Contemporáneo, 8(2), 104–20. https://doi.org/10.11600/21450366.8.2aletheia.104.121
   Google Scholar
• Aldana, G., Babativa Novoa, D., Caraballo, G., & Rey, C. (2020). Escala de actitudes hacia la investigación (EACIN): Evaluación de sus propiedades psicométricas en una muestra colombiana. CES Psicología, 13(1), 89–103. https://doi.org/10.21615/cesp.13.1.6
   Google Scholar
• Aldana de Becerra, G. M., & Joya Ramírez, N. S. (2011). Actitudes Hacia la Investigación Científica en Docentes de Metodología de la Investigación. Tabula Rasa, 14(14), 295–309. https://doi.org/10.25058/20112742.428
   Google Scholar
• Balta, N., Japashov, N., Karimova, A., Agaidarova, S., Abisheva, S., & Potvin, P. (2023). Middle and high school girls’ attitude to science, technology, engineering, and mathematics career interest across grade levels and school types. Frontiers in Education, 8, 1013. https://doi.org/10.3389/feduc.2023.1158041
   Google Scholar
• Barrett, B., Brown, R., & Mundt, M. (2008). Comparison of anchor-based and distributional approaches in estimating important difference in common cold. Quality of Life Research, 17(1), 75–85. https://doi.org/10.1007/s11136-007-9277-2
   PubMed Web of Science ®Google Scholar
• Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976), 25(24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014
   PubMed Web of Science ®Google Scholar
• Bolin, B., Lee, K., Glenmaye, L., & Yoon, D. (2012). Impact of research orientation on attitudes toward research of Social work students. Journal of Social Work Education, 48(2), 223–243. https://doi.org/10.5175/JSWE.2012.200900120
   Web of Science ®Google Scholar
• Bradforth, S. E., Miller, E. R., Dichtel, W. R., Leibovich, A. K., Feig, A. L., Martin, J. D., Bjorkman, K. S., Schultz, Z. D., & Smith, T. L. (2015). University learning: Improve undergraduate science education. Nature, 523(7560), 282–284. https://doi.org/10.1038/523282a
   PubMed Web of Science ®Google Scholar
• Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005
   Web of Science ®Google Scholar
• Castro Molinares, S. P. (2017). Diseño y validación de un instrumento para evaluar la actitud hacia la investigación formativa en estudiantes universitarios. Actualidades Pedagógicas, 1(70), 165–182. https://doi.org/10.19052/ap.3996
   Google Scholar
• Chen, L., Bae, S. R., Battista, C., Qin, S., Chen, T., Evans, T. M., & Menon, V. (2018). Positive attitude toward math supports early academic success: Behavioral evidence and neurocognitive mechanisms. Psychological Science, 29(3), 390–402. https://doi.org/10.1177/0956797617735528
   PubMed Web of Science ®Google Scholar
• Cheng, M. F., & Lo, Y. H. (2022). Innovative STEM curriculum to enhance students’ engineering design skills and attitudes towards STEM. Concepts and Practices of STEM Education in Asia, 117–137. https://doi.org/10.1007/978-981-19-2596-2_7
   Google Scholar
• Cho, E., & Kim, S. (2015). Cronbach’s coefficient alpha: Well known but poorly understood. Organizational Research Methods, 18(2), 207–230. https://doi.org/10.1177/1094428114555994
   Web of Science ®Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112(1), 155–159. https://doi.org/10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98
   Web of Science ®Google Scholar
• Crawford, A. V., Green, S. B., Levy, R., Lo, W.-J., Scott, L., Svetina, D., & Thompson, M. S. (2010). Evaluation of parallel analysis Methods for determining the number of factors. Educational and Psychological Measurement, 70(6), 885–901. https://doi.org/10.1177/0013164410379332
   Web of Science ®Google Scholar
• Curran, J., & Rosen, D. (2006). Student attitudes toward college courses: An examination of influences and intentions. Journal of Marketing Education, 28(2), 135–148. https://doi.org/10.1177/0273475306288401
   Google Scholar
• Debelak, R., Tran, U. S., & Ebrahimi, M. (2016). Comparing the effects of different smoothing algorithms on the assessment of dimensionality of ordered categorical items with parallel analysis. PLOS ONE, 11(2), e0148143. https://doi.org/10.1371/journal.pone.0148143
   PubMed Web of Science ®Google Scholar
• Else-Quest, N. M., Mineo, C. C., & Higgins, A. (2013). Math and Science attitudes and achievement at the intersection of gender and ethnicity. Psychology of Women Quarterly, 37(3), 293–309. https://doi.org/10.1177/0361684313480694
   Web of Science ®Google Scholar
• Emily Oon, P. T., & Subramaniam, R. (2023). Gender differences in attitudes towards science: Comparison of middle school students in England, Singapore and USA using complete TIMSS 2011 data. Research in Science & Technological Education, 1–20. https://doi.org/10.1080/02635143.2023.2177267
   Web of Science ®Google Scholar
• Finney, S. J., & DiStefano, C. (2013). Nonnormal and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (2nd ed., pp. 439–492). IAP Information Age Publishing.
   Google Scholar
• Gardner, R. C., & MacIntyre, P. D. (1993). On the measurement of affective variables in second language learning. Language Learning, 43(2), 157–194. https://doi.org/10.1111/j.1467-1770.1992.tb00714.x
   Web of Science ®Google Scholar
• Garrido, L. E., Abad, F. J., & Ponsoda, V. (2013). A new look at Horn’s parallel analysis with ordinal variables. Psychological Methods, 18(4), 454–474. https://doi.org/10.1037/a0030005
   PubMed Web of Science ®Google Scholar
• Goodboy, A. K., & Martin, M. M. (2020). Omega over alpha for reliability estimation of unidimensional communication measures. Annals of the International Communication Association, 44(4), 422–439. https://doi.org/10.1080/23808985.2020.1846135
   Google Scholar
• Gredig, D., & Bartelsen-Raemy, A. (2018). Exploring social work students’ attitudes toward research courses: Predictors of interest in research-related courses among first year students enrolled in a bachelor’s programme in Switzerland. Social Work Education, 37(2), 190–208. https://doi.org/10.1080/02615479.2017.1389880
   Web of Science ®Google Scholar
• Gregory, V. L. (2010). Gregory research beliefs scale: Factor structure and internal consistency. Research on Social Work Practice, 20(6), 641–650. https://doi.org/10.1177/1049731509353049
   Web of Science ®Google Scholar
• Hamid, M., Sami, W., & Sidek, M. (2017). Discriminant validity assessment: Use of Fornell & Larcker criterion versus HTMT criterion. Journal of Physics Conference Series, 890, 012163. https://doi.org/10.1088/1742-6596/890/1/012163
   Google Scholar
• Hayes, A. F., & Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But …. Communication Methods and Measures, 14(1), 1–24. https://doi.org/10.1080/19312458.2020.1718629
   Web of Science ®Google Scholar
• Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115–135. https://doi.org/10.1007/s11747-014-0403-8
   Web of Science ®Google Scholar
• Hernández, R., Thieme, T., & Araos, F. (2017). Adaptación y Análisis Psicométrico de la Versión Española del Índice Internacional de Función Eréctil (IIEF) en Población Chilena. Terapia Psicológica, 35(3), 223–230. https://doi.org/10.4067/S0718-48082017000300223
   Web of Science ®Google Scholar
• Hidalgo, J., Aldana, G., León, P., & Ucedo, V. (2023). Escala de actitudes hacia la investigación (EACIN-R): propiedades psicométricas en universitarios peruanos. Propósitos y Representaciones, 11(1), e1699. https://doi.org/10.20511/pyr2023.v11n1.1699
   Google Scholar
• Hofstein, A., Maoz, N., & Rishpon, M. (2010). Attitudes towards school Science: A comparison of participants and nonparticipants in extracurricular Science activities. School Science and Mathematics, 90(1), 13–22. https://doi.org/10.1111/j.1949-8594.1990.tb11988.x
   Google Scholar
• Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447
   PubMed Web of Science ®Google Scholar
• Howard, A., & Michael, P. G. (2019). Psychometric properties and factor structure of the attitudes toward research scale in a graduate student sample. Psychology Learning & Teaching, 18(3), 259–274. https://doi.org/10.1177/1475725719842695
   Google Scholar
• Jones, M. G., Howe, A., & Rua, M. J. (2000). Gender differences in students’ experiences, interests, and attitudes toward science and scientists. Science Education, 84(2), 180–192. https://doi.org/10.1002/(SICI)1098-237X(200003)84:2<180:AID-SCE3>3.0.CO;2-X
   Web of Science ®Google Scholar
• Jöreskog, K., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language.
   Google Scholar
• Kardash, C. M. (2000). Evaluation of undergraduate research experience: Perceptions of undergraduate interns and their faculty mentors. Journal of Educational Psychology, 92(1), 191–201. https://doi.org/10.1037/0022-0663.92.1.191
   Web of Science ®Google Scholar
• Khan, M., Abid, M., & Malone, K. L. (2022). Scientific attitudes: Gender differences, impact on physics scores and choices to study physics at higher levels among pre-college STEM students. International Journal of Science Education, 44(11), 1816–1839. https://doi.org/10.1080/09500693.2022.2097331
   Web of Science ®Google Scholar
• Kirk, S. A. R. A. (1981). Research knowledge and orientation amongst social work students. In S. W. Briar & A. H. Rubin (Eds.), Research utilization in social work education (pp. 29–39). Council on Social Work Education.
   Google Scholar
• Kline, R. (2015). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.
   Google Scholar
• Kline, R. (2022). Principles and practice of structural equation modeling.
   Google Scholar
• Kollmayer, M., Schultes, M. T., Lüftenegger, M., Finsterwald, M., Spiel, C., & Schober, B. (2020). REFLECT – a Teacher training program to promote gender equality in schools [article]. Frontiers in Education, 5. Article 136. https://doi.org/10.3389/feduc.2020.00136
   Google Scholar
• Kopalle, P. K., & Lehmann, D. R. (1997). Alpha inflation? The impact of eliminating scale items on Cronbach’s alpha. Organizational Behavior and Human Decision Processes, 70(3), 189–197. https://doi.org/10.1006/obhd.1997.2702
   Web of Science ®Google Scholar
• Kracker, J. (2002). Research anxiety and students’ perceptions of research: An experiment. Part I. Effect of teaching Kuhlthau’s ISP model. Journal of the American Society for Information Science and Technology, 53(4), 282–294. https://doi.org/10.1002/asi.10040
   Web of Science ®Google Scholar
• Lopatto, D. (2003). The essential features of undergraduate research. Council on Undergraduate Research Quarterly, 139. https://www.cur.org/assets/1/7/mar03toc.pdf
   Google Scholar
• Lopatto, D. (2006). Undergraduate research as a catalyst for liberal learning. Peer Review, 8, 22–25. https://www.proquest.com/docview/216599120?sourcetype=Scholarly%20Journals
   Google Scholar
• Maguiña Custodio, L. M. J. (2021). Escala de Actitudes hacia la Investigación-versión Revisada (EACIN-R): propiedades psicométricas y datos normativos en estudiantes universitarios, Lima Metropolitana, 2021. Psycométrica, Universidad César Vallejo. https://repositorio.ucv.edu.pe/handle/20.500.12692/70510
   Google Scholar
• Mao, P., Cai, Z., He, J., Chen, X., & Fan, X. (2021). The relationship between attitude toward Science and academic achievement in Science: A three-level meta-analysis [systematic review]. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.784068
   Web of Science ®Google Scholar
• Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. https://doi.org/10.1093/biomet/57.3.519
   Web of Science ®Google Scholar
• Marsh, H. W., & Hau, K. T. G. D. (2005). Goodness of fit evaluation in structural equation modeling. In A. M. J. Maydeu-Olivares (Ed.), Contemporary psychometrics (pp. 275–340). Erlbaum.
   Google Scholar
• McGuire, W. J. (1969). The nature of attitudes and attitude change. In G. A. Lindzey (Ed.), The handbook of social psychology (2nd ed., Vol. 3, pp. 136–314). Addison-Wesley.
   Google Scholar
• McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
   PubMed Web of Science ®Google Scholar
• Muñoz, J. X., Hinostroza, A. R., Daza, N. F., Nunura, L. V., Rodriguez, B. K., & Abanto, W. I. (2020). Evidencia de los procesos psicométricos en la escala de actitud frente a la investigación en estudiantes universitarios de la ciudad de Trujillo. PAIAN, 11(1), 1–15. https://doi.org/10.26495/rcp.v11i1.1319
   Google Scholar
• Muthén, B., & Asparouhov, T. (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17(3), 313–335. https://doi.org/10.1037/a0026802
   PubMed Web of Science ®Google Scholar
• Muthuswamy, P., Vanitha, R., Chandramohan, S., & Ramesh, P. (2017). A study on attitude towards research among the doctoral students. International Journal of Civil Engineering & Technology, 8, 811–823. https://iaeme.com/MasterAdmin/Journal_uploads/IJCIET/VOLUME_8_ISSUE_11/IJCIET_08_11_083.pdf
   Google Scholar
• National Science Foundation. (2014). Integrated postsecondary education data system, 2013, completions survey. https://webcaspar.nsf.gov
   Google Scholar
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
   Google Scholar
• Osborne, J., Simon, S., & Collins, S. (2003). Attitudes towards science: A review of the literature and its implications. International Journal of Science Education, 25(9), 1049–1079. https://doi.org/10.1080/0950069032000032199
   Web of Science ®Google Scholar
• Ozturk, M. (2011). Confirmatory factor analysis of the educators’ attitudes toward Educational research scale. Kuram ve Uygulamada Egitim Bilimleri, 11, 737–747. https://files.eric.ed.gov/fulltext/EJ927375.pdf
   Google Scholar
• Papanastasiou, E. (2014). Revised attitudes toward research scale (R-ATR). A first look at its psychometric properties. Journal of Research in Education, 24, 146–159. https://doi.org/10.1037/t35506-000
   Google Scholar
• Papanastasiou, E. C. (2005). Factor structure of the “attitudes toward research” scale. Statistics Education Research Journal, 4(1), 16–26. https://doi.org/10.52041/serj.v4i1.523
   Google Scholar
• Papanastasiou, E. C., & Schumacker, R. (2014). Rasch rating scale analysis of the attitudes toward research scale. Journal of Applied Measurement, 15(2), 189–199.
   PubMedGoogle Scholar
• Petrella, J. K., & Jung, A. P. (2008). Undergraduate Research: Importance, benefits, and challenges. International Journal of Exercise Science, 1(3), 91–95.
   Google Scholar
• Quezada-Berumen, L., Moral de la Rubia, J., & Landero-Hernández, R. (2019). Validación de la Escala de Actitud hacia la Investigación en Estudiantes Mexicanos de Psicología. Revista Evaluar, 19(1). https://doi.org/10.35670/1667-4545.v19.n1.23874
   Google Scholar
• Raykov, T. (2007). Reliability if deleted, not ‘alpha if deleted’: Evaluation of scale reliability following component deletion. The British Journal of Mathematical and Statistical Psychology, 60(2), 201–216. https://doi.org/10.1348/000711006x115954
   PubMed Web of Science ®Google Scholar
• Raykov, T. (2008). Alpha if item deleted: A note on loss of criterion validity in scale development if maximizing coefficient alpha. The British Journal of Mathematical and Statistical Psychology, 61(2), 275–285. https://doi.org/10.1348/000711007x188520
   PubMedGoogle Scholar
• Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8, 23–74. https://psycnet.apa.org/record/2003-08119-003
   Google Scholar
• Schreiber, J. B. (2017). Update to core reporting practices in structural equation modeling. Research in Social and Administrative Pharmacy, 13(3), 634–643. https://doi.org/10.1016/j.sapharm.2016.06.006
   PubMed Web of Science ®Google Scholar
• Sellami, A., Al-Ali, A., Allouh, A., & Alhazbi, S. (2023). Student attitudes and interests in STEM in Qatar through the lens of the Social cognitive theory. Sustainability, 15(9), 7504. https://doi.org/10.3390/su15097504
   Web of Science ®Google Scholar
• Sizemore, O. J., & Lewandowski, G. W. (2009). Learning might not equal liking: Research Methods course changes knowledge but not attitudes. Teaching of Psychology, 36(2), 90–95. https://doi.org/10.1080/00986280902739727
   Web of Science ®Google Scholar
• Sofiani, D., Maulida, A. S., Fadhillah, N., & Sihite, D. Y. (2017). Gender differences in students’ attitude towards science. Journal of Physics Conference Series, 895, 012168. https://doi.org/10.1088/1742-6596/895/1/012168
   Google Scholar
• Turner, S., & Ireson, G. (2010). Fifteen pupils’ positive approach to primary school science: When does it decline? Educational Studies, 36(2), 119–141. https://doi.org/10.1080/03055690903148662
   Web of Science ®Google Scholar
• Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for Organizational research. Organizational Research Methods, 3(1), 4–70. https://doi.org/10.1177/109442810031002
   Web of Science ®Google Scholar
• van der Westhuizen, S. (2015). Reliability and validity of the attitude towards research scale for a sample of industrial psychology students. South African Journal of Psychology, 45(3), 386–396. https://doi.org/10.1177/0081246315576266
   Web of Science ®Google Scholar
• van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740
   Web of Science ®Google Scholar
• Wajid, U., & Jami, H. (2020). Research self-efficacy among students: Role of metacognitive awareness of reading strategies, research anxiety, and attitude towards research. Pakistan Journal of Psychological Research, 35(2), 271–293. https://doi.org/10.33824/PJPR.2020.35.2.15
   Google Scholar
• Wiebe, E., Unfried, A., & Faber, M. (2018). The relationship of STEM attitudes and career interest. Eurasia Journal of Mathematics, Science and Technology Education, 14(10). https://doi.org/10.29333/ejmste/92286
   Google Scholar
• Wood, W. (2000). Attitude change: Persuasion and Social influence. Annual Review of Psychology, 51(1), 539–570. https://doi.org/10.1146/annurev.psych.51.1.539
   PubMed Web of Science ®Google Scholar
• Xiao, Y., Liu, H., & Hau, K.-T. (2019). A comparison of CFA, ESEM, and BSEM in test structure analysis. Structural Equation Modeling: A Multidisciplinary Journal, 26(5), 665–677. https://doi.org/10.1080/10705511.2018.1562928
   Web of Science ®Google Scholar
• Yau, H. K., & Leung, Y. F. (2018). The relationship between self-efficacy and attitudes towards the use of Technology in learning in Hong Kong higher Education. International MultiConference of Engineers and Computer Scientists 2018 (IMECS 2018) (Vol. II, pp. 832–834): Newswood Limited.
   Google Scholar