Replicable quantitative psychological and educational research: Possibility or pipe dream?

References

• Aldhous, P. (2011, May 5). Journal rejects studies contradicting precognition. New Scientist. https://www.newscientist.com/article/dn20447-journal-rejects-studies-contradicting-precognition/
   Google Scholar
• Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100(3), 407–425. https://doi.org/10.1037/a0021524
   PubMed Web of Science ®Google Scholar
• Bruner, J. (1996). The culture of education. Harvard University Press.
   Google Scholar
• Cai, J., Morris, A., Hohensee, C., Hwang, S., Robison, V., & Hiebert, J. (2018). The role of replication studies in educational research. Journal for Research in Mathematics Education, 49(1), 2–8. https://doi.org/10.5951/jresematheduc.49.1.0002
   Web of Science ®Google Scholar
• Cantley, I. (2015). How secure is a Newtonian paradigm for psychological and educational measurement? Theory & Psychology, 25(1), 117–138. https://doi.org/10.1177/0959354314561141
   Web of Science ®Google Scholar
• Cantley, I. (2017). A quantum measurement paradigm for educational predicates: Implications for validity in educational measurement. Educational Philosophy and Theory, 49(4), 405–421. https://doi.org/10.1080/00131857.2015.1048668
   Web of Science ®Google Scholar
• Cantley, I. (2019). PISA and policy-borrowing: A philosophical perspective on their interplay in mathematics education. Educational Philosophy and Theory, 51(12), 1200–1215. https://doi.org/10.1080/00131857.2018.1523005
   Web of Science ®Google Scholar
• Collins, H. M. (1985). Changing order: Replication and induction in scientific practice. Sage.
   Google Scholar
• Cumming, G. (2014). The new statistics: Why and how. Psychological Science, 25(1), 7–29. https://doi.org/10.1177/0956797613504966
   PubMed Web of Science ®Google Scholar
• Danziger, K. (1990). Constructing the subject: Historical origins of psychological research. Cambridge University Press.
   Google Scholar
• Duncan, C., & Sankey, D. (2019). Two conflicting visions of education and their consilience. Educational Philosophy and Theory, 51(14), 1454–1464. https://doi.org/10.1080/00131857.2018.1557044
   Web of Science ®Google Scholar
• Duncan, C., Kim, M., Baek, S., Wu, K. Y. Y., & Sankey, D. (2022). The limits of motivation theory in education and the dynamics of value-embedded learning (VEL). Educational Philosophy and Theory, 54 (5), 618–629. https://doi.org/10.1080/00131857.2021.1897575
   Web of Science ®Google Scholar
• Earp, B. D., & Trafimow, D. (2015). Replication, falsification, and the crisis of confidence in social psychology. Frontiers in Psychology, 6, 621. https://doi.org/10.3389/fpsyg.2015.00621
   PubMed Web of Science ®Google Scholar
• Fanelli, D. (2018). Opinion: Is science really facing a reproducibility crisis, and do we need it to? Proceedings of the National Academy of Sciences of the United States of America, 115(11), 2628–2631. https://doi.org/10.1073/pnas.1708272114
   PubMed Web of Science ®Google Scholar
• Frias‐Navarro, D., Pascual‐Llobell, J., Pascual‐Soler, M., Perezgonzalez, J., & Berrios‐Riquelme, J. (2020). Replication crisis or an opportunity to improve scientific production? European Journal of Education, 55(4), 618–631. https://doi.org/10.1111/ejed.12417
   Web of Science ®Google Scholar
• Gigerenzer, G. (2018). Statistical rituals: The replication delusion and how we got there. Advances in Methods and Practices in Psychological Science, 1(2), 198–218. https://doi.org/10.1177/2515245918771329
   Google Scholar
• Gilbert, D. T., King, G., Pettigrew, S., & Wilson, T. D. (2016). Comment on “estimating the reproducibility of psychological science”. Science (New York, N.Y.), 351(6277), 1037. https://doi.org/10.1126/science.aad7243
   PubMed Web of Science ®Google Scholar
• Glass, G. V. (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5(10), 3–8. https://doi.org/10.3102/0013189X005010003
   Google Scholar
• Hattie, J. A. C. (2009). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge.
   Google Scholar
• Hedges, L. V. (2018). Challenges in building usable knowledge in education. Journal of Research on Educational Effectiveness, 11(1), 1–21. https://doi.org/10.1080/19345747.2017.1375583
   Web of Science ®Google Scholar
• Hughes, B. M. (2018). Psychology in crisis. Palgrave.
   Google Scholar
• John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524–532. https://doi.org/10.1177/0956797611430953
   PubMed Web of Science ®Google Scholar
• Kim, J. S. (2019). Making every study count: Learning from replication failure to improve intervention research. Educational Researcher, 48(9), 599–607. https://doi.org/10.3102/0013189X19891428
   Web of Science ®Google Scholar
• Krueger, J. (2001). Null hypothesis significance testing: On the survival of a flawed method. The American Psychologist, 56(1), 16–26. https://doi.org/10.1037/0003-066x.56.1.16
   PubMed Web of Science ®Google Scholar
• Lingard, B. (2013). The impact of research on education policy in an era of evidence-based policy. Critical Studies in Education, 54(2), 113–131. https://doi.org/10.1080/17508487.2013.781515
   Web of Science ®Google Scholar
• Luntley, M. (2017). Forgetski Vygotsky: Or, a plea for bootstrapping accounts of learning. Educational Philosophy and Theory, 49(10), 957–970. https://doi.org/10.1080/00131857.2016.1248341
   Web of Science ®Google Scholar
• Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43(6), 304–316. https://doi.org/10.3102/0013189X14545513
   Web of Science ®Google Scholar
• Makel, M. C., Hodges, J., Cook, B. G., & Plucker, J. A. (2021). Both questionable and open research practices are prevalent in education research. Educational Researcher, 50(8), 493–504. https://doi.org/10.3102/0013189X211001356
   Web of Science ®Google Scholar
• Makel, M. C., Smith, K. N., McBee, M. T., Peters, S. J., & Miller, E. M. (2019). A path to greater credibility: Large-scale collaborative education research. AERA Open, 5(4), 233285841989196. https://doi.org/10.1177/2332858419891963
   Web of Science ®Google Scholar
• Malcolm, N. (1986). Wittgenstein: Nothing is hidden. Blackwell.
   Google Scholar
• Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences of the United States of America, 115(11), 2600–2606. https://doi.org/10.1073/pnas.1708274114
   PubMed Web of Science ®Google Scholar
• Nosek, B. A., & Lakens, D. (2014). Registered reports: A method to increase the credibility of published results. Social Psychology, 45(3), 137–141. https://doi.org/10.1027/1864-9335/a000192
   Web of Science ®Google Scholar
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), 943. https://doi.org/10.1126/science.aac4716
   Web of Science ®Google Scholar
• Pellegrini, M., & Vivanet, G. (2021). Evidence-based policies in education: Initiatives and challenges in Europe. ECNU Review of Education, 4(1), 25–45. https://doi.org/10.1177/2096531120924670
   Google Scholar
• Sharpe, D., & Poets, S. (2020). Meta-analysis as a response to the replication crisis. Canadian Psychology/Psychologie Canadienne, 61(4), 377–387. https://doi.org/10.1037/cap0000215
   Web of Science ®Google Scholar
• Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
   PubMed Web of Science ®Google Scholar
• Srivastava, S. (2012, September 27). A Pottery Barn rule for scientific journals. The Hardest Science. https://thehardestscience.com/2012/09/27/a-pottery-barn-rule-for-scientific-journals/
   Google Scholar
• Vanpaemel, W., Vermorgen, M., Deriemaecker, L., & Storms, G. (2015). Are we wasting a good crisis? The availability of psychological research data after the storm. Collabra, 1(1), 3. https://doi.org/10.1525/collabra.13
   Google Scholar
• Vaughn, S., Klingner, J. K., Swanson, E. A., Boardman, A. G., Roberts, G., Mohammed, S. S., & Stillman-Spisak, S. J. (2011). Efficacy of collaborative strategic reading with middle school students. American Educational Research Journal, 48(4), 938–964. https://doi.org/10.3102/0002831211410305
   Web of Science ®Google Scholar
• Wiggins, B. J., & Christopherson, C. D. (2019). The replication crisis in psychology: An overview for theoretical and philosophical psychology. Journal of Theoretical and Philosophical Psychology, 39(4), 202–217. https://doi.org/10.1037/teo0000137
   Web of Science ®Google Scholar
• Wittgenstein, L. (1978). Remarks on the foundations of mathematics (3rd ed., G. H. von Wright, R. Rhees, & G. E. M. Anscombe, Eds.; G. E. M. Anscombe, Trans.). Blackwell.
   Google Scholar
• Wittgenstein, L. (2009). Philosophical investigations: The German text with an English translation. (P. M. S. Hacker & J. Schulte, Eds.; G. E. M. Anscombe, P. M. S. Hacker, & J. Schulte Trans.; 4th ed.). Wiley-Blackwell.
   Google Scholar
• Wright, C. (2001). Rails to infinity. Harvard University Press.
   Google Scholar