Evidential Value of Intervention Studies in Two School Psychology Journals: A p-Curve Analysis of Research from 2011 to 2021

REFERENCES

• Ardoin, S. P., Morena, L. S., Binder, K. S., & Foster, T. E. (2013). Examining the impact of feedback and repeated readings on oral reading fluency: Let’s not forget prosody. School Psychology Quarterly, 28(4), 391–404. https://doi.org/10.1037/spq0000027
   PubMed Web of Science ®Google Scholar
• Bartoš, F., & Schimmack, U. (2022). Z-curve 2.0: Estimating replication rates and discovery rates. Meta-Psychology, 6. https://doi.org/10.15626/MP.2021.2720
   Google Scholar
• Begeny, J. C. (2011). Effects of the helping early literacy with practice strategies (HELPS) reading fluency program when implemented at different frequencies. School Psychology Review, 40(1), 149–157. https://doi.org/10.1080/02796015.2011.12087734
   Web of Science ®Google Scholar
• Bishop, D. (2019). Rein in the four horsemen of irreproducibility. Nature, 568(7753), 435–435. https://doi.org/10.1038/d41586019-01307-2
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Hedges, L., Higgins, H., & Rothstein, H. (2009). Introduction to meta-analysis. John Wiley & Sons. https://doi.org/10.1002/9780470743386
   Google Scholar
• Bradshaw, C. P., Pas, E. T., Bottiani, J. H., Debnam, K. J., Reinke, W. M., Herman, K. C., & Rosenberg, M. S. (2018). Promoting cultural responsivity and student engagement through double check coaching of classroom teachers: An efficacy study. School Psychology Review, 47(2), 118–134. & Gregory, A https://doi.org/10.17105/SPR-2017-0119.V47-2
   Web of Science ®Google Scholar
• Bruns, S. B., & Ioannidis, J. P. (2016). P-curve and p-hacking in observational research. PloS One, 11(2), e0149144. https://doi.org/10.1371/journal.pone.0149144
   PubMed Web of Science ®Google Scholar
• Cairo, A. H., Green, J. D., Forsyth, D. R., Behler, A. M. C., & Raldiris, T. L. (2020). Gray (literature) matters: Evidence of selective hypothesis reporting in social psychological research. Personality & Social Psychology Bulletin, 46(9), 1344–1362. https://doi.org/10.1177/0146167220903896
   PubMed Web of Science ®Google Scholar
• Castro-Olivo, S. M. (2014). Promoting social-emotional learning in adolescent Latino ELLs: A study of the culturally adapted Strong Teens program. School Psychology Quarterly, 29(4), 567–577. https://doi.org/10.1037/spq0000055
   PubMed Web of Science ®Google Scholar
• Chiu, A. W., Langer, D. A., McLeod, B. D., Har, K., Drahota, A., Galla, B. M., Jacobs, J., Ifekwunigwe, M., & Wood, J. J. (2013). Effectiveness of modular CBT for child anxiety in elementary schools. School Psychology Quarterly, 28(2), 141–153. https://doi.org/10.1037/spq0000017
   PubMed Web of Science ®Google Scholar
• Clarke, B., Doabler, C. T., Strand Cary, M., Kosty, D., Baker, S., Fien, H., & Smolkowski, K. (2014). Preliminary evaluation of a tier 2 mathematics intervention for first-grade students: Using a theory of change to guide formative evaluation activities. School Psychology Review, 43(2), 160–178. https://doi.org/10.1080/02796015.2014.12087442
   Web of Science ®Google Scholar
• Codding, R. (2021). School psychology vision for the future. School Psychology, 36(1), 1–5. https://doi.org/10.1037/spq0000425
   Google Scholar
• Cook, C. R., Coco, S., Zhang, Y., Fiat, A. E., Duong, M. T., Renshaw, T. L., Long, A. C., & Frank, S. (2018). Cultivating positive teacher–student relationships: Preliminary evaluation of the establish–maintain–restore (EMR) method. School Psychology Review, 47(3), 226–243. https://doi.org/10.17105/SPR-2017-0025.V47-3
   Web of Science ®Google Scholar
• Cook, C. R., Frye, M., Slemrod, T., Lyon, A. R., Renshaw, T. L., & Zhang, Y. (2015). An integrated approach to universal prevention: Independent and combined effects of PBIS and SEL on youths’ mental health. School Psychology Quarterly, 30(2), 166–183. https://doi.org/10.1037/spq0000102
   PubMed Web of Science ®Google Scholar
• CONGRESS.GOV. (2015). Every student succeeds act, 20 U.S.C. § 6301. https://www.congress.gov/bill/114th-congress/senate-bill/1177
   Google Scholar
• Cook, B. G., Lloyd, J. W., Mellor, D., Nosek, B. A., & Therrien, W. J. (2018). Promoting open science to increase the trustworthiness of evidence in special education. Exceptional Children, 85(1), 104–118. https://doi.org/10.1177/0014402918793138
   Web of Science ®Google Scholar
• Dean, M., Williams, J., Orlich, F., & Kasari, C. (2020). Adolescents with autism spectrum disorder and social skills groups at school: A randomized trial comparing intervention environment and peer composition. School Psychology Review, 49(1), 60–73. https://doi.org/10.1080/2372966x.2020.1716636
   PubMed Web of Science ®Google Scholar
• D’Intino, J., Lysenko, E., & Shaw, S. (2018). Questionable research practices and evidence-based practices in school psychology. Communiqué, 47(8), 10–11.
   Google Scholar
• DiGirolamo, A. M., Desai, D., Farmer, D., McLaren, S., Whitmore, A., McKay, D., Fitzgerald, L., Pearson, S., & McGiboney, G. (2021). Results from a statewide school-based mental health program: Effects on school climate. School Psychology Review, 50(1), 81–98. https://doi.org/10.1080/2372966X.2020.1837607
   Web of Science ®Google Scholar
• Doabler, C. T., Clarke, B., Kosty, D. B., Baker, S. K., Smolkowski, K., & Fien, H. (2016). Effects of a core kindergarten mathematics curriculum on the mathematics achievement of Spanish-speaking English learners. School Psychology Review, 45(3), 343–361. https://doi.org/10.17105/SPR45-3.343-361
   Google Scholar
• Doll, B., Garcia-Vazquez, E., DiPerna, J., & Clark, E. (2020). How the history of American Psychological Association Division 16 can shape the future of school psychology: Demonstrating organizational transformation: School Psychology. School Psychology, 35(6), 385–397. https://doi.org/10.1037/spq0000407
   Google Scholar
• Duong, M. T., Pullmann, M. D., Buntain-Ricklefs, J., Lee, K., Benjamin, K. S., Nguyen, L., & Cook, C. R. (2019). Brief teacher training improves student behavior and student–teacher relationships in middle school. School Psychology, 34(2), 212–221. https://doi.org/10.1037/spq0000296
   Google Scholar
• Durlak, J. A. (2002). Evaluating evidence-based interventions in school psychology. School Psychology Quarterly, 17(4), 475–482. https://doi.org/10.1521/scpq.17.4.475.20873
   Web of Science ®Google Scholar
• Eisenhower, A., Taylor, H., & Baker, B. L. (2016). Starting strong: A school-based indicated prevention program during the transition to kindergarten. School Psychology Review, 45(2), 141–170. https://doi.org/10.17105/SPR45-2.141-170
   Web of Science ®Google Scholar
• ElGarhy, S., & Liu, T. (2016). Effects of psychomotor intervention program on students with autism spectrum disorder. School Psychology Quarterly, 31(4), 491–506. https://doi.org/10.1037/spq0000164
   PubMed Web of Science ®Google Scholar
• Evans, S. W., Schultz, B. K., & DeMars, C. E. (2014). High School–Based treatment for adolescents with attention-deficit/hyperactivity disorder: Results from a pilot study examining outcomes and dosage. School Psychology Review, 43(2), 185–202. https://doi.org/10.1080/02796015.2014.12087444
   Web of Science ®Google Scholar
• Farmer, R., Zaheer, I., Duhon, G., & Ghazal, S. (2021). Reducing low-value practices: A functional-contextual consideration to aid in de-implementation efforts. Canadian Journal of School Psychology, 36(2), 153–165. https://doi.org/10.1177/0829573520974915
   Web of Science ®Google Scholar
• Flannery, K., Kato, M., Kittelman, A., McIntosh, K., & Triplett, D. (2020). A tier 1 intervention to increase ninth grade engagement and success: Results from a randomized controlled trial. School Psychology (Washington, D.C.), 35(1), 88–98. https://doi.org/10.1037/spq0000347
   PubMedGoogle Scholar
• Fiedler, K., & Schwarz, N. (2016). Questionable research practices revisited. Social Psychological and Personality Science, 7(1), 45–52. https://doi.org/10.1177/1948550615612150
   Web of Science ®Google Scholar
• Filderman, M., Austin, C., Boucher, A., O’Donnell, K., & Swanson, E. (2022). A Meta-analysis of the effects of reading comprehension interventions on the reading comprehension outcomes of struggling readers in third through 12th grades. Exceptional Children, 88(2), 163–184. https://doi.org/10.1177/00144029211050860
   Web of Science ®Google Scholar
• Fishstrom, S., Wang, H., Bhat, B., Daniel, J., Dille, J., Capin, P., & Vaughn, S. (2022). A meta-analysis of the effects of academic interventions on academic achievement and academic anxiety outcomes in elementary school children. Journal of School Psychology, 92, 265–284. https://doi.org/10.1016/j.jsp.2022.03.011
   PubMed Web of Science ®Google Scholar
• Friese, M., & Frankenbach, J. (2020). P-Hacking and publication bias interact to distort meta-analytic effect size estimates. Psychological Methods, 25(4), 456–471. https://doi.org/10.1037/met0000246
   PubMed Web of Science ®Google Scholar
• Froh, J. J., Bono, G., Fan, J., Emmons, R. A., Henderson, K., Harris, C., Leggio, H., & Wood, A. M. (2014). Nice thinking! An educational intervention that teaches children to think gratefully. School Psychology Review, 43(2), 132–152. https://doi.org/10.1080/02796015.2014.12087440
   Web of Science ®Google Scholar
• Gehlbach, H., & Robinson, C. D. (2021). From olde school to open science: The implications of new research norms for educational psychology and beyond. Educational Psy­cho­logist, 56(2), 79–89. https://doi.org/10.1080/00461520.2021.1898961
   Web of Science ®Google Scholar
• Henry, L., Reinke, W. M., Herman, K. C., Thompson, A. M., & Lewis, C. G. (2020). Motivational interviewing with at-risk students (MARS) mentoring: Addressing the unique mental health needs of students in alternative school placements. School Psychology Review, 50(1), 62–74. https://doi.org/10.1080/2372966X.2020.1827679
   Web of Science ®Google Scholar
• Herman, K. C., Borden, L. A., Reinke, W. M., & Webster-Stratton, C. (2011). The impact of the incredible years parent, child, and teacher training programs on children’s co-occurring internalizing symptoms. School Psychology Quarterly, 26(3), 189–201. https://doi.org/10.1037/a0025228
   PubMed Web of Science ®Google Scholar
• Hier, B. O., & Eckert, T. L. (2014). Evaluating elementary-aged students’ abilities to generalize and maintain fluency gains of a performance feedback writing intervention. School Psychology Quarterly, 29(4), 488–502. https://doi.org/10.1037/spq0000040
   PubMed Web of Science ®Google Scholar
• Ioannidis, J. P. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124
   PubMed Web of Science ®Google Scholar
• John, L. K., Loewenstein, G., & Prelec, D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23(5), 524–532. https://doi.org/10.1177/0956797611430953
   PubMed Web of Science ®Google Scholar
• Koenig, E. A., Eckert, T. L., & Hier, B. O. (2016). Using performance feedback and goal setting to improve elementary students’ writing fluency: A randomized controlled trial. School Psychology Review, 45(3), 275–295. https://doi.org/10.17105/SPR45-3.275-295
   Web of Science ®Google Scholar
• Kratochwill, T. R., & Stoiber, K. C. (2002). Evidence-based interventions in school psychology: Conceptual foundations of the Procedural and Coding Manual of Division 16 and the Society for the Study of School Psychology Task Force. School Psychology Quarterly, 17(4), 341–389. https://doi.org/10.1521/scpq.17.4.341.20872
   Web of Science ®Google Scholar
• Kratochwill, T. R., Stoiber, K. C., & Gutkin, T. (2000). Empirically supported interventions in school psychology: The role of negative results in outcome research. Psychology in the Schools, 37(5), 399–413. https://doi.org/10.1037/h0088780
   Web of Science ®Google Scholar
• Kühberge, A., Fritz, A., & Scherndl, T. (2014). Publication bias in psychology: A diagnosis based on the correlation between effect size and sample size. PloS One, 9(9), e105825. https://doi.org/10.1371/journal.pone.0105825
   PubMed Web of Science ®Google Scholar
• Lakens, D. (2015). On the challenges of drawing conclusions from p-values just below 0.05. PeerJ, 3, e1142. https://doi.org/10.7717/peerj.1142
   PubMed Web of Science ®Google Scholar
• Lilienfeld, S., Ammirati, R., & David, M. (2012). Distinguishing science from pseudosicnece in school psychology: Science and scientific thinking as safeguards against human error. Journal of School Psychology, 50(1), 7–36. https://doi.org/10.1016/j.jsp.2011.09.006
   PubMed Web of Science ®Google Scholar
• MacCoun, R. (2022). Hacking—A strategic analysis. In L. Jussim, S. Stevens, & J. Krosnick (Eds.), Research integrity: Best practices for the social and behavioral sciences (pp. 295–313). Oxford University Press.
   Google Scholar
• Macphee, F. L., Merrill, B. M., Altszuler, A. R., Ramos, M. C., Gnagy, E. M., Greiner, A. R., Coxe, S., Raiker, J. S., Coles, E., Burger, L., & Pelham, W. E. (2019). The effect of weighted vests and stability balls with and without psychostimulant medication on classroom outcomes for children with ADHD. School Psychology Review, 48(3), 276–289. https://doi.org/10.17105/SPR-2017-0151.V48-3
   Web of Science ®Google Scholar
• Maggin, D. (2022). Journal editor and associate editor perspectives on research reproducibility and open science. Remedial and Special Education, 43(3), 135–146. https://doi.org/10.1177/07419325211017294
   Web of Science ®Google Scholar
• Maggin, D., Robertson, R., & Cook, B. (2020). Introduction to the special series on results-blind peer review: An experimental analysis on editorial recommendations and manuscript evaluations. Behavioral Disorders, 45(4), 195–206. https://doi.org/10.1177/0198742920936619
   Web of Science ®Google Scholar
• Makel, M., & Plucker, J. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43(6), 304–316. https://doi.org/10.3102/0013189X14545513
   Web of Science ®Google Scholar
• Makel, M., Plucker, J., & Hegarty, B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7(6), 537–542. https://www.jstor.org/stable/44282603 https://doi.org/10.1177/1745691612460688
   Web of Science ®Google Scholar
• Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015). Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? The American Psychologist, 70(6), 487–498. https://doi.org/10.1037/a0039400
   PubMed Web of Science ®Google Scholar
• McGill, R., Ward, T., & Cavinez, G. (2018). On the evidential value of school psychology intervention research. The School Psychologist, 72, 48–57.
   Google Scholar
• McIntosh, K., Girvan, E. J., Fairbanks Falcon, S., McDaniel, S. C., Smolkowski, K., Bastable, E., Santiago-Rosario, M. R., Izzard, S., Austin, S. C., Nese, R. N. T., & Baldy, T. S. (2021). Equity-focused PBIS approach reduces racial inequities in school discipline: A randomized controlled trial. School Psychology, 36(6), 433–444. https://doi.org/10.1037/spq0000466
   Google Scholar
• McShane, B. B., Böckenholt, U., & Hansen, K. T. (2016). Adjusting for publication bias in meta-analysis: An evaluation of selection methods and some cautionary notes. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 11(5), 730–749. https://doi.org/10.1177/1745691616662243
   PubMedGoogle Scholar
• Mikami, A. Y., Gregory, A., Allen, J. P., Pianta, R. C., & Lun, J. (2011). Effects of a teacher professional development intervention on peer relationships in secondary classrooms. School Psychology Review, 40(3), 367–385. https://doi.org/10.1080/02796015.2011.12087704
   PubMed Web of Science ®Google Scholar
• Moreau, D., & Gamble, B. (2022). Conducting a meta-analysis in the age of open science: Tools, tips, and practical recommendations. Psychological Methods, 27(3), 426–432. https://doi.org/10.1037/met0000351
   PubMed Web of Science ®Google Scholar
• Myers, J., Hughes, E., Witzel, B., Anderson, R., & Owens, J. (2023). A Meta-analysis of mathematical interventions for increasing the word problem solving performance of upper elementary and secondary students with mathematics difficulties. Journal of Research on Educational Effectiveness, 16(1), 1–35. https://doi.org/10.1080/19345747.2022.2080131
   Web of Science ®Google Scholar
• National Association of School Psychologists. (2020). The professional Standards of National School Psychologists. https://www.nasponline.org/x55315.xml
   Google Scholar
• National Association of School Psychologists. (2024). About NASP. https://www.nasponline.org/utility/about-nasp
   Google Scholar
• Nelson, P. M., Klingbeil, D. A., & Van Norman, E. R. (2020). Ongoing practice opportunities as a method for maintaining reading intervention effects. School Psychology Review, 49(3), 212–221. https://doi.org/10.1080/2372966X.2020.1720802
   Google Scholar
• Noell, G. H., Volz, J. R., Henderson, M. Y., & Williams, K. L. (2017). Evaluating an integrated support model for increasing treatment plan implementation following consultation in schools. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, 32(4), 525–538. https://doi.org/10.1037/spq0000195
   PubMed Web of Science ®Google Scholar
• Nosek, B., & Lakens, D. (2014). Registered reports: A method to increase the credibility of published results. Social Psychology, 45(3), 137–141. https://doi.org/10.1027/1864-9335/a000192
   Web of Science ®Google Scholar
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science (New York, N.Y.), 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
   PubMed Web of Science ®Google Scholar
• Ostrov, J. M., Godleski, S. A., Kamper-DeMarco, K. E., Blakely-McClure, S. J., & Celenza, L. (2015). Replication and extension of the early childhood friendship project: Effects on physical and relational bullying. School Psychology Review, 44(4), 445–463. https://doi.org/10.17105/spr-15-0048.1
   Web of Science ®Google Scholar
• Parker, D. C., Stewart, L. H., Kaminski, R. A., Thomson, S., & Pulles, S. M. (2020). Outcomes of a vocabulary intervention implemented by community AmeriCorps members. School Psychology Review, 49(3), 321–332. https://doi.org/10.1080/2372966X.2020.1766342
   Web of Science ®Google Scholar
• Putwain, D. W., & Pescod, M. (2018). Is reducing uncertain control the key to successful test anxiety intervention for secondary school students? Findings from a randomized control trial. School Psychology Quarterly, 33(2), 283–292. https://doi.org/10.1037/spq0000228
   Google Scholar
• Reis, D., & Friese, M. (2022). The myriad forms of p-hacking. In W. O’Donohue, A. Masuda, & S. Lilienfeld (Eds.), Avoiding questionable research practices in applied psychology (pp. 101–121). Sprinter International Publishing.
   Google Scholar
• Roberson, A., Farmer, R., Shaw, S., Upton, S., & Zaheer, I. (2020). Opening doors to open science and scholarship for school psychology research, training, and practice, PsyArXiv Preprint. https://doi.org/10.31234/osf.io/su53p
   Google Scholar
• Rogers, L. S., & Ardoin, S. P. (2018). Investigating the benefit of adding listening passage preview to repeated readings. School Psychology Quarterly, 33(3), 439–447. https://doi.org/10.1037/spq0000227
   PubMed Web of Science ®Google Scholar
• Roth, R. A., Suldo, S. M., & Ferron, J. M. (2017). Improving middle school students’ subjective well-being: Efficacy of a multicomponent positive psychology intervention targeting small groups of youth. School Psychology Review, 46(1), 21–41. https://doi.org/10.17105/10.17105/SPR46-1.21-41
   Web of Science ®Google Scholar
• Santiago, C. D., Raviv, T., Ros, A. M., Brewer, S. K., Distel, L. M. L., Torres, S. A., Fuller, A. K., Lewis, K. M., Coyne, C. A., Cicchetti, C., & Langley, A. K. (2018). Implementing the bounce back trauma intervention in urban elementary schools: A real-world replication trial. School Psychology Quarterly, 33(1), 1–9. https://doi.org/10.1037/spq0000229
   PubMed Web of Science ®Google Scholar
• Shaw, S. (2021). Implementing evidence-based practices in school psychology: Excavation by de-implementing the disproved. Canadian Journal of School Psychology, 36(2), 91–97. https://doi.org/10.1177/08295735211000513
   Web of Science ®Google Scholar
• Shaw, S., & D’Intino, J. (2017). Evidence-based practices and the reproducibility crisis in psychology. Communiqué, 45(5), 21–22.
   Google Scholar
• Shaw, S., & Pecsi, S. (2021). When is the evidence sufficiently supportive of real-world application? Evidence-based practices, open science, clinical readiness level. Psychology in the Schools, 58(10), 1891–1901. https://doi.org/10.1002/pits.22537
   Web of Science ®Google Scholar
• Shih, W., Dean, M., Kretzmann, M., Locke, J., Senturk, D., Mandell, D. S., Smith, T., & Kasari, C. (2019). Remaking recess intervention for improving peer interactions at school for children with autism spectrum disorder: Multisite randomized trial. School Psychology Review, 48(2), 133–144. https://doi.org/10.17105/SPR-2017-0113.V48-2
   Web of Science ®Google Scholar
• Sibley, M. H., Morley, C., Rodriguez, L., Coxe, S. J., Evans, S. W., Morsink, S., & Torres, F. (2020). A peer-delivered intervention for high school students with impairing ADHD symptoms. School Psychology Review, 49(3), 275–290. https://doi.org/10.1080/2372966X.2020.1720803
   Web of Science ®Google Scholar
• Simmons, J., & Simonsohn, U. (2017). Power posing: P -Curving the evidence. Psychological Science, 28(5), 687–693. https://doi.org/10.1177/0956797616658563
   PubMed Web of Science ®Google Scholar
• Simmons, J., Nelson, L., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22(11), 1359–1366. https://doi.org/10.1177/0956797611417632
   PubMed Web of Science ®Google Scholar
• Simmons, J., Nelson, L., & Simonsohn, U. (2018). P-curve handles heterogeneity just fine. https://datacolada.org/67
   Google Scholar
• Simonsohn, U., Nelson, L., & Simmons, J. (2014). P-curve: A key to the file-drawer. Journal of Experimental Psychology. General, 143(2), 534–547. https://doi.org/10.1037/a0033242
   PubMed Web of Science ®Google Scholar
• Simonsohn, U., Nelson, L., & Simmons, J. (2019). P-curve won’t do your laundry, but it will distinguish replicable from non-replicable findings in observational research: Comment on Bruns & Ioannidis (2016). PloS One, 14(3), e0213454. https://doi.org/10.1371/journal.pone.0213454
   PubMed Web of Science ®Google Scholar
• Simonsohn, U., Nelson, L., Simmons, J. (2015). Official user-guide to the p-curve. https://www.p-curve.com/guide.pdf
   Google Scholar
• Simonsohn, U., Simmons, J., & Nelson, L. (2015). Better p-curves: Making p-curve analysis more robust to errors, fraud, and ambitious p-hacking: A reply to Ulrich and Miller (2015). Journal of Experimental Psychology: General, 144(6), 1146–1152. https://doi.org/10.1037/xge0000104
   PubMed Web of Science ®Google Scholar
• Soderberg, C., Errington, T., Schiavone, S., Bottesini, J., Thorn, F., Vazire, S., Esterling, K., & Nosek, B. (2021). Initial evidence of research quality of registered reports compared with the standard publishing model. Nature Human Behaviour, 5(8), 990–997. https://doi.org/10.1038/s41562-021-01142-4
   PubMed Web of Science ®Google Scholar
• Solomon, B. (2016). The implications of “estimating the reproducibility of psychology science” for school psychology research. Communiqué, 44(8), 9–10.
   Google Scholar
• Sterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995). Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The American Statistician, 49(1), 108–112. https://doi.org/10.2307/2684823
   Web of Science ®Google Scholar
• Sullivan, G., & Feinn, R. (2012). Using effect size—or why the p value is not enough. Journal of Graduate Medical Education, 4(3), 279–282. https://doi.org/10.4300/JGME-D-12-00156.1
   PubMedGoogle Scholar
• Taylor, K. L. H., Skinner, C. H., Ciancio, D. J., Daniels, S., Wright, S., Ryan, K., Ruddy, J., Moore, T., McCurdy, M., & Cihak, D. F. (2020). Effects of unfamiliar diverse names on elementary students’ passage comprehension. School Psychology, 35(3), 215–225. https://doi.org/10.1037/spq0000352
   Google Scholar
• Tejada-Gallardo, C., Blasco-Belled, A., Torrelles-Nadal, C., & Alsinet, C. (2020). Effects of school-based multicomponent positive psychology interventions on well-being and distress in adolescents: A systematic review and meta-analysis. Journal of Youth and Adolescence, 49(10), 1943–1960. https://doi.org/10.1007/s10964-020-01289-9
   PubMed Web of Science ®Google Scholar
• The CASEL Program Guide Review Team & Program Guide Advisory Panel. (2020). Evidence-based social and emotional learning programs: CASEL criteria updates and rationale. https://casel.org/11_casel-program-criteria-rationale/?view=true
   Google Scholar
• Tilly Iii, D. (2008). The evolution of school psychology to science-based practice: Problem solving and the three-tiered model. In A. Thomas & J. Grimes (Eds.). Best practices in school psychology V.2 (pp. 17–36). National Association of School Psychologists.
   Google Scholar
• Ulrich, R., & Miller, J. (2015). p-Hacking by post hoc selection with multiple opportunities: Detectability by skewness test? Comment on Simonsohn, Nelson, and Simmons (2014). Journal of Experimental Psychology: General, 144(6), 1137–1145. https://doi.org/10.1037/xge0000086
   PubMed Web of Science ®Google Scholar
• van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2016). Conducting meta-analyses based on p values: Reservations and recommendations for applying p-uniform and p-curve. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 11(5), 713–729. https://doi.org/10.1177/1745691616650874
   PubMedGoogle Scholar
• van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2015). Meta-analysis using effect size distributions of only statistically significant studies. Psychological Methods, 20(3), 293–309. https://doi.org/10.1037/met0000025
   PubMed Web of Science ®Google Scholar
• Van Herwegen, J., Costa, H. M., & Passolunghi, M. C. (2017). Improving approximate number sense abilities in preschoolers: PLUS games. School Psychology Quarterly, 32(4), 497–508. https://doi.org/10.1037/spq0000191
   PubMed Web of Science ®Google Scholar
• Wasserstein, R. L., & Lazar, N. A. (2016). The ASA statement on p-values: Context, process, and purpose. The American Statistician, 70(2), 129–133. https://doi.org/10.1080/00031305.2016.1154108
   Web of Science ®Google Scholar
• Watson, K. (2023). Meta-analysis of school-based mental health interventions [Unpublished Doctoral dissertation]. University of Colorado. ProQuest. http://www.proquest.com.hmlproxy.lib.csufresno.edu/en-us/products/dissertations/individuals.shtml
   Google Scholar
• Woznyj, H. M., Grenier, K., Ross, R., Banks, G. C., & Rogelberg, S. G. (2018). Results-blind review: A masked crusader for science. European Journal of Work and Organizational Psychology, 27(5), 561–576. https://doi.org/10.1080/1359432X.2018.1496081
   Web of Science ®Google Scholar
• Zaboski, B., Schrack, A., Joyce-Beaulieu, D., & MacInnes, J. (2017). Broadening our understanding of evidence-based practice: Effective and discredited interventions. Contemporary School Psychology, 21(3), 287–297. https://doi.org/10.1007/s40688-017-0131-4
   Google Scholar