Informant Discrepancies in Universal Screening as a Function of Student and Teacher Characteristics

REFERENCES

• Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child–adolescent behavioral and emotional problems: Implications of crossinformant correlations for situational specificity. Psychological Bulletin, 101, 213–232. https://doi.org/10.1037/0033-2909.101.2.213
   PubMed Web of Science ®Google Scholar
• Allen, A. N., Kilgus, S. P., Burns, M. K., & Hodgson, C. (2019). Surveillance of internalizing behaviors: A reliability and validity generalization study of universal screening evidence. School Mental Health, 11(2), 194–209. https://doi.org/10.1007/s12310-018-9290-3
   Web of Science ®Google Scholar
• American Academy of Pediatrics, American Academy of child and adolescent psychiatry, & children’s hospital association. (2021). AAP-AACAP-CHA declaration of a national emergency in child and adolescent mental health. Retrieved from https://www.aap.org/en/advocacy/child-and-adolescent-healthy-mental-development/aapaacap-cha-declaration-of-a-national-emergency-in-child-and-adolescent-mental-health/.
   Google Scholar
• Bitsko, R. H., Claussen, A. H., Lichstein, J., Black, L. I., Jones, S. E., Danielson, M. L., Hoenig, J. M., Davis Jack, S. P., Brody, D. J., Gyawali, S., Maenner, M. J., Warner, M., Holland, K. M., Perou, R., Crosby, A. E., Blumberg, S. J., Avenevoli, S., Kaminski, J. W., & Ghandour, R. M. (2022). Mental health surveillance among children – United States, 2013–2019. MMWR Supplements, 71(2), 1–42. https://doi.org/10.15585/mmwr.su7102a1
   PubMedGoogle Scholar
• Burns, J. R., & Rapee, R. M. (2022). Barriers to universal mental health screening in schools: The perspective of school psychologists. Journal of Applied School Psychology, 38(3), 223–240. https://doi.org/10.1080/15377903.2021.1941470
   Web of Science ®Google Scholar
• Cole, D. A., Martin, J. M., Jacquez, F. M., Tram, J. M., Zelkowitz, R., Nick, E. A., & Rights, J. D. (2017). Time-varying and time-invariant dimensions of depression in children and adolescents: Implications for cross-informant agreement. Journal of Abnormal Psychology, 126(5), 635–651. https://doi.org/10.1037/abn0000267
   PubMed Web of Science ®Google Scholar
• de Haan, A., Prinzie, P., Sentse, M., & Jongerling, J. (2018). Latent difference score modeling: A flexible approach for studying informant discrepancies. Psychological Assessment, 30(3), 358–369. https://doi.org/10.1037/pas0000480
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D. E., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900. https://doi.org/10.1037/a0038498
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Cook, C. R., Gresham, F. M., Makol, B. A., & Wang, M. (2019). Informant discrepancies in assessment of psychosocial functioning in school-based services and research: Review and directions for future research. Journal of School Psychology, 74, 74–89. https://doi.org/10.1016/j.jsp.2019.05.005
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Epkins, C. C., Asmundson, G. J. G., Augenstein, T. M., Becker, K. D., Becker, S. P., Bonadio, F. T., Borelli, J. L., Boyd, R. C., Bradshaw, C. P., Burns, G. L., Casale, G., Causadias, J. M., Cha, C. B., Chorpita, B. F., Cohen, J. R., Comer, J. S., Crowell, S. E., Dirks, M. A., … Youngstrom, E. A. (2023). Editorial statement about JCCAP’s 2023 special issue on informant discrepancies in youth mental health assessments: Observations, guidelines, and future directions grounded in 60 years of research. Journal of Clinical Child and Adolescent Psychology, 52(1), 147–158. https://doi.org/10.1080/15374416.2022.2158842
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., & Kazdin, A. E. (2004). Measuring informant discrepancies in clinical child research. Psychological Assessment, 16(3), 330–334. https://doi.org/10.1037/1040-3590.16.3.330
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483–509. https://doi.org/10.1037/0033-2909.131.4.483
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Lerner, M. D., Keeley, L. M., Weber, R. J., Drabick, D. A., Rabinowitz, J., & Goodman, K. L. (2019). Improving interpretability of subjective assessments about psychological phenomena: A review and cross-cultural meta-analysis. Review of General Psychology, 23(3), 293–319. https://doi.org/10.1177/1089268019837645
   Web of Science ®Google Scholar
• Dowdy, E., & Kim, E. (2012). Choosing informants when conducting a universal screening for behavioral and emotional risk. School Psychology Forum: Research in Practice, 6(4), 1–10.
   Google Scholar
• Fallon, L. M., Veiga, M. B., Susilo, A., Robinson‐Link, P., Berkman, T. S., Minami, T., & Kilgus, S. P. (2022). Exploring the relationship between teachers’ perceptions of cultural responsiveness, student risk, and classroom behavior. Psychology in the Schools, 59(10), 1948–1964. https://doi.org/10.1002/pits.22568
   Web of Science ®Google Scholar
• Grund, S., Lüdtke, O., & Robitzsch, A. (2018). Multiple imputation of missing data for multilevel models: Simulations and recommendations. Organizational Research Methods, 21(1), 111–149. https://doi.org/10.1177/1094428117703686
   Web of Science ®Google Scholar
• Grund, S., Lüdtke, O., & Robitzsch, A. (2019). Missing data in multilevel research. In S. E. Humphrey & J. M. LeBreton (Eds.), Handbook for multilevel theory, measurement, and analysis (pp. 365–386) American Psychological Association. https://doi.org/10.1037/0000115-017
   Google Scholar
• Illuminate Education. (2021). FastBridge social emotional behavior national norms report.
   Google Scholar
• Illuminate Education. (2022). FastBridge SAEBRS. https://www.illuminateed.com/products/fastbridge/social-emotional-behavior-assessment/saebrs/.
   Google Scholar
• Jones, S. E., Ethier, K. A., Hertz, M., DeGue, S., Le, V. D., Thornton, J., Lim, C., Dittus, P. J., & Geda, S. (2022). Mental health, suicidality, and connectedness among high school students during the COVID-19 pandemic–Adolescent Behaviors and Experiences Survey, United States, January–June 2021. Morbidity and Mortality Weekly Report, 71(3), 16–21. https://doi.org/10.15585/mmwr.su7103a3externalicon
   Google Scholar
• Kern, L., Mathur, S. R., Albrecht, S. F., Poland, S., Rozalski, M., & Skiba, R. J. (2017). The need for school-based mental health services and recommendations for implementation. School Mental Health, 9(3), 205–217. https://doi.org/10.1007/s12310-017-9216-5
   Web of Science ®Google Scholar
• Kilgus, S. P., Chafouleas, S. M., Riley-Tillman, T. C., & von der Embse, N. P. (2014). Social, academic, and emotional behavior risk screener (SAEBRS). Theodore J. Christ & Colleagues.
   Google Scholar
• Kilgus, S. P., Eklund, K., von der Embse, N. P., Taylor, C. N., & Sims, W. A. (2016). Psychometric defensibility of the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) Teacher Rating Scale and multiple gating procedure within elementary and middle school samples. Journal of School Psychology, 58, 21–39. https://doi.org/10.1016/j.jsp.2016.07.001
   PubMed Web of Science ®Google Scholar
• Kilgus, S. P., Eklund, K., von der Embse, N. P., Weist, M., Barber, A. J., Kaul, M., & Dodge, S. (2021). Structural validity and reliability of Social, Academic, and Emotional Behavior Risk Screener–Student Rating Scale scores: A replication study. Assessment for Effective Intervention, 46(4), 259–269. https://doi.org/10.1177/1534508420909527
   Web of Science ®Google Scholar
• Kilgus, S. P., Taylor, C. N., & von der Embse, N. P. (2018). Screening for behavioral risk: Identification of high risk cut scores within the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS). School Psychology Quarterly, 33(1), 155–159. https://doi.org/10.1037/spq0000230
   PubMed Web of Science ®Google Scholar
• Kilgus, S. P., & von der Embse, N. P. (2015). Social, Academic, and Emotional Behavior Risk Screener [Assessment instrument]. Fastbridge Learning.
   Google Scholar
• Kuhn, C., Aebi, M., Jakobsen, H., Banaschewski, T., Poustka, L., Grimmer, Y., Goodman, R., & Steinhausen, H.-C. (2017). Effective mental health screening in adolescents: Should we collect data from youth, parents or both? Child Psychiatry and Human Development, 48(3), 385–392. https://doi.org/10.1007/s10578-016-0665-0
   PubMed Web of Science ®Google Scholar
• Laird, R. D., & De Los Reyes, A. (2013). Testing informant discrepancies as predictors of early adolescent psychopathology: Why difference scores cannot tell you what you want to know and how polynomial regression may. Journal of Abnormal Child Psychology, 41(1), 1–14. https://doi.org/10.1007/s10802-012-9659-y
   PubMed Web of Science ®Google Scholar
• Lane, K. L., Oakes, W. P., Lusk, M. E., Cantwell, E. D., & Schatschneider, C. (2016). Screening for intensive intervention needs in secondary schools: Directions for the future. Journal of Emotional and Behavioral Disorders, 24(3), 159–172. https://doi.org/10.1177/1063426615618624
   Web of Science ®Google Scholar
• Lorah, J. (2018). Effect size measures for multilevel models: Definition, interpretation, and TIMSS example. Large-Scale Assessments in Education, 6(1), 8. https://doi.org/10.1186/s40536-018-0061-2
   Web of Science ®Google Scholar
• Margherio, S. M., Evans, S. W., & Owens, J. S. (2019). Universal screening in middle and high schools: Who falls through the cracks? School Psychology, 34(6), 591–602. https://doi.org/10.1037/spq0000337
   Google Scholar
• McLean, D., Eklund, K., Kilgus, S. P., & Burns, M. K. (2019). Influence of teacher burnout and self-efficacy on teacher-related variance in social-emotional and behavioral screening scores. School Psychology, 34(5), 503–511. https://doi.org/10.1037/spq0000304
   Google Scholar
• Moore, S. A., Dowdy, E., Fleury, I., DiStefano, C., & Greer, F. W. (2022). Comparing informants for mental health screening at the preschool level. School Psychology Review, 51(5), 589–608. https://doi.org/10.1080/2372966X.2020.1841546
   Google Scholar
• Murray, A. L., Nivette, A., Obsuth, I., Hafetz Mirman, J., Mirman, D., Ribeaud, D., & Eisner, M. (2022). Gender differences in cross-informant discrepancies in aggressive and prosocial behavior: A latent difference score analysis. Psychological Assessment, 34(5), 409–418. https://doi.org/10.1037/pas0001091
   Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (2023). Mplus (Version 8.9). Authors.
   Google Scholar
• National Association of School Psychologists. (2015). Mental and behavioral health services for children and adolescents [Position statement]. Author.
   Google Scholar
• National Center on Educational Outcomes & TIES Center. (2020). MTSS for all: Including students with the most significant cognitive disabilities [Research brief]. Authors.
   Google Scholar
• Nook, E. C. (2021). Emotion differentiation and youth mental health: Current understanding and open questions. Frontiers in Psychology, 12, 700298. https://doi.org/10.3389/fpsyg.2021.700298
   PubMed Web of Science ®Google Scholar
• Ohrt, J. H., Deaton, J. D., Linich, K., Guest, J. D., Wymer, B., & Sandonato, B. (2020). Teacher training in K–12 student mental health: A systematic review. Psychology in the Schools, 57(5), 833–846. https://doi.org/10.1002/pits.22356
   Web of Science ®Google Scholar
• Radez, J., Reardon, T., Creswell, C., Lawrence, P. J., Evdoka-Burton, G., & Waite, P. (2021). Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. European Child & Adolescent Psychiatry, 30(2), 183–211. https://doi.org/10.1007/s00787-019-01469-4
   PubMed Web of Science ®Google Scholar
• Redding, C. (2019). A teacher like me: A review of the effect of student–teacher racial/ethnic matching on teacher perceptions of students and student academic and behavioral outcomes. Review of Educational Research, 89(4), 499–535. https://doi.org/10.3102/0034654319853545
   Web of Science ®Google Scholar
• Smith-Millman, M. K., Flaspohler, P. D., Maras, M. A., Splett, J. W., Warmbold, K., Dinnen, H., & Luebbe, A. (2017). Differences between teacher reports on universal risk assessments. Advances in School Mental Health Promotion, 10(4), 235–249. https://doi.org/10.1080/1754730X.2017.1333914
   Web of Science ®Google Scholar
• Snijders, T. A. B. (2005). Power and sample size in multilevel linear models. In B. S. Everitt & D. C. Howell (Eds.), Encyclopedia of statistics in behavioral science (Vol. 3; pp. 1570–1573). Wiley.
   Google Scholar
• Splett, J. W., Garzona, M., Gibson, N., Wojtalewicz, D., Raborn, A., & Reinke, W. M. (2019). Teacher recognition, concern, and referral of children’s internalizing and externalizing behavior problems. School Mental Health, 11(2), 228–239. https://doi.org/10.1007/s12310-018-09303-z
   Web of Science ®Google Scholar
• Splett, J. W., Raborn, A., Brann, K., Smith-Millman, M. K., Halliday, C., & Weist, M. D. (2020). Between-teacher variance of students’ teacher-rated risk for emotional, behavioral, and adaptive functioning. Journal of School Psychology, 80, 37–53. https://doi.org/10.1016/j.jsp.2020.04.001
   PubMed Web of Science ®Google Scholar
• Splett, J. W., Smith-Millman, M., Raborn, A., Brann, K. L., Flaspohler, P. D., & Maras, M. A. (2018). Student, teacher, and classroom predictors of between-teacher variance of students’ teacher-rated behavior. School Psychology Quarterly, 33(3), 460–468. https://doi.org/10.1037/spq0000241
   PubMed Web of Science ®Google Scholar
• Tanner, N., Eklund, K., Kilgus, S. P., & Johnson, A. H. (2018). Generalizability of universal screening measures for behavioral and emotional risk. School Psychology Review, 47(1), 3–17. https://doi.org/10.17105/SPR-2017-0044.V47-1
   Web of Science ®Google Scholar
• Thomas, D. R., & Zumbo, B. D. (2012). Difference scores from the point of view of reliability and repeated-measures ANOVA: In defense of difference scores for data analysis. Educational and Psychological Measurement, 72(1), 37–43. https://doi.org/10.1177/0013164411409929
   Web of Science ®Google Scholar
• Valiente, C., Swanson, J., DeLay, D., Fraser, A. M., & Parker, J. H. (2020). Emotion-related socialization in the classroom: Considering the roles of teachers, peers, and the classroom context. Developmental Psychology, 56(3), 578–594. https://doi.org/10.1037/dev0000863
   PubMed Web of Science ®Google Scholar
• Villodas, M. T., Pfiffner, L. J., Moses, J. O., Hartung, C., & McBurnett, K. (2019). The roles of student gender, race, and psychopathology in teachers’ identification of students for services. Children and Youth Services Review, 107, 104468. https://doi.org/10.1016/j.childyouth.2019.104468
   Web of Science ®Google Scholar
• von der Embse, N. P., Kilgus, S. P., Iaccarino, S., & Levi-Nielsen, S. (2017). Screening for student mental health risk: Diagnostic accuracy, measurement invariance, and predictive validity of the Social, Academic, and Emotional Behavior Risk Screener-Student Rating Scale (SAEBRS-SRS). School Mental Health, 9(3), 273–283. https://doi.org/10.1007/s12310-017-9214-7
   Web of Science ®Google Scholar
• von der Embse, N., Kim, E., Jenkins, A., Sanchez, A., Kilgus, S. P., & Eklund, K. (2021). Profiles of rater dis/agreement within universal screening in predicting distal outcomes. Journal of Psychopathology and Behavioral Assessment, 43(3), 632–645. https://doi.org/10.1007/s10862-021-09869-0
   Web of Science ®Google Scholar
• von der Embse, N., Kim, E. S., Kilgus, S., Dedrick, R., & Sanchez, A. (2019). Multi-informant universal screening: Evaluation of rater, item, and construct variance using a trifactor model. Journal of School Psychology, 77, 52–66. https://doi.org/10.1016/j.jsp.2019.09.005
   PubMed Web of Science ®Google Scholar
• von der Embse, N. P., Pendergast, L. L., Kilgus, S. P., & Eklund, K. R. (2016). Evaluating the applied use of a mental health screener: Structural validity of the Social, Academic, and Emotional Behavior Risk Screener. Psychological Assessment, 28(10), 1265–1275. https://doi.org/10.1037/pas0000253
   PubMed Web of Science ®Google Scholar
• Weeks, M., Ploubidis, G. B., Cairney, J., Wild, T. C., Naicker, K., & Colman, I. (2016). Developmental pathways linking childhood and adolescent internalizing, externalizing, academic competence, and adolescent depression. Journal of Adolescence, 51(1), 30–40. https://doi.org/10.1016/j.adolescence.2016.05.009
   PubMedGoogle Scholar
• Wood, B. J., & Ellis, F. (2022). Universal mental health screening practices in Midwestern schools: A window of opportunity for school psychologist leadership and role expansion? Contemporary School Psychology, Advance online publication. https://doi.org/10.1007/s40688-022-00430-8
   Google Scholar
• Zakszeski, B. N., Rutherford, L., Heidelburg, K., & Thomas, L. (2021). In pursuit of equity: Discipline disproportionality and SWPBIS implementation in urban schools. School Psychology, 36(2), 122–130. https://doi.org/10.1037/spq0000428
   Google Scholar