The Operations Triad Model and Youth Mental Health Assessments: Catalyzing a Paradigm Shift in Measurement Validation

References

• Achenbach, T. M. (2020). Bottom-up and top-down paradigms for psychopathology: A half century odyssey. Annual Review of Clinical Psychology, 16, 1–24. https://doi.org/10.1146/annurev-clinpsy-071119-115831
   PubMed Web of Science ®Google Scholar
• Achenbach, T. M., Krukowski, R. A., Dumenci, L., & Ivanova, M. Y. (2005). Assessment of adult psychopathology: Meta-analyses and implications of cross-informant correlations. Psychological Bulletin, 131(3), 361–382. https://doi.org/10.1037/0033-2909.131.3.361
   PubMed Web of Science ®Google Scholar
• Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213–232. https://doi.org/10.1037/0033-2909.101.2.213
   PubMed Web of Science ®Google Scholar
• Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. University of Vermont Research Center for Children, Youth, & Families.
   Google Scholar
• Al Ghriwati, N., Winter, M. A., Greenlee, J. L., & Thompson, E. L. (2018). Discrepancies between parent and self-reports of adolescent psychosocial symptoms: Associations with family conflict and asthma outcomes. Journal of Family Psychology, 32(7), 992–997. https://doi.org/10.1037/fam0000459
   PubMed Web of Science ®Google Scholar
• Alfano, C. A., & Beidel, D. C. (2011). Social anxiety in adolescents and young adults: Translating developmental science into practice. American Psychological Association.
   Google Scholar
• Alvarez, I., Herrero, M., Martínez‐Pampliega, A., & Escudero, V. (2021). Measuring perceptions of the therapeutic alliance in individual, family, and group therapy from a systemic perspective: Structural validity of the SOFTA‐s. Family Process, 60(2), 302–315. https://doi.org/10.1111/famp.12565
   PubMed Web of Science ®Google Scholar
• American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed.).
   Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.).
   Google Scholar
• Atkins, M. S., Cappella, E., Shernoff, E. S., Mehta, T. G., & Gustafson, E. L. (2017). Schooling and children’s mental health: Realigning resources to reduce disparities and advance public health. Annual Review of Clinical Psychology, 13, 123–147. https://doi.org/10.1146/annurev-clinpsy-032816-045234
   PubMed Web of Science ®Google Scholar
• August, G. J., Piehler, T. F., & Bloomquist, M. L. (2016). Being “SMART” about adolescent conduct problems prevention: Executing a SMART pilot study in a juvenile diversion agency. Journal of Clinical Child and Adolescent Psychology, 45(4), 495–509. https://doi.org/10.1080/15374416.2014.945212
   PubMed Web of Science ®Google Scholar
• Bandura, A. (1977). Social learning theory. Prentice-Hall.
   Google Scholar
• Bartholomew, D. J., Steele, F., Moustaki, I., & Galbraith, J. I. (2002). The analysis and interpretation of multivariate data for social scientists. Chapman & Hall/CRC.
   Google Scholar
• Bauer, D. J., Howard, A. L., Baldasaro, R. E., Curran, P. J., Hussong, A. M., Chassin, L., & Zucker, R. A. (2013). A trifactor model for integrating ratings across multiple informants. Psychological Methods, 18(4), 475–493. https://doi.org/10.1037/a0032475
   PubMed Web of Science ®Google Scholar
• Beck, A. T. (1993). Cognitive therapy: Past, present, and future. Journal of Consulting and Clinical Psychology, 61(2), 194–198. https://doi.org/10.1037/0022-006X.61.2.194
   PubMed Web of Science ®Google Scholar
• Becker-Haimes, E. M., Jensen-Doss, A., Birmaher, B., Kendall, P. C., & Ginsburg, G. S. (2018). Parent–youth informant disagreement: Implications for youth anxiety treatment. Clinical Child Psychology and Psychiatry, 23(1), 42–56. https://doi.org/10.1177/1359104516689586
   PubMed Web of Science ®Google Scholar
• Borsboom, D. (2005). Measuring the mind. Cambridge University Press.
   Google Scholar
• Boutron, I., Dutton, S., Ravaud, P., & Altman, D. G. (2010). Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA, 303(20), 2058–2064. https://doi.org/10.1001/jama.2010.651
   PubMed Web of Science ®Google Scholar
• Brase, G. L. (2014). Behavioral science integration: A practical framework of multi-level converging evidence for behavioral science theories. New Ideas in Psychology, 33, 8–20. https://doi.org/10.1016/j.newideapsych.2013.11.001
   Web of Science ®Google Scholar
• Bronfenbrenner, U. (1979). The ecology of human development. Harvard University Press.
   Google Scholar
• Bruno, N., & Paolo Battaglini, P. (2008). Integrating perception and action through cognitive neuropsychology (broadly conceived). Cognitive Neuropsychology, 25(7–8), 879–890. https://doi.org/10.1080/02643290802519591
   Web of Science ®Google Scholar
• Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
   PubMed Web of Science ®Google Scholar
• Cannon, C. J., Makol, B. A., Keeley, L. M., Qasmieh, N., Okuno, H., Racz, S. J., & De Los Reyes, A. (2020). A paradigm for understanding adolescent social anxiety with unfamiliar peers: Conceptual foundations and directions for future research. Clinical Child and Family Psychology Review, 23(3), 338–364. https://doi.org/10.1007/s10567-020-00314-4
   PubMed Web of Science ®Google Scholar
• Charamut, N. R., Racz, S. J., Wang, M., & De Los Reyes, A. (2022). Integrating multi-informant reports of youth mental health: A construct validation test of Kraemer and Colleagues’ (2003) satellite model. Frontiers in Psychology, 13, 911629. https://doi.org/10.3389/fpsyg.2022.911629
   Google Scholar
• Cicchetti, D. (1984). The emergence of developmental psychopathology. Child Development, 55(1), 1–7. https://doi.org/10.2307/1129830
   PubMed Web of Science ®Google Scholar
• Clark, D. A., Listro, C. J., Lo, S. L., Durbin, C. E., Donnellan, M. B., & Neppl, T. K. (2016). Measurement invariance and child temperament: An evaluation of sex and informant differences on the child behavior questionnaire. Psychological Assessment, 28(12), 1646–1662. https://doi.org/10.1037/pas0000299
   PubMed Web of Science ®Google Scholar
• Clarkson, T., Kang, E., Capriola-Hall, N., Lerner, M. D., Jarcho, J., & Prinstein, M. J. (2020). Meta-analysis of the RDoC social processing domain across units of analysis in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 49(3), 297–321. https://doi.org/10.1080/15374416.2019.1678167
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.
   Google Scholar
• Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Routledge.
   Google Scholar
• Crick, N. R., & Dodge, K. A. (1994). A review and reformulation of social information- processing mechanisms in children’s social adjustment. Psychological Bulletin, 115(1), 74–101. https://doi.org/10.1037/0033-2909.115.1.74
   Web of Science ®Google Scholar
• Cuijpers, P., Karyotaki, E., Eckshtain, D., Ng, M. Y., Corteselli, K. A., Noma, H., Quero, S., & Weisz, J. R. (2020). Psychotherapy for depression across different age groups: A systematic review and meta-analysis. JAMA Psychiatry, 77(7), 694–702. http://doi.org/10.1001/jamapsychiatry.2020.0164
   PubMed Web of Science ®Google Scholar
• Curran, P. J., Georgeson, A. R., Bauer, D. J., & Hussong, A. M. (2021). Psychometric models for scoring multiple reporter assessments: Applications to integrative data analysis in prevention science and beyond. International Journal of Behavioral Development, 45(1), 40–50. https://doi.org/10.1177/0165025419896620
   PubMed Web of Science ®Google Scholar
• Darling, N., & Steinberg, L. (1993). Parenting style as context: An integrative model. Psychological Bulletin, 113(3), 487–496. https://doi.org/10.1037/0033-2909.113.3.487
   Web of Science ®Google Scholar
• De Los Reyes, A. (2011). More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child and Adolescent Psychology, 40(1), 1–9. https://doi.org/10.1080/15374416.2011.533405
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A. (2021). (Second) inaugural editorial: How the journal of clinical child and adolescent psychology can nurture team science approaches to addressing burning questions about mental health. Journal of Clinical Child and Adolescent Psychology, 50(1), 1–11. https://doi.org/10.1080/15374416.2020.1858839
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900. https://doi.org/10.1037/a0038498
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Bunnell, B. E., & Beidel, D. C. (2013b). Informant discrepancies in adult social anxiety disorder assessments: Links with contextual variations in observed behavior. Journal of Abnormal Psychology, 122(2), 376–386. https://doi.org/10.1037/a0031150
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Cook, C. R., Gresham, F. M., Makol, B. A., & Wang, M. (2019c). Informant discrepancies in assessments of psychosocial functioning in school-based services and research: Review and directions for future research. Journal of School Psychology, 74, 74–89. https://doi.org/10.1016/j.jsp.2019.05.005
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Cook, C. R., Sullivan, M., Morrell, N., Gresham, F. M., Wang, M., Gresham, F. M., Makol, B. M., Keeley, L. M., & Qasmieh, N. (2022c). The Work and Social Adjustment Scale for Youth: Psychometric properties of the teacher version and evidence of contextual variability in psychosocial impairments. Psychological Assessment, 34(8), 777–790. https://doi.org/10.1037/pas0001139
   Google Scholar
• De Los Reyes, A., Drabick, D. A. G., Makol, B. A., & Jakubovic, R. (2020). Introduction to the special section: The research domain criteria’s units of analysis and cross-unit correspondence in youth mental health research. Journal of Clinical Child and Adolescent Psychology, 49(3), 279–296. https://doi.org/10.1080/15374416.2020.1738238
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Henry, D. B., Tolan, P. H., & Wakschlag, L. S. (2009). Linking informant discrepancies to observed variations in young children’s disruptive behavior. Journal of Abnormal Child Psychology, 37(5), 637–652. https://doi.org/10.1007/s10802-009-9307-3
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Kundey, S. M. A., & Wang, M. (2011). The end of the primary outcome measure: A research agenda for constructing its replacement. Clinical Psychology Review, 31(5), 829–838. https://doi.org/10.1016/j.cpr.2011.03.011
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Lerner, M. D., Keeley, L. M., Weber, R., Drabick, D. A. G., Rabinowitz, J., & Goodman, K. L. (2019a). Improving interpretability of subjective assessments about psychological phenomena: A review and cross-cultural meta-analysis. Review of General Psychology, 23(3), 293–319. https://doi.org/10.1177/108926801983764
   Web of Science ®Google Scholar
• De Los Reyes, A., Lerner, M. D., Thomas, S. A., Daruwala, S. E., & Goepel, K. A. (2013c). Discrepancies between parent and adolescent beliefs about daily life topics and performance on an emotion recognition task. Journal of Abnormal Child Psychology, 41(6), 971–982. https://doi.org/10.1007/s10802-013-9733-0
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., & Makol, B. A. (2022). Informant reports in clinical assessment. In G. Asmundson (Ed.), Comprehensive clinical psychology (2nd ed., Vol. 4, pp. 105–122). Elsevier. https://doi.org/10.1016/B978-0-12-818697–8.00113-8
   Google Scholar
• De Los Reyes, A., & Makol, B. A. (in press). Interpreting convergences and divergences in multi- informant, multi-method assessment. In J. Mihura (Ed.), The Oxford handbook of personality and psychopathology assessment (2nd ed.). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780190092689.013.33
   Google Scholar
• De Los Reyes, A., & Ohannessian, C. M. (2016). Introduction to the special issue: Discrepancies in adolescent-parent perceptions of the family and adolescent adjustment. Journal of Youth and Adolescence, 45(10), 1957–1972. https://doi.org/10.1007/s10964-016-0533-z
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Ohannessian, C. M., & Racz, S. J. (2019b). Discrepancies between adolescent and parent reports about family relationships. Child Development Perspectives, 13(1), 53–58. https://doi.org/10.1111/cdep.12306
   Web of Science ®Google Scholar
• De Los Reyes, A., Talbott, E., Power, T., Michel, J., Cook, C. R., Racz, S. J., & Fitzpatrick, O. (2022a). The needs-to-goals gap: How informant discrepancies in youth mental health assessments impact service delivery. Clinical Psychology Review, 92, 102114. https://doi.org/10.1016/j.cpr.2021.102114
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. A. (2013a). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9, 123–149. https://doi.org/10.1146/annurev-clinpsy-050212-185617
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Tyrell, F. A., Watts, A. L., & Asmundson, G. J. G. (2022b). Conceptual, methodological, and measurement factors that disqualify use of measurement invariance techniques to detect informant discrepancies in youth mental health assessments. Frontiers in Psychology, 13, 931296. https://doi.org/10.3389/fpsyg.2022.931296
   Google Scholar
• Deros, D. E., Racz, S. J., Lipton, M. F., Augenstein, T. M., Karp, J. N., Keeley, L. M., Qasmieh, N., Grewe, B. I., Aldao, A., & De Los Reyes, A. (2018). Multi-informant assessments of adolescent social anxiety: Adding clarity by leveraging reports from unfamiliar peer confederates. Behavior Therapy, 49(1), 84–98. https://doi.org/10.1016/j.beth.2017.05.001
   PubMed Web of Science ®Google Scholar
• Duhig, A. M., Renk, K., Epstein, M. K., & Phares, V. (2000). Interparental agreement on internalizing, externalizing, and total behavior problems: A meta-analysis. Clinical Psychology: Science and Practice, 7(4), 435–453. https://doi.org/10.1093/clipsy.7.4.435
   Web of Science ®Google Scholar
• Dunning, D., Heath, C., & Suls, J. M. (2004). Flawed self-assessment: Implications for health, education, and the workplace. Psychological Science in the Public Interest, 5(3), 69–106. https://doi.org/10.1111/j.1529-1006.2004.00018.x
   PubMedGoogle Scholar
• Dunteman, G. H. (1989). Principal components analysis (No. 69). Sage.
   Google Scholar
• Eckshtain, D., Kuppens, S., Ugueto, A., Ng, M. Y., Vaughn-Coaxum, R., Corteselli, K., & Weisz, J. R. (2020). Meta-analysis: 13-year follow-up of psychotherapy effects on youth depression. Journal of the American Academy of Child and Adolescent Psychiatry, 59(1), 45–63. https://doi.org/10.1016/j.jaac.2019.04.002
   PubMed Web of Science ®Google Scholar
• Edgeworth, F. Y. (1888). The statistics of examinations. Journal of the Royal Statistical Society, 51(3), 598–635. https://www.jstor.org/stable/2339898
   Google Scholar
• Edwards, J. R. (1994). The study of congruence in organizational behavior research: Critique and a proposed alternative. Organizational Behavior and Human Decision Processes, 58(1), 51–100. https://doi.org/10.1006/obhd.1994.1029
   Web of Science ®Google Scholar
• Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., & Lischetzke, T. (2008). Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13(3), 230–253. https://doi.org/10.1037/a0013219
   PubMed Web of Science ®Google Scholar
• Fergusson, D. M., Boden, J. M., & Horwood, L. J. (2009). Situational and generalized conduct problems and later life outcomes: Evidence from a New Zealand birth cohort. Journal of Child Psychology and Psychiatry, 50(9), 1084–1092. https://doi.org/10.1111/j.1469-7610.2009.02070.x
   PubMed Web of Science ®Google Scholar
• Festa, J. E., Producer, Sinclair, N., Producer, Monroe, M., Producer, & Marshall, F., Director. (2020). The Bee Gees: How can you mend a broken heart. Home Box Office. Documentary.
   Google Scholar
• Fisher, E., Bromberg, M. H., Tai, G., & Palermo, T. M. (2017). Adolescent and parent treatment goals in an internet-delivered chronic pain self-management program: Does agreement of treatment goals matter? Journal of Pediatric Psychology, 42(6), 657–666. https://doi.org/10.1093/jpepsy/jsw098
   PubMed Web of Science ®Google Scholar
• Fiske, D. W., & Campbell, D. T. (1992). Citations do not solve problems. Psychological Bulletin, 112(3), 393–395. https://doi.org/10.1037/0033-2909.112.3.393
   Web of Science ®Google Scholar
• Florean, I. S., Dobrean, A., Balazsi, R., Roșan, A., Păsărelu, C. R., Predescu, E., & Rad, F. (2022). Measurement invariance of Alabama parenting questionnaire across age, gender, clinical status, and informant. Assessment, 107319112110681. https://doi.org/10.1177/10731911211068178
   Google Scholar
• Follet, L., Okuno, H., & De Los Reyes, A. (2022). Assessing peer-related impairments linked to adolescent social anxiety: Strategic selection of informants optimizes prediction of clinically relevant domains. Behavior Therapy. Advance online publication. https://doi.org/10.1016/j.beth.2022.06.010
   Google Scholar
• Garb, H. N. (2003). Incremental validity and the assessment of psychopathology in adults. Psychological Assessment, 15(4), 508–520. http://dx.doi.org/10.1037/1040-3590.15.4.508
   PubMed Web of Science ®Google Scholar
• Garner, W. R., Hake, H. W., & Eriksen, C. W. (1956). Operationism and the concept of perception. Psychological Review, 63(3), 149–159. https://doi.org/10.1037/h0042992
   PubMed Web of Science ®Google Scholar
• Geiser, C., Eid, M., West, S. G., Lischetzke, T., & Nussbeck, F. W. (2012). A comparison of method effects in two confirmatory factor models for structurally different methods. Structural Equation Modeling, 19(3), 409–436. https://doi.org/10.1080/10705511.2012.687658
   Web of Science ®Google Scholar
• Glenn, L. E., Keeley, L. M., Szollos, S., Okuno, H., Wang, X., Rausch, E., Deros, D. E., Karp, J. N., Qasmieh, N., Makol, B. A., Augenstein, T. M., Lipton, M. F., Racz, S. J., Scharfstein, L., Beidel, D. C., & De Los Reyes, A. (2019). Trained observers’ ratings of adolescents’ social anxiety and social skills within controlled, cross-contextual social interactions with unfamiliar peer confederates. Journal of Psychopathology and Behavioral Assessment, 41(1), 1–15. https://doi.org/10.1007/s10862-018-9676-4
   Web of Science ®Google Scholar
• Goldenweiser, A. A. (1912). Folk-psychology. Psychological Bulletin, 9(10), 373–380. https://doi.org/10.1037/h0074365
   Google Scholar
• Goodman, S. H., Rouse, M. H., Connell, A. M., Broth, M. R., Hall, C. M., & Heyward, D. (2011). Maternal depression and child psychopathology: A meta-analytic review. Clinical Child and Family Psychology Review, 14(1), 1–27. https://doi.org/10.1007/s10567-010-0080-1
   PubMed Web of Science ®Google Scholar
• Grace, R. C. (2001). On the failure of operationism. Theory and Psychology, 11(1), 5–33. https://doi.org/10.1177/0959354301111001
   Web of Science ®Google Scholar
• Haeberlin, H. K. (1916). The theoretical foundations of Wundt’s folk-psychology. Psychological Review, 23(4), 279–302. https://doi.org/10.1037/h0075449
   Google Scholar
• Hawley, K. M., & Weisz, J. R. (2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71(1), 62–70. https://doi.org/10.1037/0022-006X.71.1.62
   PubMed Web of Science ®Google Scholar
• Hempel, C. G. (1966). Philosophy of natural science. Prentice-Hall.
   Google Scholar
• Highhouse, S. (2009). Designing experiments that generalize. Organizational Research Methods, 12(3), 554–566. https://doi.org/10.1177/1094428107300396
   Web of Science ®Google Scholar
• Hoffman, L. J., & Chu, B. C. (2015). Target problem (mis) matching: Predictors and consequences of parent–youth agreement in a sample of anxious youth. Journal of Anxiety Disorders, 31, 11–19. https://doi.org/10.1016/j.janxdis.2014.12.015
   PubMed Web of Science ®Google Scholar
• Horwitz, E. H., Schoevers, R. A., Ketelaars, C. E. J., Kan, C. C., Van Lammeren, A. M. D. N., Meesters, Y., Spek, A. A., Wouters, S., Teunisse, J. P., Cuppen, L., Bartels, A. A. J., Schuringa, E., Moorlag, H., Raven, D., Wiersma, D., Minderaa, R. B., & Hartman, C. A. (2016). Clinical assessment of ASD in adults using self- and other-report: Psychometric properties and validity of the Adult Social Behavior Questionnaire (ASBQ). Research in Autism Spectrum Disorders, 24, 17–28. https://doi.org/10.1016/j.rasd.2016.01.003
   Web of Science ®Google Scholar
• Howe, G. W., Dagne, G. A., Brown, C. H., Brincks, A. M., Beardslee, W., Perrino, T., & Pantin, H. (2019). Evaluating construct equivalence of youth depression measures across multiple measures and multiple studies. Psychological Assessment, 31(9), 1154–1167. https://doi.org/10.1037/pas0000737
   PubMed Web of Science ®Google Scholar
• Hunsley, J., & Lee, C. M. (2014). Introduction to clinical psychology (2nd ed.). Wiley.
   Google Scholar
• Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3, 29–51. https://doi.org/10.1146/annurev.clinpsy.3.022806.091419
   PubMed Web of Science ®Google Scholar
• Hunsley, J., & Mash, E. J., (Eds.). (2018). A guide to assessments that work (2nd ed.). Oxford University Press.
   Google Scholar
• Jungersen, C. M., & Lonigan, C. J. (2021). Do parent and teacher ratings of ADHD reflect the same constructs? A measurement invariance analysis. Journal of Psychopathology and Behavioral Assessment, 43(4), 778–792. https://doi.org/10.1007/s10862-021-09874-3
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2013). Behavior modification in applied settings (7th ed.). Waveland Press.
   Google Scholar
• Kazdin, A. E. (2017). Research design in clinical psychology (5th ed.). Pearson.
   Google Scholar
• Kazdin, A. E., & Rotella, C. (2009). The Kazdin method for parenting the defiant child: With no pills, no therapy, no contest of wills. Houghton Mifflin Harcourt.
   Google Scholar
• Kazdin, A. E., & Wassell, G. (2000). Therapeutic changes in children, parents, and families resulting from treatment of children with conduct problems. Journal of the American Academy of Child and Adolescent Psychiatry, 39(4), 414–420. https://doi.org/10.1097/00004583-200004000-00009
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E., & Whitley, M. K. (2003). Treatment of parental stress to enhance therapeutic change among children referred for aggressive and antisocial behavior. Journal of Consulting and Clinical Psychology, 71(3), 504–515. https://doi.org/10.1037/0022-006X.71.3.504
   PubMed Web of Science ®Google Scholar
• Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). Guilford Press.
   Google Scholar
• Knobe, J., & Mendlow, G. S. (2004). The good, the bad and the blameworthy: Understanding the role of evaluative reasoning in folk psychology. Journal of Theoretical and Philosophical Psychology, 24(2), 252–258. https://doi.org/10.1037/h0091246
   Google Scholar
• Konold, T., & Cornell, D. (2015). Multilevel multitrait–multimethod latent analysis of structurally different and interchangeable raters of school climate. Psychological Assessment, 27(3), 1097–1109. https://doi.org/10.1037/pas0000098
   PubMed Web of Science ®Google Scholar
• Konold, T., & Sanders, E. A. (2020). The nature of rater effects and differences in multilevel MTMM latent variable models. Measurement: Interdisciplinary Research and Perspectives, 18(4), 177–195. https://doi.org/10.1080/15366367.2020.1746897
   Web of Science ®Google Scholar
• Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566–1577. https://doi.org/10.1176/appi.ajp.160.9.1566
   PubMed Web of Science ®Google Scholar
• Krause, N., Liang, J., Bennett, J., Kobayashi, E., Akiyama, H., & Fukaya, T. (2010). A descriptive analysis of religious involvement among older adults in Japan. Aging and Society, 30(4), 671–696. https://doi.org/10.1017/S0144686X09990766
   Google Scholar
• Laird, R. D. (2020). Analytical challenges of testing hypotheses of agreement and discrepancy: Comment on Campione-Barr, Lindell, and Giron (2020). Developmental Psychology, 56(5), 970–977. https://doi.org/10.1037/dev0000763
   PubMed Web of Science ®Google Scholar
• Laird, R. D., & De Los Reyes, A. (2013). Testing informant discrepancies as predictors of early adolescent psychopathology: Why difference scores cannot tell you what you want to know and how polynomial regression may. Journal of Abnormal Child Psychology, 41(1), 1–14. https://doi.org/10.1007/s10802-012-9659-y
   PubMed Web of Science ®Google Scholar
• Laird, R. D., & Weems, C. F. (2011). The equivalence of regression models using difference scores and models using separate scores for each informant: Implications for the study of informant discrepancies. Psychological Assessment, 23(2), 388–397. https://doi.org/10.1037/a0021926
   PubMed Web of Science ®Google Scholar
• Lakind, D., Bradley, W. J., Patel, A., Chorpita, B. F., & Becker, K. D. (2022). A multidimensional examination of the measurement of treatment engagement: Implications for children’s mental health services and research. Journal of Clinical Child and Adolescent Psychology, 51(4), 453–468. https://doi.org/10.1080/15374416.2021.1941057
   PubMed Web of Science ®Google Scholar
• Lapouse, R., & Monk, M. A. (1958). An epidemiologic study of behavior characteristics in children. American Journal of Public Health, 48(9), 1134–1144. https://doi.org/10.2105/AJPH.48.9.1134
   Web of Science ®Google Scholar
• Lei, H., Nahum-Shani, I., Lynch, K., Oslin, D., & Murphy, S. A. (2012). A “SMART” design for building individualized treatment sequences. Annual Review of Clinical Psychology, 8, 21–48. https://doi.org/10.1146/annurev-clinpsy-032511-143152
   PubMed Web of Science ®Google Scholar
• Lerner, M. D., De Los Reyes, A., Drabick, D. G., Gerber, A. H., & Gadow, K. D. (2017). Informant discrepancy defines discrete, clinically useful autism spectrum disorder subgroups. Journal of Child Psychology and Psychiatry, 58(7), 829–839. https://doi.org/10.1111/jcpp.12730
   PubMed Web of Science ®Google Scholar
• Levy, P. (1969). Platonic true scores and rating scales: A case of uncorrelated definitions. Psychological Bulletin, 71(4), 276–277. https://doi.org/10.1037/h0026855
   PubMed Web of Science ®Google Scholar
• Liu, J., Dong, F., Lee, C. M., Reyes, J., & Ivanova, M. (2021). The application of the adult self- report and the adult behavior checklist form to Chinese adults: Syndrome structure, inter- informant agreement, and cultural comparison. International Journal of Environmental Research and Public Health, 18(12), 6352. https://doi.org/10.3390/ijerph18126352
   PubMed Web of Science ®Google Scholar
• LoBue, V., Reider, L. B., Kim, E., Burris, J. L., Oleas, D. S., Buss, K. A., Pérez-Edgar, K., & Field, A. P. (2020). The importance of using multiple outcome measures in infant research. Infancy, 25(4), 420–437. https://doi.org/10.1111/infa.12339
   PubMed Web of Science ®Google Scholar
• Loeber, R., Green, S. M., & Lahey, B. B. (1990). Mental health professionals’ perception of the utility of children, mothers, and teachers as informants on childhood psychopathology. Journal of Clinical Child Psychology, 19(2), 136–143. https://doi.org/10.1207/s15374424jccp1902_5
   Web of Science ®Google Scholar
• Makol, B. A., De Los Reyes, A., Garrido, E., Harlaar, N., & Taussig, H. (2021). Assessing the mental health of maltreated youth with child welfare involvement using multi-informant reports. Child Psychiatry and Human Development, 52(1), 49–62. https://doi.org/10.1007/s10578-020-00985-8
   PubMed Web of Science ®Google Scholar
• Makol, B. A., De Los Reyes, A., Ostrander, R., & Reynolds, E. K. (2019). Parent-youth divergence (and convergence) in reports of youth internalizing problems in psychiatric inpatient care. Journal of Abnormal Child Psychology, 47(10), 1677–1689. https://doi.org/10.1007/s10802-019-00540-7
   PubMed Web of Science ®Google Scholar
• Makol, B. A., Youngstrom, E. A., Racz, S. J., Qasmieh, N., Glenn, L. E., & De Los Reyes, A. (2020). Integrating multiple informants’ reports: How conceptual and measurement models may address long-standing problems in clinical decision- making. Clinical Psychological Science, 8(6), 953–970. https://doi.org/10.1177/2167702620924439
   Web of Science ®Google Scholar
• Markon, K. E., Chmielewski, M., & Miller, C. J. (2011). The reliability and validity of discrete and continuous measures of psychopathology: A quantitative review. Psychological Bulletin, 137(5), 856–879. https://doi.org/10.1037/a0023678
   PubMed Web of Science ®Google Scholar
• Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525–543. https://doi.org/10.1007/BF02294825
   Web of Science ®Google Scholar
• Meyer, G. J., Finn, S. E., Eyde, L. D., Kay, G. G., Moreland, K. L., Dies, R. R., Eisman, E. J., Kubiszyn, T. W., & Reed, G. M. (2001). Psychological testing and psychological assessment: A review of evidence and issues. American Psychologist, 56(2), 128–165. https://doi.org/10.1037/0003-066X.56.2.128
   PubMed Web of Science ®Google Scholar
• Millsap, E. (2011). Statistical methods for studying measurement invariance. Taylor & Francis.
   Google Scholar
• Murray, A. L., Speyer, L. G., Hall, H. A., Valdebenito, S., & Hughes, C. (2021). Teacher versus parent informant measurement invariance of the strengths and difficulties questionnaire. Journal of Pediatric Psychology, 46(10), 1249–1257. https://doi.org/10.1093/jpepsy/jsab062
   PubMed Web of Science ®Google Scholar
• Nelson, J. M., & Lovett, B. J. (2019). Assessing ADHD in college students: Integrating multiple evidence sources with symptom and performance validity data. Psychological Assessment, 31(6), 793–804. https://doi.org/10.1037/pas0000702
   PubMed Web of Science ®Google Scholar
• Ng, M. Y., & Weisz, J. R. (2016). Building a science of personalized intervention for youth mental health. Journal of Child Psychology and Psychiatry, 57(3), 216–236. http://dx.doi.org/10.1111/jcpp.12470
   PubMed Web of Science ®Google Scholar
• Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw-Hill.
   Google Scholar
• Offord, D. R., Boyle, M. H., Racine, Y., Szatmari, P., Fleming, J. E., Sanford, M., & Lipman, E. L. (1996). Integrating assessment data from multiple informants. Journal of the American Academy of Child and Adolescent Psychiatry, 35(8), 1078–1085. https://doi.org/10.1097/00004583-199608000-00019
   PubMed Web of Science ®Google Scholar
• Olino, T. M., Finsaas, M., Dougherty, L. R., & Klein, D. N. (2018). Is parent–child disagreement on child anxiety explained by differences in measurement properties? An examination of measurement invariance across informants and time. Frontiers in Psychology, 9, 1295. https://doi.org/10.3389/fpsyg.2018.01295
   PubMed Web of Science ®Google Scholar
• Olino, T. M., Michelini, G., Mennies, R. J., Kotov, R., & Klein, D. N. (2021). Does maternal psychopathology bias reports of offspring symptoms? A study using moderated non‐ linear factor analysis. Journal of Child Psychology and Psychiatry, 62(10), 1195–1201. https://doi.org/10.1111/jcpp.13394
   PubMed Web of Science ®Google Scholar
• Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716
   Web of Science ®Google Scholar
• Osterlind, S. J., & Everson, H. T. (2009). Differential item functioning. Sage.
   Google Scholar
• Popper, K. R. (1962). Conjectures and refutations: The growth of scientific knowledge. Basic Books.
   Google Scholar
• Prinstein, M. J., Rancourt, D., Adelman, C. B., Ahlich, E., Smith, J., & Guerry, J. D. (2018). Peer status and psychopathology. In W. Bukowski, B. Laursen, & K. H. Rubin (Eds.), Handbook of peer interactions, relationships, and groups (2nd ed., pp. 617–636). Guilford Press.
   Google Scholar
• Rausch, E., Racz, S. J., Augenstein, T. M., Keeley, L., Lipton, M. F., Szollos, S., Riffle, J., Moriarity, D., Kromash, R., & De Los Reyes, A. (2017). A multi-informant approach to measuring depressive symptoms in clinical assessments of adolescent social anxiety using the Beck Depression Inventory-II: Convergent, incremental, and criterion-related validity. Child and Youth Care Forum, 46(5), 661–683. https://doi.org/10.1007/s10566-017-9403-4
   Web of Science ®Google Scholar
• Rescorla, L. A., Achenbach, T. M., Ivanova, M. Y., Turner, L. V., Árnadóttir, H., Au, A., Caldas, J. C., Chen, Y.-C., Decoster, J., Fontaine, J., Funabiki, Y., Guðmundsson, H. S., Leung, P., Liu, J., Maraš, J. S., Marković, J., Oh, K. J., da Rocha, M. M., Samaniego, V. C., … Zasepa, E. (2016). Collateral reports and cross-informant agreement about adult psychopathology in 14 societies. Journal of Psychopathology and Behavioral Assessment, 38(3), 381–397. https://doi.org/10.1007/s10862-016-9541-2
   Web of Science ®Google Scholar
• Rescorla, L. A., Ivanova, M. Y., Achenbach, T. M., Almeida, V., Anafarta-Sendag, M., Bite, I., Caldas, J. C., Capps, J. W., Chen, Y. C., Colombo, P., da Silva Oliveira, M., Dobrean, A., Erol, A., Frigerio, A., Funabiki, Y., Gedutienė, R., Guðmundsson, H. S., Heo, M. Q., Kim, Y. A., … Zasępa, E. (2022). Older adult psychopathology: International comparisons of self-reports, collateral reports, and cross-informant agreement. International Psychogeriatrics, 34(5), 467–478. https://doi.org/10.1017/S1041610220001532
   Web of Science ®Google Scholar
• Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement. In A. H. Prokasy (Ed.), Classical conditioning II: Current research and theory (pp. 64–99). Appleton-Century-Croft.
   Google Scholar
• Richters, J. E. (1992). Depressed mothers as informants about their children: A critical review of the evidence for distortion. Psychological Bulletin, 112(3), 485–499. https://doi.org/10.1037/0033-2909.112.3.485
   PubMed Web of Science ®Google Scholar
• Roberts, B. W., & Caspi, A. (2001). Personality development and the person-situation debate: It’s déjà vu all over again. Psychological Inquiry, 12(2), 104–109. https://doi.org/10.1207/S15327965PLI1202_04
   Web of Science ®Google Scholar
• Rubio-Stipec, M., Fitzmaurice, G., Murphy, J., & Walker, A. (2003). The use of multiple informants in identifying the risk factors of depressive and disruptive disorders: Are they interchangeable? Social Psychiatry and Psychiatric Epidemiology, 38(2), 51–58. https://doi.org/10.1007/s00127-003-0600-0
   PubMed Web of Science ®Google Scholar
• Russell, J. D., Graham, R. A., Neill, E. L., & Weems, C. F. (2016). Agreement in youth-parent perceptions of parenting behaviors: A case for testing measurement invariance in reporter discrepancy research. Journal of Youth and Adolescence, 45(10), 2094–2107. https://doi.org/10.1007/s10964-016-0495-1
   PubMed Web of Science ®Google Scholar
• Schiltz, H. K., Magnus, B. E., McVey, A. J., Haendel, A. D., Dolan, B. K., Stanley, R. E., Willar, K. A., Pleiss, S. J., Carson, A. M., Carlson, M., Murphy, C., Vogt, E. M., Yund, B. D., & Van Hecke, A. V. (2021). A psychometric analysis of the social anxiety scale for adolescents among youth with autism spectrum disorder: Caregiver–adolescent agreement, factor structure, and validity. Assessment, 28(1), 100–115. https://doi.org/10.1177/1073191119851563
   PubMed Web of Science ®Google Scholar
• Sewart, A. R., & Craske, M. G. (2020). Inhibitory learning. In J. S. Abramowitz & S. M. Blakey (Eds.), Clinical handbook of fear and anxiety: Maintenance processes and treatment mechanisms (pp. 265–285). American Psychological Association.
   Google Scholar
• Shin, H. J., Rabe-Hesketh, S., & Wilson, M. (2019). Trifactor models for multiple-ratings data. Multivariate Behavioral Research, 54(3), 360–381. https://doi.org/10.1080/00273171.2018.1530091
   PubMed Web of Science ®Google Scholar
• Skinner, B. F. (1953). Science and human behavior. MacMillan.
   Google Scholar
• Smetana, J. G. (2008). “It’s 10 o’clock: Do you know where your children are?” Recent advances in understanding parental monitoring and adolescents’ information management. Child Development Perspectives, 2(1), 19–25. https://doi.org/10.1111/j.1750-8606.2008.00036.x
   Web of Science ®Google Scholar
• Soland, J., & Kuhfeld, M. (2022). Examining the performance of the trifactor model for multiple raters. Applied Psychological Measurement, 46(1), 53–67. https://doi.org/10.1177/01466216211051728
   PubMed Web of Science ®Google Scholar
• Sternberg, R. J. (2005). The importance of converging operations in the study of human intelligence. Cortex, 41(2), 243–244. https://doi.org/10.1016/S0010-9452(08)70908-0
   PubMed Web of Science ®Google Scholar
• Sulik, M. J., Blair, C., & Greenberg, M., & Family Life Project Investigators. (2017). Child conduct problems across home and school contexts: A person-centered approach. Journal of Psychopathology and Behavioral Assessment, 39(1), 46–57. https://doi.org/10.1007/s10862-016-9564-8
   PubMed Web of Science ®Google Scholar
• Szkody, E., Rogers, M. M., & McKinney, C. (2022). Discrepancy analysis of emerging adult and parental report of psychological problems and relationship quality. Journal of Psychopathology and Behavioral Assessment, 44(2), 444–455. https://doi.org/10.1007/s10862-021-09949-1
   Web of Science ®Google Scholar
• Tackett, J. L., Lilienfeld, S. O., Patrick, C. J., Johnson, S. L., Krueger, R. F., Miller, J. D., Oltmanns, T. F., & Shrout, P. E. (2017). It’s time to broaden the replicability conversation: Thoughts for and from clinical psychological science. Perspectives on Psychological Science, 12(5), 742–756. https://doi.org/10.1177/1745691617690042
   Web of Science ®Google Scholar
• Talbott, E., De Los Reyes, A., Power, T., Michel, J., & Racz, S. J. (2021). A team-based collaborative care model for youth with attention deficit hyperactivity disorder in education and pediatric health care settings. Journal of Emotional and Behavioral Disorders, 29(1), 24–33. https://doi.org/10.1177/1063426620949987
   Web of Science ®Google Scholar
• Tversky, A., & Kahneman, D. (1974, September 27). Judgment under uncertainty: Heuristics and biases. Science, 185(4157), 1124–1131. https://doi.org/10.1126/science.185.4157.1124
   PubMed Web of Science ®Google Scholar
• Tyrell, F. A., Yates, T. M., Widaman, K. F., Reynolds, C. A., & Fabricius, W. V. (2019). Data harmonization: Establishing measurement invariance across different assessments of the same construct across adolescence. Journal of Clinical Child and Adolescent Psychology, 48(4), 555–567. https://doi.org/10.1080/15374416.2019.1622124
   PubMed Web of Science ®Google Scholar
• Vallar, G. (2006). Memory systems: The case of phonological short-term memory. A festschrift for cognitive neuropsychology. Cognitive Neuropsychology, 23(1), 135–155. https://doi.org/10.1080/02643290542000012
   PubMed Web of Science ®Google Scholar
• van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2012). Agreement of informants on emotional and behavioral problems from childhood to adulthood. Psychological Assessment, 24(2), 293–300. https://doi.org/10.1037/a0025500
   PubMed Web of Science ®Google Scholar
• van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2020). Multitrait-multimethod analyses of change of internalizing and externalizing problems in adolescence: Predicting internalizing and externalizing DSM disorders in adulthood. Journal of Abnormal Psychology, 129(4), 343–354. https://doi.org/10.1037/abn0000510
   PubMed Web of Science ®Google Scholar
• Vazire, S. (2006). Informant reports: A cheap, fast, and easy method for personality assessment. Journal of Research in Personality, 40(5), 472–481. https://doi.org/10.1016/j.jrp.2005.03.003
   Web of Science ®Google Scholar
• Von Der Heide, R. J., Wenger, M. J., Bittner, J. L., & Fitousi, D. (2018). Converging operations and the role of perceptual and decisional influences on the perception of faces: Neural and behavioral evidence. Brain and Cognition, 122, 59–75. https://doi.org/10.1016/j.bandc.2018.01.007
   PubMed Web of Science ®Google Scholar
• Wakschlag, L. S., Tolan, P. H., & Leventhal, B. L. (2010). Research review: “Ain’t misbehavin:” Toward a developmentally-specified nosology for preschool disruptive behavior. Journal of Child Psychology and Psychiatry, 51(1), 3–22. http://dx.doi.org/10.1111/j.1469-7610.2009.02184.x
   PubMed Web of Science ®Google Scholar
• Watts, A. L., Makol, B. A., Palumbo, I. M., De Los Reyes, A., Olino, T. M., Latzman, R. D., DeYoung, C. G., Wood, P. K., & Sher, K. J. (2022). How robust is the p-factor? Using multitrait-multimethod modeling to inform the meaning of general factors of psychopathology in youth. Clinical Psychological Science, 10(4), 640–661. https://doi.org/10.1177/21677026211055170
   PubMed Web of Science ®Google Scholar
• Weersing, V. R., Jeffreys, M., Do, M. C. T., Schwartz, K. T., & Bolano, C. (2017). Evidence base update of psychosocial treatments for child and adolescent depression. Journal of Clinical Child and Adolescent Psychology, 46(1), 11–43. https://doi.org/10.1080/15374416.2016.1220310
   PubMed Web of Science ®Google Scholar
• Weisz, J. R. (2004). Psychotherapy for children and adolescents: Evidence-based treatments and case examples. Cambridge University Press.
   Google Scholar
• Weisz, J. R., Hawley, K. M., & Doss, A. J. (2004). Empirically tested psychotherapies for youth internalizing and externalizing problems and disorders. Child and Adolescent Psychiatric Clinics of North America, 13(4), 729–815. https://doi.org/10.1016/j.chc.2004.05.006
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., Jensen Doss, A., & Hawley, K. M. (2005). Youth psychotherapy outcome research: A review and critique of the evidence base. Annual Review of Psychology, 56, 337–363. https://doi.org/10.1146/annurev.psych.55.090902.141449
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., & Kazdin, A. E., (Eds.). (2017). Evidence-based psychotherapies for children and adolescents (3rd ed.). Guilford Press.
   Google Scholar
• Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., Jensen-Doss, A., & Fordwood, S. R. (2017). What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice. American Psychologist, 72(2), 79–117. https://doi.org/10.1037/a0040360
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., McCarty, C. A., & Valeri, S. M. (2006). Effects of psychotherapy for depression in children and adolescents: A meta-analysis. Psychological Bulletin, 132(1), 132–149. https://doi.org/10.1037/0033-2909.132.1.132
   PubMed Web of Science ®Google Scholar
• Wundt, W. (1916). Elements of folk psychology: Outlines of a psychological history of the development of mankind E. L. Schaub, (Trans.). George Allen & Unwin. https://doi.org/10.1037/13042-000
   Google Scholar
• Yeh, M., & Weisz, J. R. (2001). Why are we here at the clinic? Parent-child (dis)agreement on referral problems at outpatient treatment entry. Journal of Consulting and Clinical Psychology, 69(6), 1018–1025. https://doi.org/10.1037/0022-006X.69.6.1018
   PubMed Web of Science ®Google Scholar
• Zeid, D., Carter, J., & Lindberg, M. A. (2018). Comparisons of alcohol and drug dependence in terms of attachments and clinical issues. Substance Use and Misuse, 53(1), 1–8. https://doi.org/10.1080/10826084.2017.1319865
   PubMed Web of Science ®Google Scholar