Predictive Utility of Irritability “In Context”: Proof-of-Principle for an Early Childhood Mental Health Risk Calculator

References

• Ambrosini, P. J. (2000). Historical development and present status of the schedule for affective disorders and schizophrenia for school-age children (K-SADS). Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 49–58. https://doi.org/10.1097/00004583-200001000-00016
   PubMed Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (DSM-5®) (5th ed.). American Psychiatric Association.
   Google Scholar
• Angold, A., & Costello, E. J. (2000). The child and adolescent psychiatric assessment (CAPA). Journal of the American Academy of Child and Adolescent Psychiatry, 39(1), 39–48. https://doi.org/10.1097/00004583-200001000-00015
   PubMed Web of Science ®Google Scholar
• Beauchaine, T. P., & Tackett, J. L. (2019). Irritability as a transdiagnostic vulnerability trait: Current issues and future directions. Behavior Therapy, 51(2), 350–364. https://doi.org/10.1016/j.beth.2019.10.009
   PubMed Web of Science ®Google Scholar
• Beidas, R. S., Buttenheim, A. M., & Mandell, D. S. (2021). Transforming mental health care delivery through implementation science and behavioral economics. JAMA Psychiatry, 78(9), 941–942. https://doi.org/10.1001/jamapsychiatry.2021.1120
   PubMed Web of Science ®Google Scholar
• Bevilacqua, L., Kelly, Y., Heilmann, A., Priest, N., & Lacey, R. E. (2021). Adverse childhood experiences and trajectories of internalizing, externalizing, and prosocial behaviors from childhood to adolescence. Child Abuse & Neglect, 112, 104890. https://doi.org/10.1016/j.chiabu.2020.104890
   PubMed Web of Science ®Google Scholar
• Birmaher, B., Merranko, J. A., Goldstein, T. R., Gill, M. K., Goldstein, B. I., Hower, H., Yen, S., Hafeman, D., Strober, M., Diler, R. S., Axelson, D., Ryan, N. D., & Keller, M. B. (2018). A risk calculator to predict the individual risk of conversion from subthreshold bipolar symptoms to bipolar disorder i or ii in youth. Journal of the American Academy of Child & Adolescent Psychiatry, 57(10), 755–763.e754. https://doi.org/10.1016/j.jaac.2018.05.023
   PubMed Web of Science ®Google Scholar
• Boat, T. F. (2015). Improving lifetime health by promoting behavioral health in children. JAMA, 313(15), 1509–1510. https://doi.org/10.1001/jama.2015.2977
   PubMed Web of Science ®Google Scholar
• Briggs-Gowan, M., & Carter, A. (1998). Preliminary acceptability and psychometrics of the infant-toddler social and emotional assessment (ITSEA): A new adult report questionnaire. Infant Mental Health Journal, 19, 422–445. https://doi.org/10.1002/SICI_1097-0355_199824_19:4<422:AID-IMHJ5>3.0.CO;2-U
   Web of Science ®Google Scholar
• Bunford, N., Evans, S. W., & Wymbs, F. (2015). ADHD and emotion dysregulation among children and adolescents. Clinical Child and Family Psychology Review, 18(3), 185–217. https://doi.org/10.1007/s10567-015-0187-5
   PubMed Web of Science ®Google Scholar
• Burgess, D. J., Fu, S. S., & Van Ryn, M. (2004). Why do providers contribute to disparities and what can be done about it? Journal of General Internal Medicine, 19(11), 1154–1159. https://doi.org/10.1111/j.1525-1497.2004.30227.x
   PubMed Web of Science ®Google Scholar
• Caye, A., Agnew-Blais, J., Arseneault, L., Gonçalves, H., Kieling, C., Langley, K., Menezes, A., Moffitt, T., Passos, I., & Rocha, T. (2020). A risk calculator to predict adult attention-deficit/hyperactivity disorder: Generation and external validation in three birth cohorts and one clinical sample. Epidemiology and Psychiatric Sciences, 29, e37. https://doi.org/10.1017/S2045796019000283
   Web of Science ®Google Scholar
• Cicchetti, D., & Dawson, G. (2002). Editorial: Multiple levels of analysis. Development and Psychopathology, 14(3), 417–420. https://doi.org/10.1017/S0954579402003012
   PubMed Web of Science ®Google Scholar
• Damen, J. A., Hooft, L., Schuit, E., Debray, T. P., Collins, G. S., Tzoulaki, I., Lassale, C. M., Siontis, G. C., Chiocchia, V., Roberts, C., Schlüssel, M. M., Gerry, S., Black, J. A., Heus, P., van der Schouw, Y. T., Peelen, L. M., & Moons, K. G. (2016). Prediction models for cardiovascular disease risk in the general population: Systematic review. BMJ, 353, i2416. https://doi.org/10.1136/bmj.i2416
   PubMed Web of Science ®Google Scholar
• Damme, K. S. F., Norton, E. S., Briggs-Gowan, M. J., Wakschlag, L. S., & Mittal, V. A. (2022). Developmental patterning of irritability enhances prediction of psychopathology in preadolescence: Improving RDoC with developmental science. Journal of Psychopathology and Clinical Science, 131(6), 556–566. https://doi.org/10.1037/abn0000655
   PubMedGoogle Scholar
• Egger, H. L., Erkanli, A., Keeler, G., Potts, E., Walter, B., & Angold, A. (2006). The test-retest reliability of the preschool age psychiatric assessment (PAPA). Journal of the American Academy of Child & Adolescent Psychiatry, 45(5), 538–549. https://doi.org/10.1097/01.chi.0000205705.71194.b8
   PubMed Web of Science ®Google Scholar
• Elliott, C. (1983). Differential abilities scales: Introductory and technical handbook. Psychological Corporation.
   Google Scholar
• Essex, M., Boyce, W., Goldstein, L., Armstrong, J., Kraemer, H., & Kupfer, D. (2002). The confluence of mental, physical, social, and academic difficulties in middle childhood. II: Developing the MacArthur Health and Behavior Questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 41(5), 588–603. https://doi.org/10.1097/00004583-200205000-00017
   PubMed Web of Science ®Google Scholar
• Evans, S. C., Burke, J. D., Roberts, M. C., Fite, P. J., Lochman, J. E., Francisco, R., & Reed, G. M. (2017). Irritability in child and adolescent psychopathology: An integrative review for icd-11. Clinical Psychology Review, 53, 29–45. https://doi.org/10.1016/j.cpr.2017.01.004
   PubMed Web of Science ®Google Scholar
• Evans, S. C., Wei, M. A., Harmon, S. L., & Weisz, J. R. (2021). Modular psychotherapy outcomes for youth with different latent profiles of irritability and emotion dysregulation. Frontiers in Psychiatry, 12, 446. https://doi.org/10.3389/fpsyt.2021.618455
   Web of Science ®Google Scholar
• Finlay-Jones, A., Varcin, K., Leonard, H., Bosco, A., Alvares, G., & Downs, J. (2019). Very early identification and intervention for infants at risk of neurodevelopmental disorders: A transdiagnostic approach. Child Development Perspectives, 13(2), 97–103. https://doi.org/10.1111/cdep.12319
   Web of Science ®Google Scholar
• Fortier, I., Raina, P., Van den Heuvel, E. R., Griffith, L. E., Craig, C., Saliba, M., Doiron, D., Stolk, R. P., Knoppers, B. M., & Ferretti, V. (2017). Maelstrom research guidelines for rigorous retrospective data harmonization. International Journal of Epidemiology, 46, 103–105. https://doi.org/10.1093/ije/dyw075
   PubMed Web of Science ®Google Scholar
• Frick, P. J., & White, S. (2008). Research review: The importance of callous-unemotional traits for developmental models of aggressive and antisocial behavior. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 49(4), 359–375. https://doi.org/10.1111/j.1469-7610.2007.01862.x
   PubMed Web of Science ®Google Scholar
• Goff, D. C., Jr., Lloyd-Jones, D. M., Bennett, G., Coady, S., D’Agostino, R. B., Gibbons, R., Greenland, P., Lackland, D. T., Levy, D., O’donnell, C. J., Robinson, J. G., Schwartz, J. S., Shero, S. T., Smith, S. C., Jr., Sorlie, P., Stone, N. J., & Wilson, P. W. (2014). 2013 ACC/AHA guideline on the assessment of cardiovascular risk: A report of the American College of Cardiology/American Heart Association task force on practice guidelines. Circulation, 129(25_suppl_2), S49–73. https://doi.org/10.1161/01.cir.0000437741.48606.98
   PubMed Web of Science ®Google Scholar
• Hahn, T., Nierenberg, A. A., & Whitfield-Gabrieli, S. (2017). Predictive analytics in mental health: Applications, guidelines, challenges and perspectives. Molecular Psychiatry, 22(1), 37–43. https://doi.org/10.1038/mp.2016.201
   PubMed Web of Science ®Google Scholar
• Heard-Garris, N., Davis, M. M., Estabrook, R., Burns, J., Briggs-Gowan, M., Allen, N., Carnethon, M., Aguayo, L., Wakschlag, L., & Penedo, F. (2020). Adverse childhood experiences and biomarkers of inflammation in a diverse cohort of early school-aged children. Brain, Behavior, & Immunity-Health, 1, 100006. https://doi.org/10.1016/j.bbih.2019.100006
   PubMedGoogle Scholar
• Helms, J. E., Jernigan, M., & Mascher, J. (2005). The meaning of race in psychology and how to change it: A methodological perspective. American Psychologist, 60(1), 27–36. https://doi.org/10.1037/0003-066X.60.1.27
   PubMed Web of Science ®Google Scholar
• Hill, C., Maskowitz, K., Danis, B., Keenan, K., Burns, J., & Wakschlag, L. (2008). Validation of a clinically sensitive observational coding system for parenting behaviors: The parenting clinical observation schedule. Parenting: Science & Practice, 8(2), 53–85. https://doi.org/10.1080/15295190802045469
   Web of Science ®Google Scholar
• Keim-Malpass, J., Kitzmiller, R. R., Skeeles-Worley, A., Lindberg, C., Clark, M. T., Tai, R., Calland, J. F., Sullivan, K., Moorman, J. R., & Anderson, R. A. (2018). Advancing continuous predictive analytics monitoring: Moving from implementation to clinical action in a learning health system. Critical Care Nursing Clinics, 30(2), 273–287. https://doi.org/10.1016/j.cnc.2018.02.009
   PubMed Web of Science ®Google Scholar
• Krogh-Jespersen, S., Kaat, A., Gray, L., Petitclerc, A., Burns, J., Briggs-Gowan, H., Adam, M., & Wakschlag, L. (2021). Calibrating temper loss severity in the transition to toddlerhood: Implications for developmental science. Applied Developmental Science, 26(4), 1–14. https://doi.org/10.1080/10888691.2021.1995386
   Web of Science ®Google Scholar
• Lloyd-Jones, D. M., Allen, N. B., Anderson, C. A., Black, T., Brewer, L. C., Foraker, R. E., Grandner, M. A., Lavretsky, H., Perak, A. M., Sharma, G., Rosamond, W., & American Heart Association. (2022). Life’s essential 8: Updating and enhancing the American Heart Association’s Construct of Cardiovascular Health: A presidential advisory from the American Heart Association. Circulation, 146(5), e18–43. https://doi.org/10.1161/CIR.0000000000001078
   PubMed Web of Science ®Google Scholar
• Luby, J., Allen, N., Estabrook, R., Pine, D. S., Rogers, C., Krogh-Jespersen, S., Norton, E. S., & Wakschlag, L. (2019). Mapping infant neurodevelopmental precursors of mental disorders: How synthetic cohorts & computational approaches can be used to enhance prediction of early childhood psychopathology. Behaviour Research and Therapy, 123, 103–484. https://doi.org/10.1016/j.brat.2019.103484
   Web of Science ®Google Scholar
• Luby, J., Sullivan, J., Belden, A., Stalets, M., Blankenship, S., & Spitznagel, E. (2006). An observational analysis of behavior in depressed preschoolers: Further validation of early-onset depression. Journal of American Academy of Child Adolescent Psychiatry, 45(2), 203–212. https://doi.org/10.1097/01.chi.0000188894.54713.ee
   PubMed Web of Science ®Google Scholar
• MacNeill, L. A., Allen, N., Poleon, R., Vargas, T., Osborne, J., Damme, K., Barch, D., Krogh-Jespersen, S., Norton, E., Rogers, C., Smyser, C., Louby, J., Mittal, V., & Wakschlag, L. S. (2021). Translating RDoC to real-world impact in developmental psychopathology: A neurodevelopmental framework for application of mental health risk calculators. Development and Psychopathology, 33(5), 1665–1684. https://doi.org/10.1017/S0954579421000651
   PubMed Web of Science ®Google Scholar
• McLaughlin, K. A. (2016). Future directions in childhood adversity and youth psychopathology. Journal of Clinical Child & Adolescent Psychology, 45(3), 361–382. https://doi.org/10.1080/15374416.2015.1110823
   PubMed Web of Science ®Google Scholar
• McLaughlin, K. A., Green, J. G., Gruber, M. J., Sampson, N. A., Zaslavsky, A. M., & Kessler, R. C. (2012). Childhood adversities and first onset of psychiatric disorders in a national sample of US adolescents. Archives of General Psychiatry, 69(11), 1151–1160. https://doi.org/10.1001/archgenpsychiatry.2011.2277
   PubMed Web of Science ®Google Scholar
• McNulty, M., Smith, J., Villamar, J., Burnett-Zeigler, I., Vermeer, W., Benbow, N., Gallo, C., Wilensky, U., Hjorth, A., & Mustanski, B. (2019). Implementation research methodologies for achieving scientific equity and health equity. Ethnicity & Disease, 29(Suppl 1), 83–92. https://doi.org/10.18865/ed.29.S1.83
   PubMedGoogle Scholar
• Meehan, A. J., Latham, R. M., Arseneault, L., Stahl, D., Fisher, H. L., & Danese, A. (2020). Developing an individualized risk calculator for psychopathology among young people victimized during childhood: A population-representative cohort study. Journal of Affective Disorders, 262, 90–98. https://doi.org/10.1016/j.jad.2019.10.034
   PubMed Web of Science ®Google Scholar
• Merle, J., Carroll, A. J., Mohanty, N., Berkel, C., Scherr, C., Davis, M. M., Wakschlag, L. S., & Smith, J. D. (2023). Pediatric clinicians’ perspectives on identification and intervention for young children’s social-emotional wellbeing in primary care. Submitted Manuscript.
   Google Scholar
• Mittal, V. A., & Wakschlag, L. S. (2017). Research domain criteria (RDoC) grows up: Strengthening neurodevelopmental investigation within the RDoC framework. Journal of Affective Disorders, 216, 30–35. https://doi.org/10.1016/j.jad.2016.12.011
   PubMed Web of Science ®Google Scholar
• Morris, A., Wakschlag, L., Krogh-Jespersen, S., Fox, N., Planalp, B., Perlman, S., Shuffrey, L., Smith, B., Lorenzo, N., Amso, D., Coles, C., & Johnson, S. (2020). Principles for guiding the selection of early childhood neurodevelopmental risk and resilience measures: Healthy brain and child development study as an exemplar. Adversity and Resilience Science, 1(4), 247–267. https://doi.org/10.1007/s42844-020-00025-3
   PubMedGoogle Scholar
• Obermeyer, Z., Powers, B., Vogeli, C., & Mullainathan, S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science, 366(6464), 447–453. https://doi.org/10.1126/science.aax2342
   PubMed Web of Science ®Google Scholar
• Oliver, D., Spada, G., Colling, C., Broadbent, M., Baldwin, H., Patel, R., Stewart, R., Stahl, D., Dobson, R., & McGuire, P. (2021). Real-world implementation of precision psychiatry: Transdiagnostic risk calculator for the automatic detection of individuals at-risk of psychosis. Schizophrenia Research, 227, 52–60. https://doi.org/10.1016/j.schres.2020.05.007
   PubMed Web of Science ®Google Scholar
• Osborne, K. J., & Mittal, V. A. (2019). External validation and extension of the napls-2 and sips-rc personalized risk calculators in an independent clinical high-risk sample. Psychiatry Research, 279, 9–14. https://doi.org/10.1016/j.psychres.2019.06.034
   PubMed Web of Science ®Google Scholar
• Pencina, M. J., & D’agostino, R. B., Sr. (2012). Thoroughly modern risk prediction. Science Translational Medicine, 4(131), 131fs110. https://doi.org/10.1126/scitranslmed.3004127
   Web of Science ®Google Scholar
• Pool, L. R., Ning, H., Wilkins, J., Lloyd-Jones, D. M., & Allen, N. B. (2018). Use of long-term cumulative blood pressure in cardiovascular risk prediction models. JAMA Cardiology, 3(11), 1096–1100. https://doi.org/10.1001/jamacardio.2018.2763
   PubMed Web of Science ®Google Scholar
• Shaw, D. (2013). Future directions for research on the development and prevention of early conduct problems. Journal of Clinical Child & Adolescent Psychology, 42(3), 418–428. https://doi.org/10.1080/15374416.2013.777918
   PubMed Web of Science ®Google Scholar
• Shonkoff, J. P., & Bales, S. N. (2011). Science does not speak for itself: Translating child development research for the public and its policymakers. Child Development, 82(1), 17–32. https://doi.org/10.1111/j.1467-8624.2010.01538.x
   PubMed Web of Science ®Google Scholar
• Silva Ribeiro, J., Pereira, D., Salagre, E., Coroa, M., Santos Oliveira, P., Santos, V., Madeira, N., Grande, I., & Vieta, E. (2020). Risk calculators in bipolar disorder: A systematic review. Brain Sciences, 10(8), 525. https://doi.org/10.3390/brainsci10080525
   PubMed Web of Science ®Google Scholar
• Smith, J. D., Wakschlag, L., Krogh-Jespersen, S., Walkup, J. T., Wilson, M. N., Dishion, T. J., & Shaw, D. S. (2019). Dysregulated irritability as a window on young children’s psychiatric risk: Transdiagnostic effects via the family check-up. Development and Psychopathology, 31(5), 1887–1899. https://doi.org/10.1017/S0954579419000816
   PubMed Web of Science ®Google Scholar
• Sniderman, A. D., D’Agostino, R. B., Sr., & Pencina, M. J. (2015). The role of physicians in the era of predictive analytics. JAMA, 314(1), 25–26. https://doi.org/10.1001/jama.2015.6177
   PubMed Web of Science ®Google Scholar
• Sonuga-Barke, E. J. S. (2014). Editorial: ‘What’s up, RDoC?’ - can identifying core dimensions of early functioning help us understand, and then reduce, developmental risk for mental disorders? Journal of Child Psychology and Psychiatry, 55(8), 849–851. https://doi.org/10.1111/jcpp.12293
   PubMed Web of Science ®Google Scholar
• Stringaris, A., & Goodman, R. (2009). Longitudinal outcome of youth oppositionality: Irritable, headstrong, and hurtful behaviors have distinctive predictions. Journal of the American Academy of Child and Adolescent Psychiatry, 48(4), 404–412. https://doi.org/10.1097/CHI.0b013e3181984f30
   PubMed Web of Science ®Google Scholar
• Taylor, E., & Sonuga-Barke, E. (2008). Disorders of attention and activity. In M. Rutter, D. Bishop, D. Pine, S. Scott, J. Stevenson, E. Taylor, & A. Thapar (Eds.), Rutter’s child and adolescent psychiatry (pp. 521–542). Blackwell.
   Google Scholar
• Van Ryn, M., & Fu, S. S. (2003). Paved with good intentions: Do public health and human service providers contribute to racial/ethnic disparities in health? American Journal of Public Health, 93(2), 248–255. https://doi.org/10.2105/AJPH.93.2.248
   PubMed Web of Science ®Google Scholar
• Vidal-Ribas, P., Brotman, M. A., Valdivieso, I., Leibenluft, E., & Stringaris, A. (2016). The status of irritability in Psychiatry: A conceptual and quantitative review. Journal of the American Academy of Child & Adolescent Psychiatry, 55(7), 556–570. https://doi.org/10.1016/j.jaac.2016.04.014
   PubMed Web of Science ®Google Scholar
• Wakschlag, L., Briggs-Gowan, M., Choi, S., Nichols, S., Kestler, J., Burns, J., Carter, A., & Henry, D. (2014). Advancing a multidimensional, developmental spectrum approach to preschool disruptive behavior. Journal of the American Academy of Child & Adolescent Psychiatry, 53(1), 82–96. https://doi.org/10.1016/j.jaac.2013.10.011
   PubMed Web of Science ®Google Scholar
• Wakschlag, L., Perlman, S., Blair, R., Leibenluft, E., Briggs-Gowan, M., & Pine, D. (2018). The neurodevelopmental basis of early childhood disruptive behavior: Irritable and callous phenotypes as exemplars. American Journal of Psychiatry, 175(2), 114–130. https://doi.org/10.1176/appi.ajp.2017.17010045
   PubMed Web of Science ®Google Scholar
• Wakschlag, L. S., Finlay-Jones, A. L., MacNeill, L. A., Kaat, A. J., Brown, C. H., Davis, M. M., Franklin, P., Berkel, C., Krogh-Jespersen, S., & Smith, J. D. (2022). Don’t get lost in translation: Integrating developmental and implementation sciences to accelerate real-world impact on children’s development, health, and wellbeing [Perspective]. Frontiers in Public Health, 10, 827412. https://doi.org/10.3389/fpubh.2022.827412
   PubMed Web of Science ®Google Scholar
• Wakschlag, L. S., Roberts, M. Y., Flynn, R. M., Smith, J. D., Krogh-Jespersen, S., Kaat, A. J., Gray, L., Walkup, J., Marino, B. S., Norton, E. S., & Davis, M. M. (2019). Future directions for early childhood prevention of mental disorders: A road map to mental health, earlier. Journal of Clinical Child & Adolescent Psychology, 48(3), 539–554. https://doi.org/10.1080/15374416.2018.1561296
   PubMed Web of Science ®Google Scholar
• Wiggins, J. L., Briggs-Gowan, M. J., Estabrook, R., Brotman, M. A., Pine, D. S., Leibenluft, E., & Wakschlag, L. S. (2018). Identifying clinically significant irritability in early childhood. Journal of the American Academy of Child & Adolescent Psychiatry, 57(3), 191–199. https://doi.org/10.1016/j.jaac.2017.12.008
   PubMed Web of Science ®Google Scholar
• Wiggins, J., Mitchell, C., Stringaris, A., & Leibenluft, E. (2014). Developmental trajectories of irritability and bidirectional associations with maternal depression. Journal of the American Academy of Child & Adolescent Psychiatry, 53(11), 1191–1205. https://doi.org/10.1016/j.jaac.2014.08.005
   PubMed Web of Science ®Google Scholar
• Wiggins, J., Ureña Rosario, A. MacNeill, L. A., Smith, J. D., & Wakschlag, L. (2023). Prevalence, stability, and predictive utility of the MAPS clinically optimized irritability score: Pragmatic early assessment of mental disorder risk. Submitted Manuscript.
   Google Scholar
• Wiggins, J., Ureña Rosario, A., Zhang, Y., MacNeill, L. A., Yu, Q., Norton, E. S., Smith, J. D., & Wakschlag, L. (2023). Advancing earlier transdiagnostic identification of mental health risk with the MAPS temper loss scale: A pragmatic approach to irritability characterization at the transition to toddlerhood. Submitted Manuscript.
   Google Scholar
• Wilson, P. W., Nam, B. H., Pencina, M., D’agostino, R. B., Benjamin, E. J., & O’donnell, C. J. (2005). C-reactive protein and risk of cardiovascular disease in men and women from the Framingham heart study. Archives of Internal Medicine, 165(21), 2473–2478. https://doi.org/10.1001/archinte.165.21.2473
   PubMed Web of Science ®Google Scholar
• Youngstrom, E. A., Halverson, T. F., Youngstrom, J. K., Lindhiem, O., & Findling, R. L. (2018). Evidence-based assessment from simple clinical judgments to statistical learning: Evaluating a range of options using pediatric bipolar disorder as a diagnostic challenge. Clinical Psychological Science, 6(2), 243–265. https://doi.org/10.1177/2167702617741845
   PubMed Web of Science ®Google Scholar
• Youngstrom, E. A., & Van Meter, A. (2016). Empirically supported assessment of children and adolescents. Clinical Psychology: Science and Practice, 23(4), 327–347. https://doi.org/10.1037/h0101738
   Web of Science ®Google Scholar