Using Machine Learning to Identify Suicide Risk: A Classification Tree Approach to Prospectively Identify Adolescent Suicide Attempters

REFERENCES

• Berman, N. C., Stark, A., Cooperman, A., Wilhelm, S., & Cohen, I. G. (2015). Effect of patient and therapist factors on suicide risk assessment. Death Studies, 39(7), 433–441. doi:10.1080/07481187.2014.958630
   PubMed Web of Science ®Google Scholar
• Bolton, J. M., Spiwak, R., & Sareen, J. (2012). Predicting suicide attempts with the SAD PERSONS scale: A longitudinal analysis. The Journal of Clinical Psychiatry, 73(3), e735–e741. doi:10.4088/JCP.11m07362
   PubMedGoogle Scholar
• Breiman, L., Friedman, J., Stone, C. J., & Olshen, R. A. (1984). Classification and regression trees. Monterey, CA: Wadsworth & Brooks.
   Google Scholar
• Brown, G. K., Beck, A. T., Steer, R. A., & Grisham, J. R. (2000). Risk factors for suicide in psychiatric outpatients: A 20-year prospective study. Journal of Consulting and Clinical Psychology, 68(3), 371–377. doi:10.1037//0022-006.X.68.3.371
   PubMed Web of Science ®Google Scholar
• Bryan, C. J., & Rudd, M. D. (2006). Advances in the assessment of suicide risk. Journal of Clinical Psychology, 62(2), 185–200. doi:10.1002/jclp.20222
   PubMed Web of Science ®Google Scholar
• Centers for Disease Control and Prevention. (2019). Injury prevention & control: Data & statistics (WISQARS). http://www.cdc.gov/injury/wisqars/index.html. Accessed 20 March 2019.
   Google Scholar
• Chantala, K. (2006). Guidelines for analyzing add health data. Chapel Hill, NC: Carolina Population Center: University of North Carolina Chapel Hill.
   Google Scholar
• Chu, C., Klein, K. M., Buchman-Schmitt, J. M., Hom, M. A., Hagan, C. R., & Joiner, T. E. (2015). Routinized assessment of suicide risk in clinical practice: An empirically informed update. Journal of Clinical Psychology, 71(12), 1186–1200. doi:10.1002/jclp.22210
   PubMed Web of Science ®Google Scholar
• Committee on Practice and Ambulatory Medicine, AAP Bright Futures Periodicity Schedule Workgroup. (2019). 2019 recommendations for preventive pediatric health care. Pediatrics, 143(3).
   Web of Science ®Google Scholar
• De’ath, G., & Fabricius, K. E. (2000). Classification and regression trees: A powerful yet simple technique for ecological data analysis. Ecology, 81(11), 3178–3192. doi:10.2307/177409
   Web of Science ®Google Scholar
• Franklin, J. C., Ribeiro, J. D., Fox, K. R., Bentley, K. H., Kleiman, E. M., Huang, X., … Nock, M. K. (2016). Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychological Bulletin, 143(2), 197–232.
   Web of Science ®Google Scholar
• Goldberg, D. E., & Holland, J. H. (1988). Genetic algorithms and machine learning. Machine Learning, 3(2/3), 95–99.
   Google Scholar
• Goldstein, R. B., Black, D. W., Nasrallah, A., & Winokur, G. (1991). The prediction of suicide: Sensitivity, specificity, and predictive value of a multivariate model applied to suicide among 1906 patients with affective disorders. Archives of General Psychiatry, 48(5), 418–422.
   PubMed Web of Science ®Google Scholar
• Gould, M. S., Greenberg, T., Velting, D. M., & Shaffer, D. (2003). Youth suicide risk and preventive interventions: A review of the past 10 years. Journal of the American Academy of Child and Adolescent Psychiatry, 42(4), 386–405. doi:10.1097/01.CHI.0000046821.95464.CF
   PubMed Web of Science ®Google Scholar
• Harris, K. M. (2013). The Add Health Study: Design and accomplishments. Retrieved from http://www.cpc.unc.edu/projects/addhealth/data/guides/DesignPaperWIIV.pdf
   Google Scholar
• Harris, K. M., & Udry, J. R. (2016). National Longitudinal Study of Adolescent to Adult Health (Add Health), 1994-2008 [Public Use]. ICPSR21600-v17. Chapel Hill, NC: Carolina Population Center, University of North Carolina-Chapel Hill/Ann Arbor, MI: Inter-university Consortium for Political and Social Research [distributors], 05–25. http://doi.org/10.3886/ICPSR21600.v17
   Google Scholar
• Hill, R. M., Oosterhoff, B., & Kaplow, J. B. (2017). Prospective identification of adolescent suicidal ideation using classification tree analysis: Models for community-based screening. Journal of Consulting and Clinical Psychology, 85(7), 702–711. doi:10.1037/ccp0000218
   PubMed Web of Science ®Google Scholar
• Hill, R. M., & Pettit, J. W. (2019). Pilot randomized controlled trial of LEAP: A program to reduce adolescent perceived burdensomeness. Journal of Clinical Child and Adolescent Psychology, 48(sup1), S45–S56. doi:10.1080/15374416.2016.1188705
   PubMed Web of Science ®Google Scholar
• Hom, M. A., Joiner, T. E., & Bernert, R. A. (2016). Limitations of a single-item assessment of suicide attempt history: Implications for standardized suicide risk assessment. Psychological Assessment, 28(8), 1026–1030. doi:10.1037/pas0000241
   PubMed Web of Science ®Google Scholar
• Joiner, T. E. (2005). Why people die by suicide. Cambridge, MA, US: Harvard University Press.
   Google Scholar
• Joiner, T. E., Walker, R. L., Rudd, M. D., & Jobes, D. A. (1999). Scientizing and routinizing the assessment of suicidality in outpatient practice. Professional Psychology: Research and Practice, 30(5), 447–453. doi:10.1037//0735-7028.30.5.447
   Web of Science ®Google Scholar
• Just, M. A., Pan, L., Cherkassky, V. L., McMakin, D., Cha, C., Nock, M. K., & Brent, D. (2017). Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth. Nature Human Behaviour, 1, 911–919. doi:10.1038/s41562-017-0234-y
   PubMed Web of Science ®Google Scholar
• Kann, L., McManus, T., Harris, W. A., Shanklin, S. L., Flint, K. H., Hawkins, J., … Zaza, S. (2016). Youth risk behavior surveillance – United States, 2015. MMWR. Surveillance Summaries, 65(6), 1–174. doi:10.15585/mmwr.ss6506a1
   Web of Science ®Google Scholar
• Kessler, R. C., Stein, M. B., Petukhova, M. V., Bliese, P., Bossarte, R. M., Bromet, E. J., … Ursano, R. J. (2017). Predicting suicides after outpatient mental health visits in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Molecular Psychiatry, 22(4), 544–551. doi:10.1038/mp.2016.110
   PubMed Web of Science ®Google Scholar
• Kim, H., & Loh, W. (2001). Classification trees with unbiased multiway splits. Journal of the American Statistical Association, 96, 598–604.
   Web of Science ®Google Scholar
• Kim, H., & Loh, W. (2003). Classification trees with bivariate linear discriminant node models. Journal of Computational and Graphical Statistics, 12(3), 512–530. doi:10.1198/1061860032049
   Web of Science ®Google Scholar
• Kim, H., & Loh, W. (2008). CRUISE user manual. Department of Statistics, University of Wisconsin, Madison. Technical Report 989.
   Google Scholar
• Mann, J. J., Ellis, S. P., Waternaux, C. M., Liu, X., Oquendo, M. A., Malone, K. M., … Currier, D. (2008). Classification trees distinguish suicide attempters in major psychiatric disorders: A model of clinical decision-making. The Journal of Clinical Psychiatry, 69(1), 23–31. doi:10.4088/JCP.v69n0104
   PubMed Web of Science ®Google Scholar
• McCarthy, J. F., Bossarte, R. M., Katz, I. R., Thompson, C., Kemp, J., Hannemann, C. M., … Schoenbaum, M. (2015). Predictive modeling and concentration of the risk of suicide: Implications for preventive intervention in the US Department of Veterans Affairs. American Journal of Public Health, 105(9), 1935–1942. doi:10.2105/AJPH.2015.302737
   PubMed Web of Science ®Google Scholar
• Millner, A. J., Lee, M. D., & Nock, M. K. (2015). Single-item measurement of suicidal behaviors: Validity and consequences of misclassification. PLoS ONE, 10(10), e0141606. doi:10.1371/jounal.pone.0141606
   PubMed Web of Science ®Google Scholar
• Murphy, K. P. (2012). Machine learning: A probabilistic perspective. Cambridge, MA: MIT press.
   Google Scholar
• Nordstrom, P., Asberg, M., Aberg-Wistedt, A., & Nordin, C. (1995). Attempted suicide predicts suicide risk in mood disorders. Acta Psychiatrica Scandinavica, 92(5), 345–350. doi:10.1111/j.1600-0447.1995.tb.09595.x
   PubMed Web of Science ®Google Scholar
• O’Connor, R. C. (2011). The integrated motivational-volitional model of suicidal behavior. Crisis, 32(6), 295–298. doi:10.1027/0337-5910/a000120
   PubMedGoogle Scholar
• Osman, A., Bagge, C. L., Guitierrez, P. M., Konick, L. C., Kooper, B. A., & Barrios, F. X. (2001). The Suicidal Behaviors Questionnaire- Revised (SBQ-R): Validation with clinical and nonclinical samples. Assessment, 2001(5), 443–454. doi:10.1177/107319110100800409
   Web of Science ®Google Scholar
• Posner, K., Brown, G. K., Stanley, B., Brent, D. A., Yershova, K. V., Oquendo, M. A., … Mann, J. J. (2011). The Columbia–Suicide Severity Rating Scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. American Journal of Psychiatry, 168(12), 1266–1277. doi:10.1176/appi.ajp.2011.10111704
   PubMed Web of Science ®Google Scholar
• Regehr, C., LeBlanc, V. R., Bogo, M., Paterson, J., & Birze, A. (2015). Suicide risk assessments: Examining influences on clinicians’ professional judgement. American Journal of Orthopsychiatry, 85(4), 295–301. doi:10.1037/ort0000075
   PubMed Web of Science ®Google Scholar
• Richiardi, J., Achard, S., Bunke, H., & Van De Ville, D. (2013). Machine learning with brain graphs: Predictive modeling approaches for functional imaging in systems neuroscience. IEEE Signal Processing Magazine, 30(3), 58–70. doi:10.1109/MSP.2012.2233865
   Web of Science ®Google Scholar
• Shepard, D. S., Gurewich, D., Lwin, A. K., Reed, G. A., & Silverman, M. M. (2016). Suicide and suicidal attempts in the United States: Costs and policy implications. Suicide and Life-Threatening Behavior, 46(3), 352–362. doi:10.1111/sltb.12225
   PubMed Web of Science ®Google Scholar
• Stanley, B., & Brown, G.K. (2012). Safety Planning Intervention: A Brief Intervention to Mitigate Suicide Risk. Cognitive and Behavioral Practice, 19(2), 256–264. doi:10.1016/j.cbpra.2011.01.001
   Web of Science ®Google Scholar
• Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics. Boston, MA: Allyn & Bacon.
   Google Scholar
• Tucker, R.P., Tackett, M.J., Glickman, D., & Reger, M.A. (2019). Ethical and practical considerations in the use of a predictive model to trigger suicide prevention interventions in healthcare settings. Suicide and Life-Threatening Behavior, 49(2), 382–392. doi:10.1111/sltb.12431
   PubMed Web of Science ®Google Scholar
• Walsh, C. G., Ribeiro, J. D., & Franklin, J. C. (2017). Predicting risk of suicide attempts over time through machine learning. Clinical Psychological Science, 5(3), 457–469. doi:10.1177/2167702617691560
   Web of Science ®Google Scholar
• Wang, Y., Bhaskaran, J., Sareen, J., Bolton, S.-L., Chateau, D., & Bolton, J. M. (2016). Clinician prediction of future suicide attempts: A longitudinal study. The Canadian Journal of Psychiatry, 61(7), 428–432. doi:10.1177/0706743716645287
   Web of Science ®Google Scholar