The Terrorist Radicalization Assessment Protocol-18 (TRAP-18) in Australia: face validity, content validity, and utility in the Australian context

References

• Alexandre, N. M. C., & Coluci, M. Z. O. (2011). Content validity in the development and adaptation processes of measurement instruments. Ciência & Saúde Coletiva, 16(7), 3061–3068.
   Google Scholar
• Almanasreh, E., Moles, R., & Chen, T. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15(2), 214–221.
   Google Scholar
• Ananian-Welsh, R., & Williams, G. (2014). The new terrorists: The normalisation and spread of anti-terror laws in Australia. Melbourne University Law Review, 38(2), 362–408.
   Google Scholar
• Andrews, D. A., Bonta, J., & Hoge, R. (1990). Classification for effective rehabilitation: Rediscovering psychology. Criminal Justice and Behaviour, 17, 19–52.
   Google Scholar
• ASIO. (2021). ASIO Annual Report 2020-21. Australian Government. Commonwealth of Australia. ISSN 2204-4213.
   Google Scholar
• Böckler, N., Allwinn, M., Metwaly, C., Wypych, B., Hoffmann, J., & Zick, A. (2021). Islamist terrorists in Germany and their warning behaviors: A comparative assessment of attackers and other convicts using the TRAP-18. Journal of Threat Assessment and Management, 7(3-4), 157–172. doi:10.1037/tam0000150.supp
   Google Scholar
• Brod, M., Tesler, L. E., & Christensen, T. L. (2009). Qualitative research and content validity: Developing best practices based on science and experience. Qualitative Life Research, 18, 1263–1278.
   Google Scholar
• Brugh, C. S., Desmarais, S. L., & Simons-Rudolph, J. (2020). Application of the TRAP-18 framework to U.S. and Western European lone actor terrorists. Studies in Conflict & Terrorism, 0(00), 1–26. doi:10.1080/1057610X.2020.1758372
   Google Scholar
• Challacombe, D. J., & Lucas, P. A. (2018). Postdicting violence with sovereign citizen actors: An exploratory test of the TRAP-18. Journal of Threat Assessment and Management, 6(1), 51–59. doi:10.1037/tam0000105
   Google Scholar
• Clemmow, C., Gill, P., Bouhana, N., Silber, J., & Horgan, J. G. (2020). Disaggregating lone-actor grievance-fuelled violence: Comparing lone-actor terrorists and mass murderers. Terrorism and Political Violence, 0(00), 1–26. doi:10.1080/09546553.2020.1718661
   Google Scholar
• Dawson, S. O. (2013). A threat assessment perspective of Type III workplace mass homicides (Doctoral thesis, Capella University).
   Google Scholar
• Desmarais, S. L., & Singh, J. P. (2013). Instruments for assessing recidivism risk: A review of validation studies conducted in the U.S. Lexington, KY: Council of State Governments.
   Google Scholar
• Dimaksyan, M. (2021). Influences on Islamists: An analysis of radicalisation and terrorism in an Australian context (Doctoral Thesis, Federation University Australia).
   Google Scholar
• Erlandsson, A., & Meloy, J. R. (2018). The Swedish school attack in Trollhättan. Journal of Forensic Sciences, 63(6), 1917–1927. doi:10.1111/1556-4029.13800
   Google Scholar
• Fernández García-Andrade, R., Serván Rendón-Luna, B., Reneses Prieto, B., Vidal Martínez, V., Medina Téllez de Meneses, E., & Fernández Rodríguez, E. (2019). Forensic-psychiatric assessment of the risk of terrorist radicalisation in the mentally ill patient. Spanish Journal of Legal Medicine, 45(2), 59–66. doi:10.1016/j.reml.2019.01.001
   Google Scholar
• Gill, P., & Corner, E. (2016). Lone-actor terrorist target choice. Behavioral Sciences & the Law, 34(5), 693–705. doi:10.1002/bsl.2268
   Google Scholar
• Gill, P., Corner, E., Conway, M., Thornton, A., Bloom, M., & Horgan, J. G. (2017). Terrorist use of the internet by numbers: Quantifying behaviors, patterns, and processes. Criminology & Public Policy, 16(1), 99–117. doi:10.1111/1745-9133.12249
   Google Scholar
• Gill, P., Horgan, J., Corner, E., & Silver, J. (2016). Indicators of lone actor violent events: The problems of low base rates and long observational periods. Journal of Threat Assessment and Management, 3(3-4), 165–173. doi:10.1037/tam0000066
   Google Scholar
• Gill, P., Horgan, J., & Deckert, P. (2014). Bombing alone: Tracing the motivations and antecedent behaviors of lone-actor terrorists. Journal of Forensic Sciences, 59(2), 425–435. doi:10.1111/1556-4029.12312
   Google Scholar
• Gill, P., Marchment, Z., Corner, E., & Bouhana, N. (2018). Terrorist decision making in the context of risk, attack planning, and attack commission. Studies in Conflict & Terrorism, 43(2), 145–160. doi:10.1080/1057610X.2018.1445501
   Google Scholar
• Gill, P., Stewart, K., Treasure, E., & Chadwick, B. (2008). Methods of data collection in qualitative research: Interviews and focus groups. British Dental Journal, 204(6), 291–295.
   Google Scholar
• Goodwill, A., & Meloy, J. R. (2019). Visualizing the relationship among indicators for lone actor terrorist attacks: Multidimensional scaling and the TRAP-18. Behavioral Sciences and the Law, 37, 522–539. doi:10.1002/bsl.2434
   Google Scholar
• Gottfredson, S. D., & Moriarty, L. J. (2006). Statistical risk assessment: Old problems and new applications. Crime and Delinquency, 52(1), 178–200.
   Google Scholar
• Grant, J. S., & Davis, L. L. (1996). Selection and use of content experts for instrument development. Research in Nursing and Health, 20, 269–274.
   Google Scholar
• Guest, G., Namey, E., Taylor, J., Eley, N., & McKenna, K. (2017). Comparing focus groups and individual interviews: Findings from a randomized study. International Journal of Social Research Methodology, 20(6), 693–708. doi:10.1080/13645579.2017.1281601
   Google Scholar
• Guldimann, A., & Meloy, J. R. (2020). Assessing the threat of lone-actor terrorism: the reliability and validity of the TRAP-18. Forensische Psychiatrie, 14(2), 158–166.
   Google Scholar
• Guy, L. S. (2008). Performance indicators of the structured professional judgement approach for assessing risk for violence to others: A meta-analytic survey (Unpublished doctoral dissertation, Burnaby, Canada: Department of Psychology, Simon Fraser University).
   Google Scholar
• Harris-Hogan, S., Barrelle, K., & Zammit, A. (2016). What is countering violent extremism? Exploring CVE policy and practice in Australia. Behavioral Sciences of Terrorism & Political Aggression, 8(1), 6–24.
   Google Scholar
• Hart, S., Sturmey, P., Logan, C., & McMurran, M. (2011). Forensic case formulation. International Journal of Forensic Mental Health, 10(2), 118–126. doi:10.1080/14999013.2011.577137
   Google Scholar
• Hart, S. D., & Logan, C. (2011). Formulation of violence risk using evidence-based assessments: The structured professional judgment approach. In P. Sturmey & M. McMurran (Eds.), Forensic case formulation. Chichester: Wiley-Blackwell.
   Google Scholar
• Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment, 7(3), 238–247. doi:10.1037/1040-3590.7.3.238
   Google Scholar
• Hoffmann, J., Meloy, J. R., Guldimann, A., & Ermer, A. (2011). Attacks on German public figures, 1968-2004: Warning behaviors, potentially lethal and nonlethal acts, psychiatric status, and motivations. Behavioral Sciences and the Law, 29(2), 155–179. doi:10.1002/bsl.979
   Google Scholar
• Horgan, J. G., Gill, P., Bouhana, N., Silver, J., & Corner, E. (2016). Across the universe? A comparative analysis of violent behavior and radicalization across three offender types with implications for criminal justice training and education. Washington, DC: US Department of Justice.
   Google Scholar
• Institute for Economics and Peace. (2020). Global Terrorism Index 2020: Measuring the Impact of Terrorism. Sydney. Retrieved from https://visionofhumanity.org/reports
   Google Scholar
• Koller, I., Levenson, M. R., & Gluck, J. (2017). What do you think you are measuring? A mixed-methods procedure for assessing the content validity of test items and theory-based scaling. Frontiers in Psychology, 8(126), 1–20. doi:10.3389/fpsyg.2017.00126
   Google Scholar
• Kropp, P. R., & Hart, S. D. (2000). The Spousal Assault Risk Assessment (SARA) guide: Reliability and validity in adult male offenders. Law and human behavior, 24(1), 101–118.
   Google Scholar
• Kupper, J., & Meloy, J. R.. (2021). TRAP-18 indicators validated through the forensic linguistic analysis of targeted violence manifestos. Journal of Threat Assessment and Management, 8(4), 174–199.
   Google Scholar
• LaFree, G., & Dugan, L. (2007). Introducing the global terrorism database. Terrorism and Political Violence, 19(2), 181–204.
   Google Scholar
• LaFree, G., Dugan, L., & Miller, E. (2014). Putting terrorism in context: Lessons from the global terrorism database. Routledge.
   Google Scholar
• Living Safe Together. (2020). What is the Australian Government doing? Retrieved from https://www.livingsafetogether.gov.au
   Google Scholar
• Lloyd, M. (2019). Extremist risk assessments: a directory. Actors and Narratives. Centre for Research and Evidence on Security Threats (CREST).
   Google Scholar
• Lowenkamp, C. T., Latessa, E. J., & Holsinger, A. M. (2006). The risk principle in action: What have we learned from 13,676 offenders and 97 correctional programs? Crime & Delinquency, 52(1), 77–93.
   Google Scholar
• Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35(6), 382–386.
   Google Scholar
• Marchment, Z., & Gill, P. (2019). Modelling the spatial decision making of terrorists: The discrete choice approach. Applied Geography, 104, 21–31. doi:10.1016/j.apgeog.2019.01.009
   Google Scholar
• Marsteller, J. A., Hsu, Y., Chan, K. S., & Lubomski, L. (2017). Assessing content validity and user perspectives on the team check-up tool: Expert survey and user focus groups. BMJ Quality & Safety, 26, 288–295.
   Google Scholar
• Mastaglia, B., Toye, C., & Kristjanson, L. J. (2003). Ensuring content validity in instrument development: Challenges and innovative approaches. Contemporary Nurse, 14(3), 281–291. doi:10.5172/conu.14.3.281
   Google Scholar
• Meloy, J. R. (2017). TRAP-18: Terrorist radicalization assessment protocolTM user manual (Version 1.0). Global Institute of Forensic Research.
   Google Scholar
• Meloy, J. R. (2018). The operational development and empirical testing of the terrorist radicalization assessment protocol (TRAP–18). Journal of Personality Assessment, 100(5), 483–492.
   Google Scholar
• Meloy, J. R., & Gill, P. (2016). The lone-actor terrorist and the TRAP-18. Journal of Threat Assessment and Management, 3(1), 37–52. doi:10.1037/tam0000061
   Google Scholar
• Meloy, J. R., Goodwill, A., Clemmow, C., & Gill, P. (2021). Time sequencing the TRAP-18 indicators. Journal of Threat Assessment and Management, 8(1-2), 1–19. doi:10.1037/tam0000157.
   Google Scholar
• Meloy, J. R., Goodwill, A., Meloy, M. J., Amat, G., Martinez, M., & Morgan, M. (2019). Some TRAP-18 indicators discriminate between terrorist attackers and other subjects of national security concern. Journal of Threat Assessment and Management, 6(2), 93–110. doi:10.1037/tam0000119
   Google Scholar
• Meloy, J. R., Roshdi, K., Glaz-Ocik, J., & Hoffman, J. (2015). Investigating the individual terrorist in Europe. Journal of Threat Assessment and Management, 2(3-4), 140–152. doi:10.1037/tam0000036
   Google Scholar
• Mitchell, J V. (1986). Measurement in the larger context: Critical current issues. Professional Psychology: Research and Practice, 17(6), 544–550.
   Google Scholar
• Monahan, J. (2012). The individual risk assessment of terrorism. Public Policy, and Law, 18(2), 167.
   Google Scholar
• Monahan, J. (2016). The individual risk assessment of terrorism: Recent developments. In G. LaFree & J. D. Freilich (Eds.), The handbook of the criminology of terrorism (pp. 520–534).
   Google Scholar
• Monahan, J., Steadman, H. J., Silver, E., Appelbaum, P. S., Robbins, P. C., Mulvey, E. P., & Banks, S. (2001). Rethinking risk assessment: The MacArthur study of mental disorder and violence. New York, NY: Oxford University Press.
   Google Scholar
• Morgan, D. L. (1997). Focus groups as qualitative research. Sage.
   Google Scholar
• Pathé, M. T., Haworth, D. J., Goodwin, T., Holman, A. G., Amos, S. J., Winterbourne, P., & Day, L. (2018). Establishing a joint agency response to the threat of lone-actor grievance-fuelled violence. The Journal of Forensic Psychiatry & Psychology, 29(1), 37–52.
   Google Scholar
• Richmond, J. P., & Wright, M. E. (2006). Development of a constipation risk assessment scale. Journal of Orthopaedic Nursing, 10(4), 186–197. doi:10.1016/j.joon.2006.08.001
   Google Scholar
• Sarma, K. (2017). Risk assessment and the prevention of radicalization from nonviolence into terrorism. American Psychologist, 72(3), 278–288.
   Google Scholar
• Scarcella, A., Page, R., & Furtado, V. (2016). Terrorism, radicalisation, extremism, authoritarianism and fundamentalism: A systematic review of the quality and psychometric properties of assessments. PLoS One, 11(12), e1066947. doi:10.1371/journal.pone.0166947
   Google Scholar
• Schuurman, B. (2018). Research on terrorism, 2007-2016: A review of data, methods, and authorship. Terrorism and Political Violence, 1–16. doi:10.1080/09546553.2018.1439023
   Google Scholar
• Silver, J., Horgan, J., & Gill, P. (2018). Foreshadowing targeted violence: Assessing leakage of intent by public mass murderers. Aggression and Violent Behavior, 38, 94–100. doi:10.1016/j.avb.2017.12.002
   Google Scholar
• Singh, J. P. (2013). Predictive validity performance indicators in violence risk assessment: A methodological primer. Behavioral Sciences and the Law, 31(1), 8–22.
   Google Scholar
• Singh, J. P., Desmarais, S. L., Hurducas, C., Arbach-Lucioni, K., Condemarin, C., Dean, K., … Otto, R. K. (2014). International perspectives on the practical application of violence risk assessment: A global survey of 44 countries. International Journal of Forensic Mental Health, 13(3), 193–206. doi:10.1080/14999013.2014.922141
   Google Scholar
• Singh, J. P., Grann, M., & Fazel, S. (2011). A comparative study of violence risk assessment tools: A systematic review and metaregression analysis of 68 studies involving 25,980 participants. Clinical Psychology Review, 31(3), 499–513. doi:10.1016/j.cpr.2010.11.009
   Google Scholar
• Skeem, J. L., & Monahan, J. (2011). Current directions in violence risk assessment. Current Directions in Psychological Science, 20(1), 38–42. doi:10.1177/0963721410397271
   Google Scholar
• State Coroner of New South Wales. (2017). Inquest into the deaths arising from the Lindt Café siege: Findings and recommendations. Retrieved from http://www.lindtinquest.justice.nsw.gov.au/
   Google Scholar
• Tin, D., Hart, A., Hertelendy, A. J., & Ciottone, G. R. (2021). Terrorism in Australia: A decade of escalating deaths and injuries supporting the need for counter-terrorism medicine. Prehospital and Disaster Medicine, 36(3), 265–269.
   Google Scholar
• Vogt, D. S., King, D. W., & King, L. A. (2004). Focus groups in psychological assessment: Enhancing content validity by consulting members of the target population. Psychological Assessment, 16(3), 231–243. doi:10.1037/1040-3590.16.3.231
   Google Scholar
• Vossekuil, B., Fein, R. A., Reddy, M., Borum, R., & Modzeleski, W. (2002). The final report and findings of the safe school initiative: Implications for the prevention of school attacks in the United States. United States Secret Service and United States Department of Education. Washington D.C.
   Google Scholar
• Williams, A., Corner, E., & Taylor, H. (2020). Vehicular ramming attacks: Assessing the effectiveness of situational crime prevention using crime script analysis. Terrorism and Political Violence, 0(00), 1–15. doi:10.1080/09546553.2020.181.0025
   Google Scholar
• Williams, G. (2013). The Legal Legacy of the War on Terror. Macquarie Law Journal, 12, 3–20.
   Google Scholar
• Wynd, C. A., & Atkins-Schaeffer, M. (2002). The osteoporosis risk assessment tool: Establishing content validity through a panel of experts. Applied Nursing Research, 16(2), 184–188.
   Google Scholar
• Yang, M., Wong, S. P., & Coid, J. (2010). The efficacy of violence prediction: A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136(5), 740–767. doi:10.1037/a0020473
   Google Scholar
• Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., Alavi-Majd, H., & Nikanfar, A. R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165–178. doi:10.15171/jcs.2015.017
   Google Scholar