Inter-rater reliability of the Short-Term Assessment of Risk and Treatability (START)

References

• Abidin, Z., Davoren, M., Naughton, L., Gibbons, O., Nulty, A., & Kennedy, H. G. (2013). Susceptibility (risk and protective) factors for in-patient violence and self-harm: Prospective study of structured professional judgement instruments START and SAPROF, DUNDRUM-3 and DUNDRUM-4 in forensic mental health services. BMC Psychiatry, 13(1), 197.
   PubMedGoogle Scholar
• Althaus, C. E. (2005). A disciplinary perspective on the epistemological status of risk. Risk Analysis, 25(3), 567–588.
   PubMed Web of Science ®Google Scholar
• Belfrage, H., Strand, S., Storey, J. E., Gibas, A. L., Kropp, P., & Hart, S. D. (2012). Assessment and management of risk for intimate partner violence by police officers using the spousal assault risk assessment guide. Law and Human Behavior, 36(1), 62–67.
   Web of Science ®Google Scholar
• Bland, J. M., & Altman, D. G. (1997). Statistics notes: Cronbach’s alpha. BMJ, 314(7080), 572.
   PubMed Web of Science ®Google Scholar
• Bonta, J. (2002). Offender risk assessment: Guidelines for selection and use. Criminal Justice and Behavior, 29(4), 355–379.
   Web of Science ®Google Scholar
• Bonta, J., Blais, B., & Wilson, H. A. (2013). The prediction of risk for mentally disordered offenders: A quantitative synthesis 2013–01. Ottawa (Canada): Public Safety Canada. Retrieved from http://www.publicsafety.gc.ca/cnt/rsrcs/pblctns/prdctn-rsk-mntlly-dsrdrd/index-en.aspx
   Google Scholar
• Bowers, I., Stewart, D., Papadopoulos, C., Dack, C., Ross, J., Khanom, H., & Jeffery, D. (2011). Inpatient violence and aggression: A literature review. Report from the Conflict and Containment Reduction Research Programme: Institute of Psychiatry, Kings College, London. Retrieved from http://s3.amazonaws.com/academia.edu.documents
   Google Scholar
• Braithwaite, E., Charette, Y., Crocker, A. G., & Reyes, A. (2010). The predictive validity of clinical ratings of the Short-Term Assessment of Risk and Treatability (START). International Journal of Forensic Mental Health Services, 9(4), 271–281.
   Google Scholar
• Chu, C. M., Thomas, S. D. M., Ogloff, J. R. P., & Daffern, M. (2011). The predictive validity of the Short-Term Assessment of Risk and Treatability (START) in a secure forensic hospital: Risk factors and strengths. International Journal of Forensic Mental Health, 10(4), 337–345.
   Google Scholar
• Chukwuma, J. (2015). Low Secure versus locked rehabilitation units: A reflection. Journal of Psychiatric Intensive Care, 11(2), 73–77.
   Google Scholar
• Conroy, M. A., & Murrie, D. C. (2007). Forensic evaluation of violence risk: A guide to risk assessment and risk management. New York, NY: Oxford University Press.
   Google Scholar
• Crocker, A. G., Braithwaite, E., Laferriere, D., Gagnon, D., Venegas, C., & Jenkins, T. (2011). START changing practice: Implementing a risk assessment and management tool in a civil psychiatric setting. International Journal of Forensic Mental Health, 10(1), 13–28.
   Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. Retrieved from http://psych.colorado.edu/~carey/courses/psyc5112/readings/alpha_cronbach.pdf
   Web of Science ®Google Scholar
• De Vogel, V., & De Ruiter, C. (2004). Differences between clinicians and researchers in assessing risk of violence in forensic psychiatric patients. Journal of Forensic Psychiatry & Psychology, 15(1), 145–164.
   Web of Science ®Google Scholar
• De Vogel, V., & De Ruiter, C. (2006). Structured professional judgment of violence risk factor in the forensic clinical practice: A prospective study into the predictive validity of the Dutch HCR-20. Psychology Crime and Law, 12(3), 321–336.
   Web of Science ®Google Scholar
• De Vries Robbé, M., De Vogel, V., & De Spa, E. (2011). Protective factors for violence risk in forensic psychiatric patients: A retrospective validation study of the SAPROF. International Journal of Forensic Mental Health, 10(3), 178–186.
   Google Scholar
• De Vries Robbé, M., De Vogel, V., & Douglas, K. S. (2013). Risk factors and protective factors: A two-sided dynamic approach to violence risk assessment. Journal of Forensic Psychiatry and Psychology, 24(4), 440–457.
   Web of Science ®Google Scholar
• Department of Health. (2014). Positive and proactive care: Reducing the need for restrictive interventions. Retrieved from https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/300293/JRA_DoH_Guidance_on_RP_web_accessible.pdf
   Google Scholar
• Desmarais, S. L., Nicholls, T. L., Read, J. D., & Brink, J. (2010). Confidence and accuracy in assessments of short-term risks presented by forensic psychiatric patients. Journal of Forensic Psychiatry and Psychology, 21(1), 1–22.
   Web of Science ®Google Scholar
• Desmarais, S. L., Van Dorn, R. A., Telford, R. P., Petrila, J., & Coffey, T. (2012). Characteristics of START assessments completed in mental health jail diversion programs. Behavioural Sciences and the Law, 30(4), 448–469.
   PubMed Web of Science ®Google Scholar
• Desmet, M., Vanheule, S., Groenvynck, H., Verhaeghe, P., Vogel, J., & Bogaerts, S. (2007). The depressive experiences questionnaire. European Journal of Psychological Assessment, 23(2), 89–98.
   Web of Science ®Google Scholar
• Dickens, G. L., & O’Shea, L. E. (2015). How short should short-term risk assessment be? Determining the optimum interval for START reassessment in secure mental health service. Journal of Psychiatric and Mental Health Nursing, 22(6), 397–406.
   PubMed Web of Science ®Google Scholar
• Douglas, K. S., Guy, L. S., & Hart, S. D. (2009). Psychosis as a risk factor for violence to others: A meta-analysis. Psychological Bulletin, 135(5), 679–706. 10.1037/a0016311
   PubMed Web of Science ®Google Scholar
• Douglas, K. S., Hart, S. D., Webster, C. D., & Belfrage, H. (2013). HCR-20 V3: Assessing risk for violence-user guide. Burnaby, Canada: Mental Health, Law, and Policy Institute, Simon Fraser University.
   Google Scholar
• Doyle, M., & Dolan, M. (2002). Violence risk assessment: Combining actuarial and clinical information to structure clinical judgements for the formulation and management of risk. Journal of Psychiatric and Mental Health Nursing, 9(6), 649–657.
   PubMedGoogle Scholar
• Doyle, M., Lewis, G., & Brisbane, M. (2008). Implementing the Short-Term Assessment of Risk and Treatability (START) in a forensic mental health service. Psychiatric Bulletin, 32(11), 406–408.
   Google Scholar
• Dye, S., Smyth, L., & Pereira, S. (2016). ‘Locked rehabilitation’: A need for clarification. British Journal of Psychiatry Bulletin, 40(1), 1–4.
   Google Scholar
• Fazel, S., Gulati, G., Linsell, L., Geddes, J. R., & Grann, M. (2009). Schizophrenia. and violence: Systematic review and meta-analysis. Public Library of Science Medicine, 6(8), e1000120.
   Google Scholar
• Fazel, S., Singh, J. P., Doll, H., & Grann, M. (2012). The prediction of violence and antisocial behaviour: A systematic review and meta-analysis of the utility of risk assessment instruments in 73 samples involving 24,827 individuals. BMJ, 345, e4692.
   PubMed Web of Science ®Google Scholar
• George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference (4th ed.). Allyn & Bacon: Boston.
   Google Scholar
• Gorrindo, T., Goldfarb, E., Chevalier, L., Hoeppner, B. B., Birnbaum, R. J., Meller, B., … Weiss, A. P. (2013). Interprofessional difference in disposition decisions: Results from a standardised wed-based patient assessment. Psychiatric Services, 64(8), 808–811.
   PubMedGoogle Scholar
• Gray, N. S., Benson, R., Craig, R., Davies, H., Fitzgerald, S., Huckle, P., … Snowden, R. J. (2011). The Short-Term Assessment of Risk and Treatability (START): A prospective study of inpatient behaviour. International Journal of Forensic Mental Health, 10(4), 305–313.
   Google Scholar
• Gray, R., Bressington, D., Hughes, E., & Ivanecka, A. (2016). A systematic review of the effects of novel psychoactive substances ‘legal highs’ on people with severe mental illness. Journal of Psychiatric and Mental Health Nursing, 23(5), 267–281.
   PubMed Web of Science ®Google Scholar
• Grove, W. M., & Meehl, P. E. (1996). Comparative efficacy of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction: The clinical–Statistical controversy. Psychology, Public Policy, and Law, 2(2), 293–323. 10.1037/1076-8971.2.2.293
   Web of Science ®Google Scholar
• Guy, L. S., Douglas, K. S., & Hart, S. D. (2015). Risk Assessment and communication. In B. L. Cutler & P. A. Zapf (Eds.), APA handbook of forensic psychology, Vol. 1: Individual and situational influences in criminal and civil contexts (pp. 35–86). Washington, DC: American Psychological Association.
   Google Scholar
• Hanson, R. K., & Bussière, M. T. (1998). Predicting relapse: A meta-analysis of offender recidivism studies. Journal of Consulting and Clinical Psychology, 66(2), 348–362.
   PubMed Web of Science ®Google Scholar
• Hanson, R. K., & Morton-Bourgon, K. (2004). Predictors of sexual recidivism: An updated meta-analysis 2004-02. Ottawa, Canada: Public Safety and Emergency Preparedness Canada. Retrieved from http://www.publicsafety.gc.ca/cnt/rsrcs/pblctns/2004-02-prdctrs-sxl-rcdvsm-pdtd/index-eng.aspx
   Google Scholar
• Hare, R. D. (2003). Manual for the revised psychopathy checklist ((2nd ed.). Toronto, ON: Multi-Health Systems.
   Google Scholar
• Harris, G. T., & Rice, M. E. (2015). Progress in violence risk assessment and communication: Hypothesis versus evidence. Behavioral Sciences & the Law, 33(1), 128–145.
   PubMed Web of Science ®Google Scholar
• Harris, P. B., Boccaccini, M. T., & Murrie, D. C. (2015). Rater differences in psychopathy measure scoring and predictive validity. Law and Human Behavior, 39(4), 321–331. 10.1037/lhb0000115
   PubMed Web of Science ®Google Scholar
• Hilton, N. Z., Carter, A., Harris, G. T., & Sharpe, A. J. B. (2008). Does using nonumerical terms to describe risk aid violence risk communication? Clinician agreement and decision-making. Journal of Interpersonal Violence, 23(2), 171–188.
   PubMed Web of Science ®Google Scholar
• Imam, S. F., Patel, H., Mahmoud, M., & Fremont, R. D. (2013). Bath salts intoxication: A case series. Journal of Emergency Medicine, 45(3), 361–365.
   PubMed Web of Science ®Google Scholar
• Johnson, T., & Wislar, J. (2012). Response rates and nonresponse error in surveys. The Journal of the American Medical Association, 307(17), 1805–1806.
   PubMed Web of Science ®Google Scholar
• Kingston, D. A., Olver, M. E., Harris, M., Booth, B. D., Gulati, S., & Cameron, C. (2016). The relationship between mental illness and violence in mentally disordered offender sample: Evaluating criminogenic and psychopathological predictors. Psychology, Crime & Law, 22(7), 1–23.
   Web of Science ®Google Scholar
• Klabunde, C. N., Willis, G. B., & Casalino, L. P. (2013). Facilitators and barriers to survey participation by physicians: A call to action for researchers. Evaluation & the Health Professions, 36(3), 279–295.
   PubMed Web of Science ®Google Scholar
• Koerner, K., & Castonguay, L. G. (2015). Practice-orientated research: What it takes to do collaborative research in private practice. Psychotherapy Research, 25(1), 67–83.
   PubMed Web of Science ®Google Scholar
• Large, M. M., Ryan, C. J., Callaghan, S., Paton, M. B., & Singh, S. P. (2013). Can violence risk assessment really assist in clinical decision-making? Australian and New Zealand Journal of Psychiatry, 48(3), 286–288.
   PubMed Web of Science ®Google Scholar
• Mental Health Act. (1983). Retrieved from http://www.legislation.gov.uk/ukpga/1983/20/contents
   Google Scholar
• Michel, S. F., Riaz, M., Webster, C., Hart, S. D., Levander, S., Müller-Isberner, R., & Hodgins, S. (2013). Using the HCR-20 to predict aggressive behavior among men with schizophrenia living in the community: Accuracy of prediction, general and forensic settings, and dynamic risk factors. International Journal of Forensic Mental Health, 12(1), 1–13.
   Web of Science ®Google Scholar
• Monahan, J., & Skeem, J. L. (2014). The evolution of violence risk assessment. CNS Spectrums, 19, 419–424.
   PubMed Web of Science ®Google Scholar
• Morris, D. (2013). The predictive validity of the Short Term Assessment of Risk and Treatability in an inpatient female forensic population. Unpublished Masters Thesis, School of Psychology, University of Birmingham, Birmingham, UK.
   Google Scholar
• Mullen, P. E., Mackenzie, R., Ogloff, J. R., Pathé, M., McEwan, T., & Purcell, R. (2006). Assessing and managing the risks in the stalking situation. The Journal of the American Academy of Psychiatry and the Law, 34(4), 439–450.
   PubMed Web of Science ®Google Scholar
• National Institute for Health and Care Excellence (2015). Violence and aggression: Short-term management in mental health, health and community settings. Retrieved from https://www.nice.org.uk/guidance/ng10
   Google Scholar
• Nicholls, T. L., Brink, J., Desmarais, S. L., Webster, C. D., & Martin, M. L. (2006). The Short-Term Assessment of Risk and Treatability (START): A prospective validation study in a forensic sample. Assessment, 13(3), 313–327.
   PubMed Web of Science ®Google Scholar
• Nicholls, T. L., Petersen, K., Brink, J., & Webster, C. (2011). A clinical risk profile of forensic psychiatric patients: Treatment team STARTs in a Canadian service. International Journal of Forensic Mental Health, 10(3), 187–199.
   Google Scholar
• Nonstad, K., Nesset, M. B., Kroppan, E., Pedersen, T. W., Nottestad, J. A., Almvik, R., & Palmstierna, T. (2010). Predictive validity and other psychometric properties of the Short-Term Assessment of Risk and Treatability (START) in a Norwegian high secure hospital. International Journal of Forensic Mental Health Services, 9(4), 294–299.
   Google Scholar
• O’Shea, L. E., & Dickens, G. L. (2014). Short-Term Assessment of Risk and Treatability (START): Systematic review and meta-analysis. Psychological Assessment, 26(3), 990–1002.
   PubMed Web of Science ®Google Scholar
• O’Shea, L. E., Picchioni, M. M., & Dickens, G. L. (2015). The predictive validity of the Short-Term Assessment of Risk and Treatability (START) for multiple adverse outcomes in a secure psychiatric inpatient setting. Assessment, 23(2), 150–162.
   PubMed Web of Science ®Google Scholar
• Penny, S. R., McMaster, R., & Wilkie, T. (2014). Multirater reliability of the historical, clinical, and risk management-20. Assessment, 21(1), 15–27.
   PubMed Web of Science ®Google Scholar
• Peters, E., & Slovic, P. (2000). The springs of action: Affective and analytical information processing in choice. Personality and Social Psychology Bulletin, 26(12), 1465–1475.
   Web of Science ®Google Scholar
• Philipse, M. W. G., Koeter, M. W. J., Van Der Staak, C. P. F., & Van Den Brink, W. (2005). Reliability and discriminant validity of dynamic reoffending risk indicators in forensic clinical practice. Criminal Justice and Behavior, 32(6), 643–664.
   Web of Science ®Google Scholar
• Sandberg, J. G., Johnson, L. N., Robia, M., & Miller, R. B. (2002). Clinician identified barriers to clinical research. Journal of Marital and Family Therapy, 28(1), 61–67.
   PubMed Web of Science ®Google Scholar
• Schuringa, E., Spreen, M., & Bogaerts, S. (2014). Inter-rater and test-retest reliability, internal consistency, and factorial structure of the instrument for forensic treatment evaluation. Journal of Forensic Psychology Practice, 14(2), 127–144.
   Web of Science ®Google Scholar
• Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420–428.
   PubMed Web of Science ®Google Scholar
• Singh, J., Desmarais, S., Hurducas, C., Arbach-Lucioni, K., Condemarin, C., Dean, D., & Otto, R. (2014). International perspectives on the practical application of violence risk assessment: A global survey of 44 countries. International Journal of Forensic Mental Health, 13(3), 1–14.
   Web of Science ®Google Scholar
• Slovic, P., Finucane, M. L., Peters, E., & MacGregor, D. G. (2004). Risk as analysis and risk as feelings: Some thoughts about affect, reason, risk and rationality. Risk Analysis, 24(2), 311–322.
   PubMed Web of Science ®Google Scholar
• Storey, J. E., Kropp, R. P., Hart, S. D., Belfrage, H., & Strand, S. (2013). Assessment and management of risk for intimate partner violence by police officers using the brief spousal assault form for the evaluation of risk. Criminal Justice and Behavior, 41(2), 256–271.
   Web of Science ®Google Scholar
• Sutherland, A. A., Johnstone, L., Davidson, K. M., Hart, S. D., Cooke, D. J., Kropp, P. R., & Stocks, R. (2012). Sexual violence risk assessment: An investigation of the interrater reliability of professional judgments made using the risk for sexual violence protocol. International Journal of Forensic Mental Health, 11(2), 119–133.
   Web of Science ®Google Scholar
• Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55.
   PubMedGoogle Scholar
• Tharp, A. T., DeGue, S., Valle, L. A., Brookmeyer, K. A., Massetti, G. M., & Matjasko, J. L. (2012). A systematic qualitative review of risk and protective factors for sexual violence perpetration. Trauma, Violence and Abuse, 14(2), 133–167.
   PubMed Web of Science ®Google Scholar
• Tully, R. J., Chou, S. C., & Browne, K. B. (2013). A systematic review on the effectiveness of sex offender risk assessment tools in predicting sexual recidivism of adult male sex offenders. Clinical Psychology Review, 33(2), 287–316.
   PubMed Web of Science ®Google Scholar
• Ward, T., & Willis, G. M. (2016). Responsivity dynamic risk factors and offender rehabilitation: A comparison of the good lives model and the risk-need model. In Treatment of sex offenders (pp. 175–190). Basel: Springer International Publishing.
   Google Scholar
• Webster, C. D., Haque, Q., & Hucker, S. J. (2013). Violence risk-assessment and management: Advances through structured professional judgement and sequential redirections. New York: John Wiley & Sons.
   Google Scholar
• Webster, C. D., Martin, M. L., Brink, J., Nicholls, T. L., & Desmarais, S. (2009). Manual for the Short Term Assessment of Risk and Treatability (START) (revised). Version 1.1. Port Coquitlam, BC: Forensic Psychiatric Services Commission and Hamilton, Ontario: St. Joseph’s Healthcare.
   Google Scholar
• Whittington, R., Hockenhull, J., McGuire, J. C., Leitner, M., Barr, W., Cherry, M. G., … Dickson, R. (2013). A systematic review of risk assessment strategies for populations at high risk of engaging in violent behaviour: Update 2002–8. Scientific summary: Populations at high risk of engaging in violent behaviour. Health Technology Assessment, 17, 50.
   Web of Science ®Google Scholar
• Wilson, C. M., Desmarais, S. L., Nicholls, T. L., & Brink, J. (2010). The role of client strengths in assessments of risk using the Short-Term Assessment of Risk and Treatability (START). International Journal of Forensic Mental Health Services, 9(4), 282–293. 10.1080/14999013.2010.534694
   Google Scholar