Does the Predictive Validity of Psychopathy Ratings Depend on the Clinical Experience of the Raters?

References

• Boccaccini, M. T., Murrie, D. C., Rufino, K. A., & Gardner, B. O. (2014). Evaluator differences in PCL-R factor and facet level scoring. Law and Human Behavior, 38, 337–345. doi: 10.1037/lhb0000069
   PubMed Web of Science ®Google Scholar
• Boccaccini, M.T., Turner, D., & Murrie, D.C. (2008). Do some evaluators report consistently higher or lower scores on the PCL-R?: Findings from a statewide sample of sexually violent predator evaluations. Psychology, Public Policy, and Law, 14, 262–283. doi: 10.1037/a00114523
   Web of Science ®Google Scholar
• Boccaccini, M.T., Turner, D., Murrie, D. C., & Rufino, K. A. (2012). Do PCL-R scores from state or defense experts best predict future misconduct among civilly committed sex offenders? Law and Human Behavior, 36, 159–169. doi: 10.1037/h0093949
   PubMed Web of Science ®Google Scholar
• Brammer, R. (2002). Effects of experience and training on diagnostic accuracy. Psychological Assessment, 14, 110–113. doi: 10.1037/1040-3590.14.1.110
   PubMed Web of Science ®Google Scholar
• DeLong, E.R., DeLong, D.M., & Clarke-Pearson D.L. (1988). Comparing the area under two or more correlated receiver operating characteristic curves: A nonparametric approach. Biometrics, 44, 837–845.
   PubMed Web of Science ®Google Scholar
• DeMatteo, D., Edens, J. F., Galloway, M., Cox, J., Toney Smith, S., & Koller, J. P. (2014). Investigating the role of the Psychopathy Checklist-Revised in United States case law. Psychology, Public Policy, and Law, 20, 96–107. doi: 10.1037/a0035452
   Web of Science ®Google Scholar
• de Vogel, V., & de Ruiter, C. (2006). Structured professional judgment of violence risk in forensic clinical practice: A prospective study into the predictive validity of the Dutch HCR-20. Psychology, Crime, and Law, 12, 321–336. doi: 10.1080/10683160600569029
   Web of Science ®Google Scholar
• Edens, J. F., Campbell, J. S., & Weir, J. M. (2007). Youth psychopathy and criminal recidivism: A meta-analysis of the psychopathy checklist measures. Law and Human Behavior, 31, 53–75. doi: 10.1007/s10979-006-9019-y
   PubMed Web of Science ®Google Scholar
• Edens, J. F., Cox, J., Toney Smith, S., deMatteo, D., & Sörman, K. (2015). How reliable are Psychopathy checklist-Revised scores in Canadian criminal trials? A case law review. Psychological Assessment, 27, 447–456. Doi: 10.1037/pas0000048
   PubMed Web of Science ®Google Scholar
• Garb, H. N. (1998). Studying the clinician: Judgment research and clinical assessment. Washington, DC: American Psychological Association.
   Google Scholar
• Garb, H. N., & Boyle, P. A. (2014). Understanding why some clinicians use pseudoscientific methods: Findings from research on clinical judgment. In S.O. Lilienfeld, S. J., Lynn, and J. M. Lohr (Eds.). Science and Pseudoscience in Clinical Psychology (2nd ed., pp. 19–41). New York, NY: Guilford.
   Google Scholar
• Guy, L. S., Edens, J. F., Anthony, C., & Douglas, K. S. (2005). Does psychopathy predict institutional misconduct among adults? A meta-analytic investigation. Journal of Consulting and Clinical Psychology, 73, 1056–1064. doi: 10.1037/0022-006x.73.6.1056
   PubMed Web of Science ®Google Scholar
• Hare, R. D. (2003). Hare Psychopathy Checklist-Revise manual (2nd ed.). Toronto, Canada: Multi-Health System.
   Google Scholar
• Harris, P. B., Boccaccini, M. T., & Murrie, D. C. (2015). Rater differences in psychopathy measure scoring and predictive validity. Law and Human Behavior, 39, 321–331. doi: 10.1037/lhb0000115
   PubMed Web of Science ®Google Scholar
• Hart, S. D., Cox, D. N., & Hare, R. D. (1995). The Hare Psychopathy Checklist: Screening Version (PCL:SV). Toronto, Canada: Multi-Heath Systems.
   Google Scholar
• Hawes, S. M., Boccaccini, M.T., & Murrie, D. C. (2013). Psychopathy and the combination of psychopathy and sexual deviance as predictors of sexual recidivism: Meta-analytic findings using the Psychopathy Checklist-Revised. Psychological Assessment, 25, 233–243. doi: 10.1037/a0030391
   PubMed Web of Science ®Google Scholar
• Jackson, R. L., Rogers, R., & Shuman, D. W. (2004). The adequacy and accuracy of sexually violent predator evaluations: Contextualized risk assessment in clinical practice. International Journal of Forensic Mental Health, 3, 115–129.
   Google Scholar
• Jeon, H., Boccaccini, M. T., Rufino, K., Jo, E., & Jang, H. (2015, March). Do Psychopathy Checklist scores from experienced clinicians outperform those from less experienced clinicians? Poster presented at the meeting of the American Psychology-Law Society, San Diego, CA.
   Google Scholar
• Kennealy, P. J., Skeem, J. L., Walters, G. D., & Camp, J. (2010). Do core interpersonal and affective traits of PCL-R psychopathy interact with antisocial behavior and disinhibition to predict violence? Psychological Assessment, 23, 569–580. doi: 10.1037/a0019618
   Web of Science ®Google Scholar
• Knight, R. A., & Thornton, D. (2007). Evaluating and improving risk assessment schemes for sexual recidivism: A long-term follow-up of convicted sexual offenders ( U.S. Department of Justice Report, Document No. 217618). Washington, DC: U.S. Department of Justice.
   Google Scholar
• Leistico, A. M., Salekin, R. T., DeCoster, J., & Rogers, R. (2008). A large-scale meta-analysis relating the hare measures of psychopathy to antisocial conduct. Law and Human Behavior, 32, 28–45. doi: 10.1007/sl10979-007-9096-6
   PubMed Web of Science ®Google Scholar
• McNeil, D. E., Gregory, A. L., Lam, J. N., Binder, R. L., & Sullivan, G. R. (2003). Utility of decision support tools for assessing acute violence risk. Journal of Consulting and Clinical Psychology, 71, 945–953. doi: 10.1037/0022-006X.71.5.945
   PubMed Web of Science ®Google Scholar
• Miller, H. A., Kimonis, E. R., Otto, R. K., Kline, S. M., & Wasserman, A. L. (2012). Reliability of risk assessment measures used in Sexually Violent Predator proceedings. Psychological Assessment, 24, 944–953. doi: 10.1037/a0028411
   PubMed Web of Science ®Google Scholar
• Miller, D. J., Spengler, E. S., Spengler, P. M. (2015). A meta-analysis of confidence and judgment accuracy in clinical decision making. Journal of Counseling Psychology, 62, 553–567. doi: 10.1037/cou0000105
   PubMed Web of Science ®Google Scholar
• Monahan, J., Steadman, H., Silver, E., Appelbaum, P., Robbins, P., Mulvey, E., Roth, L., Grisso, T., & Banks, S. (2001). Rethinking Risk Assessment: The MacArthur Study of Mental Disorder and Violence. New York, NY: Oxford University Press.
   Google Scholar
• Murrie, D.C., Boccaccini, M.T., Caperton, J.D., & Rufino, K.A. (2012). Field validity of the Psychopathy Checklist-Revised in sex offender risk assessment. Psychological Assessment, 24, 524–529. doi: 10.1037/a0026015
   PubMed Web of Science ®Google Scholar
• Murrie, D.C., Boccaccini, M.T., Johnson, J.T., & Janke, C. (2008). Does interrater (dis)agreement on Psychopathy checklist scores in sexually violent predator trials suggest partisan allegiance in forensic evaluations? Law and Human Behavior, 32, 352–362. doi 10.1007/s10979-007-9097-5
   PubMed Web of Science ®Google Scholar
• Murrie, D.C., Boccaccini, M.T., Turner, D., Meeks, M., Woods, C., & Tussey, C. (2009). Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation? Psychology, Public Policy, and Law, 15, 19–53. doi: 10.1037/a0014897
   Web of Science ®Google Scholar
• Neal, T. M. S., & Grisso, T. (2014). Assessment practices and expert judgment methods in forensic psychology and psychiatry: An international snapshot. Criminal Justice and Behavior, 41, 1406–1421. doi: 10.1177/0093854814548449
   Web of Science ®Google Scholar
• Olver, M. E., & Wong, S. C. (2006). Psychopathy, sexual deviance, and recidivism among sex offenders. Sexual Abuse: Journal of Research and Treatment, 18, 65–82. doi:10.1007/s11194-006-9006-3
   PubMed Web of Science ®Google Scholar
• Rufino, K. A., Boccaccini, M. T., Hawes, S., & Murrie, D. C. (2012). When experts disagreed, who was correct? A comparison of PCL-R scores from independent raters and opposing forensic expert. Law and Human Behavior, 36, 527–537. doi:10.1037/h0093988
   PubMed Web of Science ®Google Scholar
• Singh, J. P., Desmarais, S. L., Hurducas, C., Arbach-Lucioni, K., Condemarin, C., & Dean, K. (2014). International perspectives on the practical application of violent risk assessment: A global survey of 44 countries. International Journal of Forensic Mental Health, 13, 193–206. doi: 10.1080/14999013.2014.922141
   Web of Science ®Google Scholar
• Spain, S. E., Douglas, K. S., Poythress, N. G., & Epstein, M. (2004). The relationship between psychopathic features, violence, and treatment outcome: The comparison of three youth psychopathic measures. Behavioral Sciences and the Law, 22, 85–102. doi: 10.1002/bsl.576
   PubMed Web of Science ®Google Scholar
• Spengler, P. M., & Pilipis, L. A. (2015). A comprehensive meta-reanalysis of the robustness of the experience-accuracy effect in clinical judgment. Counseling Psychologist, 62, 360–378. doi:10.1177/cou0000065
   Google Scholar
• Teo, A. R., Holley, S. R., Leary, M., & McNeil, D. E. (2012). The relationship between level of training and accuracy of violence risk assessment. Psychiatric Services, 63, 1089–1094. doi: 10.1176/appi.ps.201200019
   PubMed Web of Science ®Google Scholar
• Vilojen, J. L., McLachlan, K., & Vincent, G. (2012). Assessing violence risk and psychopathy in juvenile and adult offenders: A survey of clinical practices. Assessment, 17, 377–395. doi: 10.1177/1073191109359587
   Web of Science ®Google Scholar
• Walters, G. D., Knight, R. A., Grann, M., & Dahle, K. P. (2008). Incremental validity of the Psychopathy Checklist facet scores: Predicting release outcome in six samples. Journal of Abnormal Psychology, 117, 396–405. doi:10.1037/0021-843X.117.2.396
   PubMed Web of Science ®Google Scholar
• Walters, G. D., Kroner, D. G., DeMatteo, D., & Locklair, B. R. (2014). The impact of base ate utilization and clinical experience on the accuracy of judgments made with the HCR-20. Journal of Forensic Psychology Practice, 14, 288–301. doi: 10.1080/15228932.2014.941726
   Web of Science ®Google Scholar
• Yang, M., Wong, S. C. P., & Coid, J. (2010). The efficacy of violence prediction” A meta-analytic comparison of nine risk assessment tools. Psychological Bulletin, 136, 740–767. doi: 10.1037/a0020473
   PubMed Web of Science ®Google Scholar