Development of the FORUM: a new patient and clinician reported outcome measure for forensic mental health services

References

• Bishop, P., & Herron, R. (2015). Use and misuse of the Likert item responses and other ordinal measures. International Journal of Exercise Science, 8, 297–302.
   Google Scholar
• Bouman, Y., Schene, A., & de Ruiter, C. (2009). Subjective well-being and recidivism in forensic psychiatric outpatients. The International Journal of Forensic Mental Health, 8(4), 225–234. https://doi.org/10.1080/14999011003635647
   Google Scholar
• Brady, S. (2015). Utilizing and adapting the Delphi method for use in qualitative research. International Journal of Qualitative Methods, 14(5). https://doi.org/10.1177/1609406915621381
   PubMedGoogle Scholar
• Brédart, A., Marrel, A., Abetz-Webb, L., Lasch, K., & Acquadro, C. (2014). Interviewing to develop patient-reported outcome (PRO) measures for clinical research: Eliciting patients’ experience. Health and Quality of Life Outcomes, 12(1), 15. https://doi.org/10.1186/1477-7525-12-15
   PubMedGoogle Scholar
• Brookes, S., Chalmers, K., Avery, K., Coulman, K., Blazeby, J., Barham, C., …  on behalf of the, ROMIO study group (2018). impact of question order on prioritisation of outcomes in the development of a core outcome set: A randomised controlled trial. Trials, 19(1), 66. https://doi.org/10.1186/s13063-017-2405-6
   PubMedGoogle Scholar
• Brown, S., O’Rourke, S., & Schwannauer, M. (2019). Risk factors for inpatient violence and self-harm in forensic psychiatry: The role of head injury, schizophrenia and substance misuse. Brain Injury, 33(3), 313–321. https://doi.org/10.1080/02699052.2018.1553064
   PubMed Web of Science ®Google Scholar
• Buchanan, A., & Grounds, A. (2011). Forensic psychiatry and public protection. British Journal of Psychiatry, 198(6), 420–423. https://doi.org/10.1192/bjp.bp.111.095471
   PubMed Web of Science ®Google Scholar
• Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., & Neville, A. J. (2014). The use of triangulation in qualitative research. Oncology Nursing Forum, 41(5), 545–547. https://doi.org/10.1188/14.Onf.545-547
   PubMed Web of Science ®Google Scholar
• Castleberry, A., & Nolen, A. (2018). Thematic analysis of qualitative research data: Is it as easy as it sounds? Currents in Pharmacy Teaching and Learning, 10(6), 807–815. https://doi.org/10.1016/j.cptl.2018.03.019
   PubMed Web of Science ®Google Scholar
• Centre for Mental Health. (2013). Guidance for commissioners of forensic mental health services. Author.
   Google Scholar
• Chambers, J., Yiend, J., Barrett, B., Burns, T., Doll, H., Fazel, S., Jenkinson, C., Kaur, A., Knapp, M., Plugge, E., Sutton, L., & Fitzpatrick, R. (2009). Outcome measures used in forensic mental health research: A structured review. Criminal Behaviour and Mental Health, 19(1), 9–27. https://doi.org/10.1002/cbm.724
   PubMed Web of Science ®Google Scholar
• Clark, D., Canvin, L., Green, J., Layard, R., Pilling, S., & Janecka, M. (2018). Transparency about the outcomes of mental health services (IAPT approach): an analysis of public data. Lancet, 391(10121), 679–686. https://doi.org/10.1016/S0140-6736(17)32133-5
   PubMed Web of Science ®Google Scholar
• Clarke, P., Fiebig, D., & Gerdtham, U. (2008). Optimal recall length in survey design. Journal of Health Economics, 27(5), 1275–1284. https://doi.org/10.1016/j.jhealeco.2008.05.012
   PubMed Web of Science ®Google Scholar
• Clarke, C., Lumbard, D., Sambrook, S., & Kerr, K. (2016). What does recovery mean to a forensic mental health patient? A systematic review and narrative synthesis of the qualitative literature. The Journal of Forensic Psychiatry & Psychology, 27(1), 38–54. https://doi.org/10.1080/14789949.2015.1102311
   Web of Science ®Google Scholar
• Coffey, M., Hannigan, B., Barlow, S., Cartwright, M., Cohen, R., Faulkner, A., Jones, A., & Simpson, A. (2019). Recovery-focused mental health care planning and co-ordination in acute inpatient mental health settings: A cross national comparative mixed methods study. BMC Psychiatry, 19(1), 115. https://doi.org/10.1186/s12888-019-2094-7
   PubMed Web of Science ®Google Scholar
• Crew, R., & Williamson, P. (2020). DelphiManager (Version 5.0). https://www.comet-initiative.org/delphimanager/
   Google Scholar
• Crocker, A., Livingston, J., & Leclair, M. (2017). Forensic mental health systems internationally. In R. Roesch & A. N. Cook (Eds.), Handbook of forensic mental health services (pp. 3–76). Routledge/Taylor & Francis Group.
   Google Scholar
• de Meyer, D., Kottner, J., Beele, H., Schmitt, J., Lange, T., Van Hecke, A., Verhaeghe, S., & Beeckman, D. (2019). Delphi procedure in core outcome set development: Rating scale and consensus criteria determined outcome selection. Journal of Clinical Epidemiology, 111, 23–31. https://doi.org/10.1016/j.jclinepi.2019.03.011
   PubMed Web of Science ®Google Scholar
• de Vet, H., Terwee, C., Mokkink, L., & Knol, D. (2011). Measurement in medicine: A practical guide. Cambridge University Press.
   Google Scholar
• Dickens, G., Sugarman, P., & Walker, L. (2007). HoNOS-secure: A reliable outcome measure for users of secure and forensic mental health services. Journal of Forensic Psychiatry & Psychology, 18(4), 507–514. https://doi.org/10.1080/14789940701492279
   Web of Science ®Google Scholar
• Drennan, J. (2003). Cognitive interviewing: Verbal data in the design and pretesting of questionnaires. Journal of Advanced Nursing, 42(1), 57–63. https://doi.org/10.1046/j.1365-2648.2003.02579.x
   PubMed Web of Science ®Google Scholar
• Etikan, I., Musa, S., & Alkassim, R. (2016). Comparison of convenience sampling and purposive sampling. American Journal of Theoretical and Applied Statistics, 5(1), 1–4. https://doi.org/10.11648/j.ajtas.20160501.11
   Google Scholar
• Fazel, S., Fiminska, Z., Cocks, C., & Coid, J. (2016). Patient outcomes following discharge from secure psychiatric hospitals: Systematic review and meta-analysis. British Journal of Psychiatry, 208(1), 17–25. https://doi.org/10.1192/bjp.bp.114.149997
   PubMed Web of Science ®Google Scholar
• Fitzpatrick, R., Chambers, J., Burns, T., Doll, H., Fazel, S., Jenkinson, C., Kaur, A., Knapp, M., Sutton, L., &  Yiend, J. (2010). A systematic review of outcome measures used in forensic mental health research with consensus panel opinion. Health Technology Assessment, 14(18), 1–94. https://doi.org/10.3310/hta14180
   Web of Science ®Google Scholar
• Georgiou, M., Oultram, M., & Haque, Q. (2019). Standards for forensic mental health services: Low and medium secure care. 3rd ed. London, UK: Royal College of Psychiatrists.
   Google Scholar
• Grundy, A., Keetharuth, A., Barber, R., Carlton, J., Connell, J., Taylor Buck, E., Barkham, M., Ricketts, T., Robotham, D., Rose, D., Kay, J., Hanlon, R., & Brazier, J. (2019). Public involvement in health outcomes research: Lessons learnt from the development of the recovering quality of life (ReQoL) measures. Health and Quality of Life Outcomes, 17(1), 60. https://doi.org/10.1186/s12955-019-1123-z
   PubMedGoogle Scholar
• Gudjonsson, G., Webster, G., & Green, T. (2010). The recovery approach to care in psychiatric services: Staff attitudes before and after training. The Psychiatrist, 34(8), 326–329. https://doi.org/10.1192/pb.bp.109.028076
   Google Scholar
• Hansen, E. (2020). Successful qualitative health research: A practical introduction. Routledge.
   Google Scholar
• Hare-Duke, L., Furtado, V., Guo, B., & Völlm, B. (2018). Long-stay in forensic-psychiatric care in the UK. Social Psychiatry and Psychiatric Epidemiology, 53(3), 313–321. https://doi.org/10.1007/s00127-017-1473-y
   PubMed Web of Science ®Google Scholar
• Latham, R., & Williams, H. (2020). Community forensic psychiatric services in England and Wales. CNS Spectrums, 25(5), 604–617. https://doi.org/10.1017/S1092852919001743
   PubMed Web of Science ®Google Scholar
• Livingston, J. (2018). What does success look like in the forensic mental health system? Perspectives of service users and service providers. International Journal of Offender Therapy and Comparative Criminology, 62(1), 208–228. https://doi.org/10.1177/0306624X16639973
   PubMed Web of Science ®Google Scholar
• MacLennan, S., Kirkham, J., Lam, T., & Williamson, P. (2018). A randomized trial comparing three Delphi feedback strategies found no evidence of a difference in a setting with high initial agreement. Journal of Clinical Epidemiology, 93, 1–8. https://doi.org/10.1016/j.jclinepi.2017.09.024
   PubMed Web of Science ®Google Scholar
• Morrissey, C., Geach, N., Alexander, R., Chester, V., Devapriam, J., Duggan, C., … Walker, D. M. (2017). Researching outcomes from forensic services for people with intellectual or developmental disabilities: A systematic review, evidence synthesis and expert and patient/carer consultation. NIHR Journals Library. Health Services and Delivery Research, 5(3). https://doi.org/10.3310/hsdr05030
   Google Scholar
• NHS England. (2020a). Clinical reference group for adult secure services. https://www.england.nhs.uk/commissioning/spec-services/npc-crg/group-c/c02/
   Google Scholar
• NHS England. (2020b). Service specifications: Adult medium secure services including access assessment service and forensic outreach and liaison services (FOLS). https://www.england.nhs.uk/wp-content/uploads/2018/03/adult-medium-secure-service-specification-v3.pdf
   Google Scholar
• NHS England. (2020c). Specialised services quality dashboards. https://www.england.nhs.uk/commissioning/spec-services/npc-crg/spec-dashboards/#mental-health
   Google Scholar
• NHS England and NHS Improvement. (2016). Delivering the five year forward view for mental health: Developing quality and outcomes measure. NHS England. https://www.england.nhs.uk/mentalhealth/wp-content/uploads/sites/29/2016/02/mh-quality-outcome.pdf
   Google Scholar
• Nilsson, T., Munthe, C., Gustavson, C., Forsman, A., & Anckarsäter, H. (2009). The precarious practice of forensic psychiatric risk assessments. International Journal of Law and Psychiatry, 32(6), 400–407. https://doi.org/10.1016/j.ijlp.2009.09.010
   PubMed Web of Science ®Google Scholar
• Nottinghamshire Healthcare NHS foundation Trust. (2021). Nottinghamshire Healthcare NHS foundation Trust. Nottingham, United Kingdom: Nottinghamshire Healthcare NHS foundation Trust. https://www.nottinghamshirehealthcare.nhs.uk/
   Google Scholar
• Nowell, L., Norris, J., White, D., & Moules, N. (2017). Thematic analysis: Striving to meet the trustworthiness criteria. International Journal of Qualitative Methods, 16(1). https://doi.org/10.1177/1609406917733847
   PubMed Web of Science ®Google Scholar
• Obbarius, A., van Maasakkers, L., Baer, L., Clark, D. M., Crocker, A. G., de Beurs, E., Emmelkamp, P. M. G., Furukawa, T. A., Hedman-Lagerlöf, E., Kangas, M., Langford, L., Lesage, A., Mwesigire, D. M., Nolte, S., Patel, V., Pilkonis, P. A., Pincus, H. A., Reis, R. A., Rojas, G., … Rose, M. (2017). Standardization of health outcomes assessment for depression and anxiety: Recommendations from the ICHOM depression and anxiety working group. Quality of Life Research, 26(12), 3211–3225. https://doi.org/10.1007/s11136-017-1659-5
   PubMed Web of Science ®Google Scholar
• O'Dwyer, S., Davoren, M., Abidin, Z., Doyle, E., McDonnell, K., & Kennedy, H. (2011). The DUNDRUM quartet: Validation of structured professional judgement instruments DUNDRUM-3 assessment of programme completion and DUNDRUM-4 assessment of recovery in forensic mental health services. BMC Research Notes, 4(1), 229. https://doi.org/10.1186/1756-0500-4-229
   PubMedGoogle Scholar
• O’ Flynn, P., O’ Regan, R., O’ Reilly, K., & Kennedy, H. G. (2018). Predictors of quality of life among inpatients in forensic mental health: Implications for occupational therapists. BMC Psychiatry, 18(1), 16. https://doi.org/10.1186/s12888-018-1605-2
   PubMedGoogle Scholar
• Oxford Health NHS Foundation Trust. (2020). Oxford Health NHS Foundation Trust. Oxford, United Kingdom: Oxford Health NHS Foundation Trust. https://www.oxfordhealth.nhs.uk/about-us/
   Google Scholar
• Prinsen, C., Mokkink, L., Bouter, L., Alonso, J., Patrick, D., de Vet, H., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. https://doi.org/10.1007/s11136-018-1798-3
   PubMed Web of Science ®Google Scholar
• Recovery and Outcomes. (2020). Recovery and Outcomes. London, United Kingdom: Rethink Mental Illness. http://www.recoveryandoutcomes.org/about-us/about-recovery-and-outcomes.html
   Google Scholar
• Rose, D., Thornicroft, G., & Slade, M. (2006). Who decides what evidence is? Developing a multiple perspectives paradigm in mental health. Acta Psychiatrica Scandinavica, 113(s429), 109–114. https://doi.org/10.1111/j.1600-0447.2005.00727.x
   Web of Science ®Google Scholar
• Samartzis, L., & Talias, M. (2020). Assessing and improving the quality in mental health services. International Journal of Environmental Research and Public Health, 17(1), 249. https://doi.org/10.3390/ijerph17010249
   Web of Science ®Google Scholar
• Sharkey, K., Savulescu, J., Aranda, S., & Schofield, P. (2010). Clinician gate-keeping in clinical research is not ethically defensible: An analysis. Journal of Medical Ethics, 36(6), 363–366. https://doi.org/10.1136/jme.2009.031716
   PubMed Web of Science ®Google Scholar
• Shinkfield, G., & Ogloff, J. (2015). Use and interpretation of routine outcome measures in forensic mental health. International Journal of Mental Health Nursing, 24(1), 11–18. https://doi.org/10.1111/inm.12092
   PubMed Web of Science ®Google Scholar
• Terwee, C., Prinsen, C., Chiarotto, A., Westerman, M., Patrick, D., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Mokkink, L. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0
   PubMed Web of Science ®Google Scholar
• Thomas, S., Slade, M., McCrone, P., Harty, M., Parrott, J., Thornicroft, G., & Leese, M. (2008). The reliability and validity of the forensic camberwell assessment of need (CANFOR): a needs assessment for forensic mental health service users. International Journal of Methods in Psychiatric Research, 17(2), 111–120. https://doi.org/10.1002/mpr.235
   PubMed Web of Science ®Google Scholar
• Tomlin, J., Lega, I., Braun, P., Kennedy, H. G., Herrando, V., Barroso, R., Castelletti, L., Mirabella, F., Scarpa, F., Völlm, B., Pham, T., Müller-Isberner, R., Taube, M., Rivellini, G., Calevro, V., Liardo, R., Pennino, M., Markiewicz, I., Barbosa, F., … Čėsnienė, I.,  the experts of, C. A. I. S (2021). Forensic mental health in Europe: Some key figures. Social Psychiatry and Psychiatric Epidemiology, 56(1), 109–117. https://doi.org/10.1007/s00127-020-01909-6
   PubMed Web of Science ®Google Scholar
• Vale, M., & Good, M. (2020). Transcending the profession: Psychiatric patients’ experiences of trust in clinicians. Journal of Health and Social Behavior, 61(2), 208–222. https://doi.org/10.1177/0022146520918559
   PubMed Web of Science ®Google Scholar
• Völlm, B. (2019). How long is (too) long? BJPsych Bulletin, 43(4), 151–153. https://doi.org/10.1192/bjb.2019.24
   PubMed Web of Science ®Google Scholar
• Vollm, B., Clarke, M., Herrando, V., Seppanen, A. O., Gosek, P., Heitzman, J., & Bulten, E. (2018). European psychiatric association (EPA) guidance on forensic psychiatry: Evidence based assessment and treatment of mentally disordered offenders. European Psychiatry, 51, 58–73. https://doi.org/10.1016/j.eurpsy.2017.12.007
   PubMed Web of Science ®Google Scholar
• Völlm, B., Foster, S., Bates, P., & Huband, N. (2017). How best to engage users of forensic services in research: Literature review and recommendations. International Journal of Forensic Mental Health, 16(2), 183–195. https://doi.org/10.1080/14999013.2016.1255282
   Web of Science ®Google Scholar
• Wallang, P., Kamath, S., Parshall, A., Saridar, T., & Shah, M. (2018). Implementation of outcomes-driven and value-based mental health care in the UK. British Journal of Hospital Medicine, 79(6), 322–327. https://doi.org/10.12968/hmed.2018.79.6.322
   Web of Science ®Google Scholar
• Wiering, B., de Boer, D., & Delnoij, D. (2017). Patient involvement in the development of patient-reported outcome measures: A scoping review. Health Expectations, 20(1), 11–23. https://doi.org/10.1111/hex.12442
   PubMed Web of Science ®Google Scholar
• Williamson, P., Altman, D., Bagley, H., Barnes, K., Blazeby, J., Brookes, S., Clarke, M., Gargon, E., Gorst, S., Harman, N., Kirkham, J. J., McNair, A., Prinsen, C. A. C., Schmitt, J., Terwee, C. B., & Young, B. (2017). The COMET handbook: Version 1.0. Trials, 18(S3), 280. https://doi.org/10.1186/s13063-017-1978-4
   PubMed Web of Science ®Google Scholar