Reliability and validity of the FORUM-P and FORUM-C: two novel instruments for outcome measurement in forensic mental health

References

• Aas, I. H. M. (2011). Guidelines for rating Global Assessment of Functioning (GAF). Annals of General Psychiatry, 10(2). https://doi.org/10.1186/1744-859X-10-2.
   PubMedGoogle Scholar
• Bauer, M. S., Damschroder, L., Hagedorn, H., Smith, J., & Kilbourne, A. M. (2015). An introduction to implementation science for the non-specialist. BMC Psychology, 3(1), 32. https://doi.org/10.1186/s40359-015-0089-9
   PubMedGoogle Scholar
• Bland, J. M., & Altman, D. G. (1997). Statistics notes: Cronbach's alpha. BMJ, 314(7080), 572. https://doi.org/10.1136/bmj.314.7080.572
   PubMed Web of Science ®Google Scholar
• Chandwani, K. D., Zhao, F., Morrow, G. R., Deshields, T. L., Minasian, L. M., Manola, J., & Fisch, M. J. (2017). Lack of patient-clinician concordance in cancer patients: Its relation with patient variables. Journal of Pain and Symptom Management, 53(6), 988–998. https://doi.org/10.1016/j.jpainsymman.2016.12.347
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104
   Web of Science ®Google Scholar
• Collins, B. (2019). Outcomes for mental health services. What really matters? King's Fund.
   Google Scholar
• Crocker, A. G., Livingston, J. D., & Leclair, M. C. (2017). Forensic mental health systems internationally. In R. Roesch & A. N. Cook (Eds.), Handbook of forensic mental health services (pp. 3–76). Routledge/Taylor & Francis Group. https://doi.org/10.4324/9781315627823-2
   Google Scholar
• Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555
   Web of Science ®Google Scholar
• de Vet, H. C., Terwee, C. B., Mokkink, L. B., & Knol, D. L. (2011). Measurement in medicine: A practical guide. Cambridge University Press.
   Google Scholar
• Dickens, G., Sugarman, P., & Walker, L. (2007). HoNOS-secure: A reliable outcome measure for users of secure and forensic mental health services. Journal of Forensic Psychiatry & Psychology, 18(4), 507–514. https://doi.org/10.1080/14789940701492279
   Web of Science ®Google Scholar
• Dickinson, T., & Wright, K. M. (2008). Stress and burnout in forensic mental health nursing: A literature review. British Journal of Nursing, 17(2), 82–87. https://doi.org/10.12968/bjon.2008.17.2.28133
   PubMedGoogle Scholar
• Douglas, K. S. (2014). Version 3 of the historical-clinical-risk management-20 (HCR-20V3): Relevance to violence risk assessment and management in forensic conditional release contexts [review]. Behavioral Sciences & The Law, 32(5), 557–576. https://doi.org/10.1002/bsl.2134
   PubMed Web of Science ®Google Scholar
• Edworthy, R., & Vollm, B. (2016). Long-stay in high and medium secure forensic psychiatric care - prevalence, patient characteristics and pathways in England. European Psychiatry, 33(SUPPL.), S180. https://doi.org/10.1016/j.eurpsy.2016.01.385
   Google Scholar
• Fazel, S., Fiminska, Z., Cocks, C., & Coid, J. (2016). Patient outcomes following discharge from secure psychiatric hospitals: Systematic review and meta-analysis. British Journal of Psychiatry, 208(1), 17–25. https://doi.org/10.1192/bjp.bp.114.149997
   PubMed Web of Science ®Google Scholar
• Fazel, S., & Wolf, A. (2017). Selecting a risk assessment tool to use in practice: A 10-point guide [review]. Evidence Based Mental Health, 21, 21. https://doi.org/10.1136/eb-2017-102861
   Web of Science ®Google Scholar
• Fitzpatrick, R., Chambers, J., Burns, T., Doll, H., Fazel, S., Jenkinson, C., Kaur, A., Knapp, M., Sutton, L., & Yiend, J. (2010). A systematic review of outcome measures used in forensic mental health research with consensus panel opinion. Health Technology Assessment (Winchester, England), 14(18), 1–94. https://doi.org/10.3310/hta14180
   Web of Science ®Google Scholar
• Holtrop, J. S., & Glasgow, R. E. (2020). Pragmatic research: An introduction for clinical practitioners. Family Practice, 37(3), 424–428. https://doi.org/10.1093/fampra/cmz092
   Web of Science ®Google Scholar
• Kennedy, H. G. (2002). Therapeutic uses of security: Mapping forensic mental health services by stratifying risk. Advances in Psychiatric Treatment, 8(6), 433–443. https://doi.org/10.1192/apt.8.6.433
   Google Scholar
• King, G., & Wand, J. (2007). Comparing incomparable survey responses: Evaluating and selecting anchoring vignettes. Political Analysis, 15(1), 46–66. https://doi.org/10.1093/pan/mpl011
   Web of Science ®Google Scholar
• Krosnick, J. A. (2018). Questionnaire design. In D. L. Vannette & J. A. Krosnick (Eds.), The Palgrave handbook of survey research (pp. 439–455). Springer.
   Google Scholar
• Latham, R., & Williams, H. K. (2020). Community forensic psychiatric services in England and Wales. CNS Spectrums, 25(5), 604–617. https://doi.org/10.1017/S1092852919001743
   PubMed Web of Science ®Google Scholar
• MacInnes, D., Beer, D., Keeble, P., Rees, D., & Reid, L. (2011). Service-user involvement in forensic mental health care research: Areas to consider when developing a collaborative study. Journal of Mental Health, 20(5), 464–472. https://doi.org/10.3109/09638231003728109
   PubMed Web of Science ®Google Scholar
• Maddock, A. (2015). Consensus or contention: An exploration of multidisciplinary team functioning in an Irish mental health context. European Journal of Social Work, 18(2), 246–261. https://doi.org/10.1080/13691457.2014.885884
   Web of Science ®Google Scholar
• Mezey, G., White, S., Thachil, A., Berg, R., Kallumparam, S., Nasiruddin, O., Wright, C., & Killaspy, H. (2013). Development and preliminary validation of a measure of social inclusion for use in people with mental health problems: The SInQUE. International Journal of Social Psychiatry, 59(5), 501–507. https://doi.org/10.1177/0020764012443752
   PubMed Web of Science ®Google Scholar
• Newman, C., Jackson, J., Macleod, S., & Eason, M. (2020). A survey of stress and burnout in forensic mental health nursing. Journal of Forensic Nursing, 16(3), 161–168. https://doi.org/10.1097/jfn.0000000000000271
   PubMed Web of Science ®Google Scholar
• Pillay, S. M., Oliver, B., Butler, L., & Kennedy, H. G. (2008). Risk stratification and the care pathway. Irish Journal of Psychological Medicine, 25(4), 123–127. https://doi.org/10.1017/S0790966700011228
   PubMedGoogle Scholar
• Powers, J. H., Patrick, D. L., Walton, M. K., Marquis, P., Cano, S., Hobart, J., Isaac, M., Vamvakas, S., Slagle, A., Molsen, E., & Burke, L. B. (2017). Clinician-reported outcome assessments of treatment benefit: Report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force. Value in Health, 20(1), 2–14. https://doi.org/10.1016/j.jval.2016.11.005
   PubMed Web of Science ®Google Scholar
• Prinsen, C. A. C., Mokkink, L. B., Bouter, L. M., Alonso, J., Patrick, D. L., de Vet, H. C. W., & Terwee, C. B. (2018). COSMIN guideline for systematic reviews of patient-reported outcome measures. Quality of Life Research, 27(5), 1147–1157. https://doi.org/10.1007/s11136-018-1798-3
   PubMed Web of Science ®Google Scholar
• Ryland, H., Cook, J., Ferris, R., Markham, S., Sales, C., Fitzpatrick, R., & Fazel, S. (2021). Development of the FORUM: A new patient and clinician reported outcome measure for forensic mental health services. Psychology, Crime & Law, 1–18. https://doi.org/10.1080/1068316X.2021.1962873
   Web of Science ®Google Scholar
• Ryland, H., Cook, J., Fitzpatrick, R., & Fazel, S. (2021). Ten outcome measures in forensic mental health: A survey of clinician views on comprehensiveness, ease of use and relevance. Criminal Behaviour & Mental Health, 31(6). https://doi.org/10.1002/cbm.2221
   PubMed Web of Science ®Google Scholar
• Ryland, H., Cook, J., Yukhnenko, D., Fitzpatrick, R., & Fazel, S. (2021). Outcome measures in forensic mental health services: A systematic review of instruments and qualitative evidence synthesis. European Psychiatry, 64(1), e37. https://doi.org/10.1192/j.eurpsy.2021.32
   PubMed Web of Science ®Google Scholar
• Sawilowsky, S., & Fahoome, G. (2005). Kruskal-Wallis test. In B. Everitt & D. Howell (Eds.), Encyclopaedia of statistics in behavioral science. John Wiley and Sons. https://doi.org/10.1002/0470013192.bsa333
   Google Scholar
• Senior, M., Fazel, S., & Tsiachristas, A. (2020). The economic impact of violence perpetration in severe mental illness: A retrospective, prevalence-based analysis in England and Wales. Lancet Public Health, 5(2), e99–e106. https://doi.org/10.1016/S2468-2667(19)30245-2
   PubMed Web of Science ®Google Scholar
• Shinkfield, G., & Ogloff, J. (2014). A review and analysis of routine outcome measures for forensic mental health services. International Journal of Forensic Mental Health, 13(3), 252–271. https://doi.org/10.1080/14999013.2014.939788
   Web of Science ®Google Scholar
• Shumlich, E. J., Reid, G. J., Hancock, M., & Hoaken, P. (2019). Executive dysfunction in Criminal populations: Comparing forensic psychiatric patients and correctional offenders. International Journal of Forensic Mental Health, 18(3), 243–259. https://doi.org/10.1080/14999013.2018.1495279
   Web of Science ®Google Scholar
• Sonderen, E. V., Sanderman, R., & Coyne, J. C. (2013). Ineffectiveness of reverse wording of questionnaire items: Let’s learn from cows in the rain. PLOS ONE, 8(7), e68967. https://doi.org/10.1371/journal.pone.0068967
   PubMed Web of Science ®Google Scholar
• Spencer, B. W. J., Gergel, T., Hotopf, M., & Owen, G. S. (2018). Unwell in hospital but not incapable: Cross-sectional study on the dissociation of decision-making capacity for treatment and research in in-patients with schizophrenia and related psychoses. British Journal of Psychiatry, 213(2), 484–489. https://doi.org/10.1192/bjp.2018.85
   PubMed Web of Science ®Google Scholar
• Tapp, J., Warren, F., Fife-Schaw, C., Perkins, D., & Moore, E. (2013). What do the experts by experience tell us about ‘what works’ in high secure forensic inpatient hospital services? Journal of Forensic Psychiatry & Psychology, 24(2), 160–178. https://doi.org/10.1080/14789949.2012.760642
   Web of Science ®Google Scholar
• Terwee, C. B., Dekker, F. W., Wiersinga, W. M., Prummel, M. F., & Bossuyt, P. M. M. (2003). On assessing responsiveness of health-related quality of life instruments: Guidelines for instrument evaluation. Quality of Life Research, 12(4), 349–362. https://doi.org/10.1023/A:1023499322593
   PubMed Web of Science ®Google Scholar
• Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C. W., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27(5), 1159–1170. https://doi.org/10.1007/s11136-018-1829-0
   PubMed Web of Science ®Google Scholar
• Thomas, S. D., Slade, M., McCrone, P., Harty, M. A., Parrott, J., Thornicroft, G., & Leese, M. (2008). The reliability and validity of the forensic Camberwell Assessment of Need (CANFOR): A needs assessment for forensic mental health service users. International Journal of Methods in Psychiatric Research, 17(2), 111–120. https://doi.org/10.1002/mpr.235
   PubMed Web of Science ®Google Scholar
• Völlm, B., Foster, S., Bates, P., & Huband, N. (2017). How best to engage users of forensic services in research: Literature review and recommendations. International Journal of Forensic Mental Health, 16(2), 183–195. https://doi.org/10.1080/14999013.2016.1255282
   Web of Science ®Google Scholar
• Vollm, B. A., Clarke, M., Herrando, V. T., Seppanen, A. O., Gosek, P., Heitzman, J., & Bulten, E. (2018). European psychiatric Association (EPA) guidance on forensic psychiatry: Evidence based assessment and treatment of mentally disordered offenders. European Psychiatry, 51, 58–73. https://doi.org/10.1016/j.eurpsy.2017.12.007
   PubMed Web of Science ®Google Scholar
• Watson, J. C. (2017). Establishing evidence for internal structure using exploratory factor analysis. Measurement and Evaluation in Counseling and Development, 50(4), 232–238. https://doi.org/10.1080/07481756.2017.1336931
   Web of Science ®Google Scholar
• Wolf, A., Fanshawe, T., Sariaslan, A., Cornish, R., Larsson, H., & Fazel, S. (2018). Prediction of violent crime on discharge from secure psychiatric hospitals: A clinical prediction rule (FoVOx). European Psychiatry, 47, 88–93. https://doi.org/10.1016/j.eurpsy.2017.07.011
   PubMed Web of Science ®Google Scholar
• Zar, J. H. (2005). Spearman rank correlation. In P. Armitage & T. Colton (Eds.), Encyclopedia of biostatistics. John Wiley & Sons. https://doi.org/10.1002/0470011815.b2a15150
   Google Scholar