Virtual patient simulations for brief assessment of mental health disorders in integrated care settings

References

• Albright, G., Adam, C., Goldman, R., & Serri, D. (2013). A game-based simulation utilizing virtual humans to train physicians to screen and manage the care of patients with mental health disorders. Games for Health Journal, 2, 269–273. doi:10.1089/g4h.2013.0064
   PubMed Web of Science ®Google Scholar
• Alinier, G., Hunt, B., Gordon, R., & Harwood, C. (2006). Effectiveness of intermediate‐fidelity simulation training technology in undergraduate nursing education. Journal of Advanced Nursing, 54, 359–369. doi:10.1111/jan.2006.54.issue-3
   PubMed Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
   Google Scholar
• American Psychological Association, Commission on Accreditation. (2015). Standards of Accreditation for Health Service Psychology. Retrieved from http://www.apa.org/ed/accreditation/about/policies/standards-of-accreditation.pdf
   Google Scholar
• Auger, R. W. (2004). What we don’t know CAN hurt us: Mental health counselor’s implicit assumptions about human nature. Journal of Mental Health Counseling, 26, 13–24. doi:10.17744/mehc.26.1.q2r31fh0na9efbv0
   Google Scholar
• Author 1b. (2016). A pilot feasibility study of virtual patient simulation to enhance social work students’ brief mental health assessment skills. Social Work in Health Care, 55(9), 675–693. doi:10.1080/00981389.2016.1210715
   PubMed Web of Science ®Google Scholar
• Badger, L., & MacNeil, G. (2002). Standardized clients in the classroom: A novel instructional technique for social work educators. Research on Social Work Practice, 12, 364–374. doi:10.1177/1049731502012003002
   Web of Science ®Google Scholar
• Badger, L. W., & McNeil, G. (1998). Rationale for utilizing standardized clients in the training and evaluation of social work students. Journal of Teaching in Social Work, 16, 203. doi:10.1300/J067v16n01_13
   Google Scholar
• Bandura, A. (1991). Social cognitive theory of self-regulation. Organizational Behavior and Human Decision Processes, 50, 248–287. doi:10.1016/0749-5978(91)90022-L
   Web of Science ®Google Scholar
• Bandura, A. (2006). Guide for constructing self-efficacy scales. In T. Urdan, & F. Pajares (Eds.), Self-Efficacy Beliefs of Adolescents (pp. 307–337). Greenwich, CT: Information Age.
   Google Scholar
• Bangor, A., Kortum, P. T., & Miller, J. T. (2008). An empirical evaluation of the system usability scale. International. Journal of Human–Computer Interaction, 24, 574–594. doi:10.1080/10447310802205776
   Web of Science ®Google Scholar
• Bateman, J., Allen, M. E., Kidd, J., Parsons, N., & Davies, D. (2012). Virtual patients design and its effect on clinical reasoning and student experience: A protocol for a randomised factorial multi-centre study. BMC medical education, 12(1), 62: 1–8.
   PubMed Web of Science ®Google Scholar
• Bogo, M. (2015). Field education for clinical social work practice: Best practices and contemporary challenges. Clinical Social Work Journal, 43, 317–324. doi:10.1007/s10615-015-0526-5
   Web of Science ®Google Scholar
• Bogo, M., Rawlins, M., Katz, E., & Logie, C. (2014). Using simulation in assessment and teaching: OSCE adapted for Social Work. Alexandria, VA: Council on Social Work Education.
   Google Scholar
• Brooke, J. (1996). SUS-A quick and dirty usability scale. Usability Evaluation in Industry, 189(194), 4–7.
   Google Scholar
• Campbell, A. J., Amon, K. L., Nguyen, M., Cumming, S., Selby, H., Lincoln, M., … Gonczi, A. (2015). Virtual world interview skills training for students studying health professions. Journal of Technology in Human Services, 33, 156–171. doi:10.1080/15228835.2015.1022682
   Web of Science ®Google Scholar
• Carter, I., Bornais, J., & Bilodeau, D. (2011). Considering the use of standardized clients in professional social work education. Collected Essays on Learning and Teaching, 4, 95–102. doi:10.22329/celt.v4i0.3279
   Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159. doi:10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Collins, P. Y., Patel, V., Joestl, S. S., March, D., Insel, T. R., Daar, A. S., … Fairburn, C. (2011). Grand challenges in global mental health. Nature, 475, 27–30. doi:10.1038/475027a
   PubMed Web of Science ®Google Scholar
• Cook, D., Erwin, P., & Triola, M. (2010). Computerized virtual patients in health professions education: A systematic review and meta-analysis. Academic Medicine, 85, 1589–1602. doi:10.1097/ACM.0b013e3181edfe13
   PubMed Web of Science ®Google Scholar
• Cook, D., & Triola, M. (2009). Virtual patients: A critical literature review and proposed next steps. Medical Education, 43(4), 303–311. doi:10.1111/med.2009.43.issue-4
   PubMed Web of Science ®Google Scholar
• Cooper, L. L., & Briggs, L. (2014). Transformative learning: Simulations in social work education. Retrieved from http://[email protected]
   Google Scholar
• Council on Social Work Education. (2015). Educational policy and accreditation standards. Washington, DC: Author.
   Google Scholar
• De Winter, J. C. (2013). Using the Student’s t-test with extremely small sample sizes. Practical Assessment, Research & Evaluation, 18, 1–12.
   Google Scholar
• Dudding, C. C., Hulton, L., & Stewart, A. L. (2016). Simulated Patients, Real IPE LessonsWhen you bring together students from three disciplines to treat virtual patients, interprofessional learning gets real. The ASHA Leader, 21(11), 52–59. doi:10.1044/leader.FTR2.21112016.52
   Google Scholar
• Ellis, M. V., Berger, L., Hanus, A. E., Ayala, E. E., Swords, B. A., & Siembor, M. (2013). Inadequate and harmful clinical supervision: Testing a revised framework and assessing occurrence. The Counseling Psychologist, 42, 434–472. doi:10.1177/0011000013508656
   Web of Science ®Google Scholar
• Feingold, C. E., Calaluce, M., & Kallen, M. A. (2004). Computerized patient model and simulated clinical experiences: Evaluation with baccalaureate nursing students. Journal of Nursing Education, 43, 156–163.
   PubMed Web of Science ®Google Scholar
• First, M. B., Williams, J. B., Karg, R. S., & Spitzer, R. L. (2015). User’s guide to structured clinical interview for DSM-5 disorders (SCID-5-CV) clinical version. Arlington, VA: American Psychiatric Publishing.
   Google Scholar
• Fleming, M., Olsen, D., Stathes, H., Boteler, L., Grossberg, P., Pfeifer, J., … Skochelak, S. (2009). Virtual reality skills training for health care professionals in alcohol screening and brief intervention. The Journal of the American Board of Family Medicine, 22, 387–398. doi:10.3122/jabfm.2009.04.080208
   PubMed Web of Science ®Google Scholar
• Forsberg, E., Ziegert, K., Hult, H., & Fors, U. (2016). Assessing progression of clinical reasoning through virtual patients: An exploratory study. Nurse Education in Practice, 16(1), 97–103. doi:10.1016/j.nepr.2015.09.006
   PubMed Web of Science ®Google Scholar
• Friederichs, S., Bolman, C., Oenema, A., Guyaux, J., & Lechner, L. (2014). Motivational interviewing in a web-based physical activity intervention with an avatar: Randomized controlled trial. Journal of Medical Internet Research, 16(2), e48. doi:10.2196/jmir.2974
   PubMed Web of Science ®Google Scholar
• Healy, K., Meagher, G., & Cullin, J. (2009). Retaining novices to become expert child protection practitioners: Creating career pathways in direct practice. British Journal of Social Work, 39, 299–317. doi:10.1093/bjsw/bcm125
   Web of Science ®Google Scholar
• Heinrichs, L., Dev, P., & Davies, D. (2017). Virtual environments and virtual patients in healthcare. In D. Nestel, M. Kelly, B. Jolly, & M. Watson (Eds.),Healthcare Simulation Education: Evidence, Theory and Practice. (pp. 128 –145). Chichester, UK: Wiley
   Google Scholar
• Holden, G., Meenaghan, T., Anastas, J., & Metrey, G. (2002). Outcomes of social work education: The case for social work self-efficacy. Journal of Social Work Education, 38, 115–133.
   Web of Science ®Google Scholar
• Horevitz, E., & Manoleas, P. (2013). Professional competencies and training needs of professional social workers in integrated behavioral health in primary care. Social Work in Health Care, 52, 752–787. doi:10.1080/00981389.2013.791362
   PubMed Web of Science ®Google Scholar
• Horvitz-Lennon, M., Kilbourne, A. M., & Pincus, H. A. (2006). From silos to bridges: Meeting the general health care needs of adults with severe mental illnesses. Health Affairs, 25(3), 659–669. doi:10.1377/hlthaff.25.3.659
   PubMed Web of Science ®Google Scholar
• Huwendiek, S., Duncker, C., Reichert, F., De Leng, B. A., Dolmans, D., Van Der Vleuten, C. P., … Tönshoff, B. (2013). Learner preferences regarding integrating, sequencing and aligning virtual patients with other activities in the undergraduate medical curriculum: A focus group study. Medical Teacher, 35, 920–929. doi:10.3109/0142159X.2013.826790
   PubMed Web of Science ®Google Scholar
• Jason, L. A., & Ferrari, J. R. (2010). Oxford House recovery homes: Characteristics and effectiveness. Psychological Services, 7, 92–102. doi:10.1037/a0017932
   PubMed Web of Science ®Google Scholar
• Jeffries, P. R., Woolf, S., & Linde, B. (2003). Technology-based vs. traditional instruction: A comparison of two methods for teaching the skill of performing a 12-lead ECG. Nursing Education Perspectives, 24, 70–74.
   PubMedGoogle Scholar
• Judge, T. A., Jackson, C. L., Shaw, J. C., Scott, B. A., & Rich, B. L. (2007). Self-efficacy and work-related performance: The integral role of individual differences. Journal of Applied Psychology, 92, 107–127. doi:10.1037/0021-9010.92.1.107
   PubMed Web of Science ®Google Scholar
• Kelly, M. S., Berzin, S. C., Frey, A., Alvarez, M., Shaffer, G., & O’Brien, K. (2010). The state of school social work: Findings from the national school social work survey. School Mental Health, 2, 132–141. doi:10.1007/s12310-010-9034-5
   Google Scholar
• Kenny, P., Rizzo, A. A., Parsons, T. D., Gratch, J., & Swartout, W. (2007). A virtual human agent for training novice therapist clinical interviewing skills. Annual Review of Cyber Therapy and Telemedicine, 5, 77–83.
   Google Scholar
• Khanna, M. S., & Kendall, P. C. (2015). Bringing technology to training: Web-based therapist training to promote the development of competent cognitive-behavioral therapists. Cognitive and Behavioral Practice, 22, 291–301. doi:10.1016/j.cbpra.2015.02.002
   Web of Science ®Google Scholar
• Kleinsmith, A., Rivera-Gutierrez, D., Finney, G., Cendan, J., & Lok, B. (2015). Understanding empathy training with virtual patients. Computers in Human Behavior, 52, 151–158. doi:10.1016/j.chb.2015.05.033
   PubMed Web of Science ®Google Scholar
• Knowles, M. (1984). Andragogy in action: Applying modern principles of adult education. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Ko, S. J., Ford, J. D., Kassam-Adams, N., Berkowitz, S. J., Wilson, C., Wong, M., … Layne, C. M. (2008). Creating trauma-informed systems: Child welfare, education, first responders, health care, juvenile justice. Professional Psychology: Research and Practice, 39, 369–404.
   Web of Science ®Google Scholar
• Kolb, A. Y., & Kolb, D. A. (2012). Experiential learning theory. In R. M. Steel (Ed,), Encyclopedia of the Sciences of Learning (pp. 1215–1219). New York, NY: Springer.
   Google Scholar
• Larson, L. M., Clark, M. P., Wesely, L. H., Koraleski, S. F., Daniels, J. A., & Smith, P. L. (1999). Videos versus role plays to increase counseling self-efficacy in pre-practica trainees. Counselor Education & Supervision, 38, 237–248. doi:10.1002/ceas.1999.38.issue-4
   Google Scholar
• Larson, L. M., & Daniels, J. A. (1998). Review of the counseling self-efficacy literature. The Counseling Psychologist, 26, 179–218. doi:10.1177/0011000098262001
   Web of Science ®Google Scholar
• Lee, M., & Fortune, A. E. (2013a). Do we need more “Doing” activities or “Thinking” activities in the field practicum? Journal of Social Work Education, 49, 646–660.
   Web of Science ®Google Scholar
• Lee, M., & Fortune, A. E. (2013b). Patterns of field learning activities and their relation to learning outcome. Journal of Social Work Education, 49, 420–438.
   Web of Science ®Google Scholar
• Leigh, G. T. (2008). High-fidelity patient simulation and nursing students’ self-efficacy: A review of the literature. International Journal of Nursing Education Scholarship, 5, 1–17.
   Google Scholar
• Levine, J., & Adams, R. H. (2013). Introducing case management to students in a virtual world: An exploratory study. Journal of Teaching in Social Work, 33, 552–565. doi:10.1080/08841233.2013.835766
   Google Scholar
• Levitov, J. E., Fall, K. A., & Jennings, M. C. (1999). Counselor clinical training with client-actors. Counselor Education & Supervision, 38, 249–263. doi:10.1002/j.1556-6978.1999.tb00575.x
   Google Scholar
• Lichvar, A. B., Hedges, A., Benedict, N. J., & Donihi, A. C. (2016). Combination of a flipped classroom format and a virtual patient case to enhance active learning in a required therapeutics course. American Journal of Pharmaceutical Education, 80(10), 175.
   PubMed Web of Science ®Google Scholar
• Lundgren, L., & Krull, I. (2014). The Affordable Care Act: New opportunities for social work to take leadership in behavioral health and addiction treatment. Journal of the Society for Social Work and Research, 5, 415–438. doi:10.1086/679302
   Web of Science ®Google Scholar
• Maicher, K., Danforth, D., Price, A.Zimmerman, L.Wilcox, B.Liston, B., … & Post, D. (2017). Developing a conversational virtual standardized patient to enable students to practice history-taking skills. Simulation in Healthcare. Training and Education in Professional Psychology, 12(2), 124–131.
   Google Scholar
• Masters, K. S., Beacham, A. O., & Clement, L. R. (2015). Use of a standardized patient protocol to assess clinical competency: The University of Colorado Denver comprehensive clinical competency examination. Training and Education in Professional Psychology, 9, 170–174. doi:10.1037/tep0000079
   Web of Science ®Google Scholar
• McConville, S. A., & Lane, A. M. (2006). Using on-line video clips to enhance self-efficacy toward dealing with difficult situations among nursing students. Nurse Education Today, 26, 200–208. doi:10.1016/j.nedt.2005.09.024
   PubMed Web of Science ®Google Scholar
• McDaniel, S. H., Grus, C. L., Cubic, B. A., Hunter, C. L., Kearney, L. K., Schuman, C. C., … Miller, B. F. (2014). Competencies for psychology practice in primary care. American Psychologist, 69, 409–429. doi:10.1037/a0036072
   PubMed Web of Science ®Google Scholar
• Morris, S. B., & DeShon, R. P. (2002). Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychological Methods, 7, 105–125. doi:10.1037/1082-989X.7.1.105
   PubMed Web of Science ®Google Scholar
• O’Donnell, A. N., Williams, M., & Kilbourne, A. M. (2013). Overcoming roadblocks: Current and emerging reimbursement strategies for integrated mental health services in primary care. Journal of General Internal Medicine, 28, 1667–1672. doi:10.1007/s11606-013-2496-z
   PubMed Web of Science ®Google Scholar
• Olfson, M., Kroenke, K., Wang, S., & Blanco, C. (2014). Trends in office-based mental health care provided by psychiatrists and primary care physicians. The Journal of Clinical Psychiatry, 75, 247–253. doi:10.4088/JCP.13m08834
   PubMed Web of Science ®Google Scholar
• Pantziaras, I., Fors, U., & Ekblad, S. (2015). Training with virtual patients in transcultural psychiatry: Do the learners actually learn? Journal of Medical Internet Research, 17(2), e46. doi:10.2196/jmir.3497
   PubMedGoogle Scholar
• Parsons, T. D. (2015). Virtual standardized patients for assessing the competencies of psychologists. Retrieved from http://www.igi-global.com/chapter/virtual-standardized-patients-for-assessing-the-competencies-of-psychologists/113106.
   Google Scholar
• Parsons, T. D., Kenny, P., Ntuen, C. A., Pataki, C. S., Pato, M. T., Rizzo, A. A., … Sugar, J. (2008). Objective structured clinical interview training using a virtual human patient. Studies in Health Technology and Informatics, 132, 357–362.
   PubMedGoogle Scholar
• Patient Protection and Affordable Care Act, 42 U.S.C. § 18001 et seq. (2010). Retrieved from: http://housedocs.house.gov/energycommerce/ppacacon.pdf/
   Google Scholar
• Petracchi, H., & Collins, K. (2006). Utilizing actors to simulate clients in social work student role plays: Does this approach have a place in social work education? Journal of Teaching in Social Work, 26, 223–233. doi:10.1300/J067v26n01_13
   Google Scholar
• Pinquart, M., Juang, L. P., & Silbereisen, R. K. (2003). Self-efficacy and successful school-to-work transition: A longitudinal study. Journal of Vocational Behavior, 63, 329–346. doi:10.1016/S0001-8791(02)00031-3
   Web of Science ®Google Scholar
• Pollard, R. Q., Jr, Betts, W. R., Carroll, J. K., Waxmonsky, J. A., Barnett, S., deGruy, F. V., III, Kellar-Guenther, Y. (2014). Integrating primary care and behavioral health with four special populations: Children with special needs, people with serious mental illness, refugees, and deaf people. American Psychologist, 69, 377–387. doi:10.1037/a0036220
   PubMed Web of Science ®Google Scholar
• Posel, N., Mcgee, J. B., & Fleiszer, D. M. (2014). Twelve tips to support the development of clinical reasoning skills using virtual patient cases. Medical Teacher, 37, 813–818. doi:10.3109/0142159X.2014.993951
   PubMed Web of Science ®Google Scholar
• Primm, A. B., Vasquez, M. J. T., Mays, R. A., Sammons-Posey, D., McKnight-Eily, L. R., Presley-Cantrell, L. R., … Perry, G. S. (2010). The role of public health in addressing racial and ethnic disparities in mental health and mental illness. Preventing Chronic Disease: Public Health Research, Practice and Policy, 7(1), 1–7.
   Web of Science ®Google Scholar
• Rawlings, M., Bogo, M., Katz, E., & Johnson, B. (2012, October). Designing objective structured clinical examinations (OSCE) to assess social work student competencies. Paper session presented at the Council on Social Work Education 58th Annual Program Meeting - Social Work: A Capital Venture, Washington, DC
   Google Scholar
• Rawlings, M. A. (2012). Assessing BSW student direct practice skill using standardized clients and self-efficacy theory. Journal of Social Work Education, 48, 553–576. doi:10.5175/JSWE.2012.201000070
   Web of Science ®Google Scholar
• Reeves, W. C., Strine, T. W., Pratt, L. A., Thompson, W., Ahluwalia, I., Dhingra, S. S., … Morrow, B. (2011). Mental illness surveillance among adults in the United States. Mental and Mortality Weekly Report, 60(3), 1–29. Retrieved from http://origin.glb.cdc.gov/mmWR/preview/mmwrhtml/su6003a1.htm
   Google Scholar
• Reinsmith-Jones, K., Kibbe, S., Crayton, T., & Campbell, E. (2015). Use of Second Life in social work education: Virtual world experiences and their effect on students. Journal of Social Work Education, 51, 90–108.
   Web of Science ®Google Scholar
• Sampson, M., Parrish, D. E. Parrish, D. E. & Washburn, M. (2017). Assessing MSW students integrated behavioral health skills using an Objective Structured Clinical Examination. Journal of Social Work Education. doi:10.1080/10437797.2017.1299064
   PubMed Web of Science ®Google Scholar
• Satter, R. M., Cohen, T., Ortiz, P., Kahol, K., Mackenzie, J., Olson, C., … Patel, V. L. (2012). Avatar–based simulation in the evaluation of diagnosis & management of mental health disorders in primary care. Journal of Biomedical Informatics, 45, 1137–1150. doi:10.1016/j.jbi.2012.07.009
   PubMed Web of Science ®Google Scholar
• Singh, T., & Rajput, M. (2006). Misdiagnosis of bipolar disorder. Psychiatry, 3, 57–63.
   PubMedGoogle Scholar
• Skovholt, T. M., & Rønnestad, M. H. (2003). Struggles of the novice counselor and therapist. Journal of Career Development, 30, 45–58. doi:10.1177/089484530303000103
   Web of Science ®Google Scholar
• Talbot, T. B., Sagae, K., John, B., & Rizzo, A. A. (2012). Sorting out the virtual patient: How to exploit artificial intelligence, game technology and sound educational practices to create engaging role-playing simulations.International Journal of Gaming and Computer-Mediated Simulations, 4(3), 1–19. doi:10.4018/IJGCMS
   Google Scholar
• Thériault, A., Gazzola, N., & Richardson, B. (2009). Feelings of incompetence in novice therapists: Consequences, coping, and correctives. Canadian Journal of Counselling, 43, 105–119.
   Google Scholar
• Triola, M., Feldman, H., Kalet, A., Zabar, S., Kachur, E., Gillespie, C., … Lipkin, M. (2006). A randomized trial of teaching clinical skills using virtual and live standardized patients. Journal of General Internal Medicine, 21, 424–429. doi:10.1111/j.1525-1497.2006.00421.x
   PubMed Web of Science ®Google Scholar
• Turner, H. M., & Bernard, R. M. (2006). Calculating and synthesizing effect sizes. Contemporary Issues in Communication Science and Disorders, 33, 42–55.
   Google Scholar
• Washburn, M., Bordnick, P. & Rizzo, A. S. (2016). A pilot feasibility study of virtual patient simulation to enhance social work students brief mental health assessment skills. Social Work in Health Care, 55(9), 675–693.
   Web of Science ®Google Scholar
• Washburn, M. & Zhou, S. (in press). Technology enhanced clinical simulations: Tools for practicing clinical skills in online social work programs. Journal of Social Work Education.
   Web of Science ®Google Scholar
• Wayne, J., Bogo, M., & Raskin, M. (2010). Field education as the signature pedagogy of social work education. Journal of Social Work Education, 46, 327–339. doi:10.5175/JSWE.2010.200900043
   Web of Science ®Google Scholar
• Wilkening, G. L., Gannon, J. M., Ross, C., Brennan, J. L., Fabian, T. J., Marcsisin, M. J., & Benedict, N. J. (2016). Evaluation of branched-narrative virtual patients for interprofessional education of psychiatry residents. Academic Psychiatry, 41(1), 71–75.
   Web of Science ®Google Scholar
• World Health Organization, World organization of national colleges, & academic associations of general practitioners/family physicians. (2008). Integrating mental health into primary care: A global perspective. Retrieved from http://apps.who.int/iris/bitstream/10665/43935/1/9789241563680_eng.pdf
   Google Scholar