Artificial intelligence in virtual standardized patients: Combining natural language understanding and rule based dialogue management to improve conversational fidelity

References

• Battegazzorre E, Bottino A, Lamberti F. 2020. Training medical communication skills with virtual patients: literature review and directions for future research. International Conference on Intelligent Technologies for Interactive Entertainment; 207–226.
   Google Scholar
• Campillos-Llanos L, Thomas C, Bilinski E, Zweigenbaum P, Rosset S. 2020. Designing a virtual patient dialogue system based on terminology-rich resources: challenges and evaluation. Nat Lang Eng. 26(2):183–220.
   Web of Science ®Google Scholar
• Danforth DR, Procter M, Chen R, Johnson M, Heller R. 2009. Development of virtual patient simulations for medical education. J Virt Worlds Res. 2(2):1–11.
   Google Scholar
• Dolianiti F, Tsoupouroglou I, Antoniou P, Konstantinidis S, Anastasiades S, Bamidis P. 2020. Chatbots in healthcare curricula: the case of a conversational virtual patient. International Conference on Brain Function Assessment in Learning; 137–147.
   Google Scholar
• Furlan R, Gatti M, Menè R, Shiffer D, Marchiori C, Levra AG, Saturnino V, Brunetta E, Dipaola F. 2021. A natural language processing–based virtual patient simulator and intelligent tutoring system for the clinical diagnostic process: simulator development and case study. JMIR Med Inform. 9(4):e24073.
   PubMed Web of Science ®Google Scholar
• Goffin V, Allauzen C, Bocchieri E, Hakkani-Tur D, Ljolje A, Parthasarathy S, Rahim M, Riccardi G, Saraclar M. 2005. The AT&T Watson speech recognizer. Proceedings (ICASSP'05). IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 1; I–1033.
   Google Scholar
• Gokcen A, Jaffe E, Erdmann J, White M, Danforth D. 2016. A corpus of word-aligned asked and anticipated questions in a virtual patient dialogue system. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16); 3174–3179.
   Google Scholar
• Heinrichs L, Dev P, Davies D. 2017. Virtual environments and virtual patients in healthcare. In: Nestel D, Kelly M, Jolly B, Watson M, editors. Healthcare simulation education: evidence, theory and practice. New York: Wiley; p. 69–79.
   Google Scholar
• Hirumi A, Kleinsmith A, Johnsen K, Kubovec S, Eakins M, Bogert K, Rivera-Gutierrez DJ, Reyes RJ, Lok B, Cendan J. 2016. Advancing virtual patient simulations through design research and interPLAY: part I: design and development. Education Tech Research Dev. 64(4):763–785.
   Web of Science ®Google Scholar
• Jackson J, Park S. 2020. Creating intelligent virtual patients for simulation-based pharmacy education through human-centered conversation modelling. IJSMARTTL. 2(2/3):96–114.
   Google Scholar
• Jaffe E, White M, Schuler W, Fosler-Lussier E, Rosenfeld A, Danforth D. 2015. Interpreting questions with a log-linear ranking model in a virtual patient dialogue system. Proceedings of the Tenth Workshop on Innovative Use of NLP for Building Educational Applications, Denver, Colorado. Stroudsburg (PA): Association for Computational Linguistics; p. 86–96.
   Google Scholar
• Jin L, King D, Hussein A, White M, Danforth D. 2018. Using paraphrasing and memory-augmented models to combat data sparsity in question interpretation with a virtual patient dialogue system. Proceedings of the Thirteenth Workshop on Innovative Use of NLP for Building Educational Applications; 13–23.
   Google Scholar
• Jin L, White M, Jaffe E, Zimmerman L, Danforth D. 2017. Combining CNNs and pattern matching for question interpretation in a virtual patient dialogue system. Proceedings of the Twelfth Workshop on Innovative Use of NLP for Building Educational Applications, Sept 8, Copenhagen, Denmark. Stroudsburg (PA): Association for Computational Linguistics; p. 11–19.
   Google Scholar
• Khan S. 2022. What is Word Error Rate. [accessed 2022 Feb 16]. https://www.educative.io/edpresso/what-is-word-error-rate.
   Google Scholar
• Kleinheksel AJ. 2014. Transformative learning through virtual patient simulations: predicting critical student reflections. Clin Simul Nurs. 10(6):e301–e308.
   Web of Science ®Google Scholar
• Kumar A, nee Khemchandani RR. 2018. Self-attention enhanced recurrent neural networks for sentence classification. 2018 IEEE Symposium Series on Computational Intelligence (SSCI); 905–911.
   Google Scholar
• Lee J, Kim H, Kim KH, Jung D, Jowsey T, Webster CS. 2020. Effective virtual patient simulators for medical communication training: a systematic review. Med Educ. 54(9):786–795.
   PubMed Web of Science ®Google Scholar
• Liu T, Luo J, He H, Zheng J, Zhao J, Li K. 2018. History-taking instruction for baccalaureate nursing students by virtual patient training: a retrospective study. Nurse Educ Today. 71:97–104.
   PubMed Web of Science ®Google Scholar
• Maicher KR, Danforth D, Price A, Zimmerman L, Wilcox B, Liston B, Belknap L, Ledford C, Way D, Post D, et al. 2017. Developing a conversational virtual standardized patient to enable students to practice history taking skills. Simul Healthc. 12(2):124–131.
   PubMedGoogle Scholar
• Maicher KR, Zimmerman L, Wilcox B, Liston B, Cronau H, Macerollo A, Jin L, Jaffe E, White M, Fosler-Lussier E, et al. 2019. Using virtual standardized patients to accurately assess information gathering skills in medical students. Med Teach. 41(9):1053–1059.
   PubMed Web of Science ®Google Scholar
• Motz P, Gray M, Sawyer T, Kett J, Danforth D, Maicher K, Umoren R. 2018. Virtual antenatal encounter and standardized simulation assessment (VANESSA): pilot study. JMIR Serious Games. 6(2):e9611.
   Web of Science ®Google Scholar
• Ochs M, de Montcheuil G, Pergandi JM, Saubesty J, Pelachaud C, Mestre D, Blache P. 2017. An architecture of virtual patient simulation platform to train doctors to break bad news. Conference on Computer Animation and Social Agents (CASA).
   Google Scholar
• Serai P, Sunder V, Fosler-Lussier E. 2022. Hallucination of speech recognition errors with sequence to sequence learning. IEEE/ACM Transactions on Audio, Speech, and Language Processing.
   Google Scholar
• Stiff A, White M, Fosler-Lussier E, Jin L, Jaffe E, Danforth D. 2022. A randomized prospective study of a hybrid rule-and data-driven virtual patient. Nat Lang Eng. DOI:10.1017/S1351324922000420.
   Web of Science ®Google Scholar
• Yang J, Chan M, Uribe-Quevedo A, Kapralos B, Jaimes N, Dubrowski A. 2020. Prototyping virtual reality interactions in medical simulation employing speech recognition. 22nd Symposium on Virtual and Augmented Reality (SVR); 351–355.
   Google Scholar