Designing and building OSCEBot ® for virtual OSCE – Performance evaluation

References

• Adamopoulou E, Moussiades L. Chatbots: history, technology, and applications. Mach Learn Appl. 2020; 2(October):100006. doi: 10.1016/j.mlwa.2020.100006
   Google Scholar
• Caldarini G, Jaf S, McGarry K. A literature survey of recent advances in chatbots. Infor (Switzerland). 2022;13(1): Information 13 1 41. DOI: 10.3390/info13010041.
   Google Scholar
• Desale P, Mane P, Bhutawani K, et al. Virtual Personal Assistant and Improve Education System BT - ICCCE 2019. In: A. Kumar & S. Mozar, eds. Springer Singapore; 2020. pp. 15–16.
   Google Scholar
• Brown M, Mccormack M, Reeves J, et al. (2020). 2020 EDUCAUSE horizon report TM teaching and learning edition.
   Google Scholar
• Dolianiti F, Tsoupouroglou I, Antoniou P, et al. 2020. Chatbots in healthcare curricula: the case of a conversational virtual patien. In: Frasson C Goebel R, editors. Brain function assessment in learning. pp. 137–147. 10.1007/978-3-030-60735-7_15
   Google Scholar
• Zain S. Digital transformation trends in education. In: Baker D Ellis L-B-T-F-D-I-D-I, editors. Chandos digital information review. Chandos Publishing; 2021. pp. 223–234. DOI: 10.1016/B978-0-12-822144-0.00036-7.
   Google Scholar
• Gonda DE, Chu B (2019). Chatbot as a learning resource? Creating conversational bots as a supplement for teaching assistant training course. 2019 IEEE International Conference on Engineering, Technology and Education (TALE), 1–5. 10.1109/TALE48000.2019.9225974
   Google Scholar
• Ondáš S, Pleva M, Hladek D (2019). How chatbots can be involved in the education process. 10.1109/ICETA48886.2019.9040095
   Google Scholar
• Hayashi, Yugo (2013). Pedagogical Conversational Agents for Supporting Collaborative Learning: Effects of Communication Channels. CHI ’13 Extended Abstracts on Human Factors in Computing Systems, 655–660. 10.1145/2468356.2468472
   Google Scholar
• Stathakarou N, Nifakos S, Karlgren K, Konstantinidis S T, Bamidis P D, Pattichis C S, Davoody N. (2020). Students' Perceptions on Chatbots' Potential and Design Characteristics in Healthcare Education. Stud Health Technol Inform, 272 209–212. 10.3233/SHTI200531
   PubMedGoogle Scholar
• Ho Thao Hien, Pham-Nguyen Cuong, Le Nguyen Hoai Nam, Ho Le Thi Kim Nhung, and Le Dinh Thang. 2018. Intelligent Assistants in Higher-Education Environments: The FIT-EBot, a Chatbot for Administrative and Learning Support. In Proceedings of the 9th International Symposium on Information and Communication Technology (SoICT '18). Association for Computing Machinery, New York, NY, USA, 69–76. https://doi.org/10.1145/3287921.3287937
   Google Scholar
• Lund BD, Wang T. Chatting about ChatGPT: how may AI and GPT impact academia and libraries? Brady. Library Hi Tech News. 2023;40(3):26–29. doi: 10.1108/LHTN-01-2023-0009
   Google Scholar
• Pottle J. (2019). Virtual reality and the transformation of medical education. Future Healthc J, 6(3), 181–185. 10.7861/fhj.2019-0036
   PubMedGoogle Scholar
• Guze PA. Using technology to meet the challenges of medical education. Trans Am Clin Climatol Assoc. 2015;126:260–270.
   PubMedGoogle Scholar
• Lee J, Kim H, Kim KH, et al. Effective virtual patient simulators for medical communication training: a systematic review. Med Educ. 2020;54(9):786–795. doi: https://doi.org/10.1111/medu.14152
   PubMed Web of Science ®Google Scholar
• Ochs M, Blache P, Ochs M, et al. (2018). Virtual reality for training doctors to break bad news to cite this version: hAL Id: hal-01462164 virtual reality for training doctors to break bad news.
   Google Scholar
• Gormley G. Summative OSCEs in undergraduate medical education. Ulster Med J. 2011;80(3):127–132.
   PubMedGoogle Scholar
• Keifenheim KE, Teufel M, Ip J, et al. Teaching history taking to medical students: a systematic review. BMC Med Educ. 2015;15(1). DOI: 10.1186/s12909-015-0443-x
   PubMedGoogle Scholar
• Fishman JM, Fishman, LM. History Taking in Medicine and Surgery. A. Grossman, ed. 2nd ed. Knutsford, Cheshire: PASTEST; 2010.
   Google Scholar
• Zipes DP. Braunwald’s heart disease: a textbook of cardiovascular medicine, 11th Ed. BMH Medical Journal - ISSN 2348–392X. 2018;5(2): April-June 2018. https://babymhospital.org/BMH_MJ/index.php/BMHMJ/article/view/163
   Google Scholar
• Maicher K. (2017). Developing a Conversational Virtual Standardized Patient to Enable Students to Practice History-Taking Skills. Simul Healthc, 12(2), 124–131. 10.1097/SIH.0000000000000195
   PubMedGoogle Scholar
• McLaughlin K, Gregor L, Jones A, et al. Can standardized patients replace physicians as OSCE examiners? BMC Med Educ. 2006;6(1):1–5. doi: https://doi.org/10.1186/1472-6920-6-12
   PubMedGoogle Scholar
• Zini JE, Rizk Y, Awad M, et al. (2019). Towards a deep learning question-answering specialized chatbot for objective structured clinical examinations. Proceedings of the International Joint Conference on Neural Networks, July, 1–9. 10.1109/IJCNN.2019.8851729
   Google Scholar
• Rau T, Fegert J, Liebhardt H. How high are the personnel costs for OSCE? A financial report on management aspects. GMS Z Med Ausbild. 2011;28(1):Doc13. doi 10.3205/zma000725
   PubMedGoogle Scholar
• Han ER, Yeo S, Kim MJ, et al. Medical education trends for future physicians in the era of advanced technology and artificial intelligence: an integrative review. BMC Med Educ. 2019;19(1). DOI: 10.1186/s12909-019-1891-5
   Web of Science ®Google Scholar
• Baeten M, Struyven K, Dochy F. Student-centred teaching methods: can they optimise students’ approaches to learning in professional higher education? Stud Educ Eval. 2013; 39(1):14–22. doi: 10.1016/j.stueduc.2012.11.001
   Web of Science ®Google Scholar
• Kumar JA. Educational chatbots for project-based learning: investigating learning outcomes for a team-based design course. Int J Educ Technol High Educ. 2021;18(1). DOI: 10.1186/s41239-021-00302-w
   PubMed Web of Science ®Google Scholar
• Jain N, Bhansali A, Mehta D. AngularJS: a modern MVC framework in JavaScript. J Glob Res Comput Sci. 2014;5(12):17–23.
   Google Scholar
• Reimers N, Gurevych I (2019). Sentence-BERT: sentence embeddings using siamese BERT-networks. EMNLP-IJCNLP 2019 - 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Proceedings of the Conference, 3982–3992. 10.18653/v1/d19-1410
   Google Scholar
• Devlin J, Chang M-W, Lee K, et al. {BERT: } pre-training of deep bidirectional transformers for language understanding. CoRR, abs/1810.0. 2018. Available from: http://arxiv.org/abs/1810.04805.
   Google Scholar
• Peyton K, Unnikrishnan S. Results in Engineering a comparison of chatbot platforms with the state-of-the-art sentence BERT for answering online student FAQs. Results In Eng. 2023;17(October 2022):100856. doi: 10.1016/j.rineng.2022.100856
   Google Scholar
• Fawcett T. An introduction to ROC analysis. Pattern Recognit Lett. 2006; 27(8):861–874. doi: 10.1016/j.patrec.2005.10.010
   Web of Science ®Google Scholar
• Das S, Kumar E (2018). Determining accuracy of chatbot by applying algorithm design and defined process. 2018 4th International Conference on Computing Communication and Automation, ICCCA 2018, 1–6. 10.1109/CCAA.2018.8777715
   Google Scholar
• Hidayatin L, Rahutomo F (2018). Query expansion evaluation for chatbot application. Proceedings of ICAITI 2018 - 1st International Conference on Applied Information Technology and Innovation: Toward A New Paradigm for the Design of Assistive Technology in Smart Home Care, 92–95. 10.1109/ICAITI.2018.8686762
   Google Scholar
• Altman DG (1990). Practical statistics for medical research.
   Google Scholar
• Voege P, Abu Sulayman IIM, Ouda A. Smart chatbot for user authentication. Electronics (Switzerland). 2022;11(23):4016. doi: 10.3390/electronics11234016
   Google Scholar
• Hosmer DW, Lemeshow S. Applied logistic regression. John Wiley and Sons: 2000. DOI: 10.1002/0471722146
   Google Scholar
• Youden WJ. Index for rating diagnostic tests. Cancer. 1950;3(1):32–35. doi: 10.1002/1097-0142(1950)3:1<32:AID-CNCR2820030106>3.0.CO;2-3
   PubMed Web of Science ®Google Scholar
• Balfe E, Smyth B. An analysis of query similarity in collaborative web search. In: Lect notes comput sci. Vol. 3408. 2005. pp. 330–344. DOI: 10.1007/978-3-540-31865-1_24.
   Google Scholar
• Matthys J, Elwyn G, Van Nuland M, et al. Patients’ ideas, concerns, and expectations (ICE) in general practice: impact on prescribing. Br J Gen Pract. 2009;59(558):29–36. doi: 10.3399/bjgp09X394833
   PubMed Web of Science ®Google Scholar
• Peart P. Cardiovascular history taking and clinical examination. Clinics In Integrated Care. 2022;12:100105. doi: 10.1016/j.intcar.2022.100105
   Google Scholar