Toward Immersive and Interactive Surgical Training Using Extended Reality Simulator for IoMT

Abstract

Since the advent of virtual reality (VR), it has been implemented in medical education for surgical training and anatomy education so that the Internet of Medical Things (IoMT) could be further boosted. There have been rare studies on the research trends of the evaluation of endoscopic training through different XR modalities. Position-based dynamics (PBD) has been utilized to optimize the surgical thread simulation, This paper aims to quantitatively evaluate the training performance of each XR modality in general and in terms of the medical fields studied and outcomes measured. Sensors and devices are utilized to form the Internet of Medical Things for healthcare, where the data is uploaded to the cloud and then analyzed as follows before being fed back to the doctor so that he or she can understand his or her level of operation. Through subjective and objective evaluation, the potential promoting effects of vision and touch in module training were discussed.

Keywords:

• Extended reality
• endoscopic simulation
• surgical training
• PBD
• quantitative validation

Acknowledgments

We thank Professor Jun Peng, Dr. Kai Qian, and Dr. Jiaxin Xu of Yunnan First People’s Hospital for the helpful surgical suggestion.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by the National Natural Science Foundation of China (62365017, 62062069, 62062070, 62005235) and Yunnan Outstanding Youth Fund (202301AW070001).

Notes on contributors

Junzhen Du

Junzhen Du was born in Liaocheng, Shandong, China in 1993. He received a BE degree in physics from Yunnan Normal University, Kunming, Yunnan, China, in 2018. He is currently working at Yunnan Normal University. His research focuses on the evaluation of surgical skills.

Zhibao Qin

Zhibao Qin was born in Henan, China. ME degree in optical engineering from Yunnan Normal University, Kunming, China, in 2016. He is currently working toward a PhD degree with Yunnan Normal University. His research focuses on the development and validation of the VATS training system and the evaluation of surgical skills.

Xiaoyu Cai

Xiaoyu Cai was born in Shantou, Guangdong, China in 1999. He is pursuing a Master’s program at Yunnan Normal University, Kunming, with a Bachelor’s degree from Guangdong University of Technology. Xiaoyu Cai’s research specialization lies in the field of surgical robots and their digital twins.

Jun Peng

Peng Jun, Deputy Chief Physician of Thoracic Surgery Department, Yunnan First People’s Hospital. He has been engaged in clinical work of thoracic surgery for 19 years and clinical research of thoracoscopic surgery for 11 years.

Chengli Li

Chengli Li, PhD graduated from Wuhan University of Technology, Hubei, China. He has published more than 10 academic papers. He is a member of Yunnan Key Laboratory of Optoelectronic Information Technology. His research interests include virtual surgery and digital twinning, etc.

Yonghang Tai

Yonghang Tai, PhD graduated from IISRI of Deakin University, Australia. He presided over two projects of the National Natural Science Foundation of China and published more than 60 academic papers. Member of the medical special committee of the Chinese Society of Simulation. His research interests include virtual surgery, digital twinning, etc.