The AI-Medic: an artificial intelligent mentor for trauma surgery

References

• Alsharid M, Sharma H, Drukker L, Chatelain P, Papageorghiou AT, Noble JA 2019. Captioning ultrasound images automatically. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Shenzhen, China: Springer. p. 338–346.
   Google Scholar
• Arora S, Li Y, Liang Y, Ma T, Risteski A. 2016. A latent variable model approach to pmi- based word embeddings. Trans Assoc Comput Linguist. 4:385–399. doi:10.1162/tacl_a_00106.
   Google Scholar
• Auloge P, Cazzato RL, Ramamurthy N, de Marini P, Rousseau C, Garnon J, Charles YP, Steib JP, Gangi A. 2019. Augmented reality and artificial intelligence-based navigation during percutaneous vertebroplasty: a pilot randomised clinical trial. Eur Spine J. 29(7):1580–1589.
   Google Scholar
• Bilgic E, Turkdogan S, Watanabe Y, Madani A, Landry T, Lavigne D, Feldman LS, Vassiliou MC. 2017. Effectiveness of telementoring in surgery compared with on-site mentoring: a systematic review. Surg Innov. 24(4):379–385. doi:10.1177/1553350617708725.
   Google Scholar
• Bissonnette V, Mirchi N, Ledwos N, Alsidieri G, Winkler-Schwartz A, Del Maestro RF, others. 2019. Artificial intelligence distinguishes surgical training levels in a virtual reality spinal task. JBJS. 101(23):e127. Publisher: LWW. doi:10.2106/JBJS.18.01197.
   Google Scholar
• Cer D, Yang Y, Kong S, Hua N, Limtiaco N, John RS, Constant N, Guajardo-Cespedes M, Yuan S, Tar C, et al. 2018. Universal sentence encoder. arXiv Preprint arXiv:1803.11175.
   Google Scholar
• Cortés U, Annicchiarico R, Urdiales C 2007. Agents and healthcare: usability and acceptance. In: Agent Technology and e-Health. pp. 1–4. Birkhäuser Basel.
   Google Scholar
• de Araújo Novaes M, Basu A 2020. Disruptive technologies: present and future. In: Fundamentals of Telemedicine and Telehealth. Academic Press. p. 305–330.
   Google Scholar
• Frid-Adar M, Diamant I, Klang E, Amitai M, Goldberger J, Greenspan H. 2018. GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification. Neurocomputing. 321:321–331. doi:10.1016/j.neucom.2018.09.013.
   Google Scholar
• Geng N, Xie X, Zhang Z. 2019. Addressing healthcare operational deficiencies using stochastic and dynamic programming. Int J Prod Res. 57(14):4371–4390. Publisher: Taylor & Francis. doi:10.1080/00207543.2017.1397789.
   Google Scholar
• Greenberg CC, Ghousseini HN, Quamme SRP, Beasley HL, Wiegmann DA. 2015. Surgical coaching for individual performance improvement. Ann Surg. 261(1):32–34. doi:10.1097/SLA.0000000000000776.
   Google Scholar
• Hossain MZ, Sohel F, Shiratuddin MF, Laga H. 2019. A comprehensive survey of deep learning for image captioning. ACM Comput Surv (CSUR). 51(6):1–36. Publisher: ACM New York, NY, USA.
   Google Scholar
• Jha S, MB N. 2019. The Essence of the surgical navigation system using artificial intelligence and augmented reality. Int Res J Eng Technol. 6(4).
   Google Scholar
• Jing B, Xie P, Xing E. 2017. On the automatic generation of medical imaging reports. arXiv Preprint arXiv. 1711.08195.
   Google Scholar
• Karpathy A, Fei-Fei L 2015. Deep visual-semantic alignments for generating image descriptions. In: Proceedings of the IEEE conference on computer vision and pattern recognition.. Boston, MA. p. 3128–3137.
   Google Scholar
• Kingma DP, Ba J. 2014. Adam: A method for stochastic optimization. arXiv Preprint arXiv. 1412.6980.
   Google Scholar
• Kisilev P, Sason E, Barkan E, Hashoul S. 2016. Medical image captioning: learning to describe medical image findings using multi-task-loss CNN. Riva del Garda (Italy): Deep Learning for Precision Medicine.
   Google Scholar
• Kotwal RS, Howard JT, Orman JA, Tarpey BW, Bailey JA, Champion HR, Mabry RL, Holcomb JB, Gross KR. 2016. The effect of a golden hour policy on the morbidity and mortality of combat casualties. JAMA Surg. 151(1):15–24. Publisher: American Medical Association. doi:10.1001/jamasurg.2015.3104.
   Google Scholar
• Kusner M, Sun Y, Kolkin N, Weinberger K 2015. From word embeddings to document dis- tances. In: International conference on machine learning. Lille, France. p. 957–966.
   Google Scholar
• LeNail A. 2019. Nn-svg: publication-ready neural network architecture schematics. J Open Sour Soft. 4(33):747. doi:10.21105/joss.00747.
   Google Scholar
• Li P, Jiang X, Shatkay H. 2019. Figure and caption extraction from biomedical documents. Bioinformatics. 35(21):4381–4388. doi:10.1093/bioinformatics/btz228.
   Google Scholar
• Lyndon D, Kumar A, Kim J 2017. Neural captioning for the imageCLEF 2017 medical image challenges. CLEF (Working Notes).
   Google Scholar
• Mirchi N, Bissonnette V, Yilmaz R, Ledwos N, Winkler-Schwartz A, Del Maestro RF. 2020. The virtual operative assistant: an explainable artificial intelligence tool for simulation- based training in surgery and medicine. PloS One. 15(2):e0229596. Publisher: Public Library of Science San Francisco, CA USA. doi:10.1371/journal.pone.0229596.
   Google Scholar
• Mishra S, Banerjee M 2020. Automatic caption generation of retinal diseases with self- trained RNN merge model. In: Advanced Computing and Systems for Security. Singapore: Springer. p. 1–10.
   Google Scholar
• Papineni K, Roukos S, Ward T, Zhu WJ 2002. BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting on association for computational linguistics. Association for Computational Linguistics. Philadelphia, Pennsylvania. p. 311–318.
   Google Scholar
• Patel V, Khan MN, Shrivastava A, Sadiq K, Ali SA, Moore SR, Brown DE, Syed S. 2020. Artificial intelligence applied to gastrointestinal diagnostics: a review. J Pediatr Gastroenterol Nutr. 70(1):4–11. doi:10.1097/MPG.0000000000002507.
   Google Scholar
• Pavlopoulos J, Kougia V, Androutsopoulos I 2019. A survey on biomedical image captioning. In: Proceedings of the Second Workshop on Shortcomings in Vision and Language. Minneapolis, Minnesota. p. 26–36.
   Google Scholar
• Pelka O, Friedrich CM, García Seco de Herrera A, Müller H. 2019. Overview of the image- CLEFmed 2019 concept prediction task. In: CLEF2019 Working Notes; (CEUR Workshop Proceedings. vol. 2380; Lugano, Switzerland: CEUR-WS.
   Google Scholar
• Rojas-Muñoz E, Lin C, Sanchez-Tamayo N, Cabrera ME, Andersen D, Popescu V, Barragan JA, Zarzaur B, Murphy P, Anderson K, et al. 2020. Evaluation of an augmented reality platform for austere surgical telementoring: a randomized controlled crossover study in cricothyroidotomies. NPJ Digi Med. 3(1):1–9. doi:10.1038/s41746-020-0284-9
   Google Scholar
• Schuster M, Paliwal KK. 1997. Bidirectional recurrent neural networks. IEEE Trans Signal Process. 45(11):2673–2681. doi:10.1109/78.650093.
   Google Scholar
• Sebajang H, Trudeau P, Dougall A, Hegge S, McKinley C, Anvari M. 2005. Telementoring: an important enabling tool for the community surgeon. Surg Innov. 12(4):327–331. Publisher: Westminster Publications, Inc. 708 Glen Cove Avenue, Glen Head, NY 11545, USA. doi:10.1177/155335060501200407.
   Google Scholar
• Sebajang H, Trudeau P, Dougall A, Hegge S, McKinley C, Anvari M. 2006. The role of telementoring and telerobotic assistance in the provision of laparoscopic colorectal surgery in rural areas. Surg Endosc Other Interven Techn. 20(9):1389–1393. Publisher: Springer. doi:10.1007/s00464-005-0260-0.
   Google Scholar
• Simonyan K, Zisserman A. 2014. Very deep convolutional networks for large-scale image recognition. arXiv Preprint arXiv. 1409.1556.
   Google Scholar
• Singh S, Karimi S, Ho-Shon K, Hamey L 2019. From chest X-rays to radiology reports: a multimodal machine learning approach. In: 2019 Digital Image Computing: Techniques and Applications (DICTA). Perth, Australia: IEEE. p. 1–8.
   Google Scholar
• thumbroll LLC. 2020. Thumbroll. [accessed 2020 Mar 13]. https://www. thumbroll.com/.
   Google Scholar
• Ward KPSRT, Reeder JHF 2002. Corpus-based comprehensive and diagnostic MT evaluation: Initial Arabic, Chinese, French, and Spanish results.
   Google Scholar
• Xu J, Liu W, Liu C, Wang Y, Chi Y, Xie X, Hua X 2019. Concept detection based on multi- label classification and image captioning approach-damo at imageclef 2019. In: CLEF2019 Working Notes. CEUR Workshop Proceedings,(CEUR-WS. org). Lugano, Switzerland. p. 1613–1673.
   Google Scholar
• Xu K, Ba J, Kiros R, Cho K, Courville A, Salakhudinov R, Zemel R, Bengio Y 2015. Show, attend and tell: neural image caption generation with visual attention. In: International conference on machine learning. Lille, France. p. 2048–2057.
   Google Scholar