Developing a subjective instrument for laparoscopic surgical workload in a high fidelity simulator using the NASA-TLX and SURG-TLX

References

• Abdelrahman, A. M., Yu, D., Lowndes, B. R., Buckarma, E. H., Gas, B. L., Farley, D. R., Bingener, J., & Hallbeck, M. S. (2018). Validation of a novel inverted peg transfer task: Advancing beyond the regular peg transfer task for surgical simulation-based assessment. Journal of Surgical Education, 75(3), 836–843. https://doi.org/10.1016/j.jsurg.2017.09.028
   Web of Science ®Google Scholar
• Abdi, H., & Williams, L. J. (2010). Principal component analysis. Wiley Interdisciplinary Reviews: Computational Statistics, 2(4), 433–459. https://doi.org/10.1002/wics.101
   Google Scholar
• Arora, S., Sevdalis, N., Nestel, D., Woloshynowych, M., Darzi, A., & Kneebone, R. (2010). The impact of stress on surgical performance: A systematic review of the literature. Surgery, 147(3), 318–330, 330.e311–316. https://doi.org/10.1016/j.surg.2009.10.007
   PubMed Web of Science ®Google Scholar
• Berg, R. J., Inaba, K., Sullivan, M., Okoye, O., Siboni, S., Minneti, M., Teixeira, P. G., & Demetriades, D. (2015). The impact of heat stress on operative performance and cognitive function during simulated laparoscopic operative tasks. Surgery, 157(1), 87–95. https://doi.org/10.1016/j.surg.2014.06.012
   PubMed Web of Science ®Google Scholar
• Berguer, R., Smith, W. D., & Chung, Y. H. (2001). Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery. Surgical Endoscopy, 15(10), 1204–1207. https://doi.org/10.1007/s004640080030
   PubMed Web of Science ®Google Scholar
• Brown-Clerk, B., de Laveaga, A. E., LaGrange, C. A., Wirth, L. M., Lowndes, B. R., & Hallbeck, M. S. (2011). Laparoendoscopic single-site (LESS) surgery versus conventional laparoscopic surgery: Comparison of surgical port performance in a surgical simulator with novices. Surgical Endoscopy, 25(7), 2210–2218. https://doi.org/10.1007/s00464-010-1524-x
   Web of Science ®Google Scholar
• Carswell, C. M., Clarke, D., & Seales, W. B. (2005). Assessing mental workload during laparoscopic surgery. Surgical Innovation, 12, 80–90. https://doi.org/10.1177/155335060501200112
   PubMedGoogle Scholar
• Chouillard, E., Dache, A., Torcivia, A., Helmy, N., Ruseykin, I., & Gumbs, A. (2010). Single-incision laparoscopic appendectomy for acute appendicitis: A preliminary experience. Surgical Endoscopy, 24(8), 1861–1865. https://doi.org/10.1007/s00464-009-0860-1
   Web of Science ®Google Scholar
• Dey, A., & Mann, D. D. (2010). Sensitivity and diagnosticity of NASA-TLX and simplified SWAT to assess the mental workload associated with operating an agricultural sprayer. Ergonomics, 53(7), 848–857. https://doi.org/10.1080/00140139.2010.489960
   PubMed Web of Science ®Google Scholar
• Everitt, B. S. (1995). The analysis of repeated measures: A practical review with examples. The Statistician, 44(1), 113–135. https://doi.org/10.2307/2348622
   Google Scholar
• Galy, E., Paxion, J., & Berthelon, C. (2018). Measuring mental workload with the NASA-TLX needs to examine each dimension rather than relying on the global score: An example with driving. Ergonomics, 61(4), 517–527. https://doi.org/10.1080/00140139.2017.1369583
   PubMed Web of Science ®Google Scholar
• Hallbeck, M. S., Lowndes, B. R., McCrory, B., Morrow, M. M., Kaufman, K. R., & LaGrange, C. A. (2017). Kinematic and ergonomic assessment of laparoendoscopic single-site surgical instruments during simulator training tasks. Applied Ergonomics, 62, 118–130. https://doi.org/10.1016/j.apergo.2017.02.003
   PubMed Web of Science ®Google Scholar
• Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload, 52, 139–183. https://doi.org/10.1016/s0166-4115(08)62386-9
   Google Scholar
• Hoonakker, P., Carayon, P., Gurses, A. P., Brown, R., Khunlertkit, A., McGuire, K., & Walker, J. M. (2011). Measuring workload of ICU nurses with a questionnaire survey: The NASA Task Load Index (TLX). IIE Transactions on Healthcare Systems Engineering, 1(2), 131–143. https://doi.org/10.1080/19488300.2011.609524
   PubMedGoogle Scholar
• Ishikawa, N., Arano, Y., Shimizu, S., Morishita, M., Kawaguchi, M., Matsunoki, A., Adachi, I., Shimizu, J., & Watanabe, G. (2009). Single incision laparoscopic surgery (SILS) using cross hand technique. Minimally Invasive Therapy & Allied Technologies : Technologies, 18(6), 322–324. https://doi.org/10.3109/13645700903384492
   PubMed Web of Science ®Google Scholar
• Kenward, M. G. (1987). A method for comparing profiles of repeated measurements. Applied Statistics, 36(3), 296–308. https://doi.org/10.2307/2347788
   Web of Science ®Google Scholar
• Koca, D., Yildiz, S., Soyupek, F., Gunyeli, I., Erdemoglu, E., Soyupek, S., & Erdemoglu, E. (2015). Physical and mental workload in single-incision laparoscopic surgery and conventional laparoscopy. Surgical Innovation, 22(3), 294–302. https://doi.org/10.1177/1553350614556363
   Web of Science ®Google Scholar
• Lowndes, B., Abdelrahman, A., McCrory, B., & Hallbeck, S. (2016). A preliminary study of novice workload and performance during surgical simulation tasks for conventional vs. single incision laparoscopic techniques. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59(1), 498–502. https://doi.org/10.1177/1541931215591107
   Google Scholar
• Lowndes, B. R., Forsyth, K. L., Blocker, R. C., Dean, P. G., Truty, M. J., Heller, S. F., Blackmon, S., Hallbeck, M. S., & Nelson, H. (2018). NASA-TLX assessment of surgeon workload variation across specialties. Ann Surg. 271, 686–692. https://doi.org/10.1097/SLA.0000000000003058
   Web of Science ®Google Scholar
• Lowndes, B. R., & Hallbeck, M. S. (2014). Overview of human factors and ergonomics in the OR, with an emphasis on minimally invasive surgeries. Human Factors and Ergonomics in Manufacturing and Service Industries, 24(3), 308–317. https://doi.org/10.1002/hfm.20383
   Web of Science ®Google Scholar
• McCrory, B., Lowndes, B. R., LaGrange, C. A., Miller, E. E., & Hallbeck, M. S. (2013). Comparative usability testing of conventional and single incision laparoscopic surgery devices. Human Factors: The Journal of the Human Factors and Ergonomics Society, 55(3), 619–631. https://doi.org/10.1177/0018720812465082
   Web of Science ®Google Scholar
• McCrory, B., Lowndes, B. R., Wirth, L. M., de Laveaga, A. E., LaGrange, C. A., & Hallbeck, M. S. (2012). Ergonomic evaluation of laparoendoscopic single-site surgery ports in a validated laparoscopic training model. Work, 41(Suppl 1), 1884–1890. https://doi.org/10.3233/WOR-2012-0402-1884
   Google Scholar
• Modi, H. N., Singh, H., Orihuela-Espina, F., Athanasiou, T., Fiorentino, F., Yang, G. Z., Darzi, A., & Leff, D. R. (2018). Temporal stress in the operating room: Brain engagement promotes "coping" and disengagement prompts "choking. Annals of Surgery, 267(4), 683–691. https://doi.org/10.1097/SLA.0000000000002289
   PubMed Web of Science ®Google Scholar
• Montero, P. N., Acker, C. E., Heniford, B. T., & Stefanidis, D. (2011). Single incision laparoscopic surgery (SILS) is associated with poorer performance and increased surgeon workload compared with standard laparoscopy. The American Surgeon, 77(1), 73–77. http://search.ebscohost.com.proxybz.lib.montana.edu/login.aspx?direct=true&db=a9h&AN=57404387&login.asp&site=ehost-live
   Web of Science ®Google Scholar
• Rivas, H., Varela, E., & Scott, D. (2010). Single-incision laparoscopic cholecystectomy: Initial evaluation of a large series of patients. Surgical Endoscopy, 24(6), 1403–1412. https://doi.org/10.1007/s00464-009-0786-7
   PubMed Web of Science ®Google Scholar
• Saber, A. A., Elgamal, M. H., El-Ghazaly, T. H., Dewoolkar, A. V., & Akl, A. (2010). Simple technique for single incision transumbilical laparoscopic appendectomy. International Journal of Surgery, 8(2), 128–130. https://doi.org/10.1016/j.ijsu.2009.12.001
   Web of Science ®Google Scholar
• Stahl, J. E., Egan, M. T., Goldman, J. M., Tenney, D., Wiklund, R. A., Sandberg, W. S., Gazelle, S., & Rattner, D. W. (2005). Introducing new technology into the operating room: Measuring the impact on job performance and satisfaction. Surgery, 137(5), 518–526. https://doi.org/10.1016/j.surg.2004.12.015
   PubMed Web of Science ®Google Scholar
• Wheelock, A., Suliman, A., Wharton, R., Babu, E. D., Hull, L., Vincent, C., Sevdalis, N., & Arora, S. (2015). The impact of operating room distractions on stress, workload, and teamwork. Annals of Surgery, 261(6), 1079–1084. https://doi.org/10.1097/sla.0000000000001051
   PubMed Web of Science ®Google Scholar
• Wilson, M. R., Poolton, J. M., Malhotra, N., Ngo, K., Bright, E., & Masters, R. S. (2011). Development and validation of a surgical workload measure: The surgery task load index (SURG-TLX). World Journal of Surgery, 35(9), 1961–1969. https://doi.org/10.1007/s00268-011-1141-4
   PubMed Web of Science ®Google Scholar
• Yurko, Y. Y., Scerbo, M. W., Prabhu, A. S., Acker, C. E., & Stefanidis, D. (2010). Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simulation in Healthcare, 5(5), 267–271. https://doi.org/https://doi.org/10.1097/SIH.0b013e3181e3f329
   PubMedGoogle Scholar