Exoskeleton Usability Questionnaire: a preliminary evaluation questionnaire for the lower limb industrial exoskeletons

References

• Alabdulkarim, S., and M.A. Nussbaum. 2019. “Influences of Different Exoskeleton Designs and Tool Mass on Physical Demands and Performance in a Simulated Overhead Drilling Task.” Applied Ergonomics 74: 55–66. doi:10.1016/j.apergo.2018.08.004.
   PubMed Web of Science ®Google Scholar
• Alemi, M.M., J. Geissinger, A.A. Simon, S.E. Chang, and A.T. Asbeck. 2019. “A Passive Exoskeleton Reduces Peak and Mean EMG during Symmetric and Asymmetric Lifting.” Journal of Electromyography and Kinesiology 47: 25–34. doi:10.1016/j.jelekin.2019.05.003.
   PubMed Web of Science ®Google Scholar
• Alemi, M.M., S. Madinei, S. Kim, D. Srinivasan, and M.A. Nussbaum. 2020. “Effects of Two Passive Back-Support Exoskeletons on Muscle Activity, Energy Expenditure, and Subjective Assessments during Repetitive Lifting.” Human Factors 62 (3): 458–474. doi:10.1177/0018720819897669.
   PubMed Web of Science ®Google Scholar
• Amandels, S., H.O. het Eyndt, L. Daenen, and V. Hermans. 2019. “Introduction and Testing of a Passive Exoskeleton in an Industrial Working Environment.” In Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018), Advances in Intelligent Systems and Computing, edited by S. Bagnara, R. Tartaglia, S. Albolino, T. Alexander, and Y. Fujita, 387–392. Cham, Switzerland: Springer International Publishing. doi:10.1007/978-3-319-96083-8_51.
   Google Scholar
• Antwi-Afari, M.F., H. Li, S. Anwer, D. Li, Y. Yu, H. Y. Mi, and I.Y. Wuni. 2021. “Assessment of a Passive Exoskeleton System on Spinal Biomechanics and Subjective Responses during Manual Repetitive Handling Tasks among Construction Workers.” Safety Science 142: 105382. doi:10.1016/j.ssci.2021.105382.
   Web of Science ®Google Scholar
• Baltrusch, S.J., J.H. van Dieen, C.A.M. van Bennekom, and H. Houdijk. 2020. “Testing an Exoskeleton That Helps Workers with Low-Back Pain: Less Discomfort with the Passive SPEXOR Trunk Device.” IEEE Robotics & Automation Magazine 27 (1): 66–76. doi:10.1109/MRA.2019.2954160.
   Web of Science ®Google Scholar
• Baltrusch, S.J., J.H. van Dieën, C.A.M. van Bennekom, and H. Houdijk. 2018. “The Effect of a Passive Trunk Exoskeleton on Functional Performance in Healthy Individuals.” Applied Ergonomics 72: 94–106. doi:10.1016/j.apergo.2018.04.007.
   PubMed Web of Science ®Google Scholar
• Bentler, P.M. 1990. “Comparative Fit Indexes in Structural Models.” Psychological Bulletin 107 (2): 238–246. doi:10.1037/0033-2909.107.2.238.
   PubMed Web of Science ®Google Scholar
• Bosch, T., J. van Eck, K. Knitel, and M. de Looze. 2016. “The Effects of a Passive Exoskeleton on Muscle Activity, Discomfort and Endurance Time in Forward Bending Work.” Applied Ergonomics 54: 212–217. doi:10.1016/j.apergo.2015.12.003.
   PubMed Web of Science ®Google Scholar
• Brooke, J. 1996. “SUS: A “Quick and Dirty” Usability Scale.” Usability Evaluation in Industry. Boca Raton, FL: CRC Press.
   Google Scholar
• Cha, J.S., S. Monfared, D. Stefanidis, M.A. Nussbaum, and D. Yu. 2020. “Supporting Surgical Teams: Identifying Needs and Barriers for Exoskeleton Implementation in the Operating Room.” Human Factors 62 (3): 377–390. doi:10.1177/0018720819879271.
   PubMed Web of Science ®Google Scholar
• Cohen, A.L. 1997. Elements of Ergonomics Programs: A Primer Based on Workplace Evaluations of Musculoskeletal Disorders. Darby, PA: DIANE Publishing.
   Google Scholar
• de Looze, M. P., T. Bosch, F. Krause, K. S. Stadler, and L. W. O’Sullivan. 2016. “Exoskeletons for Industrial Application and Their Potential Effects on Physical Work Load.” Ergonomics 59 (5): 671–681. doi:10.1080/00140139.2015.1081988.
   PubMed Web of Science ®Google Scholar
• Demers, L., R. Weiss-Lambrou, and B. Ska. 2002. “The Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST 2.0): an Overview and Recent Progress.” Technology and Disability 14 (3): 101–105. doi:10.3233/TAD-2002-14304.
   Google Scholar
• Demers, L., R. Weiss-Lambrou, and B. Ska. 1996. “Development of the Quebec User Evaluation of Satisfaction with Assistive Technology (QUEST).” Assistive Technology 8 (1): 3–13. doi:10.1080/10400435.1996.10132268.
   PubMedGoogle Scholar
• Ditchen, D.M., R.P. Ellegast, T. Gawliczek, B. Hartmann, and M.A. Rieger. 2015. “Occupational Kneeling and Squatting: development and Validation of an Assessment Method Combining Measurements and Diaries.” International Archives of Occupational and Environmental Health 88 (2): 153–165. doi:10.1007/s00420-014-0946-5.
   PubMed Web of Science ®Google Scholar
• Fethke, N.B., L.A. Merlino, F. Gerr, M.C. Schall, Jr., and C.A. Branch. 2015. “Musculoskeletal Pain among Midwest Farmers and Associations with Agricultural Activities.” American Journal of Industrial Medicine 58 (3): 319–330. doi:10.1002/ajim.22398.
   PubMed Web of Science ®Google Scholar
• Gumasing, M. J. J., Y.T. Prasetyo, A.K.S. Ong, S.F. Persada, and R. Nadlifatin. 2023. “Factors Influencing the Perceived Usability of Wearable Chair Exoskeleton with Market Segmentation: A Structural Equation Modeling and K-Means Clustering Approach.” International Journal of Industrial Ergonomics 93: 103401. doi:10.1016/j.ergon.2022.103401.
   Web of Science ®Google Scholar
• Hill, D., C.S. Holloway, D.Z.M. Ramirez, P. Smitham, and Y. Pappas. 2017. “What Are User Perspectives of Exoskeleton Technology? A Literature Review.” International Journal of Technology Assessment in Health Care 33 (2): 160–167. doi:10.1017/S0266462317000460.
   PubMed Web of Science ®Google Scholar
• Hooper, D., J. Coughlan, and M. Mullen. 2008. “Structural Equation Modelling: Guidelines for Determining Model Fit.” The Electronic Journal of Business Research Methods 6 (1): 53–60. doi:10.21427/D7CF7R.
   Google Scholar
• Howard, J., V.V. Murashov, B.D. Lowe, and M. L. Lu. 2020. “Industrial Exoskeletons: Need for Intervention Effectiveness Research.” American Journal of Industrial Medicine 63 (3): 201–208. doi:10.1002/ajim.23080.
   PubMed Web of Science ®Google Scholar
• Hussain, M., J. Park, N. Kim, H.K. Kim, J. Lee, and J. Lee. 2020. “Effects of Exoskeleton Robot on Human Posture and Lumbar Pressure during Manual Lifting Tasks.” ICIC Express Letters, Part B: Applications 11 (5): 439–445. doi:10.24507/icicelb.11.05.439.
   Google Scholar
• Huysamen, K., M. de Looze, T. Bosch, J. Ortiz, S. Toxiri, and L. W. O'Sullivan. 2018. “Assessment of an Active Industrial Exoskeleton to Aid Dynamic Lifting and Lowering Manual Handling Tasks.” Applied Ergonomics 68: 125–131. doi:10.1016/j.apergo.2017.11.004.
   PubMed Web of Science ®Google Scholar
• Jones, D.H. 1994. “Book Review: Statistical Methods, 8th Edition George W. Snedecor and William G. Cochran Ames: Iowa State University Press, 1989. xix + 491 pp.” Journal of Educational Statistics 19 (3): 304–307. doi:10.3102/10769986019003304.
   Google Scholar
• Kaupe, V., C. Feldmann, and H. Wagner. 2021. “Exoskeletons: productivity and Ergonomics in Logistics: A Systematic Review.” Presented at the Hamburg International Conference of Logistics (HICL) 2021, 527–561. doi:10.15480/882.3972.
   Google Scholar
• Kermavnar, T., A. W. de Vries, M. P. de Looze, and L. W. O’Sullivan. 2021. “Effects of Industrial Back-Support Exoskeletons on Body Loading and User Experience: An Updated Systematic Review.” Ergonomics 64 (6): 685–711. doi:10.1080/00140139.2020.1870162.
   PubMed Web of Science ®Google Scholar
• Kim, H.K., M. Hussain, J. Park, J. Lee, and J.W. Lee. 2021a. “Analysis of Active Back-Support Exoskeleton during Manual Load-Lifting Tasks.” Journal of Medical and Biological Engineering 41: 704–714. doi:10.1007/s40846-021-00644-w.
   Web of Science ®Google Scholar
• Kim, H. K., S. Seong, J. Park, J. Kim, J. Park, and W. Park. 2021b. “Subjective Evaluation of the Effect of Exoskeleton Robots for Rehabilitation Training.” IEEE Access 9: 130554–130561. doi:10.1109/ACCESS.2021.3112263.
   Web of Science ®Google Scholar
• Kim, S., S. Madinei, M.M. Alemi, D. Srinivasan, and M.A. Nussbaum. 2020. “Assessing the Potential for “Undesired” Effects of Passive Back-Support Exoskeleton Use during a Simulated Manual Assembly Task: Muscle Activity, Posture, Balance, Discomfort, and Usability.” Applied Ergonomics 89: 103194. doi:10.1016/j.apergo.2020.103194.
   PubMed Web of Science ®Google Scholar
• Kok, J. de., P. Vroonhof, J. Snijders, G. Roullis, M. Clarke, K. Peereboom, P. van Dorst, and I. Isusi. 2019. Work-Related Musculoskeletal Disorders: Prevalence, Costs and Demographics in the EU. Luxembourg: Publications Office of the European Union.
   Google Scholar
• Kozinc, Ž., S. Baltrusch, H. Houdijk, and N. Šarabon. 2021. “Short-Term Effects of a Passive Spinal Exoskeleton on Functional Performance, Discomfort and User Satisfaction in Patients with Low Back Pain.” Journal of Occupational Rehabilitation 31 (1): 142–152. doi:10.1007/s10926-020-09899-7.
   PubMed Web of Science ®Google Scholar
• Kuzmicheva, O., S. Focke Martinez, U. Krebs, M. Spranger, S. Moosburner, B. Wagner, and A. Gräser. 2016. “Overground Robot Based Gait Rehabilitation System MOPASS - Overview and First Results from Usability Testing.” 2016 IEEE International Conference on Robotics and Automation (ICRA). Presented at the 2016 IEEE International Conference on Robotics and Automation (ICRA), Sweden, 3756–3763, IEEE. doi:10.1109/ICRA.2016.7487563.
   Google Scholar
• Lowe, B.D., W.G. Billotte, and D.R. Peterson. 2019. “ASTM F48 Formation and Standards for Industrial Exoskeletons and Exosuits.” IISE Transactions on Occupational Ergonomics and Human Factors 7 (3–4): 230–236. doi:10.1080/24725838.2019.1579769.
   Web of Science ®Google Scholar
• Luger, T., M. Bär, R. Seibt, M.A. Rieger, and B. Steinhilber. 2023. “Using a Back Exoskeleton during Industrial and Functional Tasks—Effects on Muscle Activity, Posture, Performance, Usability, and Wearer Discomfort in a Laboratory Trial.” Human Factors 65 (1): 5–21. doi:10.1177/00187208211007267.
   PubMed Web of Science ®Google Scholar
• Luger, T., R. Seibt, T.J. Cobb, M.A. Rieger, and B. Steinhilber. 2019. “Influence of a Passive Lower-Limb Exoskeleton during Simulated Industrial Work Tasks on Physical Load, Upper Body Posture, Postural Control and Discomfort.” Applied Ergonomics 80: 152–160. doi:10.1016/j.apergo.2019.05.018.
   PubMed Web of Science ®Google Scholar
• Mertz, L. 2012. “The Next Generation of Exoskeletons: Lighter, Cheaper Devices Are in the Works.” IEEE Pulse 3 (4): 56–61. doi:10.1109/MPUL.2012.2196836.
   PubMed Web of Science ®Google Scholar
• Meyer, J.T., S.O. Schrade, O. Lambercy, and R. Gassert. 2019. “User-Centered Design and Evaluation of Physical Interfaces for an Exoskeleton for Paraplegic Users.” 2019 IEEE 16th International Conference on Rehabilitation Robotics (ICORR), Canada, 1159–1166. IEEE. doi:10.1109/ICORR.2019.8779527.
   Google Scholar
• Pillai, M.V., L. Van Engelhoven, and H. Kazerooni. 2020. “Evaluation of a Lower Leg Support Exoskeleton on Floor and below Hip Height Panel Work.” Human Factors 62 (3): 489–500. doi:10.1177/0018720820907752.
   PubMed Web of Science ®Google Scholar
• Punnett, L., and D.H. Wegman. 2004. “Work-Related Musculoskeletal Disorders: The Epidemiologic Evidence and the Debate.” Journal of Electromyography and Kinesiology 14 (1): 13–23. doi:10.1016/j.jelekin.2003.09.015.
   PubMed Web of Science ®Google Scholar
• Reid, C.R., P.M. Bush, N.H. Cummings, D.L. McMullin, and S.K. Durrani. 2010. “A Review of Occupational Knee Disorders.” Journal of Occupational Rehabilitation 20 (4): 489–501. doi:10.1007/s10926-010-9242-8.
   PubMed Web of Science ®Google Scholar
• Schneider, J.C., M.Y. Ozsecen, N.K. Muraoka, C. Mancinelli, U. Della Croce, C.M. Ryan, and P. Bonato. 2016. “Feasibility of an Exoskeleton-Based Interactive Video Game System for Upper Extremity Burn Contractures.” PM & R: The Journal of Injury, Function, and Rehabilitation 8 (5): 445–452. doi:10.1016/j.pmrj.2015.09.012.
   PubMedGoogle Scholar
• Seidler, A., U. Bolm-Audorff, N. Abolmaali, G. Elsner, and Knee Osteoarthritis Study-Group. 2008. “The Role of Cumulative Physical Work Load in Symptomatic Knee Osteoarthritis – a Case-Control Study in Germany.” Journal of Occupational Medicine and Toxicology 3 (1): 14. doi:10.1186/1745-6673-3-14.
   PubMedGoogle Scholar
• Spada, S., L. Ghibaudo, S. Gilotta, L. Gastaldi, and M.P. Cavatorta. 2017. “Investigation into the Applicability of a Passive Upper-Limb Exoskeleton in Automotive Industry.” Procedia Manufacturing 11: 1255–1262. doi:10.1016/j.promfg.2017.07.252.
   Google Scholar
• Steiger, J.H. 2007. “Understanding the Limitations of Global Fit Assessment in Structural Equation Modeling.” Personality and Individual Differences 42 (5): 893–898. doi:10.1016/j.paid.2006.09.017.
   Web of Science ®Google Scholar
• Tsai, Y. L., J. J. Huang, S. W. Pu, H. P. Chen, S. C. Hsu, J. Y. Chang, and Y. C. Pei. 2019. “Usability Assessment of a Cable-Driven Exoskeletal Robot for Hand Rehabilitation.” Frontiers in Neurorobotics 13: 3. doi:10.3389/fnbot.2019.00003.
   PubMed Web of Science ®Google Scholar
• Walker‐Bone, K., and K.T. Palmer. 2002. “Musculoskeletal Disorders in Farmers and Farm Workers.” Occupational Medicine (Oxford, England) 52 (8): 441–450. doi:10.1093/occmed/52.8.441.
   PubMed Web of Science ®Google Scholar
• Whelan, S., D.J. Ruane, J. McNamara, A. Kinsella, and A. McNamara. 2009. “Disability on Irish Farms—a Real Concern.” Journal of Agromedicine 14 (2): 157–163. doi:10.1080/10599240902813078.
   PubMed Web of Science ®Google Scholar
• Zhai, C., H. Xu, H. Fu, Y. Zhao, and Y. Duan. 2022. “Application of Exoskeleton Robot in Material Support.” Proceedings of the 2022 5th International Conference on Signal Processing and Machine Learning, SPML ’22, China. ACM, 275–281. doi:10.1145/3556384.3556426.
   Google Scholar
• Zheng, L., A.L. Hawke, and K. Evans. 2022. “Critical Review on Applications and Roles of Exoskeletons in Patient Handling.” International Journal of Industrial Ergonomics 89: 103290. doi:10.1016/j.ergon.2022.103290.
   Web of Science ®Google Scholar
• Zhu, Z., A. Dutta, and F. Dai. 2021. “Exoskeletons for Manual Material Handling – a Review and Implication for Construction Applications.” Automation in Construction 122: 103493. doi:10.1016/j.autcon.2020.103493.
   Web of Science ®Google Scholar