The Role of bi-Directional Graphic Communication in Human-Unmanned Operations

Abstract

Digitization in the battlefield enables bi-directional graphic communication, i.e., sharing pictures or video feeds derived from unmanned systems, among distributed elements. Introducing robotic technologies at the battalion level is aimed to support shorter OODA (observe-orient-decide-act) cycles and more agility. Our focus is on developing bi-directional graphic communication tools for observer-executer teams as alternative ways to communicate. Following the Design Science Research methodology, four closely related consecutive studies with subject matter experts (SMEs) demonstrate how we first learn about phenomena and then use the knowledge to design interaction tools for communication. We first study the human-human observer-executer teams. Then, as the design of the interaction tools evolves, we transfer design principles into communication tools between an executer and the unmanned system (Wizard of Oz study). Our work highlights the potential of implementing and using bi-directional graphic communication to enhance battlefield understanding in addition to verbal communication (speech or chat). We demonstrate the necessity of user-centered development and evaluation for design and application. Further, we emphasize the role of the unmanned system operator (observer) and raise questions regarding how to further progress in teaming with intelligent unmanned systems.

Acknowledgments

2013–2017, work was supported by the US Army Research Laboratory through the DCS subcontract no: APX03-S010 (BG Negev Technologies and Applications Ltd) under Prime Contract no W911NF-10-D-0002, Mr. Michael Barnes, Technical Monitor. 2017–2020, work was supported by a grant of the US Army Research Laboratory through the GDLS subcontract no: GDLS PO 40253724 (BG Negev Technologies and Applications Ltd) under Prime Contract no W911MF-10-2-0016 (Robotics Consortium), Robotics CTA 2015–2020, T2C1S3C, Michael Barnes, Technical Monitor. We wish to acknowledge the continuous support of the US ARL and the guidance of Michael Barnes. From the IDF battlelab we want to acknowledge the support of Lt. Col Yaniv Minkov, Major Yisachar Shapira, Major Yoav Yulis, Captain Omri Mualem and Uriel Houri. We recognize graduate students Regina Ziv-Schegolsky for being part of the development and execution and Yonatan Back for implementing Study IV. The views expressed in this work are those of the authors and do not reflect official army policies. This work is unclassified and approved for public release.

Additional information

Notes on contributors

Tal Oron-Gilad

Tal Oron-Gilad is a Full Professor in the Department of Industrial Engineering and Management at Ben-Gurion University, the George Shrut Chair of human performance. Her expertise is human factors engineering, Human-machine systems, and decision support systems for command and control, focusing on interaction challenges, mutual understanding and shared communication.

Ilit Oppenheim

Ilit Oppenheim is a Director of Shlomo Shmeltzer Institute for Smart transportation, Tel Aviv University. She was a research associate at Ben-Gurion University of the Negev and Horizon 2020 RESIST. Project. She holds a B.Sc. in Aeronautics Engineering, Technion, M.Sc., and PhD in Human Factors engineering, from Ben-Gurion University of the Negev.

Yisrael Parmet

Yisrael Parmet is an Associate Professor at the Department of Industrial Engineering and Management at Ben-Gurion University of the Negev, Israel. He holds a B.A. in Economics and Statistics and M.Sc. and Ph.D. degrees in Statistics from Tel-Aviv University.