Multimodal control of sensors on multiple simulated unmanned vehicles

References

• Baber , C. 1997 . Beyond the desktop: Designing and using interaction devices , San Diego, CA : Academic Press .
   Google Scholar
• Baber , C. and Mellor , B. 2001 . Using critical path analysis to model multi-modal human-computer interaction . International Journal of Human-Computer Studies , 54 : 613 – 636 .
   Web of Science ®Google Scholar
• Baddeley , A. D. 1998 . The central executive: a concept and some misconceptions . Journal of the International Neuropsychological Society , 4 : 523 – 526 .
   PubMed Web of Science ®Google Scholar
• Baddeley , A. D. 2007 . Working memory, thought and action , Oxford : Oxford University Press .
   Google Scholar
• Biermann , A. W. , Fineman , L. and Heidlage , J. F. 1992 . A voice and touch driven natural language editor and its performance . International Journal of Man-Machine Studies , 37 : 1 – 21 .
   Google Scholar
• Bolt , R. A. 1980 . Put-that-there: voice and gesture at the graphics interface . Computer Graphics , 14 : 262 – 270 .
   Google Scholar
• Bolt , R. A. 1984 . The human interface: Where people and computers meet , Boston : Lifelong Learning Publications .
   Google Scholar
• Byers , J. C. , Bittner , A. C. and Hill , S. G. 1989 . “ Traditional and raw Task Load Index (TLX) correlations: are paired comparisons necessary? ” . In Advances in industrial ergonomics and safety 1 , Edited by: Mital , A. 481 – 485 . London : Taylor and Francis .
   Google Scholar
• Chen , J. Y.C. 2008 . UAV-guided navigation for ground robot tele-operations in a military reconnaissance environment . Ergonomics , 53 : 940 – 950 .
   Google Scholar
• Chen , J. Y.C. 2009 . Concurrent performance of military and robotics tasks and effects of cueing in a simulated multi-tasking environment . Presence , 18 : 1 – 15 .
   Google Scholar
• Chen , J. Y.C. , Haas , E. C. and Barnes , M. J. 2007 . Human performance issues and user interface design for tele-operated robots . IEEE Transactions on Systems, Man and Cybernetics – Part C: Applications and Reviews , 37 : 1231 – 1245 .
   Web of Science ®Google Scholar
• Cohen , P. R. Quickset: multimodal interaction for distributed applications . 5th ACM conference on Multimedia . pp. 31 – 40 . New York : ACM .
   Google Scholar
• Cohen , P. R. 2002 . Multimodal interaction for 2D and 3D environments . IEEE Computer Graphics and Applications , 19 : 10 – 13 .
   Google Scholar
• Cummings , M. L. 2007 . Automation architectures for single operator, multiple UAV command and control . The International C2 Journal , 1 : 1 – 24 .
   Google Scholar
• Dixon , S. R. and Wickens , C. D. 2003 . “ Control of multiple-UAVs: a workload analysis ” . In 12th international symposium on aviation psychology , Dayton, OH : Association for Aviation Psychology .
   Google Scholar
• Donmez , B. , Cummings , M. L. and Graham , H. D. 2009 . Auditory decision aiding in supervisory control of multiple unmanned aerial vehicles . Human Factors , 51 : 718 – 729 .
   PubMed Web of Science ®Google Scholar
• Draper , M. Manual versus speech input for unmanned aerial vehicle control station operations . Proceedings of the 47th annual meeting of the Human Factors and Ergonomics Society . pp. 109 – 113 . Santa Monica, CA : HFES .
   Google Scholar
• Finn , A. and Scheding , S. 2010 . Developments and challenges for autonomous unmanned vehicles: a compendium , Berlin : Springer-Verlag .
   Google Scholar
• Hart , S. G. and Staveland , L. E. 1988 . “ Development of NASA-TLX (Task Load Index): results of empirical and theoretical research ” . In Human mental workload , Edited by: Hancock , P. A. and Meshkati , N. 139 – 183 . Amsterdam : Elsevier .
   Google Scholar
• Hauptmann , A. G. and McAvinney , P. 1993 . Gestures with speech for graphic manipulation . International Journal of Man-Machine Studies , 38 : 231 – 249 .
   Google Scholar
• Hegarty , M. and Waller , D. 2004 . Dissociation between mental rotation and perspective-taking spatial abilities . Intelligence , 32 : 175 – 191 .
   Web of Science ®Google Scholar
• Helleberg , J. , Wickens , C. D. and Goh , J. 2003 . “ Traffic and data link displays: auditory? Visual? Or redundant? A visual scanning analysis ” . In 12th international symposium on aviation psychology , Dayton, OH : Association for Aviation Psychology .
   Google Scholar
• Kahneman , D. 1973 . Attention and effort , Englewood Cliffs, NJ : Prentice-Hall .
   Google Scholar
• Kozhevnikov , M. and Hegarty , M. 2001 . A dissociation between object manipulation spatial ability and spatial orientation ability . Memory and Cognition , 29 : 745 – 756 .
   PubMed Web of Science ®Google Scholar
• Liu , D. , Wasson , R. and Vincenzi , D. A. 2009 . Effects of system automation management strategies and multi-mission operator-to-vehicle ratio on operator performance in UAV systems . Journal of Intelligent Robotics Systems , 54 : 795 – 810 .
   Google Scholar
• Luck , J. P. An investigation of real world control of robotic assets under communication . Proceedings of 2006 ACM conference on human-robot interaction . New York. pp. 202 – 209 . ACM Press .
   Google Scholar
• Martin , G. L. 1989 . The utility of speech input for user computer interfaces . International Journal of Man- Machine Studies , 30 : 355 – 375 .
   Google Scholar
• Maza , I. 2009 . Multimodal interface technologies for UAV ground control stations:a comparative analysis . Journal of Intelligent and Robotic Systems , 57 : 371 – 391 .
   Web of Science ®Google Scholar
• Moroney , W. F. 1995 . Some measurement and methodological considerations in the application of subjective workload measurement techniques . The International Journal of Aviation Psychology , 5 : 87 – 106 .
   Web of Science ®Google Scholar
• Nygren , T. E. 1991 . Psychometric properties of subjective workload measurement techniques: implications for their use in the assessment of perceived mental workload . Human Factors , 33 : 17 – 33 .
   Web of Science ®Google Scholar
• Oviatt , S. , Deangelli , A. and Kuhn , K. 1997 . Integration and synchronization of input modes during multimodal human-computer interaction. CHI’97 , 415 – 422 . New York : ACM .
   Google Scholar
• Oviatt , S. L. 2000 . Designing the user interface for multimodal speech and gesture applications: state-of-the-artsystems and research directions . Human-Computer Interaction , 15 : 263 – 322 .
   Web of Science ®Google Scholar
• Schmandt , C. 1990 . “ Observations of using speech input for window management ” . In Interact’90 , Edited by: Diaper , D. , Gilmore , D. , Cockton , C. and Shackel , B. 787 – 793 . Amsterdam : IOS .
   Google Scholar
• Taylor , R. M. Human automation integration for supervisory control of UAVs . Virtual media for military applications . Neuilly-Sur-Seine, France : RTO . meeting proceedings Rto-Mp-Hfm-136, Paper 12
   Google Scholar
• Thorisson , K. R. , Koons , D. R. and Bolt , R. A. 1992 . “ Multimodal natural dialogue ” . In CHI’92 , 653 – 654 . New York : ACM .
   Google Scholar
• Trouvain , B. and Schlick , C. M. 2007 . “ A comparative study of multimodal displays for multirobot supervisory control ” . In Engineering psychology and cognitive ergonomics , Edited by: Harris , D. 184 – 193 . Berlin : Springer-Verlag .
   Google Scholar
• Wickens , C. D. , Dixon , S. and Chang , D. 2003a . Using interference models to predict performance in a multiple-task UAV environment Technical Report AHFD-03–9/Maad-03–1. Savoy, IL: Aviation Human Factors Division, Institute of Aviation, University of Illinois at Urbana-Champaign
   Google Scholar
• Wickens , C. , Wickens , D. and Liu , Y. 1988 . Codes and modalities in multiple resources: a success and a qualification . Human Factors , 30 : 599 – 616 .
   PubMed Web of Science ®Google Scholar
• Wickens , C. D. and McCarley , J. 2008 . Applied attention theory , Boca-Raton, FL : Taylor and Francis .
   Google Scholar
• Wickens , C. D. , Sandry , D. and Vidulich , M. 1983 . Compatibility and resource competition between modalities of input, output, and central processing . Human Factors , 25 : 227 – 248 .
   PubMed Web of Science ®Google Scholar
• Wickens , C. D. 2003b . Attentional models of multi-task pilot performance using advanced display technology . Human Factors , 45 : 360 – 380 .
   PubMed Web of Science ®Google Scholar