Multimodal sensory information requirements for enhancing situation awareness and training effectiveness

References

• Akamatsu , M and Mackenzie , IS . 1996 . Movement characteristics using a mouse with tactile and force feedback . International Journal of Human–Computer Studies , 45 : 483 – 493 .
   Web of Science ®Google Scholar
• Allen , JF . 1983 . Maintaining knowledge about temporal intervals . Communications of the ACM , 26 ( 11 ) : 832 – 843 .
   Web of Science ®Google Scholar
• Ayyappa , E . 1997 . Normal human locomotion, part 1: basic concepts and terminology . Journal of Prosthetics & Orthotics , 9 ( 1 ) : 10 – 17 .
   Google Scholar
• Bakker , N , Werkhoven , P and Passenier , P . Aiding orientation performance in virtual environments with proprioceptive feedback . Proceedings of IEEE virtual reality annual international symposium . 14–18 March , pp. 28 – 35 . Atlanta, GA, Los Alamitos, CA : IEEE Computer Society .
   Google Scholar
• Biederman , I . 1987 . Recognition-by-components: A theory of human image understanding . Psychological Review , 94 : 115 – 147 .
   PubMed Web of Science ®Google Scholar
• Carroll , JM and Carrithers , C . 1984 . Training wheels in a user interface . Communications of the ACM , 27 ( 8 ) : 800 – 806 .
   Web of Science ®Google Scholar
• Chance , SS . 1998 . Locomotion mode affects the updating of objects encountered during travel: the contribution of vestibular and proprioceptive inputs to path integration . Presence , 7 ( 2 ) : 168 – 178 .
   Google Scholar
• Cowan , N . 2001 . The magical number four in short-term memory: A reconsideration of mental storage capacity . Behavioral & Brain Sciences , 24 : 87 – 114 .
   PubMed Web of Science ®Google Scholar
• Darken , RP , Allard , T and Achille , L . 1999 . Spatial orientation and wayfinding in large-scale virtual spaces II: Guest editors’ introduction . Presence: Teleoperators and Virtual Environments , 8 ( 6 ) : iii – vi .
   Google Scholar
• Dennehy , K and Deighton , C . “ Development of an interactionist framework for operationalising situation awareness ” . In Engineering psychology and cognitive ergonomics , Edited by: Harris , D . Vol. 1 – Transportation systems , Aldershot : Ashgate .
   Google Scholar
• Dennerlein , JT , Martin , DB and Hasser , C . 2000 . Force-feedback improves performance for steering and combined steering-targeting tasks . Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 2 ( 1 ) : 423 – 429 .
   Google Scholar
• Driskell , JE , Johnston , JH and Salas , E . 2001 . Does stress training generalize to novel ? . Human Factors , 43 ( 1 ) : 99 – 110 .
   PubMed Web of Science ®Google Scholar
• Endsley , MR . 1995 . Toward a theory of situation awareness in dynamic systems . Human Factors , 37 ( 1 ) : 32 – 64 .
   Web of Science ®Google Scholar
• Endsley , M . 1998 . Situation awareness, automation, and decision support: Designing for the future . CSERIAC Gateway , 9 ( 1 ) : 11 – 13 .
   Google Scholar
• European Telecommunications Standards Institute . 2002 . “ Rep. No. ETSI EG 202 048 v 1.1.1 ” . In Human factors: guidelines on the multimodality of icons, symbols, and pictograms , France : Sophia Antipolis Cedex .
   Google Scholar
• Feygin , D , Keehner , M and Tendick , F . 2002 . Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill . Proceedings of 10th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems . 24–25 March 2002 , Orlando, FL. Los Alamitos, CA. pp. 40 – 47 . IEEE Computer Society .
   Google Scholar
• Fowlkes , J and Washburn , D . 2004 . HAPNET: optimizing the application of haptics for training. STTR Phase I Final Report, prepared for Office of Naval Research under contract number: N00014–03-M-0263 .
   Google Scholar
• Gilkey , RH and Anderson , TR . 1997 . Binaural and spatial in real and virtual environments , Mahwah, NJ : Laurence Erlbaum Associates .
   Google Scholar
• Henry , FM . 1986 . Development of the motor memory trace and control program . Journal of Motor Behavior , 18 ( 1 ) : 77 – 100 .
   PubMed Web of Science ®Google Scholar
• Hettinger , LJ . 2002 . “ Illusory self-motion in virtual environments ” . In Handbook of virtual environments: Design, implementation, and applications , Edited by: Stanney , KM . 471 – 491 . Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Hollerbach , JM . 2002 . “ Locomotion interfaces ” . In Handbook of virtual environments: Design, implementation, and applications , Edited by: Stanney , KM . 239 – 254 . Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Insko , B . Passive haptics significantly enhances virtual environments . Proceedings of 4th annual presence workshop . 21–23 May 2001 , Philadelphia. PA [online]. Available from: ftp://ftp.cs.unc.edu/pub/publications/techreports/01=010.pdf [Accessed 16 January 2005]
   Google Scholar
• Keinan , G , Freidland , N and Sarig-Naor , V . 1990 . Training for task performance under stress: The effectiveness of phased training methods . Journal of Applied Social Psychology , 20 ( 18 ) : 1514 – 1529 .
   Web of Science ®Google Scholar
• Kramer , G . 1997 . Sonification report: Status of the field and research agenda[online] , Available from: http://www.icad.org/websiteV2.0/References/nsf.html [Accessed 2 April 2006]
   Google Scholar
• Lawson , BD , Sides , SA and Hickinbotham , KA . 2002 . “ User requirements for perceiving body acceleration ” . In Handbook of virtual environments: Design, implementation, and applications , Edited by: Stanney , KM . 135 – 161 . Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Lindeman , RW . 2005 . Effectiveness of directional vibrotactile cuing on a building-clearing task . Proceedings of CHI 2005 . 2–7April 2005 , Portland. pp. 271 – 280 .
   Google Scholar
• Loomis , JM . Personal guidance system for the visually impaired . Proceedings of the first annual ACM/SIGGAPH conference on assistive technologies . 31 October–1 November 1994 , Marina Del Ray, CA. pp. 85 – 91 . New York : Association for Computing Machinery .
   Google Scholar
• Molavi , DW . 1997 . Neuroscience tutorial , The Washington University School of Medicine [online] . Available from: http://thalamus.wustl.edu/course/[Accessed 15 April 2004]
   Google Scholar
• Montello , DR . 1992 . Characteristics of environmental spatial cognition . Psychology , 3 ( 52 ) Space (10) [online]. Available from http://psycprints.ecs.soton.ac.uk/archive/00000276/#html [Accessed 12 June 2005]
   Google Scholar
• Morie , JF . Emotionally evocative environments for training . Presented at the Army Science conference . 2–5 December 2002 , Orlando, FL. [online]. Available from: http://www.ict.usc.edu/publications/ASC-Morie-2002.pdf [Accessed 11 November 2005]
   Google Scholar
• Murray , AM , Klatzky , RL and Khosla , PK . 2003 . Psychophysical characterization and testbed validation of a wearable vibrotactile glove for telemanipulation . Presence: Teleoperators and Virtual Environments , 12 ( 2 ) : 156 – 182 .
   Google Scholar
• Nelson , W , Bolia , R and Tripp , L . 2001 . Auditory localization under sustained + G acceleration . Human Factors , 43 ( 2 ) : 299 – 309 .
   PubMedGoogle Scholar
• Orasanu , JM and Backer , P . 1996 . “ Stress and military performance ” . In Stress and human performance , Edited by: Driskell , JE and Salas , E . 89 – 126 . Mahwah, NJ : LEA .
   Google Scholar
• Perrott , D . 1996 . Aurally aided visual search under virtual and free-field listening conditions . Human Factors , 38 : 702 – 715 .
   PubMed Web of Science ®Google Scholar
• Prytherch , D and Weber , Katz . 2002 . An introduction to psychological studies of touch and the implications for an understanding of artists’ making and thinking processes . Research issues in art design and media2[online] , Available from: http://www.biad.uce.ac.uk/research/riadm/issueTwo/riadmIssue2.pdf [Accessed 4 April 2003]
   Google Scholar
• Rao , SM , Mayer , AR and Harrington , DL . 2001 . The evolution of brain activation during temporal processing . Nature Neuroscience , 4 ( 3 ) : 317 – 323 .
   PubMed Web of Science ®Google Scholar
• Reiser , JJ . 1995 . The calibration of human locomotion and models of perceptual-motor organization . Journal of Experimental Psychology: Human Perception and Performance , 21 : 480 – 497 .
   PubMed Web of Science ®Google Scholar
• Ruddle , RA and Peruch , P . 2004 . Effects of proprioceptive feedback and environmental characteristics on spatial learning in virtual environments . International Journal of Human-Computer Studies , 60 : 299 – 326 .
   Web of Science ®Google Scholar
• Rupert , A . 1997 . Which way is ? . Naval Aviation News , March–April : 16
   Google Scholar
• Salas , E , Driskell , JE and Hughes , S . 1996 . “ Introduction: the study of stress and human performance ” . In Stress and human performance , Edited by: Driskell , JE and Salas , E . 1 – 45 . Mahwah, NJ : Erlbaum .
   Google Scholar
• Shilling , R , Zyda , M and Wardynski , E . 2002 . Introducing emotion into military simulation and videogame design: America's army operations and VIRTE [online] . Available from http://www.movesinstitute.org/~zyda/pubs/ShillingGameon2002.pdf [Accessed 7 March 2006]
   Google Scholar
• Staal , MA . 2002 . Stress, cognition, and human performance: a literature review and conceptual framework[online] , Available from: http://humanfactors.arc.nasa.gov/flightcognition/Publications/IH_054_Staal.pdf [Accessed 7 March 2006]
   Google Scholar
• Stanney , K . 2004 . A paradigm shift in interactive computing: Deriving multimodal design principles from behavioral and neurological foundations . International Journal of Human–Computer Interaction , 17 ( 2 ) : 229 – 257 .
   Web of Science ®Google Scholar
• Stokes , AF and Kite , K . 2001 . “ On grasping a nettle and becoming emotional ” . In Stress, workload, and fatigue , Edited by: Hancock , PA and Desmond , PA . Mahwah, NJ : Lawrence Erlbaum Associates .
   Google Scholar
• Tähkäpää , E and Raisamo , R . Evaluating tactile feedback in graphical user interfaces . Paper presented at EuroHaptics 2002 . 8–10 July 2002 , Edinburgh, UK. [online]. Available from http://www.eurohaptics.vision.ee.ethz.ch/2002/tahkapaa.pdf [Accessed 22 August 2005]
   Google Scholar
• Tan , HZ . 2003 . A haptic back display for attentional and directional cueing . Haptics-e, 3 (1) [online] , Available from: http://www.haptics-e.org [Accessed 13 November 2003]
   Google Scholar
• Terrence , PI , Brill , JC and Gilson , RD . Body orientation and the perception of spatial auditory and tactile cues . Proceedings of the Human Factors and Ergonomics Society 49th annual meeting . pp. 1663 – 1667 . Santa Monica, CA : HFES .
   Google Scholar
• Ulate , SO . 2002 . The impact of emotional arousal on learning in virtual environments , Thesis (PhD). Naval Postgraduate School .
   Google Scholar
• Västfjäll , D . 2003 . The subjective sense of presence, emotion recognition, and experienced emotions in auditory virtual environments . Cyber Psychology & Behavior , 6 ( 2 ) : 181 – 188 .
   PubMedGoogle Scholar
• Västfjäll , D , Larsson , P and Kleiner , M . 2002 . Emotion and auditory virtual environments: Affect-based judgments of music reproduced with virtual reverberation times . Cyberpsychology & Behavior , 5 ( 1 ) : 19 – 32 .
   PubMedGoogle Scholar
• Wagner , CR , Stylopoulos , N and Howe , RD . 2002 . The role of force feedback in surgery: analysis of blunt dissection . Presented at the 10th symposium on haptic interfaces for virtual environments and teleoperator systems . 24–25 March 2002 , Orlando, FL. pp. 68 – 74 . [online]. Available from: http://biorobotics.harvard.edu/pubs/haptics2002.pdf [Accessed 6 November 2005]
   Google Scholar
• Watzman , S . 2003 . “ Visual design principles for usable interfaces ” . In The human-computer interaction handbook: Fundamentals, evolving technologies, and emerging applications , Edited by: Jacko , JA and Sears , A . 263 – 285 . Mahwah, NJ : Lawrence Erlbaum .
   Google Scholar
• Welch , R and Warren , DH . 1986 . “ Intersensory interactions ” . In Handbook of perception and human performance. Vol. I: Sensory processes and perception , Edited by: Boff , KR , Kaufman , L and Thomas , JP . 25.1 – 25.36 . New York : John Wiley .
   Google Scholar
• Wilfred , L . 2004 . Training in affectively intense virtual environments . Proceedings of world conference on e-learning in corporate, government, health, & higher education , 1 : 2233 – 2233 .
   Google Scholar
• Yang , U and Kim , GJ . Increasing the effectiveegocentric field of view with proprioceptive and tactile feedback . Proceedings of IEEE Virtual Reality 2004 . Edited by: Ikei , Y , Gobel , M and Chen , J . pp. 27 – 28 . Piscataway, NJ : Institute of Electrical and Electronics Engineers .
   Google Scholar
• Zanbaka , C . Effects of travel technique on cognition in virtual environments . Proceedings of IEEE Virtual Reality 2004 . Piscataway, NJ. Edited by: Ikei , Y , Gobel , M and Chen , J . pp. 149 – 156 . Institute of Electrical and Electronics Engineers .
   Google Scholar
• Zelaznik , HN , Spencer , RM and Ivry , RB . 2002 . Dissociation of explicit and implicit timing in repetitive tapping and drawing movements . Journal of Experiment Psychology: Human Perception & Performance , 28 : 575 – 588 .
   PubMed Web of Science ®Google Scholar