Multisensory Cues for Encoding Urgency of System Hazards: Effect of Operator Experience on Perceived Urgency

References

• Aretz, D. T., Andre, T. S., Self, B. P., & Brenaman, C. A. (2006). Effect of tactile feedback on unmanned aerial vehicle landings. In Proceedings of the Interservice/Industry Training, Simulation, and Education Conference (paper no. 2849), Orlando, FL.
   Google Scholar
• Arrabito, G. R., Ho, G., Li, Y., Giang, W., Burns, C. M., Hou, M., & Pace, P. (2013). Multimodal displays for enhancing performance in a supervisory monitoring task: Reaction time to detect critical events. In Proceedings of the 57th Human Factors and Ergonomics Society Conference (pp. 1164–1168). Thousand Oaks, CA: Sage Publications. doi:10.1177/1541931213571259
   Google Scholar
• Arrabito, G. R., Mondor, T. A., & Kent, K. J. (2004). Judging the urgency of non-verbal auditory alarms: A case study. Ergonomics, 47, 821–840. doi:10.1080/0014013042000193282
   PubMed Web of Science ®Google Scholar
• Baldwin, C. L. (2012). Auditory cognition and human performance: Research and applications. Boca Raton, FL: CRC Press. doi:10.1201/b11578
   Google Scholar
• Bellenkes, A. H., Wickens, C. D., & Kramer, A. F. (1997). Visual scanning and pilot expertise: The role of attentional flexibility and mental model development. Aviation, Space, and Environmental Medicine, 68, 569–579.
   PubMed Web of Science ®Google Scholar
• Berkun, M. M. (1964). Performance decrement under psychological stress. Human Factors: The Journal of the Human Factors and Ergonomics Society, 6, 21–30. doi:10.1177/001872086400600104
   PubMed Web of Science ®Google Scholar
• Bregman, A. S. (1990). Auditory scene analysis: The perceptual organization of sound. Cambridge, MA: MIT Press.
   Google Scholar
• Brewster, S., & Brown, L. M. (2004). Tactons: Structured tactile messages for non-visual information display. In Proceedings of the 5th Australasian User Interface Conference; Dunedin, New Zealand: Australian Computer Society (pp. 15–23). Sydney, Australia: Australian Computer Society.
   Google Scholar
• Burke, J. L., Prewett, M. S., Gray, A. A., Yang, L., Stilson, F. R. B., Coovert, M. D., … Redden, E. (2006). Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis. In Proceedings of the 8th International Conference on Multimodal Interfaces (pp. 108–117). New York, NY: Association for Computing Machinery. doi:10.1145/1180995.1181017
   Google Scholar
• Burns, C. M., Ho, G., & Arrabito, R. (2011). Mapping ecologically to modalities. In Proceedings of the Human Factors and Ergonomics Society 55th Annual Meeting (pp. 335–339). Thousand Oaks, CA: Sage Publications. doi:10.1177/1071181311551069
   Google Scholar
• Calhoun, G. L., Draper, M. H., Guilfoos, B. J., & Ruff, H. A. (2005). Tactile and aural alerts in high auditory load UAV control environments. In Proceedings of the Human Factors and Ergonomics Society 49th Annual Meeting (pp. 145–149). Thousand Oaks, CA: Sage Publications. doi:10.1177/154193120504900132
   Google Scholar
• Calhoun, G. L., Fontejon, J. V., Draper, M. H., Ruff, H. A., & Guilfoos, B. J. (2004). Tactile versus aural redundant alert cues for UAV control applications. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 137–141). Thousand Oaks, CA: Sage Publications. doi:10.1177/154193120404800130
   Google Scholar
• Carretta, T. R., Rose, M. R., & Bruskiewicz, K. T. (2017). Selection methods for operators of remotely piloted aircraft systems. In N. J. Cooke, L. J. Rowe, W. Bennett Jr., & D. Q. Joralmon (Eds.), Remotely piloted aircraft systems: A human systems integration perspective (pp. 137–162). Chichester, UK: John Wiley & Sons. doi:10.1002/9781118965900.ch6
   Google Scholar
• Cholewiak, R. W., & Collins, A. A. (2000). The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode. Perception & Psychophysics, 62, 1220–1235. doi:10.3758/BF03212124
   PubMedGoogle Scholar
• Cummings, M. L., & Mitchell, P. J. (2006). Automated scheduling decision support for supervisory control of multiple UAVs. Journal of Aerospace Computing, 3, 294–308. doi:10.2514/1.19599
   Google Scholar
• Da Silva, F. B., Scott, S. D., & Cummings, M. L. (2007). Design methodology for unmanned aerial vehicle (UAV) team coordination (Report No. HAL2007-05). Cambridge: Humans and Automation Laboratory, Massachusetts Institute of Technology.
   Google Scholar
• Davies, D. R., & Parasuraman, R. (1982). The psychology of vigilance. New York, NY: Academic Press.
   Google Scholar
• Donmez, B., Cummings, M. L., & Graham, H. D. (2009). Auditory decision aiding in supervisory control of multiple unmanned aerial vehicles. Human Factors: The Journal of the Human Factors and Ergonomics Society, 51, 718–729. doi:10.1177/0018720809347106
   PubMed Web of Science ®Google Scholar
• Edworthy, J. (1997). Cognitive compatibility and warning design. International Journal of Cognitive Ergonomics, 1, 193–209.
   Google Scholar
• Edworthy, J., Loxley, S., & Dennis, I. (1991). Improving auditory warning design: Relationship between warning sound parameters and perceived urgency. Human Factors: The Journal of the Human Factors and Ergonomics Society, 33, 205–231. doi:10.1177/001872089103300206
   PubMed Web of Science ®Google Scholar
• Endsley, M. R. (1995a). Measurement of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 65–84. doi:10.1518/001872095779049499
   Web of Science ®Google Scholar
• Endsley, M. R. (1995b). Toward a theory of situation awareness in dynamic systems. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 32–64. doi:10.1518/001872095779049543
   Web of Science ®Google Scholar
• Endsley, M. R. (1996). Automation and situation awareness. In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and applications (pp. 163–181). Mahwah, NJ: Lawrence Erlbaum Press.
   Google Scholar
• Endsley, M. R., & Bolstad, C. A. (1994). Individual differences in pilot situation awareness. International Journal of Aviation Psychology, 4, 241–264. doi:10.1207/s15327108ijap0403_3
   Google Scholar
• Endsley, M. R., & Jones, D. G. (2012). Designing for situation awareness: An approach to user-centered design (2nd ed.). Boca Raton, FL: CRC Press.
   Google Scholar
• Fitch, W. T., & Kramer, G. (1994). Sonifying the body electric: Superiority of an auditory over a visual display in a complex, multivariate system. In G. Kramer (Ed.), Auditory display: Sondification, audification, and auditory interfaces (pp. 307–325). Reading, MA: Addison-Wesley.
   Google Scholar
• Giang, W., & Burns, C. M. (2012). Sonification discriminability and perceived urgency. In Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting (pp. 1298–1302). Thousand Oaks, CA: Sage Publications. doi:10.1177/1071181312561377
   Google Scholar
• Guillaume, A. (2011). Intelligent auditory alarms. In T. Hermann, A. Hunt, & J. G. Neuhoff (Eds.), The sonification handbook (pp. 493–508). Berlin, Germany: Logos Verlag.
   Google Scholar
• Haas, E. C., & Casali, J. G. (1995). Perceived urgency of and response to multi-tone and frequency-modulated warning signals in broadband noise. Ergonomics, 38, 2313–2326. doi:10.1080/00140139508925270
   PubMed Web of Science ®Google Scholar
• Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload (pp. 139–183). Amsterdam, Holland: North-Holland. doi:10.1016/s0166-4115(08)62386-9
   Google Scholar
• Hellier, E. J., Edworthy, J., & Dennis, I. (1993). Improving auditory warning design: Quantifying and predicting the effects of different warning parameters on perceived urgency. Human Factors: The Journal of the Human Factors and Ergonomics Society, 35, 693–706. doi:10.1177/001872089303500408
   PubMed Web of Science ®Google Scholar
• Hermann, T., Hunt, A., & Neuhoff, J. G. (Eds.). (2011). The sonification handbook. Berlin, Germany: Logos Verlag.
   Google Scholar
• Hockey, G. R. J. (1997). Compensatory control in the regulation of human performance under stress and high workload: A cognitive-energetical framework. Biological Psychology, 45, 73–93. doi:10.1016/S0301-0511(96)05223-4
   PubMed Web of Science ®Google Scholar
• Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., & Van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford, UK: Oxford University Press.
   Google Scholar
• Jaffe, G. (2010, February 28). Combat generation: Drone operators climb on winds of change in the Air Force. The Washington Post. Retrieved from http://www.washingtonpost.com/wp-dyn/content/article/2010/02/27/AR2010022703754.html
   Google Scholar
• Jones, L. A. (2011). Tactile communication systems: Optimizing the display of information. In A. M. Green, C. E. Chapman, J. F. Kalaska, & F. Lepore (Eds.), Progress in brain research: Enhancing performance for action and perception (Vol. 192, pp. 113–128). Oxford, UK: Elsevier. doi:10.1518/001872008X250638
   Google Scholar
• Jones, L. A., & Sarter, N. B. (2008). Tactile displays: Guidance for their design and application. Human Factors: The Journal of the Human Factors and Ergonomics Society, 50, 90–111. doi:10.1518/001872008X250638
   PubMed Web of Science ®Google Scholar
• Kramer, G., Walker, B. N., Bonebright, T., Cook, P., Flowers, J., Miner, N., & Neuhoff, J. (1999). The sonification report: Status of the field and research agenda. Report prepared for the National Science Foundation by members of the International Community for Auditory Display. Santa Fe, NM: International Community for Auditory Display.
   Google Scholar
• Lee, Y.-H., & Liu, B.-S. (2003). Inflight workload assessment: Comparison of subjective and physiological measurements. Aviation, Space, and Environmental Medicine, 74, 1078–1084.
   PubMed Web of Science ®Google Scholar
• Lewis, B. A., Eisert, J. L., & Baldwin, C. L. (2014). Effect of tactile location, pulse duration, and interpulse interval on perceived urgency. Journal of the Transportation Research Board, 2423, 10–14. doi:10.3141/2423-02
   Google Scholar
• Li, Y. (2013). An exploration of tactile warning design based on perceived urgency (Unpublished master’s thesis). University of Waterloo, Waterloo, Canada. Retrieved from https://uwspace.uwaterloo.ca/handle/10012/7333
   Google Scholar
• Li, Y., & Burns, C. (2013). Perceived urgency of tactile warnings. In Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (pp. 530–535). New York, NY: IEEE. doi:10.1109/smc.2013.96
   Google Scholar
• Littell, R. C., Milliken, G. A., Stroup, W. W., Wolfinger, R. D., & Schabenberger, O. (2006). SAS for mixed models (2nd ed.). Cary, NC: SAS Institute.
   Google Scholar
• Lower, M. C., Wheeler, P. D., Patterson, R. D., Edworthy, J., Shailer, M. J., Milroy, R., … Chillery, J. A. (1986). The design and production of auditory warnings for helicopters I. The Sea King (Report No. AC527A). Southampton, UK: Institute of Sound and Vibration Research.
   Google Scholar
• McAdams, S. E., & Bigand, E. E. (1993). Thinking in sound: The cognitive psychology of human audition. Oxford, UK: Oxford University Press. doi:10.1093/acprof:oso/9780198522577.001.0001
   Google Scholar
• McCarley, J. S., & Wickens, C. D. (2005). Human factors implications of UAVs in the national airspace (Technical Report No. AHFD-05-05/FAA-05-01). Savoy: University of Illinois at Urbana-Champaign, Aviation Human Factors Division.
   Google Scholar
• Moore, B. C. J. (1995). An introduction to the psychology of hearing (3rd ed.). San Diego, CA: Academic Press.
   Google Scholar
• Nafe, J. P., & Wagoner, K. S. (1941). The nature of pressure adaptation. The Journal of General Psychology, 25, 323–351. doi:10.1080/00221309.1941.10544402
   Google Scholar
• Nygren, T. E. (1991). Psychometric properties of subjective workload measurement techniques: Implications for their use in the assessment of perceived mental workload. Human Factors: The Journal of the Human Factors and Ergonomics Society, 33, 17–33. doi:10.1177/001872089103300102
   Web of Science ®Google Scholar
• Patterson, R. D. (1982). Guidelines for auditory warning systems on civil aircraft (Report No. 82017). Cheltenham, UK: Civil Aviation Authority.
   Google Scholar
• Patterson, R. D., Edworthy, J., Shailer, M. J., Lower, M. C., & Wheeler, P. D. (1986). Alarm sounds for medical equipment in intensive care areas and operating theatres (Report No. AC598). Southampton, UK: Institute of Sound and Vibration Research.
   Google Scholar
• Pratt, S. M., Lewis, B. A., Peñaranda, B. N., Roberts, D. M., Gonzalez, C., & Baldwin, C. L. (2012). Perceived urgency scaling in tactile alerts. In Proceedings of the Human Factors and Ergonomics Society 56th Annual Meeting (pp. 1303–1306). Santa Monica, CA: Sage Publications. doi:10.1177/1071181312561378
   Google Scholar
• Prewett, M. S., Elliott, L. R., Walvoord, A. G., & Coovert, M. D. (2012). A meta-analysis of vibrotactile and visual information displays for improving task performance. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, 42, 123–132. doi:10.1109/TSMCC.2010.2103057
   Web of Science ®Google Scholar
• Prince, C., & Salas, E. (1997). Situation assessment for routine flight and decision making. International Journal of Cognitive Ergonomics, 1, 315–324.
   Google Scholar
• Ruff, H. A., Draper, M. H., Lu, L. G., Poole, M. R., & Repperger, D. W. (2000). Haptic feedback as a supplemental method of alerting UAV operators to the onset of turbulence. In Proceedings of the Human Factors and Ergonomics Society 44th Annual Meeting (pp. 41–44). Los Angeles, CA: SAGE Publications. doi:10.1177/154193120004401311
   Google Scholar
• Sanderson, P. M., Liu, D., & Jenkins, S. A. (2009). Auditory displays in anesthesiology. Current Opinion in Anaesthesiology, 22, 788–795. doi:10.1097/ACO.0b013e3283326a2f
   PubMed Web of Science ®Google Scholar
• Sarter, N. B. (2000). The need for multisensory interfaces in support of effective attentional allocation in highly dynamic event-driven domains: The case of cockpit automation. International Journal of Aviation Psychology, 10, 231–245. doi:10.1207/S15327108IJAP1003_02
   Web of Science ®Google Scholar
• Sarter, N. B., & Woods, D. D. (1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 5–19. doi:10.1518/001872095779049516
   Web of Science ®Google Scholar
• Sethumadhavan, A. (2009). Effects of automation types on air traffic controller situation awareness and performance. In Proceedings of the Human Factors and Ergonomics Society 53rd Annual Meeting (pp. 1–5). Thousand Oaks, CA: Sage Publications. doi:10.1518/107118109X12524440832700
   Google Scholar
• Spence, C., & Ho, C. (2008). Tactile and multisensory spatial warning signals for drivers. IEEE Transactions on Haptics, 1, 121–129. doi:10.1109/toh.2008.14
   PubMed Web of Science ®Google Scholar
• Spence, C., & Ho, C. (2015). Multisensory information processing. In D. A. Boehm-Davis, F. T. Durso, & J. D. Lee (Eds.), APA handbook of human systems integration (pp. 435–448). Washington, DC: American Psychological Association. doi:10.1037/14528-027
   Google Scholar
• US Department of Defense. (2012). Department of Defense design criteria standard: Human engineering (MIL-STD-1472G). Washington, DC: Author.
   Google Scholar
• US GAO (2012). Nonproliferation: Agencies could improve information sharing and end-use monitoring on unmanned aerial vehicle export (Report No. GAO-12-536). Washington, DC: United States Accountability Office. Retrieved from http://www.gao.gov/assets/600/593131.pdf
   Google Scholar
• van Erp, J. B. F. (2005). Vibrotactile spatial acuity on the torso: Effects of location and timing parameters. In Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (pp. 80–85). Washington, DC: IEEE. doi:10.1109/whc.2005.144
   Google Scholar
• van Erp, J. B. F., & Self, B. P. (Eds.). (2008). Tactile displays for orientation, navigation and communication in air, sea and land environments (Report No. TR-HFM-122). Neuilly-sur-Seine Cedex, France: North Atlantic Treaty Organization, Research and Technology Organization.
   Google Scholar
• van Erp, J. B. F., Veltman, J. A., van Veen, H. A. H. C., & Oving, A. B. (2002). Tactile torso display as countermeasure to reduce night vision goggles induced drift. In Proceedings of the RTO/HFM Symposium on Spatial Disorientation in Military Vehicles: Causes, Consequences and Cures (Report No. RTO-MP-086). Neuilly-sur-Seine, France: RTO NATO.
   Google Scholar
• Wickens, C. D. (2002). Multiple resources and performance prediction. Theoretical Issues in Ergonomics Science, 3, 159–177. doi:10.1080/14639220210123806
   Google Scholar