Multisensory teamwork: using a tactile or an auditory display to exchange gaze information improves performance in joint visual search

References

• Alais, D., C. Morrone, and D. Burr. 2006. “Separate Attentional Resources For Vision And Audition.” Proceedings of the Royal Society B: Biological Sciences 273 (1592): 1339–1345.
   PubMed Web of Science ®Google Scholar
• Arnell, K. M., and R. Jenkins. 2004. “Revisiting Within-Modality and Cross-Modality Attentional Blinks: Effects of Target-Distractor Similarity.” Perception & Psychophysics 66: 1147–1161.
   PubMed Web of Science ®Google Scholar
• Arnell, K. M., and J. M. Larson. 2002. “Cross-Modality Attentional Blinks Without Preparatory Task-Set Switching.” Psychonomic Bulletin & Review 9: 497–506.
   PubMed Web of Science ®Google Scholar
• Arrighi, R., R. Lunardi, and D. Burr. 2011. “Vision and Audition Do Not Share Attentional Resources in Sustained Tasks.” Frontiers in psychology 2: 56.
   PubMed Web of Science ®Google Scholar
• Auvray, M., S. Hanneton, and J. K. O’Regan. 2007. “Learning to Perceive with a Visuo-Auditory Substitution System: Localisation and Object Recognition with ’The Voice’.” Perception 36: 416–430.
   PubMed Web of Science ®Google Scholar
• Bach-y Rita, P., C. C. Collins, F. A. Saunders, B. White, and L. Scadden. 1969. “Vision Substitution by Tactile Image Projection.” Nature (221): 963–964.
   PubMed Web of Science ®Google Scholar
• Bear, M. F., B. W. Connors, and M. A. Paradiso. 2007. Neuroscience. Vol. 3. Baltimore: Lippincott Williams & Wilkins.
   Google Scholar
• Bolia, R. S., W. R. D’Angelo, and R. L. McKinley. 1999. “Aurally Aided Visual Search in Three-Dimensional Space.” Human Factors: The Journal of the Human Factors and Ergonomics Society 41 (4): 664–669.
   PubMed Web of Science ®Google Scholar
• Brennan, S. E., X. Chen, C. A. Dickinson, M. B. Neider, and G. J. Zelinsky. 2008. “Coordinating Cognition: The Costs and Benefits of Shared Gaze During Collaborative Search.” Cognition 106: 1465–1477.
   PubMed Web of Science ®Google Scholar
• Calhoun, G. L., M. H. Draper, H. A. Ruff, and J. V. Fontejon. 2002. Utilty of a Tactile Display for Cueing Faults. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 46. 2144–2148. Baltimore: SAGE Publications.
   Google Scholar
• Campbell, D., K. Palomaki, and G. Brown. 2005. “A Matlab Simulation of "Shoebox" Room Acoustics for Use in Research And Teaching.” Computing and Information Systems 9 (3): 48.
   Google Scholar
• Cholewiak, R. W., J. C. Brill, and A. Schwab. 2004. “Vibrotactile Localization on the Abdomen: Effects of Place and Space.” Perception & Psychophysics 66: 970–987.
   PubMed Web of Science ®Google Scholar
• Dewar, R. 1988. “In-Vehicle Information and Driver Overload.” International Journal of Vehicle Design 9 (4–5): 557–564.
   Web of Science ®Google Scholar
• Duncan, J., S. Martens, and R. Ward. 1997. “Restricted Attentional Capacity within but Not Between Sensory Modalities.” Nature 397: 808–810.
   Web of Science ®Google Scholar
• Erp, J. B. V. 2005. "Vibrotactile spatial acuity on the torso: effects of location and timing parameters." Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems 80–85.
   Google Scholar
• Flanagan, P., K. I. McAnally, R. L. Martin, J. W. Meehan, and S. R. Oldfield. 1998. “Aurally and Visually Guided Visual Search in a Virtual Environment.” Human Factors: The Journal of the Human Factors and Ergonomics Society 40 (3): 461–468.
   PubMed Web of Science ®Google Scholar
• Hairston, W. D., P. J. Laurienti, G. Mishra, J. H. Burdette, and M. T. Wallace. 2003. “Multisensory Enhancement of Localization Under Conditions of Induced Myopia.” Experimental Brain Research 152 (3): 404–408.
   PubMed Web of Science ®Google Scholar
• Hameed, S., S. Jayaraman, M. Ballard, and N. Sarter. 2007. "Guiding Visual Attention by Exploiting Crossmodal Spatial Links: An Application in Air Traffic Control". In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 51. 220–224. Baltimore: Sage.
   Google Scholar
• Hein, G., A. Parr, and J. Duncan. 2006. “Within-Modality and Cross-Modality Attentional Blinks in a Simple Discrimination Task.” Perception & Psychophysics 68: 54–61.
   PubMed Web of Science ®Google Scholar
• Hills, B. L. 1980. “Vision, Visibility, and Perception in Driving.” Perception 9 (2): 183-216.
   PubMed Web of Science ®Google Scholar
• Jolicoeur, P. 1999. “Restricted Attentional Capacity between Sensory Modalities.” Psychonomic Bulletin & Review 6: 87–92.
   PubMed Web of Science ®Google Scholar
• Jourdain, R. 1997. In Music, the Brain, and Ecstasy: How Music Captures our Imagination. New York: W. Morrow.
   Google Scholar
• Kärcher, S. M., S. Fenzlaff, D. Hartmann, S. K. Nagel, and P. König. 2012. “Sensory Augmentation for the Blind.” Frontiers in Human Neuroscience 6: 37.
   PubMed Web of Science ®Google Scholar
• Kaspar, K., S. König, J. Schwandt, and P. König. 2014. “The Experience of New Sensorimotor Contingencies by Sensory Augmentation.” Consciousness and cognition 28: 47–63.
   PubMed Web of Science ®Google Scholar
• Keller, P. E., G. Knoblich, and B. H. Repp. 2007. “Pianists Duet Better When They Play With Themselves: On the Possible Role of Action Simulation in Synchronization.” Consciousness and Cognition 16 (1): 102–111.
   PubMed Web of Science ®Google Scholar
• Knoblich, G., and J. S. Jordan. 2003. “Action Coordination in Groups and Individuals: Learning Anticipatory Control.” Journal of Experimental Psychology: Learning, Memory, and Cognition 29 (5): 1006–1016.
   PubMed Web of Science ®Google Scholar
• Knoblich, G., and N. Sebanz. 2006. “The Social Nature of Perception and Action.” Current Directions in Psychological Science 15 (3): 99–104.
   Web of Science ®Google Scholar
• Kourtis, D., N. Sebanz, and G. Knoblich. 2013. “Predictive Representation of Other People’S Actions in Joint Action Planning: An EEG Study.” Social Neuroscience 8 (1): 31–42.
   PubMed Web of Science ®Google Scholar
• Lederman, S. J., and R. L. Klatzky. 2009. “Haptic Perception: A Tutorial.” Attention, Perception, & Psychophysics 71 (7): 1439–1459.
   PubMed Web of Science ®Google Scholar
• Loehr, J. D., D. Kourtis, C. Vesper, N. Sebanz, and G. Knoblich. 2013. “Monitoring Individual and Joint Action Outcomes in Duet Music Performance.” Journal of Cognitive Neuroscience 25 (7): 1049–1061.
   PubMed Web of Science ®Google Scholar
• MATLAB. 2010. version 7.10.0 (R2010a), Natick, MA: The MathWorks.
   Google Scholar
• McDaniel, T., S. Krishna, V. Balasubramanian, D. Colbry, and S. Panchanathan. 2008. “Using a Haptic Belt to Convey Non-Verbal Communication Cues During Social Interactions to Individuals Who are Blind.” IEEE International Workshop on Haptic Audio Visual Environments and their Applications, Ottawa.
   Google Scholar
• Merlo, J., and P. Hancock. 2011. “Quantification of Tactile Cueing for Enhanced Target Search Capacity.” Military Psychology 23 (2): 137.
   Web of Science ®Google Scholar
• Moosbrugger, H., and A. Kelava. 2007. Testtheorie und Fragebogenkonstruktion, Heidelberg: Springer.
   Google Scholar
• Nagel, S. K., C. Carl, T. Kringe, R. Märtin, and P. König. 2005. “Beyond Sensory Substitution-Learning the Sixth Sense.” Journal of Neural Engineering 2: R13–R26.
   PubMed Web of Science ®Google Scholar
• Nikolic, M. I., A. E. Sklar, and N. B. Sarter. 1998. “Multisensory Feedback in Support of Pilot-Automation Coordination: The Case of Uncommanded Mode Transitions.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 42, 239–243. Chicago: Sage.
   Google Scholar
• Noë, A. 2009. Out of Our Heads. New York: Hill and Wang.
   Google Scholar
• O’Regan, J., and A. Noë. 2001. “A Sensorimotor Account of Vision and Visual Consciousness.” Behavioural and Brain Sciences 24: 939–973.
   PubMed Web of Science ®Google Scholar
• O’Regan, J. K. 2011. Why Red Doesn’t Sound Like a Bell: Understanding the Feel of Consciousness, Oxford: Oxford University Press.
   Google Scholar
• Perrott, D. R., J. Cisneros, R. L. McKinley, and W. R. D’Angelo. 1995. “Aurally Aided Detection and Identification of Visual Targets.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Vol. 39. 104–108. San Diego: Sage.
   Google Scholar
• Perrott, D. R., J. Cisneros, R. L. McKinley, and W. R. D’Angelo. 1996. “Aurally Aided Visual Search Under Virtual and Free-Field Listening Conditions.” Human Factors: The Journal of the Human Factors and Ergonomics Society 38 (4): 702–715.
   PubMed Web of Science ®Google Scholar
• Perrott, D. R., T. Sadralodabai, K. Saberi, and T. Z. Strybel. 1991. “Aurally Aided Visual Search in the Central Visual Field: Effects of Visual Load and Visual Enhancement of the Target.” Human Factors: The Journal of the Human Factors and Ergonomics Society 33 (4): 389–400.
   PubMed Web of Science ®Google Scholar
• Potter, M. C., M. M. Chun, B. S. Banks, and M. Muckenhoupt. 1998. “Two Attentional Deficits in Serial Target Search: The Visual Attentional Blink and an Amodal Task-Switch Deficit.” Journal of Experimental Psychology: Learning, Memory, and Cognition 24: 979–992.
   PubMed Web of Science ®Google Scholar
• Radke, S., F. P. de Lange, M. Ullsperger, and E. De Bruijn. 2011. “Mistakes that Affect Others: An fMRI Study on Processing of Own Errors in a Social Context.” Experimental Brain Research 211 (3–4): 405–413.
   PubMed Web of Science ®Google Scholar
• Rees, G., C. D. Frith, and N. Lavie. 1997. “Modulating Irrelevant Motion Perception by Varying Attentional Load in an Unrelated Task.” Science 278 (5343): 1616–1619.
   PubMed Web of Science ®Google Scholar
• Samson, D., I. A. Apperly, J. J. Braithwaite, B. J. Andrews, and S. E. Bodley Scott. 2010. “Seeing It Their Way: Evidence for Rapid and Involuntary Computation of What Other People See.” Journal of Experimental Psychology: Human Perception and Performance 36 (5): 1255–1266.
   PubMed Web of Science ®Google Scholar
• Sebanz, N., H. Bekkering, and G. Knoblich. 2006. “Joint Action: Bodies and Minds Moving Together.” Trends in Cognitive Sciences 10 (2): 70–76.
   PubMed Web of Science ®Google Scholar
• Sebanz, N., G. Knoblich, and W. Prinz. 2005. “How Two Share a Task: Corepresenting Stimulus-Response Mappings.” Journal of Experimental Psychology: Human Perception and Performance 31 (6): 1234–1246.
   PubMed Web of Science ®Google Scholar
• Sinnett, S., A. Costa, and S. Soto-Faraco. 2006. “Manipulating Inattentional Blindness Within and Across Sensory Modalities.” The Quarterly Journal of Experimental Psychology 59 (8): 1425–1442.
   Web of Science ®Google Scholar
• Sklar, A. E., and N. B. Sarter. 1999. “Good Vibrations: Tactile Feedback in Support of Attention Allocation and Human-Automation Coordination in Event-Driven Domains.” Human Factors 41: 543–552.
   PubMed Web of Science ®Google Scholar
• Soto-Faraco, S., and C. Spence. 2002. “Modality-Specific Auditory and Visual Temporal Processing Deficits.” The Quarterly Journal of Experimental Psychology 55: 23–40.
   Web of Science ®Google Scholar
• Spence, C., and C. Ho. 2008. “Multisensory Warning Signals for Event Perception and Safe Driving.” Theoretical Issues in Ergonomics Science 9: 523–554.
   Google Scholar
• Srinivasan, R., and P. P. Jovanis. 1997. “Effect of Selected In-Vehicle Route Guidance Systems on Driver Reaction Times.” Human Factors: The Journal of the Human Factors and Ergonomics Society 39 (2): 200–215.
   PubMed Web of Science ®Google Scholar
• Streeter, L. A., D. Vitello, and S. A. Wonsiewicz. 1985. “How to Tell People Where to Go: Comparing Navigational Aids.” International Journal of Man-Machine Studies 22 (5): 549–562.
   Google Scholar
• Tsang, P. S., and M. A. Vidulich. 1987. "Time-sharing Visual and Auditory Tracking Tasks". In Proceedings of the Human Factors and Ergonomics Society Annual Meeting., Vol. 31. 253–257. New York: sage Publications.
   Google Scholar
• Van der Burg, E., C. N. L. Olivers, A. W. Bronkhorst, T. Koelewijn, and J. Theeuwes. 2007. “The Absence of an Auditory-Visual Attentional Blink Is Not Due to Echoic Memory.” Perception & Psychophysics 69: 1230–1241.
   PubMed Web of Science ®Google Scholar
• Van Erp, J. B. F. 2001. “Tactile Navigation Display.” In Haptic human-computer interaction, edited by Brewster, S. and Murray-Smith, R., 165–173. Berlin: Springer. doi: 10.1007/3-540-44589-7\_18.
   Google Scholar
• Van Erp, J. B. 2005. “Presenting Directions with a Vibrotactile Torso Display.” Ergonomics 48 (3): 302–313.
   PubMed Web of Science ®Google Scholar
• Van Erp, J. B., and H. A. Van Veen. 2004. “Vibrotactile In-Vehicle Navigation System.” Transportation Research Part F: Traffic Psychology and Behaviour 7 (4): 247–256.
   Web of Science ®Google Scholar
• Van Erp, J. B., and M. H. Verschoor. 2004. “Cross-Modal Visual and Vibrotactile Tracking.” Applied Ergonomics 35 (2): 105–112.
   PubMed Web of Science ®Google Scholar
• Vesper, C., and M. J. Richardson. 2014. "Strategic Communication and Behavioral Coupling in Asymmetric Joint Action." Experimental Brain Research 232 (9): 1–12.
   PubMed Web of Science ®Google Scholar
• Vesper, C., L. Schmitz, N. Sebanz, and G. Knoblich. 2013. "Joint Action Coordination Through Strategic Reduction of Variability". In Proceedings of the 35th Annual Annual Conference of the Cognitive Science Society, Berlin, 1522–1527.
   Google Scholar
• Vesper, C., R. P. van der Wel, G. Knoblich, and N. Sebanz. 2011. “Making Oneself Predictable: Reduced Temporal Variability Facilitates Joint Action Coordination.” Experimental Brain Research 211 (3–4): 517–530.
   PubMed Web of Science ®Google Scholar
• Vesper, C., R. P. van der Wel, G. Knoblich, and N. Sebanz. 2013. “Are You Ready to Jump? Predictive Mechanisms in Interpersonal Coordination.” Journal of Experimental Psychology: Human Perception and Performance 39 (1): 48–61.
   PubMed Web of Science ®Google Scholar
• Wahn, B., and P. König. 2015a. “Audition and Vision Share Spatial Attentional Resources, Yet Attentional Load does not Disrupt Audiovisual Integration.” Frontiers in Psychology 6 (1084).
   PubMed Web of Science ®Google Scholar
• Wahn, B., and P. König. 2015b. “Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load.” Multisensory Research 28 (3–4): 371–392.
   PubMed Web of Science ®Google Scholar
• Walker, J., E. Alicandri, C. Sedney, and K. Roberts. 1991. "In-Vehicle Navigation Devices: Effects on the Safety of Driver Performance". In Vehicle Navigation and Information Systems Conference, 1991. Vol. 2. 499–525. Dearborn: IEEE.
   Google Scholar
• Wickens, C. D. 2002. “Multiple Resources and Performance Prediction.” Theoretical Issues in Ergonomics Science 3: 159–177.
   Google Scholar
• Wickens, C. D., J. Hellenberg, and X. Xu. 2002. “Pilot Maneuver Choice and Workload in Free Flight.” Human Factors: The Journal of the Human Factors and Ergonomics Society 44 (2): 171–188.
   PubMed Web of Science ®Google Scholar
• Wickham, H. 2009. ggplot2: Elegant Graphics for Data Analysis. New York: Springer.
   Google Scholar
• Wolpert, D. M., K. Doya, and M. Kawato. 2003. “A Unifying Computational Framework for Motor Control and Social Interaction.” Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences 358 (1431): 593–602.
   PubMed Web of Science ®Google Scholar