Audiovisual looming signals are not always prioritised: evidence from exogenous, endogenous and sustained attention

References

• Abrams, R. A., & Christ, S. E. (2005). The onset of receding motion captures attention: Comment on Franconeri and Simons (2003). Perception & Psychophysics, 67(2), 219–223. https://doi.org/10.3758/BF03206486
   Google Scholar
• Alais, D., van Boxtel, J. J., Parker, A., & van Ee, R. (2010). Attending to auditory signals slows visual alternations in binocular rivalry. Vision Research, 50(10), 929–935. https://doi.org/10.1016/j.visres.2010.03.010
   Google Scholar
• Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 15(9), 839–843. https://doi.org/10.1016/j.cub.2005.03.046
   Google Scholar
• Alvarez, G. A., & Cavanagh, P. (2005). Independent resources for attentional tracking in the left and right visual hemifields. Psychological Science, 16(8), 637–643. https://doi.org/10.1111/j.1467-9280.2005.01587.x
   Google Scholar
• Bacon, W. F., & Egeth, H. E. (1994). Overriding stimulus-driven attentional capture. Perception & Psychophysics, 55(5), 485–496. https://doi.org/10.3758/BF03205306
   Google Scholar
• Bartolomeo, P., & Chokron, S. (2002). Orienting of attention in left unilateral neglect. Neuroscience & Biobehavioral Reviews, 26(2), 217–234. https://doi.org/10.1016/S0149-7634(01)00065-3
   Google Scholar
• Boksem, M. A. S., Meijman, T. F., & Lorist, M. M. (2005). Effects of mental fatigue on attention: An ERP study. Cognitive Brain Research, 25(1), 107–116. https://doi.org/10.1016/j.cogbrainres.2005.04.011
   Google Scholar
• Boksem, M. A. S., & Tops, M. (2008). Mental fatigue: Costs and benefits. Brain Research Reviews, 59(1), 125–139. https://doi.org/10.1016/j.brainresrev.2008.07.001
   Google Scholar
• Bonnelle, V., Leech, R., Kinnunen, K. M., Ham, T. E., Beckmann, C. F., De Boissezon, X., Greenwood, R. J., & Sharp, D. J. (2011). Default mode network connectivity predicts sustained attention deficits after traumatic brain injury. Journal of Neuroscience, 31(38), 13442–13451. https://doi.org/10.1523/JNEUROSCI.1163-11.2011
   Google Scholar
• Burnham, B. R., & Neely, J. H. (2008). A static color discontinuity can capture spatial attention when the target is an abrupt-onset singleton. Journal of Experimental Psychology: Human Perception and Performance, 34(4), 831–841. https://doi.org/10.1037/0096-1523.34.4.831
   Google Scholar
• Cappe, C., Thut, G., Romei, V., & Murray, M. M. (2009). Selective integration of auditory-visual looming cues by humans. Neuropsychologia, 47(4), 1045–1052. https://doi.org/10.1016/j.neuropsychologia.2008.11.003
   Google Scholar
• Cecere, R., Romei, V., Bertini, C., & Làdavas, E. (2014). Crossmodal enhancement of visual orientation discrimination by looming sounds requires functional activation of primary visual areas: A case study. Neuropsychologia, 56, 350–358. https://doi.org/10.1016/j.neuropsychologia.2014.02.008
   Google Scholar
• Conrad, V, Bartels, A., Kleiner, M, & Noppeney, U.. (2010). Audiovisual interactions in binocular rivalry. Journal of Vision, 10(10), 27–27. https://doi.org/10.1167/10.10.27
   Google Scholar
• Conrad, V., Kleiner, M., Bartels, A., O’Brien, J. H., Bülthoff, H. H., & Noppeney, U. (2013). Naturalistic stimulus structure determines the integration of audiovisual looming signals in binocular rivalry. PLoS One, 8(8), e70710. https://doi.org/10.1371/journal.pone.0070710
   Google Scholar
• Corbetta, M., Patel, G., & Shulman, G. L. (2008). The reorienting system of the human brain: From environment to theory of mind. Neuron, 58(3), 306–324. https://doi.org/10.1016/j.neuron.2008.04.017
   Google Scholar
• Denham, S. L., Farkas, D., van Ee, R., Taranu, M., Kocsis, Z., Wimmer, M., Carmel, D., & Winkler, I. (2018). Similar but separate systems underlie perceptual bistability in vision and audition. Scientific Reports, 8(1), 1–10. https://doi.org/10.1038/s41598-018-25587-2
   Google Scholar
• Dent, K., & Humphreys, G. W. (2011). Neuropsychological evidence for a competitive bias against contracting stimuli. Neurocase, 17(2), 112–121. https://doi.org/10.1080/13554794.2010.498381
   Google Scholar
• Einhäuser, W., Methfessel, P., & Bendixen, A. (2017). Newly acquired audio-visual associations bias perception in binocular rivalry. Vision Research, 133, 121–129. https://doi.org/10.1016/j.visres.2017.02.001
   Google Scholar
• Esterman, M., Noonan, S. K., Rosenberg, M., & DeGutis, J. (2013). In the zone or zoning out? Tracking behavioral and neural fluctuations during sustained attention. Cerebral Cortex, 23(11), 2712–2723. https://doi.org/10.1093/cercor/bhs261
   Google Scholar
• Faber, L. G., Maurits, N. M., & Lorist, M. M. (2012). Mental fatigue affects visual selective attention. PLoS One, 7(10), e48073. https://doi.org/10.1371/journal.pone.0048073
   Google Scholar
• Farah, M. J., Wong, A. B., Monheit, M. A., & Morrow, L. A. (1989). Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal? Neuropsychologia, 27(4), 461–470. https://doi.org/10.1016/0028-3932(89)90051-1
   Google Scholar
• Folk, C. L., Remington, R. W., & Johnston, J. C. (1992). Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 4(18), 1030–1044. https://doi.org/10.1037//0096-1523.18.4.1030
   Google Scholar
• Franconeri, S. L., & Simons, D. J. (2003). Moving and looming stimuli capture attention. Perception & Psychophysics, 65(7), 999–1010. https://doi.org/10.3758/BF03194829
   Google Scholar
• Fujisaki, W., Koene, A., Arnold, D., Johnston, A., & Nishida, S. (2006). Visual search for a target changing in synchrony with an auditory signal. Proceedings of the Royal Society of London B: Biological Sciences, 273(1588), 865–874. https://doi.org/10.1098/rspb.2005.3327
   Google Scholar
• Ghazanfar, A. A., & Schroeder, C. E. (2006). Is neocortex essentially multisensory? Trends in Cognitive Sciences, 10(6), 278–285. https://doi.org/10.1016/j.tics.2006.04.008
   Google Scholar
• Gillebert, C. R., Mantini, D., Thijs, V., Sunaert, S., Dupont, P., & Vandenberghe, R. (2011). Lesion evidence for the critical role of the intraparietal sulcus in spatial attention. Brain, 134(6), 1694–1709. https://doi.org/10.1093/brain/awr085
   Google Scholar
• Glatz, C., & Chuang, L. L. (2019). The time course of auditory looming cues in redirecting visuo-spatial attention. Scientific Reports, 9(1), 1–10. https://doi.org/10.1038/s41598-018-36033-8
   Google Scholar
• Gordon, M. S., & Rosenblum, L. D. (2005). Effects of intrastimulus modality change on audiovisual time-to-arrival judgments. Perception & Psychophysics, 67(4), 580–594. https://doi.org/10.3758/bf03193516
   Google Scholar
• Innes, B. R., & Otto, T. U. (2019). A comparative analysis of response times shows that multisensory benefits and interactions are not equivalent. Scientific Reports, 9(1), 1–10. https://doi.org/10.1038/s41598-019-39924-6
   Google Scholar
• Jaekl, P., Pérez-Bellido, A., & Soto-Faraco, S. (2014). On the “visual” in “audio-visual integration”: A hypothesis concerning visual pathways. Experimental Brain Research, 232(6), 1631–1638. https://doi.org/10.1007/s00221-014-3927-8
   Google Scholar
• Johnson, K. A., Kelly, S. P., Bellgrove, M. A., Barry, E., Cox, M., Gill, M., & Robertson, I. H. (2007). Response variability in attention deficit hyperactivity disorder: Evidence for neuropsychological heterogeneity. Neuropsychologia, 45(4), 630–638. https://doi.org/10.1016/j.neuropsychologia.2006.03.034
   Google Scholar
• Johnson, K. A., Robertson, I. H., Kelly, S. P., Silk, T. J., Barry, E., Dáibhis, A., Watchorn, A., Keavey, M., Fitzgerald, M., Gallagher, L., Gill, M., & Bellgrove, M. A. (2007). Dissociation in performance of children with ADHD and high-functioning autism on a task of sustained attention. Neuropsychologia, 45(10), 2234–2245. https://doi.org/10.1016/j.neuropsychologia.2007.02.019
   Google Scholar
• Kastner, S., & Ungerleider, L. G. (2000). Mechanisms of visual attention in the human cortex. Annual Review of Neuroscience, 23, 315–341. https://doi.org/10.1146/annurev.neuro.23.1.315
   Google Scholar
• Körding, K. P., Beierholm, U., Ma, W. J., Quartz, S., Tenenbaum, J. B., & Shams, L. (2007). Causal inference in multisensory perception. PLoS One, 2(9), e943. https://doi.org/10.1371/journal.pone.0000943
   Google Scholar
• Kucyi, A., Hove, M. J., Esterman, M., Hutchison, R. M., & Valera, E. M. (2017). Dynamic brain network correlates of spontaneous fluctuations in attention. Cerebral Cortex, 27(3), 1831–1840. https://doi.org/10.1093/cercor/bhw029
   Google Scholar
• Langner, R., & Eickhoff, S. B. (2013). Sustaining attention to simple tasks: A meta-analytic review of the neural mechanisms of vigilant attention. Psychological Bulletin, 139(4), 870–900. https://doi.org/10.1037/a0030694
   Google Scholar
• Leo, F., Romei, V., Freeman, E., Ladavas, E., & Driver, J. (2011). Looming sounds enhance orientation sensitivity for visual stimuli on the same side as such sounds. Experimental Brain Research, 213(2–3), 193–201. https://doi.org/10.1007/s00221-011-2742-8
   Google Scholar
• Losier, B. J. W., & Klein, R. M. (2001). A review of the evidence for a disengage deficit following parietal lobe damage. Neuroscience & Biobehavioral Reviews, 25(1), 1–13. https://doi.org/10.1016/S0149-7634(00)00046-4
   Google Scholar
• Macaluso, E., Noppeney, U., Talsma, D., Vercillo, T., Hartcher-O’Brien, J., & Adam, R. (2016). The curious incident of attention in multisensory integration: Bottom-up vs. top-down. Multisensory Research, 29(6–7), 557–583. https://doi.org/10.1163/22134808-00002528
   Google Scholar
• Maier, J. X., Chandrasekaran, C., & Ghazanfar, A. A. (2008). Integration of bimodal looming signals through neuronal coherence in the temporal lobe. Current Biology, 18(13), 963–968. https://doi.org/10.1016/j.cub.2008.05.043
   Google Scholar
• Maier, J. X., Neuhoff, J. G., Logothetis, N. K., & Ghazanfar, A. A. (2004). Multisensory integration of looming signals by rhesus monkeys. Neuron, 43(2), 177–181. https://doi.org/10.1016/j.neuron.2004.06.027
   Google Scholar
• Mallick, D. B., Magnotti, J. F., & Beauchamp, M. S. (2015). Variability and stability in the McGurk effect: Contributions of participants, stimuli, time, and response type. Psychonomic Bulletin & Review, 22(5), 1299–1307. https://doi.org/10.3758/s13423-015-0817-4
   Google Scholar
• Marchant, J. L., Ruff, C. C., & Driver, J. (2012). Audiovisual synchrony enhances BOLD responses in a brain network including multisensory STS while also enhancing target-detection performance for both modalities. Human Brain Mapping, 33(5), 1212–1224. https://doi.org/10.1002/hbm.21278
   Google Scholar
• Matusz, P. J., & Eimer, M. (2011). Multisensory enhancement of attentional capture in visual search. Psychonomic Bulletin & Review, 18(5), 904. https://doi.org/10.3758/s13423-011-0131-8
   Google Scholar
• Maxwell, S E, Delaney, H D, & Kelley, K. (2004). Designing experiments and analyzing data: A model comparison perspective (2nd ed.). New York: Lawrence Erlbaum Associates Publishers.
   Google Scholar
• McDonald, J. J., Teder-Sälejärvi, W. A., & Hillyard, S. A. (2000). Involuntary orienting to sound improves visual perception. Nature, 407(6806), 906–908. https://doi.org/10.1038/35038085
   Google Scholar
• Mcgurk, H., & Macdonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748. https://doi.org/10.1038/264746a0
   Google Scholar
• Mishra, J., Martínez, A., & Hillyard, S. A. (2010). Effect of attention on early cortical processes associated with the sound-induced extra flash illusion. Journal of Cognitive Neuroscience, 22(8), 1714–1729. https://doi.org/10.1162/jocn.2009.21295
   Google Scholar
• Molenberghs, P., Gillebert, C. R., Schoofs, H., Dupont, P., Peeters, R., & Vandenberghe, R. (2009). Lesion neuroanatomy of the sustained attention to response task. Neuropsychologia, 47(13), 2866–2875. https://doi.org/10.1016/j.neuropsychologia.2009.06.012
   Google Scholar
• Moors, P., Huygelier, H., Wagemans, J., de-Wit, L., & van Ee, R. (2014). Suppressed visual looming stimuli are not integrated with auditory looming signals: Evidence from continuous flash suppression. I-Perception, 6(1), 48–62. https://doi.org/10.1068/i0678
   Google Scholar
• Parker, A., & Alais, D. (2007). A bias for looming stimuli to predominate in binocular rivalry. Vision Research, 47(20), 2661–2674. https://doi.org/10.1016/j.visres.2007.06.019
   Google Scholar
• Peirce, J. W. (2007). Psychopy—psychophysics software in python. Journal of Neuroscience Methods, 162(1–2), 8–13. https://doi.org/10.1016/j.jneumeth.2006.11.017
   Google Scholar
• Piazza, E. A., Denison, R. N., & Silver, M. A. (2018). Recent cross-modal statistical learning influences visual perceptual selection. Journal of Vision, 18(3). https://doi.org/10.1167/18.3.1
   Google Scholar
• Posner, M. I. (1980). Orienting of attention. Quarterly Journal of Experimental Psychology, 32(1), 3–25. https://doi.org/10.1080/00335558008248231
   Google Scholar
• Rengachary, J., d’Avossa, G., Sapir, A., Shulman, G. L., & Corbetta, M. (2009). Is the Posner reaction time test more accurate than clinical tests in detecting left neglect in acute and chronic stroke? Archives of Physical Medicine and Rehabilitation, 90(12), 2081–2088. https://doi.org/10.1016/j.apmr.2009.07.014
   Google Scholar
• Robertson, I. H., Manly, T., Andrade, J., Baddeley, B. T., & Yiend, J. (1997). “Oops!”: Performance correlates of everyday attentional failures in traumatic brain injured and normal subjects. Neuropsychologia, 35(6), 747–758. https://doi.org/10.1016/S0028-3932(97)00015-8
   Google Scholar
• Rohe, T., & Noppeney, U. (2015). Cortical hierarchies perform Bayesian causal inference in multisensory perception. PLoS Biology, 13(2), e1002073. https://doi.org/10.1371/journal.pbio.1002073
   Google Scholar
• Rovamo, J., & Raninen, A. (1984). Critical flicker frequency and M-scaling of stimulus size and retinal illuminance. Vision Research, 24(10), 1127–1131. https://doi.org/10.1016/0042-6989(84)90166-4
   Google Scholar
• Santangelo, V., & Spence, C. (2007). Multisensory cues capture spatial attention regardless of perceptual load. Journal of Experimental Psychology: Human Perception and Performance, 33(6), 1311–1321. https://doi.org/10.1037/0096-1523.33.6.1311
   Google Scholar
• Santangelo, V., & Spence, C. (2008). Crossmodal attentional capture in an unspeeded simultaneity judgement task. Visual Cognition, 16(2–3), 155–165. https://doi.org/10.1080/13506280701453540
   Google Scholar
• Shams, L., Kamitani, Y., & Shimojo, S. (2000). What you see is what you hear. Nature, 408(6814), 788. https://doi.org/10.1038/35048669
   Google Scholar
• Shore, D. I., Spence, C., & Klein, R. M. (2001). Visual prior entry. Psychological Science, 12(3), 205–212. https://doi.org/10.1111/1467-9280.00337
   Google Scholar
• Spagna, A., Mackie, M.-A., & Fan, J. (2015). Supramodal executive control of attention. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00065
   Google Scholar
• Spence, C., & Santangelo, V. (2009). Capturing spatial attention with multisensory cues: A review. Hearing Research, 258(1–2), 134–142. https://doi.org/10.1016/j.heares.2009.04.015
   Google Scholar
• Stelmach, L. B., & Herdman, C. M. (1991). Directed attention and perception of temporal order. Journal of Experimental Psychology: Human Perception and Performance, 17(2), 539–550. https://doi.org/10.1037/0096-1523.17.2.539
   Google Scholar
• Stoermer, V. S., Alvarez, G. A., & Cavanagh, P. (2014). Within-hemifield competition in early visual areas limits the ability to track multiple objects with attention. Journal of Neuroscience, 34(35), 11526–11533. https://doi.org/10.1523/JNEUROSCI.0980-14.2014
   Google Scholar
• Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14(9), 400–410. https://doi.org/10.1016/j.tics.2010.06.008
   Google Scholar
• Tarantino, V., Cutini, S., Mogentale, C., & Bisiacchi, P. S. (2013). Time-on-task in children with ADHD: An ex-Gaussian analysis. Journal of the International Neuropsychological Society, 19(7), 820–828. https://doi.org/10.1017/S1355617713000623
   Google Scholar
• ten Oever, S., Romei, V., van Atteveldt, N., Soto-Faraco, S., Murray, M. M., & Matusz, P. J. (2016). The COGs (context, object, and goals) in multisensory processing. Experimental Brain Research, 234(5), 1307–1323. https://doi.org/10.1007/s00221-016-4590-z
   Google Scholar
• Turratto, M., & Pascucci, D. (2016). Short-term and long-term plasticity in the visual-attention system: Evidence from habituation of attentional capture. Neurobiology of Learning and Memory, 130, 159–169. https://doi.org/10.1016/j.nlm.2016.02.010
   Google Scholar
• Tyll, S., Bonath, B., Schoenfeld, M. A., Heinze, H.-J., Ohl, F. W., & Noesselt, T. (2013). Neural basis of multisensory looming signals. NeuroImage, 65, 13–22. https://doi.org/10.1016/j.neuroimage.2012.09.056
   Google Scholar
• Van der Burg, E., Cass, J., Olivers, C. N. L., Theeuwes, J., & Alais, D. (2010). Efficient visual search from synchronized auditory signals requires transient audiovisual events. PLoS One, 5(5), e10664. https://doi.org/10.1371/journal.pone.0010664
   Google Scholar
• Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008a). Pip and pop: Nonspatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34(5), 1053–1065. https://doi.org/10.1037/0096-1523.34.5.1053
   Google Scholar
• Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008b). Audiovisual events capture attention: Evidence from temporal order judgments. Journal of Vision, 8(5), 2–2. https://doi.org/10.1167/8.5.2
   Google Scholar
• Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2009). Poke and pop: Tactile–visual synchrony increases visual saliency. Neuroscience Letters, 450(1), 60–64. https://doi.org/10.1016/j.neulet.2008.11.002
   Google Scholar
• Van der Burg, E., Talsma, D., Olivers, C. N. L., Hickey, C., & Theeuwes, J. (2011). Early multisensory interactions affect the competition among multiple visual objects. NeuroImage, 55(3), 1208–1218. https://doi.org/10.1016/j.neuroimage.2010.12.068
   Google Scholar
• van Ee, R., van Boxtel, J. J. A., Parker, A. L., & Alais, D. (2009). Multisensory congruency as a mechanism for attentional control over perceptual selection. The Journal of Neuroscience, 29(37), 11641–11649. https://doi.org/10.1523/JNEUROSCI.0873-09.2009
   Google Scholar
• Walker-Andrews, A. S., & Lennon, E. M. (1985). Auditory-visual perception of changing distance by human infants. Child Development, 56(3), 544–548. https://doi.org/10.2307/1129743
   Google Scholar
• Yu, R. Q., & Zhao, J. (2015). The persistence of the attentional bias to regularities in a changing environment. Attention, Perception, & Psychophysics, 77(7), 2217–2228. https://doi.org/10.3758/s13414-015-0930-5
   Google Scholar
• Zhao, J., Al-Aidroos, N., & Turk-Browne, N. B. (2013). Attention is spontaneously biased toward regularities. Psychological Science, 24(5), 667–677. https://doi.org/10.1177/0956797612460407
   Google Scholar