Do we look at lights? Using mixture modelling to distinguish between low- and high-level factors in natural image viewing

Abstract

The allocation of overt visual attention while viewing photographs of natural scenes is commonly thought to involve both bottom-up feature cues, such as luminance contrast, and top-down factors such as behavioural relevance and scene understanding. Profiting from the fact that light sources are highly visible but uninformative in visual scenes, we develop a mixture model approach that estimates the relative contribution of various low and high-level factors to patterns of eye movements whilst viewing natural scenes containing light sources. Low-level salience accounts predicted fixations at luminance contrast and at lights, whereas these factors played only a minor role in the observed human fixations. Conversely, human data were mostly explicable in terms of a central bias and a foreground preference. Moreover, observers were more likely to look near lights rather than directly at them, an effect that cannot be explained by low-level stimulus factors such as luminance or contrast. These and other results support the idea that the visual system neglects highly visible cues in favour of less visible object information. Mixture modelling might be a good way forward in understanding visual scene exploration, since it makes it possible to measure the extent that low-level or high-level cues act as drivers of eye movements.

Keywords:

• Eye movements
• Bottom-up
• Top-down
• Salience
• Lights

Acknowledgements

This work was completed whilst BTV was at University of Bristol, supported by EPSRC grant GR/S47953/01; AC by the British Academy (SG-38465). RJB was funded by EPSRC Research Grant no. EP/C516303/1. We thank our reviewers for their helpful suggestions. AC are now at the School of Psychology, University of Birmingham, Birmingham B15 2TT, UK.