How scene encoding affects memory discrimination: Analysing eye movements data using data driven methods

References

• Anderson, N. C., Anderson, F., Kingstone, A., & Bischof, W. F. (2015). A comparison of scanpath comparison methods. Behavior Research Methods, 47(4), 1377–1392. https://doi.org/10.3758/s13428-014-0550-3
   PubMed Web of Science ®Google Scholar
• Arizpe, J. M., Noles, D. L., Tsao, J. W., & Chan, A. W. Y. (2019). Eye movement dynamics differ between encoding and recognition of faces. Vision, 3(1), 9. https://doi.org/10.3390/vision3010009
   Google Scholar
• Armstrong, T., & Olatunji, B. O. (2012). Eye tracking of attention in the affective disorders: A meta-analytic review and synthesis. In Clinical psychology Review, 32(8), 704–723. https://doi.org/10.1016/j.cpr.2012.09.004.
   Google Scholar
• Borji, A., Sihite, D. N., & Itti, L. (2013). What stands out in a scene? A study of human explicit saliency judgment. Vision Research, 91, 62–77. https://doi.org/10.1016/j.visres.2013.07.016
   PubMed Web of Science ®Google Scholar
• Caldara, R., & Miellet, S. (2011). iMap: A novel method for statistical fixation mapping of eye movement data. Behavior Research Methods, 43(3), 864–878. https://doi.org/10.3758/s13428-011-0092-x
   PubMed Web of Science ®Google Scholar
• Castelhano, M. S., & Krzyś, K. (2020). Rethinking space: A review of perception, attention, and memory in scene processing. Annual Review of Vision Science, 6(1), 563–586. https://doi.org/10.1146/annurev-vision-121219-081745
   PubMedGoogle Scholar
• Choe, K. W., Kardan, O., Kotabe, H. P., Henderson, J. M., & Berman, M. G. (2017). To search or to like: Mapping fixations to differentiate two forms of incidental scene memory. Journal of Vision, 17(12), 8. https://doi.org/10.1167/17.12.8
   PubMed Web of Science ®Google Scholar
• Cristino, F., Mathôt, S., Theeuwes, J., & Gilchrist, I. D. (2010). Scanmatch: A novel method for comparing fixation sequences. Behavior Research Methods, 42(3), 692–700. https://doi.org/10.3758/BRM.42.3.692
   PubMed Web of Science ®Google Scholar
• Damiano, C., & Walther, D. B. (2019). Distinct roles of eye movements during memory encoding and retrieval. Cognition, 184(December 2018), 119–129. https://doi.org/10.1016/j.cognition.2018.12.014
   PubMedGoogle Scholar
• De Agostini, M., & Dellatolas, G. (1988). Une épreuve simple pour évaluer la préférence manuelle chez l’enfant à partir de 3 ans. Enfance; Psychologie, Pedagogie, Neuropsychiatrie, Sociologie, 41(3), 139–147. https://doi.org/10.3406/enfan.1988.2161
   Google Scholar
• Declaration of Helsinki. (2008, octobre 22). WMA declaration of Helsinki—Ethical principles for medical research involving human subjects. https://www.wma.net/what-we-do/medical-ethics/declaration-of-helsinki/
   Google Scholar
• Dupont, L., Ooms, K., Antrop, M., & Van Eetvelde, V. (2016). Comparing saliency maps and eye-tracking focus maps: The potential use in visual impact assessment based on landscape photographs. Landscape and Urban Planning, 148, 17–26. https://doi.org/10.1016/j.landurbplan.2015.12.007
   Web of Science ®Google Scholar
• Evans, K. K., & Baddeley, A. (2018). Intention, attention and long-term memory for visual scenes: It all depends on the scenes. Cognition, 180(February), 24–37. https://doi.org/10.1016/j.cognition.2018.06.022
   PubMedGoogle Scholar
• Foulsham, T., Dewhurst, R., Nyström, M., Jarodzka, H., Johansson, R., Underwood, G., & Holmqvist, K. (2012). Comparing scanpaths during scene encoding and recognition: A multi-dimensional approach. Journal of Eye Movement Research, 5(4), 3. https://doi.org/10.16910/jemr.5.4.3
   Web of Science ®Google Scholar
• Foulsham, T., & Kingstone, A. (2013). Fixation-dependent memory for natural scenes: An experimental test of scanpath theory. Journal of Experimental Psychology: General, 142(1), 41–56. https://doi.org/10.1037/a0028227
   PubMed Web of Science ®Google Scholar
• Foulsham, T., & Underwood, G. (2011). If visual saliency predicts search, then why? Evidence from normal and gaze-contingent search tasks in natural scenes. Cognitive Computation, 3(1), 48–63. https://doi.org/10.1007/s12559-010-9069-9
   Web of Science ®Google Scholar
• Frame, M. E., Warren, R., & Maresca, A. M. (2019). Scanpath comparisons for complex visual search in a naturalistic environment. Behavior Research Methods, 51(3), 1454–1470. https://doi.org/10.3758/s13428-018-1154-0
   PubMed Web of Science ®Google Scholar
• French, R. M., Glady, Y., & Thibaut, J.-P. (2017). An evaluation of scanpath-comparison and machine-learning classification algorithms used to study the dynamics of analogy making. Behavior Research Methods, 49(4), 1291–1302. https://doi.org/10.3758/s13428-016-0788-z
   PubMed Web of Science ®Google Scholar
• Hainmueller, T., & Bartos, M. (2020). Dentate gyrus circuits for encoding, retrieval and discrimination of episodic memories. Nature Reviews Neuroscience, 21(3), 153–168. https://doi.org/10.1038/s41583-019-0260-z
   PubMed Web of Science ®Google Scholar
• Harel, J., Koch, C., & Perona, P. (2007). Graph-based visual saliency. In B. Scholkopf, J. Platt, & T. Hoffman (Eds.), Advance in neural information processing systems (NIPS) (pp. 545–552). MIT Press.
   Google Scholar
• Hayes, T. R., & Henderson, J. M. (2017). Scan patterns during real-world scene viewing predict individual differences in cognitive capacity. Journal of Vision, 17(5), 23. https://doi.org/10.1167/17.5.23
   PubMed Web of Science ®Google Scholar
• Henderson, J. M., & Hayes, T. R. (2018). Meaning guides attention in real-world scene images: Evidence from eye movements and meaning maps. Journal of Vision, 18(6), 10. https://doi.org/10.1167/18.6.10
   PubMed Web of Science ®Google Scholar
• Hoffman, J. (1998). Visual attention and eye movements. In H. Pashler (Ed.), Attention (pp. 119–153). Psychology Press/Erlbaum (UK) Taylor & Francis. https://psycnet.apa.org/record/1998-07791-003
   Google Scholar
• Hunsaker, M. R., & Kesner, R. P. (2013). The operation of pattern separation and pattern completion processes associated with different attributes or domains of memory. Neuroscience & Biobehavioral Reviews, 37(1), 36–58. https://doi.org/10.1016/j.neubiorev.2012.09.014
   PubMed Web of Science ®Google Scholar
• Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews Neuroscience, 2(3), 194–203. https://doi.org/10.1038/35058500
   PubMed Web of Science ®Google Scholar
• Kafkas, A., & Montaldi, D. (2012). Familiarity and recollection produce distinct eye movement, pupil and medial temporal lobe responses when memory strength is matched. Neuropsychologia, 50(13), 3080–3093. https://doi.org/10.1016/j.neuropsychologia.2012.08.001
   PubMed Web of Science ®Google Scholar
• Kruskal, J. B. (1964). Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika, 29(1), 1–27. https://doi.org/10.1007/BF02289565
   Web of Science ®Google Scholar
• Lao, J., Miellet, S., Pernet, C., Sokhn, N., & Caldara, R. (2017). iMap4: An open source toolbox for the statistical fixation mapping of eye movement data with linear mixed modeling. Behavior Research Methods, 49(2), 559–575. https://doi.org/10.3758/s13428-016-0737-x
   PubMed Web of Science ®Google Scholar
• Liu, K. Y., Gould, R. L., Coulson, M. C., Ward, E. V., & Howard, R. J. (2016). Tests of pattern separation and pattern completion in humans-A systematic review. Hippocampus, 26(6), 705–717. https://doi.org/10.1002/hipo.22561
   PubMed Web of Science ®Google Scholar
• Loiotile, R. E., & Courtney, S. M. (2015). A signal detection theory analysis of behavioral pattern separation paradigms. Learning & Memory, 22(8), 364–369. https://doi.org/10.1101/lm.038141.115
   PubMed Web of Science ®Google Scholar
• Lyu, M., Choe, K. W., Kardan, O., Kotabe, H. P., Henderson, J. M., & Berman, M. G. (2019). Scenes that produce more consistent fixation maps are more memorable. PsyArXiv Preprints. https://pdfs.semanticscholar.org/50b7/6aa18ed9ba66e0cca3d5f630307981b2512d.pdf
   Google Scholar
• Meghanathan, R. N., Nikolaev, A. R., & van Leeuwen, C. (2019). Refixation patterns reveal memory-encoding strategies in free viewing. Attention, Perception, & Psychophysics, 81(7), 2499–2516. https://doi.org/10.3758/s13414-019-01735-2
   PubMed Web of Science ®Google Scholar
• Molitor, R. J., Ko, P. C., Hussey, E. P., & Ally, B. A. (2014). Memory-related eye movements challenge behavioral measures of pattern completion and pattern separation. Hippocampus, 24(6), 666–672. https://doi.org/10.1002/hipo.22256
   PubMed Web of Science ®Google Scholar
• Nicholls, V. I., Jean-Charles, G., Lao, J., de Lissa, P., Caldara, R., & Miellet, S. (2019). Developing attentional control in naturalistic dynamic road crossing situations. Scientific Reports, 9(1), 4176. https://doi.org/10.1038/s41598-019-39737-7
   PubMedGoogle Scholar
• Noton, D., & Stark, L. (1971). Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vision Research, 11(9), 929–IN8. https://doi.org/10.1016/0042-6989(71)90213-6
   PubMed Web of Science ®Google Scholar
• O’Connell, T. P., & Walther, D. B. (2015). Dissociation of salience-driven and content-driven spatial attention to scene category with predictive decoding of gaze patterns. Journal of Vision, 15(5), 20. https://doi.org/10.1167/15.5.20
   PubMed Web of Science ®Google Scholar
• Parag, O., & Vakil, E. (2018). Distinct eye movements for different cognitive processes as expressed in the face recognition task. Memory (Hove, England), 26(4), 524–534. https://doi.org/10.1080/09658211.2017.1381265
   PubMed Web of Science ®Google Scholar
• Park, J., Jin, Y., Ahn, S., & Lee, S. (2019). The impact of design representation on visual perception: Comparing eye-tracking data of architectural scenes between photography and line drawing. Archives of Design Research, 32(1), 5–29. https://doi.org/10.15187/adr.2019.02.32.1.5
   Google Scholar
• Ramey, M. M., Henderson, J. M., & Yonelinas, A. P. (2020a). The spatial distribution of attention predicts familiarity strength during encoding and retrieval. Journal of Experimental Psychology: General, 149(11), 2046–2062. https://doi.org/10.1037/xge0000758
   PubMed Web of Science ®Google Scholar
• Ramey, M. M., Yonelinas, A. P., & Henderson, J. M. (2020b). Why do we retrace our visual steps? Semantic and episodic memory in gaze reinstatement. Learning & Memory, 27(7), 275–283. https://doi.org/10.1101/lm.051227.119
   PubMed Web of Science ®Google Scholar
• Riche, N., Duvinage, M., Mancas, M., Gosselin, B., & Dutoit, T.. (2013). Saliency and human fixations: State-of-the-art and study of comparison metrics. In 2013 IEEE International Conference on Computer Vision, Sydney, NSW, Australia (pp. 1153–1160). IEEE. https://doi.org/10.1109/ICCV.2013.147.
   Google Scholar
• Rolls, E. T. (2016). Pattern separation, completion, and categorisation in the hippocampus and neocortex. Neurobiology of Learning and Memory, 129, 4–28. https://doi.org/10.1016/j.nlm.2015.07.008
   PubMed Web of Science ®Google Scholar
• Schomaker, J., & Wittmann, B. C. (2017). Memory performance for everyday motivational and neutral objects is dissociable from attention. Frontiers in Behavioral Neuroscience, 11(June), 1–13. https://doi.org/10.3389/fnbeh.2017.00121
   PubMedGoogle Scholar
• Schurgin, M. W. (2018). Visual memory, the long and the short of it: A review of visual working memory and long-term memory. Attention, Perception, & Psychophysics, 80(5), 1035–1056. https://doi.org/10.3758/s13414-018-1522-y
   PubMed Web of Science ®Google Scholar
• Shakespeare, T. J., Pertzov, Y., Yong, K. X. X., Nicholas, J., & Crutch, S. J. (2015). Reduced modulation of scanpaths in response to task demands in posterior cortical atrophy. Neuropsychologia, 68, 190–200. https://doi.org/10.1016/j.neuropsychologia.2015.01.020
   PubMed Web of Science ®Google Scholar
• Sharot, T., Davidson, M. L., Carson, M. M., & Phelps, E. A. (2008). Eye movements predict recollective experience. PLoS ONE, 3(8), e2884. https://doi.org/10.1371/journal.pone.0002884
   PubMed Web of Science ®Google Scholar
• Toh, W. L., Rossell, S. L., & Castle, D. J. (2011). Current visual scanpath research: A review of investigations into the psychotic, anxiety, and mood disorders. Comprehensive Psychiatry, 52(6), 567–579. https://doi.org/10.1016/j.comppsych.2010.12.005
   PubMed Web of Science ®Google Scholar
• Underwood, G., & Foulsham, T. (2006). Visual saliency and semantic incongruency influence eye movements when inspecting pictures. Quarterly Journal of Experimental Psychology, 59(11), 1931–1949. https://doi.org/10.1080/17470210500416342
   Web of Science ®Google Scholar
• Vidal, M., Turner, J., Bulling, A., & Gellersen, H. (2012). Wearable eye tracking for mental health monitoring. Computer Communications, 35(11), 1306–1311. https://doi.org/10.1016/j.comcom.2011.11.002
   Web of Science ®Google Scholar
• von der Malsburg, T., & Vasishth, S. (2011). What is the scanpath signature of syntactic reanalysis? Journal of Memory and Language, 65(2), 109–127. https://doi.org/10.1016/j.jml.2011.02.004
   Web of Science ®Google Scholar
• Wang, S., Jiang, M., Duchesne, X. M., Laugeson, E. A., Kennedy, D. P., Adolphs, R., & Zhao, Q. (2015). Atypical visual saliency in autism spectrum disorder quantified through model-based eye tracking. Neuron, 88(3), 604–616. https://doi.org/10.1016/j.neuron.2015.09.042
   PubMed Web of Science ®Google Scholar
• Wei, Z., Adeli, H., Hoai, M., Zelinsky, G., & Samaras, D. (2017). Predicting scanpath agreement during scene viewing using deep neural networks. Journal of Vision, 17(10), 749. https://doi.org/10.1167/17.10.749
   Google Scholar
• Williams, C. C., & Castelhano, M. S. (2019). The changing landscape: High-level influences on eye movement guidance in scenes. Vision, 3(3), 33. https://doi.org/10.3390/vision3030033
   Google Scholar
• Wynn, J. S., Bone, M. B., Dragan, M. C., Hoffman, K. L., Buchsbaum, B. R., & Ryan, J. D. (2016). Selective scanpath repetition during memory-guided visual search. Visual Cognition, 24(1), 15–37. https://doi.org/10.1080/13506285.2016.1175531
   PubMed Web of Science ®Google Scholar
• Wynn, J. S., Ryan, J. D., & Buchsbaum, B. R. (2020). Eye movements support behavioral pattern completion. Proceedings of the National Academy of Sciences, 117(11), 6246–6254. https://doi.org/10.1073/pnas.1917586117
   PubMed Web of Science ®Google Scholar