A common neural network architecture for visual search and working memory

ABSTRACT

Visual search and working memory (WM) are tightly linked cognitive processes. Theories of attentional selection assume that WM plays an important role in top-down guided visual search. However, computational models of visual search do not model WM. Here we show that an existing model of WM can utilize its mechanisms of rapid plasticity and pattern completion to perform visual search. In this model, a search template, like a memory item, is encoded into the network’s synaptic weights forming a momentary stable attractor. During search, recurrent activation between the template and visual inputs amplifies the target and suppresses non-matching features via mutual inhibition. While the model cannot outperform models designed specifically for search, it can, “off-the-shelf”, account for important characteristics. Notably, it produces search display set-size costs, repetition effects, and multiple-template search effects, qualitatively in line with empirical data. It is also informative that the model fails to produce some important aspects of visual search behaviour, such as suppression of repeated distractors. Also, without additional control structures for top-down guidance, the model lacks the ability to differentiate between encoding and searching for targets. The shared architecture bridges theories of visual search and visual WM, highlighting their common structure and their differences.

KEYWORDS:

• Neural model
• visual search
• working memory
• attention
• rapid synaptic plasticity
• pattern completion

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by Biotechnology and Biological Sciences Research Council [grant number BB/M010732/1 to MGS]; NIHR Oxford Health Biomedical Research Centre; James S. McDonnel Foundation: [grant number 220020405 to MGS]; MRC Clinician Scientist Fellowship [grant number MR/P00878X to SGM]; Leverhulme Trust Research Grant [grant number RPG-2018-310 to SGM]; Wellcome Trust [grant number 203139/Z/16/Z].