Stuck on semantics: Processing of irrelevant object-scene inconsistencies modulates ongoing gaze behavior

How long does it take for the human visual system to process a complex natural image? Subjectively, recognition of familiar objects and scenes appears to be virtually instantaneous, but measuring this processing time experimentally has proved difficult. Behavioural measures such as reaction times can be used, but these include not only visual processing but also the time required for response execution. However, event-related potentials (ERPs) can sometimes reveal signs of neural processing well before the motor output. Here we use a go/no-go categorization task in which subjects have to decide whether a previously unseen photograph, flashed on for just 20 ms, contains an animal. ERP analysis revealed a frontal negativity specific to no-go trials that develops roughly 150 ms after stimulus onset. We conclude that the visual processing needed to perform this highly demanding task can be achieved in under 150 ms.

The spatial interaction of visual attention and saccadic eye movements was investigated in a dual-task paradigm that required a target-directed saccade in combination with a letter discrimination task. Subjects had to saccade to locations within horizontal letter strings left and right of a central fixation cross. The performance in discriminating between the symbols "E" and "E", presented tachistoscopically before the saccade within the surrounding distractors was taken as a measure of visual attention. The data show that visual discrimination is best when discrimination stimulus and saccade target refer to the same object; discrimination at neighboring items is close to chance level. Also, it is not possible, in spite of prior knowledge of discrimination target position, to direct attention to the discrimination target while saccading to a spatially close saccade target. The data strongly argue for an obligatory and selective coupling of saccade programming and visual attention to one common target object. The results favor a model in which a single attentional mechanism selects objects for perceptual processing and recognition, and also provides the information necessary for motor action.

Humans can recognize the gist of a novel image in a single glance, independent of its complexity. How is this remarkable feat accomplished? On the basis of behavioral and computational evidence, this paper describes a formal approach to the representation and the mechanism of scene gist understanding, based on scene-centered, rather than object-centered primitives. We show that the structure of a scene image can be estimated by the mean of global image features, providing a statistical summary of the spatial layout properties (Spatial Envelope representation) of the scene. Global features are based on configurations of spatial scales and are estimated without invoking segmentation or grouping operations. The scene-centered approach is not an alternative to local image analysis but would serve as a feed-forward and parallel pathway of visual processing, able to quickly constrain local feature analysis and enhance object recognition in cluttered natural scenes.