Contact

Links

Research & Scholarship

Current Research and Scholarly Interests

We study neural mechanisms of visual-motor integration and the neural basis of cognition (e.g. attention). We study the activity of single neurons in visual and motor structures within the brain, examine how perturbing that activity affects neurons in other brain structures, and also how it affects the perceptual and motor performance of behaving animals. Questions currently addressed by our group include:

(1) How are the signals conveyed by visual cortical neurons used to guide eye movements?

(2) How does oculomotor feedback affect processing in visual cortex?

(3) What is the impact of planned movements on visual perception?

(4) What are the neural circuits and neural computations that control selective attention?

Our laboratory is also driven to develop more powerful approaches to systems-level neurobiological questions.

Publications

All Publications

Abstract

Prefrontal cortex modulates sensory signals in extrastriate visual cortex, in part via its direct projections from the frontal eye field (FEF), an area involved in selective attention. We find that working memory-related activity is a dominant signal within FEF input to visual cortex. Although this signal alone does not evoke spiking responses in areas V4 and MT during memory, the gain of visual responses in these areas increases, and neuronal receptive fields expand and shift towards the remembered location, improving the stimulus representation by neuronal populations. These results provide a basis for enhancing the representation of working memory targets and implicate persistent FEF activity as a basis for the interdependence of working memory and selective attention.

Abstract

Selective visual attention describes the tendency of visual processing to be confined largely to stimuli that are relevant to behavior. It is among the most fundamental of cognitive functions, particularly in humans and other primates for whom vision is the dominant sense. We review recent progress in identifying the neural mechanisms of selective visual attention. We discuss evidence from studies of different varieties of selective attention and examine how these varieties alter the processing of stimuli by neurons within the visual system, current knowledge of their causal basis, and methods for assessing attentional dysfunctions. In addition, we identify some key questions that remain in identifying the neural mechanisms that give rise to the selective processing of visual information.

Abstract

Neocortical activity is permeated with endogenously generated fluctuations, but how these dynamics affect goal-directed behavior remains a mystery. We found that ensemble neural activity in primate visual cortex spontaneously fluctuated between phases of vigorous (On) and faint (Off) spiking synchronously across cortical layers. These On-Off dynamics, reflecting global changes in cortical state, were also modulated at a local scale during selective attention. Moreover, the momentary phase of local ensemble activity predicted behavioral performance. Our results show that cortical state is controlled locally within a cortical map according to cognitive demands and reveal the impact of these local changes in cortical state on goal-directed behavior.

Abstract

We examined whether the preparation of saccadic eye movements, when behaviorally dissociated from covert attention, modulates activity within visual cortex. We measured single-neuron and local field potential (LFP) responses to visual stimuli in area V4 while monkeys covertly attended a stimulus at one location and prepared saccades to a potential target at another. In spite of the irrelevance of visual information at the saccade target, visual activity at that location was modulated at least as much as, and often more than, activity at the covertly attended location. Modulations of activity at the attended and saccade target locations were qualitatively similar and included increased response magnitude, stimulus selectivity, and spiking reliability, as well as increased gamma and decreased low-frequency power of LFPs. These results demonstrate that saccade preparation is sufficient to modulate visual cortical representations and suggest that the interrelationship of oculomotor and attention-related mechanisms extends to posterior visual cortex.

Abstract

We experience the visual world through a series of saccadic eye movements, each one shifting our gaze to bring objects of interest to the fovea for further processing. Although such movements lead to frequent and substantial displacements of the retinal image, these displacements go unnoticed. It is widely assumed that a primary mechanism underlying this apparent stability is an anticipatory shifting of visual receptive fields (RFs) from their presaccadic to their postsaccadic locations before movement onset. Evidence of this predictive 'remapping' of RFs has been particularly apparent within brain structures involved in gaze control. However, critically absent among that evidence are detailed measurements of visual RFs before movement onset. Here we show that during saccade preparation, rather than remap, RFs of neurons in a prefrontal gaze control area massively converge towards the saccadic target. We mapped the visual RFs of prefrontal neurons during stable fixation and immediately before the onset of eye movements, using multi-electrode recordings in monkeys. Following movements from an initial fixation point to a target, RFs remained stationary in retinocentric space. However, in the period immediately before movement onset, RFs shifted by as much as 18 degrees of visual angle, and converged towards the target location. This convergence resulted in a threefold increase in the proportion of RFs responding to stimuli near the target region. In addition, like in human observers, the population of prefrontal neurons grossly mislocalized presaccadic stimuli as being closer to the target. Our results show that RF shifts do not predict the retinal displacements due to saccades, but instead reflect the overriding perception of target space during eye movements.

Abstract

Attention deficit hyperactivity disorder (ADHD) is a complex condition with a heterogeneous presentation. Current diagnosis is primarily based on subjective experience and observer reports of behavioral symptoms - an approach that has significant limitations. Many studies show that individuals with ADHD exhibit poorer performance on cognitive tasks than neurotypical controls, and at least seven main functional domains appear to be implicated in ADHD. We discuss the underlying neural mechanisms of cognitive functions associated with ADHD, with emphasis on the neural basis of selective attention, demonstrating the feasibility of basic research approaches for further understanding cognitive behavioral processes as they relate to human psychopathology. The study of circuit-level mechanisms underlying executive functions in nonhuman primates holds promise for advancing our understanding, and ultimately the treatment, of ADHD.

Abstract

This study distinguished between different subclusters of autistic traits in the general population and examined the relationships between these subclusters, looking at the eyes of faces, and the ability to recognize facial identity. Using the Autism Spectrum Quotient (AQ) measure in a university-recruited sample, we separate the social aspects of autistic traits (i.e., those related to communication and social interaction; AQ-Social) from the non-social aspects, particularly attention-to-detail (AQ-Attention). We provide the first evidence that these social and non-social aspects are associated differentially with looking at eyes: While AQ-Social showed the commonly assumed tendency towards reduced looking at eyes, AQ-Attention was associated with increased looking at eyes. We also report that higher attention-to-detail (AQ-Attention) was then indirectly related to improved face recognition, mediated by increased number of fixations to the eyes during face learning. Higher levels of socially relevant autistic traits (AQ-Social) trended in the opposite direction towards being related to poorer face recognition (significantly so in females on the Cambridge Face Memory Test). There was no evidence of any mediated relationship between AQ-Social and face recognition via reduced looking at the eyes. These different effects of AQ-Attention and AQ-Social suggest face-processing studies in Autism Spectrum Disorder might similarly benefit from considering symptom subclusters. Additionally, concerning mechanisms of face recognition, our results support the view that more looking at eyes predicts better face memory.

Two Types of Receptive Field Dynamics in Area V4 at the Time of Eye Movements?Frontiers in systems neuroscienceHartmann, T. S., Zirnsak, M., Marquis, M., Hamker, F. H., Moore, T.2017; 11: 13-?

Abstract

How we perceive the world as stable despite the frequent disruptions of the retinal image caused by eye movements is one of the fundamental questions in sensory neuroscience. Seemingly convergent evidence points towards a mechanism which dynamically updates representations of visual space in anticipation of a movement (Wurtz, 2008). In particular, receptive fields (RFs) of neurons, predominantly within oculomotor and attention related brain structures (Duhamel et al., 1992; Walker et al., 1995; Umeno and Goldberg, 1997), are thought to "remap" to their future, post-movement location prior to an impending eye movement. New studies (Neupane et al., 2016a,b) report observations on RF dynamics at the time of eye movements of neurons in area V4. These dynamics are interpreted as being largely dominated by a remapping of RFs. Critically, these observations appear at odds with a previous study reporting a different type of RF dynamics within the same brain structure (Tolias et al., 2001), consisting of a shrinkage and shift of RFs towards the movement target. Importantly, RFs have been measured with different techniques in those studies. Here, we measured V4 RFs comparable to Neupane et al. (2016a,b) and observe a shrinkage and shift of RFs towards the movement target when analyzing the immediate stimulus response (Zirnsak et al., 2014). When analyzing the late stimulus response (Neupane et al., 2016a,b), we observe RF shifts resembling remapping. We discuss possible causes for these shifts and point out important issues which future studies on RF dynamics need to address.

Abstract

Primate vision is continuously disrupted by saccadic eye movements, and yet this disruption goes unperceived. One mechanism thought to reduce perception of this self-generated movement is saccadic suppression, a global loss of visual sensitivity just before, during, and after saccadic eye movements. The frontal eye field (FEF) is a candidate source of neural correlates of saccadic suppression previously observed in visual cortex, because it contributes to the generation of visually guided saccades and modulates visual cortical responses. However, whether the FEF exhibits a perisaccadic reduction in visual sensitivity that could be transmitted to visual cortex is unknown. To determine whether the FEF exhibits a signature of saccadic suppression, we recorded the visual responses of FEF neurons to brief, full-field visual probe stimuli presented during fixation and before onset of saccades directed away from the receptive field in rhesus macaques (Macaca mulatta) We measured visual sensitivity during both epochs and found that it declines before saccade onset. Visual sensitivity was significantly reduced in visual but not visuomotor neurons. This reduced sensitivity was also present in visual neurons with no movement-related modulation during visually guided saccades and thus occurred independently from movement-related activity. Across the population of visual neurons, sensitivity began declining ?80 ms before saccade onset. We also observed a similar presaccadic reduction in sensitivity to isoluminant, chromatic stimuli. Our results demonstrate that the signaling of visual information by FEF neurons is reduced during saccade preparation, and thus these neurons exhibit a signature of saccadic suppression.

Abstract

In order to deal with a large amount of information carried by visual inputs entering the brain at any given point in time, the brain swiftly uses the same inputs to enhance processing in one part of visual field at the expense of the others. These processes, collectively called bottom-up attentional selection, are assumed to solely rely on feedforward processing of the external inputs, as it is implied by the nomenclature. Nevertheless, evidence from recent experimental and modeling studies points to the role of feedback in bottom-up attention. Here, we review behavioral and neural evidence that feedback inputs are important for the formation of signals that could guide attentional selection based on exogenous inputs. Moreover, we review results from a modeling study elucidating mechanisms underlying the emergence of these signals in successive layers of neural populations and how they depend on feedback from higher visual areas. We use these results to interpret and discuss more recent findings that can further unravel feedforward and feedback neural mechanisms underlying bottom-up attention. We argue that while it is descriptively useful to separate feedforward and feedback processes underlying bottom-up attention, these processes cannot be mechanistically separated into two successive stages as they occur at almost the same time and affect neural activity within the same brain areas using similar neural mechanisms. Therefore, understanding the interaction and integration of feedforward and feedback inputs is crucial for better understanding of bottom-up attention.

Abstract

Saccadic eye movements cause frequent and substantial displacements of the retinal image, but those displacements go unnoticed. It has been widely assumed that this perceived stability emerges from the shifting of visual receptive fields from their current, presaccadic locations to their future, postsaccadic locations in anticipation of the retinal consequences of saccades. Although evidence consistent with this anticipatory remapping has accumulated over the years, more recent work suggests an alternative view. In this opinion article, we examine the evidence of presaccadic receptive field shifts and their relationship to the perceptual changes that accompany saccades. We argue that both reflect the selection of targets for saccades rather than the anticipation of a displaced retinal image.

Abstract

We previously reported the existence of a persistent spatial signal in the FEF during object-based STM. This persistent activity reflected the location at which the sample appeared, irrespective of the location of upcoming targets. We hypothesized that such a spatial signal could be used to maintain or enhance object-selective memory activity elsewhere in cortex, analogous to the role of a spatial signal during attention. Here, we inactivated a portion of the FEF with GABAa agonist muscimol to test whether the observed activity contributes to object memory performance. We found that, although RTs were slowed for saccades into the inactivated portion of retinotopic space, performance for samples appearing in that region was unimpaired. This contrasts with the devastating effects of the same FEF inactivation on purely spatial working memory, as assessed with the memory-guided saccade task. Thus, in a task in which a significant fraction of FEF neurons displayed persistent, sample location-based activity, disrupting this activity had no impact on task performance.

Abstract

Psychophysical and neurophysiological studies indicate that during the preparation of saccades, visual processing at the target location is facilitated automatically by the deployment of attention. It has been assumed that the neural mechanisms involved in presaccadic shifts of attention are purely spatial in nature. Saccade preparation modulates the visual responses of neurons within extrastriate area V4, where the responses to targets are enhanced and responses to nontargets are suppressed. We tested whether this effect also engages a nonspatial form of modulation. We measured the responses of area V4 neurons to oriented gratings in two monkeys (Macaca mulatta) making delayed saccades to targets distant from the neuronal receptive field (RF). We varied the orientation of both the RF stimulus and the saccadic target. We found that, in addition to the spatial modulation, saccade preparation involves a feature-dependent modulation of V4 neuronal responses. Specifically, we found that the suppression of area V4 responses to nontarget stimuli during the preparation of saccades depends on the features of the saccadic target. Presaccadic suppression was absent when the features of the saccadic target matched the features preferred by individual V4 neurons. This feature-dependent modulation occurred in the absence of any feature-attention task. We show that our observations are consistent with a computational framework in which feature-based effects automatically emerge from saccade-related feedback signals that are spatial in nature.

Abstract

In the primate visual system, information about color is known to be carried in separate divisions of the retino-geniculo-cortical pathway. From the retina, responses of photoreceptors to short (S), medium (M), and long (L) wavelengths of light are processed in two different opponent pathways. Signals in the S-opponent pathway, or blue/yellow channel, have been found to lag behind signals in the L/M-opponent pathway, or red/green channel in primary visual area V1, and psychophysical studies have suggested similar perceptual delays. However, more recent psychophysical studies have found that perceptual differences are negligible with the proper controls, suggesting that information between the two channels is integrated at some stage of processing beyond V1. To study the timing of color signals further downstream in visual cortex, we examined the responses of neurons in area V4 to colored stimuli varying along the two cardinal axes of the equiluminant opponent color space. We used information theory to measure the mutual information between the stimuli presented and the neural responses in short time windows in order to estimate the latency of color information in area V4. We found that on average, despite the latency difference in V1, information about S-opponent signals arrives in V4 at the same time as information about L/M-opponent signals. This work indicates a convergence of signal timing among chromatic channels within extrastriate cortex.

Abstract

Studies investigating the neural bases of cognitive phenomena increasingly employ multialternative detection tasks that seek to measure the ability to detect a target stimulus or changes in some target feature (e.g., orientation or direction of motion) that could occur at one of many locations. In such tasks, it is essential to distinguish the behavioral and neural correlates of enhanced perceptual sensitivity from those of increased bias for a particular location or choice (choice bias). However, making such a distinction is not possible with established approaches. We present a new signal detection model that decouples the behavioral effects of choice bias from those of perceptual sensitivity in multialternative (change) detection tasks. By formulating the perceptual decision in a multidimensional decision space, our model quantifies the respective contributions of bias and sensitivity to multialternative behavioral choices. With a combination of analytical and numerical approaches, we demonstrate an optimal, one-to-one mapping between model parameters and choice probabilities even for tasks involving arbitrarily large numbers of alternatives. We validated the model with published data from two ternary choice experiments: a target-detection experiment and a length-discrimination experiment. The results of this validation provided novel insights into perceptual processes (sensory noise and competitive interactions) that can accurately and parsimoniously account for observers' behavior in each task. The model will find important application in identifying and interpreting the effects of behavioral manipulations (e.g., cueing attention) or neural perturbations (e.g., stimulation or inactivation) in a variety of multialternative tasks of perception, attention, and decision-making.

Abstract

Primates make several saccadic eye movements each second, and yet the retinal motion these movements generate goes unnoticed. Saccadic suppression is a profound loss of visual sensitivity occurring around the time of eye movements, and it is thought to contribute to visual stability by blunting the perception of self-generated motion. Neurophysiological studies have produced evidence that neurons throughout the visual system, including both the dorsal and ventral streams of extrastriate visual cortex, show a reduction in visual responses or sensitivity around the time of saccades. However, the source of this suppression remains unknown. We review evidence that oculomotor regions such as the superior colliculus and frontal eye field may play a role, as well as anatomical data that place constraints on possible mechanisms of suppression.

Abstract

The faculty of attention endows us with the capacity to process important sensory information selectively while disregarding information that is potentially distracting. Much of our understanding of the neural circuitry underlying this fundamental cognitive function comes from neurophysiological studies within the visual modality. Past evidence suggests that a principal function of the prefrontal cortex (PFC) is selective attention and that this function involves the modulation of sensory signals within posterior cortices. In this review, we discuss recent progress in identifying the specific prefrontal circuits controlling visual attention and its neural correlates within the primate visual system. In addition, we examine the persisting challenge of precisely defining how behavior should be affected when attentional function is lost.

Abstract

Spatial attention is known to gate entry into visual short-term memory, and some evidence suggests that spatial signals may also play a role in binding features or protecting object representations during memory maintenance. To examine the persistence of spatial signals during object short-term memory, the activity of neurons in the frontal eye field (FEF) of macaque monkeys was recorded during an object-based delayed match-to-sample task. In this task, monkeys were trained to remember an object image over a brief delay, regardless of the locations of the sample or target presentation. FEF neurons exhibited visual, delay, and target period activity, including selectivity for sample location and target location. Delay period activity represented the sample location throughout the delay, despite the irrelevance of spatial information for successful task completion. Furthermore, neurons continued to encode sample position in a variant of the task in which the matching stimulus never appeared in their response field, confirming that FEF maintains sample location independent of subsequent behavioral relevance. FEF neurons also exhibited target-position-dependent anticipatory activity immediately before target onset, suggesting that monkeys predicted target position within blocks. These results show that FEF neurons maintain spatial information during short-term memory, even when that information is irrelevant for task performance.

Abstract

Shifts of gaze and of covert attention rely on tightly linked yet divergent neural mechanisms. In this issue of Neuron, Gregoriou et al. (2012) provide interesting evidence that different functional classes of neurons within the frontal eye field contribute uniquely to these two functions.

Abstract

Recent studies suggest that trial-to-trial variability of neuronal spiking responses may provide important information about behavioral state. Observed changes in variability during sensory stimulation, attention, motor preparation, and visual discrimination suggest that variability may reflect the engagement of neurons in a behavioral task. We examined changes in spiking variability of frontal eye field (FEF) neurons in a change detection task requiring monkeys to remember a visually cued location and direct attention to that location while ignoring distracters elsewhere. In this task, the firing rates (FRs) of FEF neurons not only continuously reflect the location of the remembered cue and select targets, but also predict detection performance on a trial-by-trial basis. Changes in FEF response variability, as measured by the Fano factor (FF), showed clear dissociations from changes in FR. The FF declined in response to visual stimulation at all tested locations, even in the opposite hemifield, indicating much broader spatial tuning of the FF compared with the FR. Furthermore, despite robust spatial modulation of the FR throughout all epochs of the task, spatial tuning of the FF did not persist throughout the delay period, nor did it show attentional modulation. These results indicate that changes in variability, at least in the FEF, are most effectively driven by visual stimulation, while behavioral engagement is not sufficient. Instead, changes in variability may reflect shifts in the balance between feedforward and recurrent sources of excitatory drive.

The role of neuromodulators in selective attentionTRENDS IN COGNITIVE SCIENCESNoudoost, B., Moore, T.2011; 15 (12): 585-591

Abstract

Several classes of neurotransmitters exert modulatory effects on a broad and diverse population of neurons throughout the brain. Some of these neuromodulators, especially acetylcholine and dopamine, have long been implicated in the neural control of selective attention. We review recent evidence and evolving ideas about the importance of these neuromodulatory systems in attention, particularly visual selective attention. We conclude that, although our understanding of their role in the neural circuitry of selective attention remains rudimentary, recent research has begun to suggest unique contributions of neuromodulators to different forms of attention, such as bottom-up and top-down attention.

Abstract

Animals can learn to voluntarily control neuronal activity within various brain areas through operant conditioning, but the relevance of that control to cognitive functions is unknown. We found that rhesus monkeys can control the activity of neurons within the frontal eye field (FEF), an oculomotor area of the prefrontal cortex. However, operantly driven FEF activity was primarily associated with selective visual attention, and not oculomotor preparation. Attentional effects were untrained and were observed both behaviorally and neurophysiologically. Furthermore, selective attention correlated with voluntary, but not spontaneous, fluctuations in FEF activity. Our results reveal a specific association of voluntarily driven neuronal activity with "top-down" attention and suggest a basis for the use of neurofeedback training to treat disorders of attention.

Abstract

Since the discovery of the nervous system's electrical excitability more than 200 years ago, neuroscientists have used electrical stimulation to manipulate brain activity in order to study its function. Microstimulation has been a valuable technique for probing neural circuitry and identifying networks of neurons that underlie perception, movement and cognition. In this review, we focus on the use of stimulation in behaving primates, an experimental system that permits causal inferences to be made about the effect of stimulation-induced activity on the resulting behaviour or neural signals elsewhere in the brain.

A reliable microinjectrode system for use in behaving monkeysJOURNAL OF NEUROSCIENCE METHODSNoudoost, B., Moore, T.2011; 194 (2): 218-223

Abstract

We describe a modified system for the precise delivery of small volumes of drugs to brain sites of behaving monkeys during simultaneous single-neuron electrophysiology. The system combines a conventional microelectrode for recording single neurons and a small gauge microsyringe in a durable design. It incorporates newly available microfluidic components to achieve high-precision fluidic control. The system is inexpensive, reusable and easy to fabricate; it minimizes neural tissue damage and achieves reliable single-neuron recordings at the injection site.

Abstract

Top-down visual attention improves perception of selected stimuli and that improvement is reflected in the neural activity at many stages throughout the visual system. Recent studies of top-down attention have elaborated on the signatures of its effects within visual cortex and have begun identifying its causal basis. Evidence from these studies suggests that the correlates of spatial attention exhibited by neurons within the visual system originate from a distributed network of structures involved in the programming of saccadic eye movements. We summarize this evidence and discuss its relationship to the neural mechanisms of spatial working memory.

Abstract

Neural responses are typically characterized by computing the mean firing rate, but response variability can exist across trials. Many studies have examined the effect of a stimulus on the mean response, but few have examined the effect on response variability. We measured neural variability in 13 extracellularly recorded datasets and one intracellularly recorded dataset from seven areas spanning the four cortical lobes in monkeys and cats. In every case, stimulus onset caused a decline in neural variability. This occurred even when the stimulus produced little change in mean firing rate. The variability decline was observed in membrane potential recordings, in the spiking of individual neurons and in correlated spiking variability measured with implanted 96-electrode arrays. The variability decline was observed for all stimuli tested, regardless of whether the animal was awake, behaving or anaesthetized. This widespread variability decline suggests a rather general property of cortex, that its state is stabilized by an input.

Changes in the Response Rate and Response Variability of Area V4 Neurons During the Preparation of Saccadic Eye MovementsJOURNAL OF NEUROPHYSIOLOGYSteinmetz, N. A., Moore, T.2010; 103 (3): 1171-1178

Abstract

The visually driven responses of macaque area V4 neurons are modulated during the preparation of saccadic eye movements, but the relationship between presaccadic modulation in area V4 and saccade preparation is poorly understood. Recent neurophysiological studies suggest that the variability across trials of spiking responses provides a more reliable signature of motor preparation than mean firing rate across trials. We compared the dynamics of the response rate and the variability in the rate across trials for area V4 neurons during the preparation of visually guided saccades. As in previous reports, we found that the mean firing rate of V4 neurons was enhanced when saccades were prepared to stimuli within a neuron's receptive field (RF) in comparison with saccades to a non-RF location. Further, we found robust decreases in response variability prior to saccades and found that these decreases predicted saccadic reaction times for saccades both to RF and non-RF stimuli. Importantly, response variability predicted reaction time whether or not there were any accompanying changes in mean firing rate. In addition to predicting saccade direction, the mean firing rate could also predict reaction time, but only for saccades directed to the RF stimuli. These results demonstrate that response variability of area V4 neurons, like mean response rate, provides a signature of saccade preparation. However, the two signatures reflect complementary aspects of that preparation.

Abstract

Voluntary attention is often allocated according to internally maintained goals. Recent evidence indicates that the frontal eye field (FEF) participates in the deployment of spatial attention, even in the absence of saccadic eye movements. In addition, many FEF neurons maintain persistent representations of impending saccades. However, the role of persistent activity in the general maintenance of spatial information, and its relationship to spatial attention, has not been explored. We recorded the responses of single FEF neurons in monkeys trained to remember cued locations in order to detect changes in targets embedded among distracters in a task that did not involve saccades. We found that FEF neurons persistently encoded the cued location throughout the trial during the delay period, when no visual stimuli were present, and during visual discrimination. Furthermore, FEF activity reliably predicted whether monkeys would detect the target change. Population analyses revealed that FEF neurons with persistent activity were more effective at selecting the target from among distracters than neurons lacking persistent activity. These results demonstrate that FEF neurons maintain spatial information in the absence of saccade preparation and suggest that this maintenance contributes to the selection of relevant visual stimuli.

Influence and Limitations of Popout in the Selection of Salient Visual Stimuli by Area V4 NeuronsJOURNAL OF NEUROSCIENCEBurrows, B. E., Moore, T.2009; 29 (48): 15169-15177

Abstract

The neural mechanism of bottom-up attention and its relationship to top-down attention are poorly understood. Visual stimuli that differ from others in their component features are salient and tend to draw attention in a bottom-up manner. "Popout" stimuli differ uniformly from surrounding items and are more easily detected than stimuli composed of a conjunction of surrounding features. We compared the responses of single area V4 neurons to popout and conjunction stimuli appearing within the classical receptive field (CRF) and found that their responses are modulated by popout. This selectivity was more robust when larger numbers of surrounding items and multiple features were included in the display, and it was absent when only a few items were presented immediately outside the CRF. In addition, the popout modulation of V4 activity was eliminated when top-down attention was directed to locations outside of the CRFs during saccade preparation, indicating that the salience of popout stimuli is not sufficient to drive selection by V4 neurons. These results demonstrate that neurons in feature-selective cortex are influenced by bottom-up attention, but that this influence is limited by top-down attention.

Dynamic sensitivity of area V4 neurons during saccade preparationPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAHan, X., Xian, S. X., Moore, T.2009; 106 (31): 13046-13051

Abstract

During the preparation of saccadic eye movements, visual attention is confined to the target of intended fixation and there is a corresponding diminution of visual sensitivity at nontarget locations. Neurons within the macaque visual cortex exhibit correlates of these perceptual changes, such as in area V4, where neuronal responses are enhanced during the preparation of saccades to stimuli within the receptive field (RF), and responses are suppressed during the preparation of saccades to other locations. Both the perceptual and neurophysiological effects suggest that the sensitivity of visual cortical neurons to input is dynamic during saccade preparation. We probed the contrast sensitivity of area V4 neurons to nontarget stimuli at varying times during the preparation of saccades to locations outside of the neuron's receptive field. We found that the contrast sensitivity of many neurons is profoundly altered within 50 ms of saccade onset. The luminance or color contrast sensitivity of individual V4 neurons could increase, decrease, or remain unchanged before saccade onset. For luminance contrast sensitivity, decreases in sensitivity were more frequent and larger in magnitude, resulting in an overall decrement in sensitivity across the population. For color contrast, the effects were smaller and more heterogeneous, resulting in little or no overall change in sensitivity across the population. Our results demonstrate the dynamic influence that saccade preparation has on the sensitivity of visual cortical neurons and suggest a basis for the changes in perception known to occur during saccade preparation.

Abstract

Previous studies have shown that the visual responses of neurons in extrastriate area V4 are enhanced prior to saccadic eye movements that target receptive field (RF) stimuli. We used receiver-operator characteristic (ROC) analysis to quantify how well V4 neurons could discriminate stable RF stimuli targeted by visually-guided saccades or ignored during saccades elsewhere. We found that discrimination was transiently enhanced prior to saccades to RF stimuli whereas it was reduced prior to saccades elsewhere. Similar to what is observed during covert attention and after frontal eye field microstimulation, the changes in stimulus discrimination were due in part to changes in response magnitude. In addition, we found evidence of an increased reliability of responses when saccades were made to the RF stimulus. These results highlight the similarity of mechanisms driving covert spatial attention and the preparation of visually-guided saccades.

Abstract

While the motor and attentional roles of the frontal eye field (FEF) are well documented, the relationship between them is unknown. We exploited the known influence of visual motion on the apparent positions of targets, and measured how this illusion affects saccadic eye movements during FEF microstimulation. Without microstimulation, saccades to a moving grating are biased in the direction of motion, consistent with the apparent position illusion. Here we show that microstimulation of spatially aligned FEF representations increases the influence of this illusion on saccades. Rather than simply impose a fixed-vector signal, subthreshold stimulation directed saccades away from the FEF movement field, and instead more strongly in the direction of visual motion. These results demonstrate that the attentional effects of FEF stimulation govern visually guided saccades, and suggest that the two roles of the FEF work together to select both the features of a target and the appropriate movement to foveate it.

Abstract

The greater spatial coherence of local field potentials (LFPs) compared with that of spiking activity has been attributed to frequency-dependent propagation of signals through the cortical medium. However, in this issue of Neuron, Logothetis and colleagues show that signal propagation within cortex is largely unbiased across different frequencies, thus suggesting a more functional and interpretable basis of LFP coherence.

Abstract

Electrical microstimulation is used widely in experimental neurophysiology to examine causal links between specific brain areas and their behavioral functions and is used clinically to treat neurological and psychiatric disorders in patients. Typically, microstimulation is applied to local brain regions as a train of equally spaced current pulses. We were interested in the sensitivity of a neural circuit to a train of variably spaced pulses, as is observed in physiological spike trains. We compared the effect of fixed, decelerating, accelerating, and randomly varying microstimulation patterns on the likelihood and metrics of eye movements evoked from the frontal eye field of monkeys, while holding the mean interpulse interval constant. Our results demonstrate that the pattern of microstimulation pulses strongly influences the probability of evoking a saccade, as well as the metrics of the saccades themselves. Specifically, the pattern most closely resembling physiological spike trains (accelerating pattern) was most effective at evoking a saccade, three times more so than the least effective decelerating pattern. A saccade-triggered average of effective random trains confirmed the positive relationship between accelerating rate and efficacy. These results have important implications for the use of electrical microstimulation in both experimental and clinical settings and suggest a means to study the role of temporal pattern in the encoding of behavioral and cognitive functions.

Rapid enhancement of visual cortical response discriminability by microstimulation of the frontal eye fieldPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAArmstrong, K. M., Moore, T.2007; 104 (22): 9499-9504

Abstract

Visual attention provides a means of selecting among the barrage of information reaching the retina and of enhancing the perceptual discriminability of relevant stimuli. Neurophysiological studies in monkeys and functional imaging studies in humans have demonstrated neural correlates of these perceptual improvements in visual cortex during attention. Importantly, voluntary attention improves the discriminability of visual cortical responses to relevant stimuli. Recent work aimed at identifying sources of attentional modulation has implicated the frontal eye field (FEF) in driving spatial attention. Subthreshold microstimulation of the FEF enhances the responses of area V4 neurons to spatially corresponding stimuli. However, it is not known whether these enhancements include improved visual-response discriminability, a hallmark of voluntary attention. We used receiver-operator characteristic analysis to quantify how well V4 responses discriminated visual stimuli and examined how discriminability was affected by FEF microstimulation. Discriminability of responses to stable visual stimuli decayed over time but was transiently restored after microstimulation of the FEF. As observed during voluntary attention, the enhancement resulted only from changes in the magnitude of V4 responses and not in the relationship between response magnitude and variance. Enhanced response discriminability was apparent immediately after microstimulation and was reliable within 40 ms of microstimulation onset, indicating a direct influence of FEF stimulation on visual representations. These results contribute to the mounting evidence that saccade-related signals are a source of spatial attentive selection.

Abstract

The influence of attention on visual cortical neurons has been described in terms of its effect on the structure of receptive fields (RFs), where multiple stimuli compete to drive neural responses and ultimately behavior. We stimulated the frontal eye field (FEF) of passively fixating monkeys and produced changes in V4 responses similar to known effects of voluntary attention. Subthreshold FEF stimulation enhanced visual responses at particular locations within the RF and altered the interaction between pairs of RF stimuli to favor those aligned with the activated FEF site. Thus, we could influence which stimulus drove the responses of individual V4 neurons. These results suggest that spatial signals involved in saccade preparation are used to covertly select among multiple stimuli appearing within the RFs of visual cortical neurons.

Abstract

The profusion of progress during the past twenty years in identifying neural correlates of selective attention within the visual system has left open the question of how visual representations are biased to favor target stimuli. Studies aimed at specifying the mechanisms that can be causally implicated in the control of visual selective attention have only recently begun in earnest. Employing both the psychophysical and the neuroanatomical data, recent neurophysiological experiments in monkeys and neuroimaging studies in humans are converging on the neural circuits that provide the source of at least some forms of attentional control signals.

Abstract

Natural scenes contain far more information than can be processed simultaneously. Thus, our visually guided behavior depends crucially on the capacity to attend to relevant stimuli. Past studies have provided compelling evidence of functional overlap of the neural mechanisms that control spatial attention and saccadic eye movements. Recent neurophysiological work demonstrates that the neural circuits involved in the preparation of saccades also play a causal role in directing covert spatial attention. At the same time, other studies have identified separable neural populations that contribute uniquely to visual and oculomotor selection. Taken together, all of the recent work suggests how visual and oculomotor signals are integrated to simultaneously select the visual attributes of targets and the saccades needed to fixate them.

Representations of faces and body parts in macaque temporal cortex: A functional MRI studyPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAPinsk, M. A., DeSimone, K., Moore, T., Gross, C. G., Kastner, S.2005; 102 (19): 6996-7001

Abstract

Human neuroimaging studies suggest that areas in temporal cortex respond preferentially to certain biologically relevant stimulus categories such as faces and bodies. Single-cell studies in monkeys have reported cells in inferior temporal cortex that respond selectively to faces, hands, and bodies but provide little evidence of large clusters of category-specific cells that would form "areas." We probed the category selectivity of macaque temporal cortex for representations of monkey faces and monkey body parts relative to man-made objects using functional MRI in animals trained to fixate. Two face-selective areas were activated bilaterally in the posterior and anterior superior temporal sulcus exhibiting different degrees of category selectivity. The posterior face area was more extensively activated in the right hemisphere than in the left hemisphere. Immediately adjacent to the face areas, regions were activated bilaterally responding preferentially to body parts. Our findings suggest a category-selective organization for faces and body parts in macaque temporal cortex.

Abstract

Methods for performing functional magnetic resonance imaging (fMRI) studies in behaving and lesioned monkeys using a human MR scanner are reported. Materials for head implant surgery were selected based on tests for magnetic susceptibility. A primate chair with a rigid head fixation system and a mock scanner environment for training were developed. To perform controlled visual studies, monkeys were trained to maintain fixation for several minutes using a novel training technique that utilized continuous juice rewards. A surface coil was used to acquire anatomical and functional images in four monkeys, one with a partial lesion of striate cortex. High-resolution anatomical images were used after non-uniform intensity correction to create cortical surface reconstructions of both lesioned and normal hemispheres. Our methods were confirmed in two visual experiments, in which functional activations were obtained during both free viewing and fixation conditions. In one experiment, face-selective activity was found in the fundus and banks of the superior temporal sulcus and the middle temporal gyrus in monkeys viewing pictures of faces and objects while maintaining fixation. In a second experiment, regions in occipital, parietal, and frontal cortex were activated in lesioned and normal animals viewing a cartoon movie. Importantly, in the animal with the striate lesion, fMRI signals were obtained in the immediate vicinity of the lesion. Our results extend those previously reported by providing a detailed account of the technique and by demonstrating the feasibility of fMRI in monkeys with lesions.

Abstract

Recently it was shown that electrical stimulation of the precentral gyrus of monkeys can evoke complex, coordinated movements. In the forelimb representation, stimulation of each site caused the arm to move to a specific final posture, and thus the hand to move to a location in space. Among these stimulation-evoked hand locations, certain regions of the hand's workspace were more represented than others. We hypothesized that a similar non-uniform distribution of hand location should be present during a monkey's spontaneous behavior. The present study examined the distribution of hand location of monkeys in their home cages. This distribution was similar to that found by stimulation of the precentral gyrus. That is, arm postures that were over-represented in spontaneous behavior were also over-represented in the movements evoked by cortical stimulation.

Visually guided behavior after V1 lesions in young and adult monkeys and its relation to blindsight in humans.Progress in brain researchGross, C. G., Moore, T., Rodman, H. R.2004; 144: 279-294

Abstract

After lesions of striate cortex in primates, there is still the capacity to detect and localize visual stimuli. In this chapter we review three aspects of our study of this phenomenon in macaques. First, we found that macaques that received their striate lesions as infants had considerably greater ability to detect and localize stimuli than those that received similar lesions as adults. Second, we suggest that the visual functions that survive striate lesions in macaques made in adulthood resemble those in human 'blindsight'. Third, we report that monkeys with striate lesions made in infancy are able to discriminate direction of visual motion.

Microstimulation of the frontal eye field and its effects on covert spatial attentionJOURNAL OF NEUROPHYSIOLOGYMoore, T., Fallah, M.2004; 91 (1): 152-162

Abstract

Many studies have established that the strength of visual perception and the strength of visual representations within visual cortex vary according to the focus of covert spatial attention. While it is clear that attention can modulate visual signals, the source of this modulation remains unknown. We have examined the possibility that saccade related mechanisms provide a source of spatial attention by studying the effects of electrical microstimulation of the frontal eye fields (FEF) on spatial attention. Monkeys performed a task in which they had to detect luminance changes of a peripheral target while ignoring a flashing distracter. The target luminance change could be preceded by stimulation of the FEF at current levels below that which evoked saccadic eye movements. We found that when the target change was preceded by stimulation of FEF, the monkey could detect smaller changes in target luminance. The increased sensitivity to the target change only occurred when the target was placed in the part of the visual field represented by neurons at the stimulation site. The magnitude of improvement depended on the temporal asynchrony of the stimulation onset and the target event. No significant effect of stimulation was observed when long intervals (>300 ms) between stimulation and the target event were used, and the magnitude of the increased sensitivity decreased systematically with increasing asynchrony. At the shortest asynchrony, FEF stimulation temporally overlapped the target event and the magnitude of the improvement was comparable to that of removing the distracter from the task. These results demonstrate that transient, but potent improvements in the deployment of covert spatial attention can be obtained by microstimulation of FEF sites from which saccadic eye movements are also evoked.

Abstract

Covert spatial attention produces biases in perceptual performance and neural processing of behaviorally relevant stimuli in the absence of overt orienting movements. The neural mechanism that gives rise to these effects is poorly understood. This paper surveys past evidence of a relationship between oculomotor control and visual spatial attention and more recent evidence of a causal link between the control of saccadic eye movements by frontal cortex and covert visual selection. Both suggest that the mechanism of covert spatial attention emerges as a consequence of the reciprocal interactions between neural circuits primarily involved in specifying the visual properties of potential targets and those involved in specifying the movements needed to fixate them.

Complex movements evoked by microstimulation of the ventral intraparietal areaPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICACooke, D. F., Taylor, C. S., Moore, T., Graziano, M. S.2003; 100 (10): 6163-6168

Abstract

Most neurons in the ventral intraparietal area (VIP) of the macaque brain respond to both visual and tactile stimuli. The tactile receptive field is usually on the face, and the visual receptive field usually corresponds spatially to the tactile receptive field. In this study, electrical microstimulation of VIP, but not of surrounding tissue, caused a constellation of movements including eye closure, facial grimacing, head withdrawal, elevation of the shoulder, and movements of the hand to the space beside the head or shoulder. A similar set of movements was evoked by an air puff to the monkey's cheek. One interpretation is that VIP contributes to defensive movements triggered by stimuli on or near the head.

Abstract

Several decades of psychophysical and neurophysiological studies have established that visual signals are enhanced at the locus of attention. What remains a mystery is the mechanism that initiates biases in the strength of visual representations. Recent evidence argues that, during spatial attention, these biases reflect nascent saccadic eye movement commands. We examined the functional interaction of saccade preparation and visual coding by electrically stimulating sites within the frontal eye fields (FEF) and measuring its effect on the activity of neurons in extrastriate visual cortex. Here we show that visual responses in area V4 could be enhanced after brief stimulation of retinotopically corresponding sites within the FEF using currents below that needed to evoke saccades. The magnitude of the enhancement depended on the effectiveness of receptive field stimuli as well as on the presence of competing stimuli outside the receptive field. Stimulation of non-corresponding FEF representations could suppress V4 responses. The results suggest that the gain of visual signals is modified according to the strength of spatially corresponding eye movement commands.

Visually guided behavior after V1 lesions in young and adult monkeys and its relation to blindsight in humansConference on the Roots of Visual AwarenessGross, C. G., Moore, T., Rodman, H. R.ELSEVIER SCIENCE BV.2003: 279?294

Abstract

Recently, we found that electrical stimulation of motor cortex caused monkeys to make coordinated, complex movements. These evoked movements were arranged across the cortex in a map of spatial locations to which the hand moved. We suggest that some of the subdivisions previously described within primary motor and premotor cortex may represent different types of actions that monkeys tend to make in different regions of space. According to this view, primary and premotor cortex may fit together into a larger map of manual space.

Abstract

Electrical microstimulation was used to study primary motor and premotor cortex in monkeys. Each stimulation train was 500 ms in duration, approximating the time scale of normal reaching and grasping movements and the time scale of the neuronal activity that normally accompanies movement. This stimulation on a behaviorally relevant time scale evoked coordinated, complex postures that involved many joints. For example, stimulation of one site caused the mouth to open and also caused the hand to shape into a grip posture and move to the mouth. Stimulation of this site always drove the joints toward this final posture, regardless of the direction of movement required to reach the posture. Stimulation of other cortical sites evoked different postures. Postures that involved the arm were arranged across cortex to form a map of hand positions around the body. This stimulation-evoked map encompassed both primary motor and the adjacent premotor cortex. We suggest that these regions fit together into a single map of the workspace around the body.

Abstract

The receptive field, defined as the spatiotemporal selectivity of neurons to sensory stimuli, is central to our understanding of the neuronal mechanisms of perception. However, despite the fact that eye movements are critical during normal vision, the influence of eye movements on the structure of receptive fields has never been characterized. Here, we map the receptive fields of macaque area V4 neurons during saccadic eye movements and find that receptive fields are remarkably dynamic. Specifically, before the initiation of a saccadic eye movement, receptive fields shrink and shift towards the saccade target. These spatiotemporal dynamics may enhance information processing of relevant stimuli during the scanning of a visual scene, thereby assisting the selection of saccade targets and accelerating the analysis of the visual scene during free viewing.

Control of eye movements and spatial attentionPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAMoore, T., Fallah, M.2001; 98 (3): 1273-1276

Abstract

Several lines of evidence suggest that planning eye movements and directing visuospatial attention share overlapping brain mechanisms. This study tested whether spatial attention can be enhanced by altering oculomotor signals within the brain. Monkeys performed a spatial attention task while neurons within the frontal eye field, an oculomotor area within prefrontal cortex, were electrically stimulated below the level at which eye movements are evoked. We found that we could improve the monkey's performance with microstimulation when, but only when, the object to be attended was positioned in the space represented by the cortical stimulation site.

Direction of motion discrimination after early lesions of striate cortex (V1) of the macaque monkeyPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAMoore, T., Rodman, H. R., Gross, C. G.2001; 98 (1): 325-330

Abstract

Previous studies have established that humans and monkeys with damage to striate cortex are able to detect and localize bright targets within the resultant scotoma. Electrophysiological evidence in monkeys suggests that residual vision also might include sensitivity to direction of visual motion. We tested whether macaque monkeys with longstanding lesions of striate cortex (V1), sustained in infancy, could discriminate visual stimuli on the basis of direction of motion. Three monkeys with unilateral striate cortex lesions sustained in infancy were tested 2-5 years postlesion on a direction of motion discrimination task. Each monkey was trained to make saccadic eye movements to a field of moving dots or to withhold such eye movements, depending on the direction of motion in a coherent random dot display. With smaller motion displays, monkeys were unable to detect or discriminate motion within the scotoma, although they could discriminate moving from static stimuli. Yet, each monkey was able to discriminate direction of motion when the motion stimulus was larger, but still confined to the scotoma. The results demonstrate that the recovery after infant damage to striate cortex includes some sensitivity to direction of visual motion.

Abstract

One hallmark of primate vision is that the direction of gaze is constantly shifting to position objects of interest appropriately on the fovea, where visual acuity is greatest. This process must involve the close cooperation of oculomotor and visual recognition mechanisms because visual details must be translated into specific motor commands. This paper describes the correspondence between the presaccadic activity of V4 neurons and the degree of visual guidance of saccadic eye movements to objects of different form. The results suggest that neurons that participate in coding visual stimuli are also involved in guiding the eyes to prominent features of objects.

Visual representations during saccadic eye movementsPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAMoore, T., Tolias, A. S., Schiller, P. H.1998; 95 (15): 8981-8984

Abstract

In normal vision, shifts of attention are usually followed by saccadic eye movements. Neurons in extrastriate area V4 are modulated by focal attention when eye movements are withheld, but they also respond in advance of visually guided saccadic eye movements. We have examined the visual selectivity of saccade-related responses of area V4 neurons in monkeys making delayed eye movements to receptive field stimuli of varying orientation. This task did not require the monkey to attend to orientation per se but merely to foveate the receptive field stimulus. We present evidence that the presaccadic enhancement exhibited by V4 neurons, quite separate from the response at stimulus onset, is a resurgent visual representation that seems as selective as the response is when the stimulus first appears. The presaccadic enhancement appears to provide a strengthening of a decaying featural representation immediately before an eye movement is directed to visual targets. We suggest that this reactivation provides a mechanism by which a clear perception of the saccade goal can be maintained during the execution of the saccade, perhaps for the purpose of establishing continuity across eye movements.

Abstract

1. Monkeys with large unilateral surgical ablations of striate cortex, sustained either in adulthood or at 5-6 wk of age, were trained on an oculomotor detection and localization task and tested with visual stimuli in the hemifields ipsilateral and contralateral to the lesion 2-5 yr after surgery. 2. Monkeys with lesions sustained in adulthood were largely unable to detect stimuli in the hemifield contralateral to the lesion, with only one monkey showing recovery toward the end of testing. Monkeys with lesions of striate cortex made in infancy, however, each showed residual detection capacity at the beginning of testing and improved to near normal by the end of testing. 3. Each of the monkeys showing a residual ability to detect within the contralateral hemifield was also able to localize visual targets with eye movements. 4. These findings demonstrate that the vision surviving striate cortex damage in primates is more robust after early damage as has been shown to be the case for primary somatosensory, motor, and association cortex.

LOCALIZATION OF VISUAL-STIMULI AFTER STRIATE CORTEX DAMAGE IN MONKEYS - PARALLELS WITH HUMAN BLINDSIGHTPROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICAMoore, T., Rodman, H. R., REPP, A. B., Gross, C. G.1995; 92 (18): 8215-8218

Abstract

Blindsight is a phenomenon in which human patients with damage to striate cortex deny any visual sensation in the resultant visual field defect but can nonetheless detect and localize stimuli when persuaded to guess. Although monkeys with striate lesions have also been shown to exhibit some residual vision, it is not yet clear to what extent the residual capacities in monkeys parallel the phenomenon of human blindsight. To clarify this issue, we trained two monkeys with unilateral lesions of striate cortex to make saccadic eye movements to visual targets in both hemifields under two conditions. In the condition analogous to clinical perimetry, they failed to initiate saccades to targets presented in the contralateral hemifield and thus appeared "blind." Only in the condition where the fixation point was turned off simultaneously with the onset of the target--signaling the animal to respond at the appropriate time--were monkeys able to localize targets contralateral to the striate lesion. These results indicate that the conditions under which residual vision is demonstrable are similar for monkeys with striate cortex damage and humans with blindsight.