Lecture 5.4 - (S, E) Coordinating Between Vision and Touch

Course video 38 of 51

This module we turn to how spatial locations are defined, and discuss the concept of a reference frame. Initially, reference frames are quite different for visual, auditory, and somatosensory information. Visual location is defined with respect to the eyes, whereas sound locations are detected with respect to the head and ears, and tactile locations are detected based on body surface position. As you'll see, the brain transforms these signals into new reference frames to facilitate interactions between these sensory systems. We then consider space on a larger scale, and ask how we know where we are and how we navigate from one place to another. Knowledge of self-motion relies in part on the vestibular system, our sense of balance. The vestibular system works in concert with vision and motor systems to update our sense of position and keep us from getting lost. This module's material is covered in chapters 7, "Your Sunglasses Are in the Milky Way", and 8, "Going Places" of Making Space.

This course is about how the brain creates our sense of spatial location from a variety of sensory and motor sources, and how this spatial sense in turn shapes our cognitive abilities.
Knowing where things are is effortless. But “under the hood,” your brain must figure out even the simplest of details about the world around you and your position in it. Recognizing your mother, finding your phone, going to the grocery store, playing the banjo – these require careful sleuthing and coordination across different sensory and motor domains. This course traces the brain’s detective work to create this sense of space and argues that the brain’s spatial focus permeates our cognitive abilities, affecting the way we think and remember.
The material in this course is based on a book I've written for a general audience. The book is called "Making Space: How the Brain Knows Where Things Are", and is available from Amazon, Barnes and Noble, or directly from Harvard University Press.
The course material overlaps with classes on perception or systems neuroscience, and can be taken either before or after such classes.
Dr. Jennifer M. Groh, Ph.D.
Professor
Psychology & Neuroscience; Neurobiology
Duke University
www.duke.edu/~jmgroh
Jennifer M. Groh is interested in how the brain process spatial information in different sensory systems, and how the brain's spatial codes influence other aspects of cognition. She is the author of a recent book entitled "Making Space: How the Brain Knows Where Things Are" (Harvard University Press, fall 2014).
Much of her research concerns differences in how the visual and auditory systems encode location, and how vision influences hearing. Her laboratory has demonstrated that neurons in auditory brain regions are sometimes responsive not just to what we hear but also to what direction we are looking and what visual stimuli we can see. These surprising findings challenge the prevailing assumption that the brain’s sensory pathways remain separate and distinct from each other at early stages, and suggest a mechanism for such multi-sensory interactions as lip-reading and ventriloquism (the capture of perceived sound location by a plausible nearby visual stimulus).
Dr. Groh has been a professor at Duke University since 2006. She received her undergraduate degree in biology from Princeton University in 1988 before studying neuroscience at the University of Michigan (Master’s, 1990), the University of Pennsylvania (Ph.D., 1993), and Stanford University (postdoctoral, 1994-1997). Dr. Groh has been teaching undergraduate classes on the neural basis of perception and memory for over fifteen years. She is presently a faculty member at the Center for Cognitive Neuroscience and the Duke Institute for Brain Sciences at Duke University. She also holds appointments in the Departments of Neurobiology and Psychology & Neuroscience at Duke.
Dr. Groh’s research has been supported by a variety of sources including the John S. Guggenheim Foundation, the National Institutes of Health, the National Science Foundation, and the Office of Naval Research Young Investigator Program, the McKnight Endowment Fund for Neuroscience, the John Merck Scholars Program, the EJLB Foundation, the Alfred P. Sloan Foundation, the Whitehall Foundation, and the National Organization for Hearing Research.