Featured Research

from universities, journals, and other organizations

New algorithm aids in both robot navigation and scene understanding

Date:

April 4, 2014

Source:

Massachusetts Institute of Technology

Summary:

Suppose you're trying to navigate an unfamiliar section of a big city, and you're using a particular cluster of skyscrapers as a reference point. Traffic and one-way streets force you to take some odd turns, and for a while you lose sight of your landmarks. When they reappear, in order to use them for navigation, you have to be able to identify them as the same buildings you were tracking before -- as well as your orientation relative to them. A new algorithm for determining the orientation of objects could aid robots in navigation, scene understanding.

Share This

The algorithm's first step is to estimate the orientations of individual points in the scene (orange arrows), which it maps onto the surface of a sphere (orange clusters). Through an iterative process, it finds the set of axes that best fit the point clusters (red, blue, and green columns), which it re-identifies with the points in the scene.

Suppose you're trying to navigate an unfamiliar section of a big city, and you're using a particular cluster of skyscrapers as a reference point. Traffic and one-way streets force you to take some odd turns, and for a while you lose sight of your landmarks. When they reappear, in order to use them for navigation, you have to be able to identify them as the same buildings you were tracking before -- as well as your orientation relative to them.

Related Articles

That type of re-identification is second nature for humans, but it's difficult for computers. At the IEEE Conference on Computer Vision and Pattern Recognition in June, MIT researchers will present a new algorithm that could make it much easier, by identifying the major orientations in 3-D scenes. The same algorithm could also simplify the problem of scene understanding, one of the central challenges in computer vision research.

The algorithm is primarily intended to aid robots navigating unfamiliar buildings, not motorists navigating unfamiliar cities, but the principle is the same. It works by identifying the dominant orientations in a given scene, which it represents as sets of axes -- called "Manhattan frames" -- embedded in a sphere. As a robot moved, it would, in effect, observe the sphere rotating in the opposite direction, and could gauge its orientation relative to the axes. Whenever it wanted to reorient itself, it would know which of its landmarks' faces should be toward it, making them much easier to identify.

As it turns out, the same algorithm also drastically simplifies the problem of plane segmentation, or deciding which elements of a visual scene lie in which planes, at what depth. Plane segmentation allows a computer to build boxy 3-D models of the objects in the scene -- which it could, in turn, match to stored 3-D models of known objects.

Julian Straub, a graduate student in electrical engineering and computer science at MIT, is lead author on the paper. He's joined by his advisors, John Fisher, a senior research scientist in MIT's Computer Science and Artificial Intelligence Laboratory, and John Leonard, a professor of mechanical and ocean engineering, as well as Oren Freifeld and Guy Rosman, both postdocs in Fisher's Sensing, Learning, and Inference Group.

The researchers' new algorithm works on 3-D data of the type captured by the Microsoft Kinect or laser rangefinders. First, using established procedures, the algorithm estimates the orientations of a large number of individual points in the scene. Those orientations are then represented as points on the surface of a sphere, with each point defining a unique angle relative to the sphere's center.

Since the initial orientation estimate is rough, the points on the sphere form loose clusters that can be difficult to distinguish. Using statistical information about the uncertainty of the initial orientation estimates, the algorithm then tries to fit Manhattan frames to the points on the sphere.

The basic idea is similar to that of regression analysis -- finding lines that best approximate scatters of points. But it's complicated by the geometry of the sphere. "Most of classical statistics is based on linearity and Euclidean distances, so you can take two points, you can sum them, divide by two, and this will give you the average," Freifeld says. "But once you are working in spaces that are nonlinear, when you do this averaging, you can fall outside the space."

Consider, for instance, the example of measuring geographical distances. "Say that you're in Tokyo and I'm in New York," Freifeld says. "We don't want our average to be in the middle of the Earth; we want it to be on the surface." One of the keys to the new algorithm is the fact it incorporates these geometries into the statistical reasoning about the scene.

In principle, it would be possible to approximate the point data very accurately by using hundreds of different Manhattan frames, but that would yield a model that's much too complex to be useful. So another aspect of the algorithm is a cost function that weighs accuracy of approximation against number of frames. The algorithm starts with a fixed number of frames -- somewhere between three and 10, depending on the expected complexity of the scene -- and then tries to pare that number down without compromising the overall cost function.

The resulting set of Manhattan frames may not represent subtle distinctions between objects that are slightly misaligned with each other, but those distinctions aren't terribly useful to a navigation system. "Think about how you navigate a room," Fisher says. "You're not building a precise model of your environment. You're sort of capturing loose statistics that allow you to complete your task in a way that you don't stumble over a chair or something like that."

Once a set of Manhattan frames has been determined, the problem of plane segmentation becomes much easier. Objects that don't take up much of the visual field -- because they're small, distant, or occluded -- make trouble for existing plane segmentation algorithms, because they yield so little depth information that their orientations can't be reliably inferred. But if the problem is one of selecting among just a handful of possible orientations, rather than a potential infinitude, it becomes much more tractable.

Massachusetts Institute of Technology. (2014, April 4). New algorithm aids in both robot navigation and scene understanding. ScienceDaily. Retrieved March 31, 2015 from www.sciencedaily.com/releases/2014/04/140404140311.htm

More From ScienceDaily

More Computers & Math News

Featured Research

Mar. 31, 2015 — Video games not only sharpen the visual processing skills of frequent players, they might also improve the brain's ability to learn those skills, according to a new study. Gamers showed faster ... full story

Mar. 31, 2015 — A team of engineers and biologists reports new progress in using computer modeling and 3D shape analysis to understand how the unique grasping tails of seahorses evolved. These prehensile tails ... full story

Mar. 30, 2015 — Neuroscientists are taking inspiration from natural motor control to design new prosthetic devices that can better replace limb function. Researchers have tested a range of brain-controlled devices ... full story

Mar. 30, 2015 — Speaking in public is the top fear for many people. Now, researchers have developed an intelligent user interface for 'smart glasses' that gives real-time feedback to the speaker on volume modulation ... full story

Mar. 30, 2015 — To help scientists make sense of 'brain big data,' researchers have used data mining to create www.neuroelectro.org, a publicly available website that acts like Wikipedia, indexing physiological ... full story

Mar. 30, 2015 — As the demand for instant, constant communication grows, so too does the urgency for more convenient portable devices -- especially computer displays that can be easily rolled up and stored or ... full story

Mar. 30, 2015 — Adolescents who have engaged in past risky online behavior such as providing personal information and befriending strangers are much more likely to repeat such behavior in the future, according to ... full story

Mar. 30, 2015 — New global forest maps combine citizen science with multiple data sources, for an unprecedented level of accuracy about the location and extent of forestland worldwide. "The new maps rely on a ... full story

Featured Videos

Bionic Ants Could Be Tomorrow's Factory Workers

Reuters - Innovations Video Online (Mar. 30, 2015) — Industrious 3D printed bionic ants working together could toil in the factories of the future, says German technology company Festo. The robotic insects cooperate and coordinate their actions and movements to achieve a common aim. Amy Pollock reports.
Video provided by Reuters

Internet Giants Drive Into the Electric Vehicle Space

Reuters - Business Video Online (Mar. 30, 2015) — Internet companies are looking to disrupt the auto industry with new smart e-vehicles, but widespread adoption in Asia may not be cured by new Chinese investments. Pamela Ambler reports.
Video provided by Reuters

Related Stories

Sep. 22, 2014 — Researchers have created a new search algorithm that improves a robot's ability to find and navigate to tagged objects. The team has implemented their system on a PR2 robot, allowing it to ... full story

Mar. 27, 2014 — A computerized process that could make minimally invasive surgery more accurate and streamlined using equipment already common in the operating room has been developed by ... full story

May 18, 2012 — A computer science engineering team has developed an indoor navigation system for people with visual impairments. The researchers have explained how a combination of human-computer interaction and ... full story

Feb. 16, 2012 — Robots could one day navigate through constantly changing surroundings with virtually no input from humans, thanks to a system that allows them to build and continuously update a three-dimensional ... full story

ScienceDaily features breaking news and videos about the latest discoveries in health, technology, the environment, and more -- from major news services and leading universities, scientific journals, and research organizations.