3-D CAVE makes data larger than life

Viewers use 8-foot-tall display, controller in 'National Treasure'

By Carla K. Johnson
Associated Press

Published: Wednesday, Feb. 20 2013 8:00 p.m. MST

In this photo made Thursday, Jan. 24, 2013, in Chicago, Andreas Linninger, University of Illinois-Chicago professor of bioengineering, chemical engineering and computer science, left, views the brain inside CAVE2. Linninger heads a study that would compare CAVE2 to conventional methods of detecting brain aneurysms and determining proper treatment. CAVE2 is a system's of 72 stereoscopic liquid crystal display panels that encircles the viewer 320 degrees and creates a 3D environment that can take you to the bridge of the Starship Enterprise, a flyover of the planet Mars, or through the blood vessels of the brain. (AP Photo/Charles Rex Arbogast) (Associated Press)

CHICAGO — Take a walk through a human brain? Fly over the surface of Mars? Computer scientists at the University of Illinois at Chicago are pushing science fiction closer to reality with a wraparound virtual world where a researcher wearing 3-D glasses can do all that and more.

In the system, known as CAVE2, an eight-foot-high screen encircles the viewer 320 degrees. A panorama of images springs from 72 stereoscopic liquid crystal display panels, conveying a dizzying sense of being able to touch what's not really there.

As far back as 1950, sci-fi author Ray Bradbury imagined a children's nursery that could make bedtime stories disturbingly real. "Star Trek" fans might remember the holodeck as the virtual playground where the fictional Enterprise crew relaxed in fantasy worlds.

The Illinois computer scientists have more serious matters in mind when they hand visitors 3-D glasses and a controller called a "wand." Scientists in many fields today share a common challenge: how to truly understand overwhelming amounts of data. Jason Leigh, co-inventor of the CAVE2 virtual reality system, believes this technology answers that challenge.

University of Illinois-Chicago computer scientist Jason Leigh, co-inventor of the CAVE2 virtual reality system, poses with a pair of specially designed 3D glasses in the CAVE2 where the system's 72 stereoscopic liquid crystal display panels encircles the viewer 320 degrees and creates a 3D environment that can take you to the bridge of the Starship Enterprise, a flyover the planet Mars, or through the blood vessels of the brain.Tuesday, Feb. 19, 2013, in Chicago. (AP Photo/Charles Rex Arbogast) (Associated Press)

"In the next five years, we anticipate using the CAVE to look at really large-scale data to help scientists make sense of that information. CAVEs are essentially fantastic lenses for bringing data into focus," Leigh said.

The CAVE2 virtual world could change the way doctors are trained and improve patient care, Leigh said. Pharmaceutical researchers could use it to model the way new drugs bind to proteins in the human body. Car designers could virtually "drive" their vehicle designs.

Imagine turning massive amounts of data — the forces behind a hurricane, for example — into a simulation that a weather researcher could enlarge and explore from the inside. Architects could walk through their skyscrapers before they are built. Surgeons could rehearse a procedure using data from an individual patient.

Brain surgeon Ali Alaraj talks about the first time he viewed the brain using the CAVE2. "You can walk between the blood vessels," said the University of Illinois neurosurgeon. (Associated Press)

But the size and expense of room-based virtual reality systems may prove insurmountable barriers to widespread use, said Henry Fuchs, a computer science professor at the University of North Carolina at Chapel Hill, who is familiar with the CAVE technology but wasn't involved in its development.

While he calls the CAVE2 "a national treasure," Fuchs predicts a smaller technology such as Google's Internet-connected eyeglasses will do more to revolutionize medicine than the CAVE. Still, he says large displays are the best way today for people to interact and collaborate.

Believers include the people at Marshalltown, Iowa-based Mechdyne Corp., which has licensed the CAVE2 technology for three years and plans to market it to hospitals, the military and in the oil and gas industry, said Kurt Hoffmeister of Mechdyne.

In Chicago, researchers and graduate students are creating virtual scenarios for testing in the CAVE2. The Mars flyover is created from real NASA data. The brain tour is based on the layout of blood vessels in a real patient.

In this photo made Thursday, Jan. 24, 2013, in Chicago is the CAVE2 "wand." The wand and a pair of 3D glasses enables viewers inside CAVE's 72 stereoscopic liquid crystal display panels encircling the viewer 320 degrees, the ability to control movement in the 3D environment that can take you to the bridge of the Starship Enterprise, a flyover of the planet Mars, or through the blood vessels of the brain. (AP Photo/Charles Rex Arbogast) (Associated Press)

Brain surgeon Ali Alaraj remembered the first time he viewed the brain using the CAVE2.

"You can walk between the blood vessels," said the University of Illinois College of Medicine neurosurgeon. "You can look at the arteries from below. You can look at the arteries from the side. ... That was science fiction for me."

In his spare time during the past two years, research assistant Arthur Nishimoto has been programming the CAVE2 computer with the specifications for the fictional Starship Enterprise. He now can walk around his life-size recreation of the TV spacecraft.

In this photo taken Thursday, Jan. 24, 2013, in Chicago, University of Illinois-Chicago computer scientist Jason Leigh, co-inventor of the CAVE2 virtual reality system, stands in the CAVE2's doorway where the system's 72 stereoscopic liquid crystal display panels encircles the viewer 320 degrees and creates a 3D environment that can take you to the bridge of the Starship Enterprise, a flyover the planet Mars, or through the blood vessels of the brain. (AP Photo/Charles Rex Arbogast) (Associated Press)

The original technology, introduced in the early 1990s, was called CAVE, which stood for Cave Automatic Virtual Environment and also cleverly referred to Plato's cave, the philosopher's analogy about shadows and reality. It was named by former lab co-directors Tom DeFanti and Dan Sandin.

The second generation of the CAVE, invented by Leigh and his collaborator Andy Johnson, has higher resolution. The project was funded by the National Science Foundation and the Department of Energy.