Controlling a flying robot with only the mind

Could help people who are paralyzed or have neurodegenerative diseases

June 7, 2013

A remote controlled helicopter has been flown through a series of hoops around a college gymnasium in Minnesota (credit: University of Minnesota)

Researchers in the University of Minnesota’s College of Science and Engineering have developed a new noninvasive system that allows people to control a flying robot using a brain-computer interface.

The study has the potential to help people who are paralyzed or have neurodegenerative diseases.

The open access study was published in IOP Publishing’s Journal of Neural Engineering.

Five subjects (three female and two male) who took part in the study were each able to successfully control the four-blade flying robot, also known as a quadcopter, quickly and accurately for a sustained amount of time.

“Our study shows that for the first time, humans are able to control the flight of flying robots using just their thoughts sensed from a noninvasive skull cap,” said Bin He, lead author of the study and biomedical engineering professor in the University of Minnesota’s College of Science and Engineering.

He said this research is intended to help people who are paralyzed or have neurodegenerative diseases regain mobility and independence by controlling wheelchairs, artificial limbs, or other devices.

The researchers said the brain-computer interface system works based on the geography of the motor cortex — the area of the cerebrum that governs movement. When we move, or think about a movement, neurons in the motor cortex produce tiny electric currents. Thinking about a different movement activates a new assortment of neurons.

Sorting out these assortments laid the groundwork for the brain-computer interface used by the University of Minnesota researchers, He said. This new study builds upon previous research at He’s lab where subjects were able to control a virtual helicopter on a computer screen.

“We were the first to use both functional MRI and EEG imaging to map where in the brain neurons are activated when you imagine movements,” He said. “So now we know where the signals will come from.”

During the study, the subjects involved faced away from the quadcopter and were asked to imagine using their right hand, left hand, and both hands together. This would instruct the quadcopter to turn right, left, lift, and then fall, respectively. The quadcopter was driven with a pre-set forward motion and controlled only by subjects’ thoughts.

The subjects were positioned in front of a screen that relayed images of the quadcopter’s flight through an on-board camera. Brain signals were recorded by the cap and sent to the quadcopter over Wi-Fi.

After several training sessions, the subjects were required to fly the quadcopter through two large rings suspended from a gymnasium ceiling. A number of statistical tests were used to calculate how each one performed. A group of subjects also directed the quadcopter with a keyboard in a control experiment allowing for a comparison between a standardized method and brain control.

“Our next step is to use the mapping and engineering technology we’ve developed to help disabled patients interact with the world,” He said. “It may even help patients with conditions like autism or Alzheimer’s disease or help stroke victims recover. We’re now studying some stroke patients to see if it’ll help rewire brain circuits to bypass damaged areas.”

The University of Minnesota study was primarily funded by the National Science Foundation (NSF).

What the disabled can do with this is good but represents only a small market for this technology. I want to be able to moves stuff with my mind. Who doesn’t? Every kid has dreamed of this.

They should just market it as a toy for the coming Christmas shopping cycle. You get one good telly advert showing how easy it is to do and how much fun it is and everybody has to have one. Then others will think up similar things to do with it. Toy-makers can lead the way on this.

You put a wee camera on it and make an app to hook up with Google Glass and you’re styling like someone in a Greg Egan novel- right now.

That’s great. Soldiers don’t have to worry so much about IEDs, land minds and such. If totally incapacitated, they can continue back to killing by flying drones with their minds. Forget about all that other stuff they might want to do, as long as they can keep killing.

By the way, could they drive a car by thinking about moving the steering wheel etc.?

Okay _this_ is cool. Wheelchairs, etc. BUT also, say, position adjustments of hospital beds and ergonomic seats for the severely disabled; imagine not having the hospital staff having to guess how to make those adjustments, the patient could do it for themselves?