Feeling glum, happy, aroused? New technology can detect your mood

By Kieron Monks, for CNN

Updated 1448 GMT (2248 HKT) February 6, 2014

Chat with us in Facebook Messenger. Find out what's happening in the world as it unfolds.

Photos:

Computing your mood – New tech that senses how you're feeling inside: is it the key to self-knowledge and the future of communication? Or just the return of the phony "mood ring"? Check out our gallery of the top mood-sensing technology in development.

Hide Caption

1 of 12

Photos:

Computing your mood – Sensoree have coined a new word to explain why they invented the "Mood Sweater." It's all about extimacy -- that's "externalized intimacy," apparently. Two sensors on the wearer's palms measure changes in electrical conductance, and a light collar glows in different hues to communicate their emotional state. Sensoree sound pretty confident in their design: the sweater even "replaces speaking," they say, "as the wearer's truths are instantly expressed with color." Pre-order it now and you'll never have to speak again!

Hide Caption

2 of 12

Photos:

Computing your mood – This concept dress called Bubelle by Philip's Design interacts with and predicts the wearer's emotional state by changing colors. A beautiful white can turn into a relaxed blue. Philip's dresses are made from high-tech materials and are still in the concept phase.

Hide Caption

3 of 12

Photos:

Computing your mood – Dutch design collective Studio Roosegaarde have developed a sensual dress called Intimacy 2.0 together with designer Anouk Wipprecht. Made of leather and smart e-foils, it 'explores the relationship between technology and intimacy'. The high-tech panels are stimulated by the heartbeat of the wearer. Initially opaque or white, they become increasingly transparent when exposed to an electric current -- in this case a beating heart.

Hide Caption

4 of 12

Photos:

Computing your mood – Ever wonder if someone is flirting with you? With the Blinklifieryou wont. The device -- created by designers Tricia Flanagan and Katia Vega -- monitors eye muscle contractions using fake eyelashes. It sends these signals to an array of lights housed in a piece of headwear (via lines of conductive eyeliner) and can turn every wink or batted eyelash into an elaborate light-show. Or make you look like an illuminated Christmas tree...

Hide Caption

5 of 12

Photos:

Computing your mood – The world was amazed and offended (and slightly creeped-out) when Microsoft announced a bra that tracks a woman's emotional state to combat overeating. The smart bra sends a signal to the wearer's smartphone when it identifies a trigger for binge eating, such as discomfort or stress. Microsoft say it wont be coming out any time soon.

Hide Caption

6 of 12

Photos:

Computing your mood – Feeling healthy? Have a tattoo tell you whether it's all going well on the inside. That is the idea behind UC San Diego's Biosensor Tattoo: the tiny temporary tattoo monitors the pH levels and lactate content in a wearer's sweat to assess the metabolic health of a patient. It's supposed to help athletes know if they're overdoing it, and whether their stamina is improving with exercise. But will it come in sailing anchor and "I (heart) mum" versions?

Hide Caption

7 of 12

Photos:

Computing your mood – Developers Phyode say the W/Me wristband is a "revolutionary product" which uses a "Life Spectrum Analyzer" to detect your body's "harmonic frequency." Err, what? In short, it measures signals from the part of your nervous system that controls heart rate and pupil dilation (among other things) to tell you if your body is showing signs of excitable, passive, anxious or pessimistic thoughts. It smashed its $100,000 Kickstarter target last summer, and is now on sale to the public for $170.

Hide Caption

8 of 12

Photos:

Computing your mood – Potentially, your mood could even be used to create something on the fly...like a delicious personalized drink! The DareDroid is a concept biomechanic cocktail making dress that uses medical technology, customized hardware and human temperament to create a freshly made cocktail. The human host and robotic dress work together to provide you with a cocktail in exchange for a game of "Truth or Dare".

Hide Caption

9 of 12

Photos:

Computing your mood – All these intrusive sensors creeping you out?Affdex, from Affectiva, claims to be able to tell how you're feeling just by looking at you. Drawing on a database of over a billion facial expressions, it uses cameras paired with complex algorithms to recognize basic emotions on people's faces. It's now being used to tell big businesses like Pepsi if you're turning your nose up at their latest campaign.

Hide Caption

10 of 12

Photos:

Computing your mood – Having an extra way to understand others' emotions -- or even your own -- can enhance comprehension levels for everyone, but especially for people with autism spectrum disorder. Emotient'sFacet software includes games that monitor the user's reactions and "can help children with autism recognize other people's emotions through facial expressions as well as express their own feelings," says Marian Bartlett, lead scientist at Emotient.

Hide Caption

11 of 12

Photos:

Computing your mood – The goal for many developers is to make tech as "empathetic" as another human being. The AutoEmotive initiative at MIT's Media Lab aims to prevent accidents with a multi-sensor-equipped Audi. The car's cameras and electrical sensors would watch for stress, distraction or tiredness and adjust lighting, music and even the car's color to increase the driver's awareness.

Hide Caption

12 of 12

Story highlights

Explore the fast-developing world of technology that can read your mood

Cameras and electronic sensors can provide information on a person's state of mind

It opens up the possibility of communicating emotions we don't even realize we have

Advertisers, medical researchers and teachers are all interested in the tech

A long distance drive can be lonely with only a radio for company, and if the driver is stressed or tired it becomes dangerous.

A car that could understand those feelings might prevent an accident, using emotional data to flag warning signs. Sensors could nest in the steering wheel and door handles to pick up electric signals from the skin. Meanwhile a camera mounted on the windshield could analyze facial expressions.

Alternatively, if the driver exhibits stress, the vehicle's coordinated sensors could soften the light and music, or broaden the headlight beams to compensate for loss of vision. A distressed state could be broadcast as a warning to other motorists by changing the color of the vehicle's conductive paint.

This empathic vehicle is the goal of AutoEmotive, a research project from the Affective Computing group at MIT's media lab, who are focused on exploring the potential of emotional connections with machines. 'AutoEmotive' is their latest and most integrated project, following successful efforts to make interfaces of everything from bras to mirrors.

Researchers believe the concept is destined for the mainstream, and have fielded interest from manufacturers. "We have already tested most of these sensors", says Javier Rivera, MIT researcher and project leader. "The hardware required could easily be built into cars. Most cars have cameras anyway; you just have more to capture the physiology. It could be done unobtrusively."

But we don't have to wait for emotion sensors. They are flooding into a new market, using a growing range of mood metrics to suit diverse applications. Voice recognition app Beyond Verbal can tell you if you flirt too much in just 20 seconds. A sweater that detects skin stimulation to color code your feelings is available for pre-order.

The fastest-developing method is facial recognition, led by Affectiva, a start-up that spun off from MIT's Affective Computing group three years ago. In that time, the company has amassed a database of over a billion facial expressions, which it uses to train algorithms to recognize and classify basic emotions such as happiness or anger, with over 90% accuracy.

JUST WATCHED

How iris recognition 'reads' your eyes

MUST WATCH

JUST WATCHED

'Electronic sketch artist' fights crime

MUST WATCH

'Electronic sketch artist' fights crime02:01

Their flagship technology, Affdex, has been swiftly adopted by advertisers, who use it to test reactions to their campaigns, and modify them accordingly. Market research partners Millward Brown have standardized its use for Fortune 500 clients including PepsiCo and Unilever.

"In the past this technology was confined to laboratories because of high cost and slow turnaround," explains Nick Langeveld, Chief Executive Officer of Affectiva. "We've cracked those issues; the cost is very low as the service is over the web, and it can be turned around almost immediately after the data is collected."

Competitor Emotient also specializes in face recognition, but its primary target is the retail sector. Their software is on trial in stores, pinpointing 44 facial movements to monitor emotional reactions of staff and shoppers, as well as demographic information including age and gender. From customer satisfaction to employee morale, the benefits to business are obvious, and Emotient claim major retail partners plan to make the system permanent.

It is also time to bring these tools into clinical practice, believes Dr. Erik Viirre, a San Diego neurophysiologist. "While so many medications list suicide risk as a possible side effect I think we have to use biosensors, and there is a big push within psychiatry to bring them in. Thought disorders could be picked up much quicker and used to determine treatment."

Viirre has studied headaches extensively and found that contributing factors build up days before they strike, including mood. He argues a multi-sensor approach combining brain scans, genetic tests and emotion sensing could dramatically improve treatment.

But emotion sensors are currently limited in their capacity to differentiate nuanced expression, says Tadas Baltrušaitis of the University of Cambridge Computer Laboratory, who has published research on the subject.

"It is easy to train a computer to recognize basic emotions, such as fear or anger. It is more difficult to recognize more complex emotional states, that might also be culturally dependent, such as confusion, interest and concentration."

But there is scope for rapid progress: "The field is relatively new, and only recently has it been possible to recognize emotions in real world environments with a degree of accuracy. The approaches are getting better every year, leading to more subtle expressions being recognizable by machines."

Baltrušaitis adds that combined sensors -- as with 'AutoEmotive' -- that pick up signals from skin, pulse, face, voice and more, could be key to progress.

Buyers beware

In this post-NSA climate, companies are keen to head off privacy concerns. Affectiva and Emotient are vehement that all their data has been gathered with permission from the subjects, while the latter defend their use of recognition software in stores by saying it does not record personal details.

But the technology is prone to abuse, according to futurist and information systems expert Chris Dancy. "I think variations are already being used in places like airports and we would never know", he says. "I can't imagine a system to take value readings of my mind for a remote company being used for good. It's a dark path."

Ironically, Dancy -- a leading proponent of the Quantified Self movement -- is pursuing many of the same insights into emotion as advertisers, but by alternative means and for personal goals. He keeps himself connected to sensors measuring pulse, REM sleep, blood sugar and more, which he cross-references against environmental input to see how the two correlate, using the results to give him understanding and influence over his mind state.

JUST WATCHED

Inventing the 3-D motion sensor

MUST WATCH

JUST WATCHED

How to hack an iPhone fingerprint sensor

MUST WATCH

How to hack an iPhone fingerprint sensor03:25

'Moodhacking' has become a popular practice among the technologically curious, and has given rise to successful applications. Members of London's Quantified Self Chapter created tools such as Mood Scope and Mappiness that help the user match their mental state to external events. Hackers and makers will have an even more powerful tool in March, when the crowd-funded OpenBCI device makes EEG brainwaves available to anyone with a computer for a bargain price.

For all the grassroots hostility towards corporate use of emotion sensors, there may be convergence. Affectiva are keen to market to Quantified Self demographics and an Affdex app for android is imminent. As the machine learning develops, and different industries combine to join the dots, we can all expect to be sharing a lot more.