HMI and web innovation / BNZ / EmotionScan

The Bank of New Zealand wanted to help people understand their strengths and weaknesses with money. But most of us struggle to be honest with ourselves about money problems, let alone a bank manager. So we created EmotionScan – an online tool that uses state-of-the-art emotion recognition technology to help people discover their own subconscious feelings about money in private.

Online film
We explained the psychology and technology behind the project in an online film, and encouraged people to try it for themselves.

EmotionScan online experience
Using advanced facial mapping and artificial intelligence, EmotionScan tracks and analyses your microexpressions through your webcam, as you’re faced with various money scenarios. Evocative sound effects, imagery and narration were carefully crafted and personalised to your situation to help you to visualise yourself in each scenario.

Audio track sample
Take a listen to one of the Voice Over and soundscape tracks we recorded with Peter Elliot which played during the experience.

Your results reveal the emotions you expressed second-by-second during your EmotionScan. You can replay each scenario and see a summary of the financial areas that made you most uncomfortable. If you feel like you want help, a one-to-one MoneyReview with the bank is just a click away.

EmotionScan interactive outdoor
This fully integrated campaign included an interactive outdoor Adshel in downtown Auckland, where the public could test out the technology for themselves and print out an emotion snapshot. This printout drove them online to try the full EmotionScan experience.

Results
EmotionScan has introduced a new approach to banking where technology helps people understand more about themselves, so they can be better with money.
Over 200,000 people took part in an EmotionScan experience - that's 6% of New Zealand adults.
And as a result, New Zealanders are now 15% more confident that BNZ is the bank to help them be good with money.

The EmotionScan campaign has won numerous local and international awards, including Axis, Caples and NZDMAs. It was also included in Contagious Magazine's Trend Seminar at Cannes Lions Festival, 2014 and featured on BBC World Service 'Click' (Tech News Podcast), 2014