BABL

GROUP PROJECT WITH Allison hwang, eunjung paik & ashlesha dhotey

PROJECT DURATION: 4 months

MY ROLE: AR Prototyping, interaction design, user study facilitation

LANGUAGE/SW USED: unity, Microsoft visual studio, AFTER EFFECTS

babl is a mixed reality language learning platform

designed for Head-mounted displays

Why is the second language so hard to learn? Why school only teaches expressions that native speakers don't use?BABL started with a bold idea - Could the learners experience a real live language through local people's life?

TRUST-BASED lANGUAGE LEARNING NETWORK

BABL is a social language learning platform grown by participants; the more people join the network, the more language contents is created.The system help learners find the right host based on their interests, motivations and profiles.

TOUR MODE - mixed reality as Shared reality

Tour mode is an immersive live tour hosted by one's local partner. Learners will see, hear and feel how local people live.With mixed reality technology, we envision that BABL can bridge between learners and local people and start the meaningful relationship.Through the shared reality, learners can get immersed into the new environment and eventually integrate themselves with the target culture.

PRACTICE mode - capture & embody LIVE LANGUAGE

Practice mode provides a safe space for learners to practice spoken language with captured moments from the tour mode. Learners can control the speed, toggle the caption and get live feedback from the system.They can also annotate and put it into the captured scene with the connected screen device.

GESTURE INTERACTIONS

Once getting into the mixed reality mode, learners and hosts interact with the system with gaze, gesture and voice. BABL supports immersive and easy learning experience with the combinations of gestures.

Swipe to open and close the toolbox panelReveal left to right for right-handed users and right to left for left-handed users

Gaze to target an icon & freeze the viewPinch and drag to doodle/pin on the field of view and release pinch to finish