Smart Navigation Assistant

Claudia is about to start a road trip and initiates the interactive capabilities of the infotainment system. This procedure can be done “offline” as she gets inside the car and calls the virtual assistant of the car (HRMN), before starting the engine. Claudia is identified and authenticated (KL) when she sits on the driver’s side. At that point the eye gaze tracking module (TOB), the expression-monitoring module (NV), and the hand-tracking module (SKS) activate, load her specific configurations (UC1) and start tracking her. She tells to the assistant the destination of her journey and the virtual assistant is ready to go. The journey starts. During the journey, it could be possible that:

Claudia has a doubtful / worried / lost expression: The driver facing sensors track the driver’s facial expressions and eye movements to understand their underlying emotions. Specifically, the eye-tracking module (TOB) and the expression-monitoring module (NV) will report to the Central Unit (HRMN IVI system). From doubtful or puzzled expressions, the system can infer that the driver might need further or more detailed navigation instructions and help in order to reach her destination. The FANCI system will communicate this level of alarm to the virtual assistant (HRMN) which will trigger the navigation system to give more detailed vocal driving instructions. For example, it could be useful for the driver to have: a) more accurate locations of road intersections, b) more accurate numbers of kilometres to the next turn, c) suggested vehicle speed.

Claudia has a confident expression: The system keeps direction to a minimum, so not to interrupt the driver’s music and to let her enjoy the ride.

Directions only when the driver missed a sign: In another case, Claudia can specify the final destination but choose that the navigation system will not provide full turn by turn directions.. In this case the system monitors the driver’s eye gaze and the direction signs posted on the road, (leveraging an outward facing sensor), and provides direction instructions to the driver only when she fails to look at a relevant sign.

Horizon 2020 Innovation Framework Programme

The FANCI project is funded by the European Commission’s Horizon 2020 framework programme for research and innovation. Horizon 2020 flagship initiative aimed at securing Europe's global competitiveness. By coupling research and innovation, Horizon 2020 is helping to achieve this with its emphasis on excellent science, industrial leadership and tackling societal challenges.

This site uses cookies to improve the browser experience and to anonymously track website usage. For more information, please read our privacy policy.By continuing to browse this website you have understood and agreed to with our cookie policy.