Objective

The FANCI near-market Innovation Action will research, innovate, architect, design, develop and validate innovative multimodal face and body analytics and natural computer interfaces (NCI), develop a reference platform fitting a variety of applications, and provide validation through user-experience evaluation and benchmarking in the rapidly expanding automotive field.The project will focus on intelligent user sensing methods, including face analysis, eye tracking, emotion, intention & authentication; hand gesture recognition; voice tone analysis; and head gesture & pose analysis. It will complement those with smart user intention or distraction estimation and system reaction methods, supplying visual (HUD, etc.), voice and haptic feedback as well as autonomous system actions.FANCI will deliver these capabilities in a market ready reference architecture, demonstrated by building a creative Automotive application-suite demonstrator. An Application Programming Interface for software application developers of pervasive natural computer interaction devices, will be supplied. The platform will empower embedded products that capture and act upon user intentions, and imaginative utility applications fusing real and virtual content.To achieve these goals FANCI will combine multi-modal sensor data in a hardware platform to enable robust operation in natural environments, sensing explicit, implicit, and emotional actions of the user in a simple, yet powerful extensible software architecture; provide a low cost, power optimised reference design for embedded products; and validate the approach by building an automotive application demonstrator.The FANCI’s partners include an effective mix of innovative pioneering SMEs, industry leaders and academic researchers, guided by a large industrial Automotive systems market leader. The project targets the call’s C focus action. It is planned for a 28-month duration, and is estimated to require total funding of around 2.5 M€.

Field of Science

/social sciences/economics and business/business and management/commerce

To achieve these goals FANCI combined multi-modal sensor data in a hardware platform to enable robust operation in natural environments, sensing explicit, implicit, and emotional actions of the user in a simple, yet powerful extensible software architecture; provided a low-cost, low-power optimised reference design for embedded products; and validated the approach by building an automotive application demonstrator. The project’s developed methods were integrated into the FANCI creative automotive applications on the partners’ universal reference platform, and validated for its user experience value as well as developer experience value.

The FANCI partners include an effective mix of innovative pioneering SMEs, industry leaders and academic researchers, guided by a large industrial Automotive systems market leader. The project, partially funded by the European Commission (EC), responded to the EC’s Horizon-2020 ICT-22-2014 call’s C focus action. It had a 28-month duration, and had a total budget of over 3.5 M€, of which the EC contributed a total funding of 2.5 M€, though in fact consumed 4.6 M€ with the difference covered by the project partners.The consortium led various dissemination and communication activities, spearheaded by the FANCI public website, and aided by the professional participation of its industrial partners’ in-house Marketing Communications specialists, leveraging social media (Twitter, LinkedIn, other) interaction and local TV and press exposure. The FANCI partners have also taken active leadership and participation roles in dissemination events, automotive and high-standard conferences and tradeshows such as CES-2017, a concertation event (ICT-2015), industry exhibitions, webinars and seminars.

The consortium’s publication activity yielded results in par with its Integration Action near-market orientation, with one Paper nominated as Best Industrial Paper at IEEE Sensors 2016. The standardisation and certification strategies activities related to formally establish acceptance and compliance of FANCI.

The project researched, innovated, architected, designed, developed and validated innovative multimodal face and body analytics and natural computer interfaces (NCI), developed a reference platform fitting a variety of applications, and provided validation through user-experience evaluation and benchmarking in the rapidly expanding automotive field.FANCI delivered a market-ready reference architecture, demonstrated by building a creative Automotive application-suite demonstrator. An Application Programming Interface for software application developers of pervasive natural computer interaction devices, was supplied. The platform empowers embedded products that capture and act upon user intentions, and imaginative utility applications fusing real and virtual content.Throughout the project, 20 deliverables were submitted as planned.The consortium led various dissemination and communication activities, spearheaded by the FANCI public website, and aided by the professional participation of its industrial partners’ in-house Marketing Communications specialists, leveraging social media (Twitter, LinkedIn, other) interaction and local TV and press exposure. The FANCI partners have also taken active leadership and participation roles in dissemination events, automotive and high-standard conferences and tradeshows such as CES-2017, a concertation event (ICT-2015), industry exhibitions, webinars and seminars. The consortium’s publication activity yielded results in par with its Integration Action near-market orientation, with one Paper nominated as Best Industrial Paper at IEEE Sensors 2016. The standardisation and certification strategies activities related to formally establish acceptance and compliance of FANCI.The project partners held face-to-face consortium meetings and technical integration workshops, as well as periodic conference calls, to ensure optimal synergy and collaboration. An online collaboration framework and document repository was set-up to further this purpose.

Expected potential impact:The multi-modality capabilities implemented at the core of the FANCI project will increased robustness and accuracy of biometrics and user state estimation. Combined with an always-on, low cost, and real-time platform, the platform will enable creation of new use cases not possible before. This will further strengthen the European business of the projects partners who each have either an OEM or licensing business model, supplying technology and services to other European companies. FANCI will have impact in several important domains, some of which are directly related to impacts expected by the call, including:● Expected Impact A: Enable better uses of ICT technologies within the creative industries by providing directly usable solutions addressing their specific needs● Expected Impact B: Provide a large spill over of the knowledge acquired to a maximum of European industries● Expected Impact C: Improve the competitive position of the European industries through the provision of cost effective, innovative and high-value products and services

The document will include the following information:
• A final publishable summary report
• A final plan for use and dissemination of foreground
• A report covering the wider societal implications of the project

A public web site will be set up. This web site will be the primary platform for the dissemination activities, including publishing information about the project goals, research, tasks and achievements. Will have intermediate updates to the web page including updates. A second update will include a Cloud API for some of the user sensing methods and third and last updates with project conclusion and final data and public deliverables.