Sensor Fusion Algorithm Development

The State-of-The-Art Data Fusion Development Framework for Automated Vehicles

BASELABS Create delivers fast sensor data fusion results with the intuitive data fusion designer. It is a prototyping software framework that is designed for the fast development of complex data fusion algorithms and environment models including 360 degree perception for level 1 to 5 autonomous vehicles. The framework can be used with all relevant middleware products like Vector vADASdeveloper, EB Assist ADTF, Robot Operating System (ROS), Simulink and others. BASELABS Create provides numerous features for the development of data fusion applications. More than support for the developer – BASELABS Create provides results.

Data fusion for level 1 to 5 autonomy

The modular Data Fusion Framework

BASELABS Create provides you with a structure for your data fusion application that is focused on scalability from Level 1 to Level 5 autonomy. You can start by focusing on a limited set of sensors and continue by adding more and more sensors over time. This is done within minutes by using the graphical user interface of the data fusion designer. There is no coding required - however the programmatic usage of the SDK is possible as well.

Data fusion for level 1 to 5 autonomy

Arbitrary sensors and data levels

BASELABS Create allows to combine information from arbitrary sensors like cameras, radars and lidars. The data from these sensors can be combined on different data levels, for example tracks from smart sensors, raw data or the result of a data preprocessing using artificial intelligence techniques such as deep learning. The result is a stable environment model with a unified output - regardless of the sensors or preprocessing you plug into the system.

Further benefits

Benefits for developers

With the data fusion designer, BASELABS Create provides an intuitive graphical interface that guides you through the design process and prompts for all relevant information like sensor parameters and characteristics. This allows an unmatched speed for the data fusion prototype development. Learn more about the data fusion designer

Change the configuration using the programmatic mode for fine-tuning and further development of your system

BASELABS Create is a powerful software development kit (SDK) for the development of data fusion algorithms. It provides a highly modular and extensible framework that allows to define custom models, e.g. to use specific sensor properties or behaviors. The framework is strong typed to prevent programming errors at its earliest stage. Learn more about the SDK

Master the challenges of data fusion

The more complex the system under development, the more demanding gets the implementation process. BASELABS Create supports the developer in tackling the challenges of data fusion. The framework handles the relevant data fusion challenges like overlapping and non-overlapping fields of view (also in different headings and the consistent tracking of multiple objects including the handover between sensors. In addition to the out-of-the box functionality, you can extend the framework with custom implementations, for example the handling of out-of-sequence measurements. Learn more about the challenges of data fusion

Further Benefits

Data fusion in the layer model

BASELABS Create closes the gap between middleware and driving function.

Image 1 of 1

BASELABS Create closes the gap between middleware and driving function and provides all relevant building blocks for data fusion algorithms. The middleware provides the infrastructure of the system like sensor interfaces to acquire sensor data. BASELABS Create complements the middleware with the data fusion functionality. Most relevant to demanding development projects like a highway-pilot is the scalable approach of BASELABS Create. Sensors can be added easily, while the output that is used by the driving functions stays the same.

Further Benefits

Extensive compatibility: middleware and hardware

Data fusion development with BASELABS Create while using the middleware and target platform of your choice.

Image 1 of 1

BASELABS Create is middleware-agnostic. That means that you can benefit from the advantages of data fusion development with BASELABS Create while using the middleware of your choice. The same applies to the prototyping platform that you use in your test vehicle. Besides using your development PC for running the data fusion, it can also be used on all relevant target platforms like the Nvidia DRIVE PX 2, dspace MicroAutobox, Renesas R-Car H3 and others. Runtime licenses are available for the usage in test fleets or in-the-loop setups.

Challenges of data fusion

The more complex the system under development, the more demanding gets the implementation process. BASELABS Create supports the developer in tackling the challenges of data fusion.

360° perception

BASELABS Create allows the implementation of sensor fusion applications with multiple sensors and overlapping as well as non-overlapping fields of view.

Image 1 of 1

Handover

Handover

The handover of objects from sensor to sensor is managed by BASELABS Create to ensure a consistent tracking of multiple objects.

Image 1 of 1

False Negatives

BASELABS Create handles false negatives - objects that are not detected by the sensor.

True Positives with Noise

Latency

BASELABS Create considers latency (object detections represent time in the past, due to delay caused by signal processing and transmission).

Image 1 of 1

User experience

Loading the player ...

BASELABS Create reduces the workload for the data fusion developer. As a user, you provide system information like the sensor (mounting position), model and sensor parameters (like the field of view and the detection rate as well as the false alarm rate). Existing models can be re-used as well. Then, you select different models with the GUI or via a programmatic call into the SDK. In most cases, the selection of a system model, a sensor measurement model and a sensor detection model is required. In addition, the selection of a track management strategy is necessary. With that information, BASELABS Create handles the 'calculation aspects' of the system: the sensor data fusion, the hand-over between sensors, all probabilistic calculations and the synchronization of the sensors.

User experience

Use the operating system of your choice

Windows and Linux

Windows and Linux

Image 1 of 1

Visual Studio

Visual Studio

Image 1 of 1

Mono Develop

Mono Develop

Image 1 of 1

You can use BASELABS Create either under Windows or under Linux. Under Windows, BASELABS Create is integrated into Microsoft Visual Studio and allows the development with the Data Fusion Designer as well as the programmatic usage of the SDK. Under Linux, BASELABS Create is used with Mono and allows the programmatic usage of the SDK.

User experience

Data fusion designer

Graphical configuration of data fusion systems.

Image 1 of 1

User experience

Domain Specific Data Fusion SDK

Modular Architecture

Modular Architecture

Image 1 of 1

Parameters

Parameters

Image 1 of 1

Inline formula documentation

Inline formula documentation

Image 1 of 1

Besides the graphical configuration with the Data Fusion Designer, BASELABS Create can be used as a software development kit (SDK) to access expert features and increase the implementation flexibility. The user can call numerous building blocks of a data fusion system from the SDK and configure the data fusion in a programmatic way.

User experience

User support

Excellent user support and rich documentation.

Image 1 of 1

Our customers work on demanding data fusion implementation projects with tight timelines. Good to know that BASELABS has a broad experience in project implementations for OEMs and Tier1s worldwide. Therefore, our customers experience outstanding support both from an application- as well as a data fusion theory-point of view.

"Just wanted to reach out to compliment the exceptional support we are getting as per the email thread below. Competent, in time and to the point. Again, this is excellent customer support in its purest form!" Lead development engineer, European OEM.

Releases

Product improvements, new software features and bug fixingBASELABS is working on permanent product improvements including new features or bug fixing. We inform our users about software updates and releases regularly.

BASELABS CREATE 4.2

Fixed: The Data Fusion Designer cannot be opened in Visual Studio 2013.

BASELABS CREATE 4.1

Fixed: Compiler error if project path contains symbols such as "#"

Fixed: Stability and consistency issues in the user interface of the data fusion designer

Fixed: Code generated by data fusion designer contains error when namespace and file name are identical