Kafka

Apache Kafka is an open-source distributed stream processing platform that is designed to be fast, scalable, and durable, developed by the Apache Software Foundation. It works well in applications that build real-time streaming data pipelines to reliably retrieve data between applications and in building real-time streaming applications that transform streams of data. The Data Integration Platform provides support to publish and consume real-time messages in Apache Kafka.

Publish and consume

Read and write streams of data like a messaging system, and create bi-directional workflows with the Data Integration Platform.

Storage

Store streams of records in a fault-tolerant way in the Kafka messaging platform.

Process

Process streams of records as they occur with the help of the Data Integration Platform.

Security

The Data Integration Platform provides secure connectivity support with Kafka through SSL and SASL.