An industry first in this release is our Apache Kafka - Apache Pulsar connector! You can try the sink
today —the source is work in progress.
As a leading streaming company, we, at Landoop, are commited to help you make the most out of your streams.

Datamountaineer and Stream Reactor Join Landoop!

We are happy to announce that Datamountaineer became part of Landoop.

We are excited to work together to create new products that will empower Kafka developers
and administrators. A platform is its users; Landoop’s mission is to help all Kafka
users get the most out of it.

Datamountaineer are authors of Stream Reactor, the largest collection of open source
Kafka connectors. We are commited to keep it that way and further improve it.

Kafka Connect UI 0.9.3 and Kafka 0.11.0.1 Upgrade

The newer Kafka Connect UI adds author and documentation support for connectors. Also this is the first tagged
release where you can name your clusters when using our docker image.
Kafka 0.11.0.1 is a bugfix release and a recommended upgrade.

Kafka Topics UI 0.9.3 Upgrade

The new version solves a couple bugs that will be most visible in the Reddit posts sample topic.
If you use the Kafka Topics UI docker image, new configuration options are available as well as
access logs and better support for k8s and rancher.

New JSON Dataset

We added a small subset of
BackBlaze's SMART dataset for Q1 2017. For this dataset we went with JSON as all our datasets up till now were in avro.
As usual, you can set the environment variable RUNNING_SAMPLEDATA=1 and these data
will keep coming (cycling over the same dataset).

Stream Reactor 0.3.0 for Kafka 0.11.0

We are proud for this release as well as for the 0.2.6 sister release which targets Kafka 0.10.2.
There are new connectors, like the FTP source connector, the ElasticSearch 5 sink conector
and the MQTT sink connector to complement the MQTT source whilst the existing connectors got even
better with improvements, fixes and KCQL 2. Some configuration options were renamed for consistency,
so check the docs and our kafka connector tests repository.

Confluent Platform OSS 3.3.0

We updated to CP 3.3.0 and Kafka 0.11.0.0. It is an exciting release with new features such as
exactly-once delivery and transactional messaging. A very nice (and needed) feature is plugin.path for Connect,
which permits libraries isolation between connectors. It comes though with a price: Connect needs a few minutes
in order to load all the libraries and start up.

New Datasets and Running Data

We added new data for you to play with: reddit posts and NYC yellow taxis trip data.
Even better, if you set the environment variable RUNNING_SAMPLEDATA=1 these data
will keep coming (cycling over the same datasets) at variable, low rates. We set the
retention size to 25MB per partition, so your docker disk won't get full. Enjoy!

Confluent Platform OSS 3.2.2

We updated to CP 3.2.2 and Kafka 0.10.2.1-cp2.

Kafka Bash Completion 0.1

We added our new project,
kafka-autocomplete
to fast-data-dev. What does this mean? Open a bash terminal inside the container:$ docker exec -it [ID|NAME] bash

Kafka Connect UI upgraded to 0.9.2

Listening to your feedback, we improved the real time validation engine to better suit your workflow.
Thank you for helping us adjust the UIs to real needs.

Kafka Topics UI upgraded to 0.9.1

This release switched to V2 APIs of Kafka REST so going forward we will only support CP3.2.x or greater.
What you get in return? Seeking in messages, partition view and more. Many smaller improvements are also included.

Schema Registry UI upgraded to 0.9.1

Bug fixes for Firefox and Safari and other enhancements.

Kafka Connect UI upgraded to 0.9.1

The upgraded version has many improvements, visual but also under the hood and fixes. Most important though, it supports
Connect 0.10.2.0. This means fast-data-dev:cp3.2 will soon get out of beta.

Logs accessible from browser

We made the various logs available through the web interface. You may find them
here.

Delete Topics Enabled

Now you can delete Kafka topics. Actually you should have been able from day one but somehow it eluded us.
Thanks @simplesteph for bringing to attention and providing a PR.

Stream Reactor 0.2.5

We updated Stream Reactor to 0.2.5. This release contains many fixes, new connectors and support for Kafka 0.10.2.0.

Sample Data

We added a topic with sample AIS messages (sea vessels position reports) which you can use to play. It is named position-reports and
you can find it here,
about one minute after fast-data-dev is spawned. We plan to add more topics for you to experiment with.

Kafka Topics UI upgraded to 0.8.3

We upgraded Kafka Topics UI to 0.8.3 which contains the new table view, as well as bug fixes, better handling of binary
key types and other enhancements.

Web server fixes for UIs

We got a couple reports about the UIs not working properly on some OSes (windows, fedora) and
certain setups. We made a change to the webserver (Caddy) configuration and instead of accessing
the REST endpoints at localhost, it will try to access them at 0.0.0.0.
Please if this setting causes you any trouble, don't hesitate to
open an issue.
Thanks @jischebeck for helping on this.

SSL support hit master

We added support for a SSL port for the broker that requires authentication. Upon startup,
fast-data-dev will create a CA and key-certificate pairs for kafka and clients. Learn how easy it is to
enable and use this feature!

JMX support added

We now enable JMX by default for the Kafka components and make it available at ports 9581-9584.
You can optionally disable it via -e DISABLE_JMX=1.

Kafka does not run as root anymore

This is important! Fast Data Dev’s behaviour changed. Kafka is now running by default
as user nobody instead of the superuser (root). If you need the old behaviour use -e RUN_AS_ROOT=1
on your docker command line.