Log Compaction | Highlights in the Kafka and Stream Processing Community | November 2015

The Apache Kafka community just concluded its busiest month ever. As we are preparing for the upcoming release of Kafka 0.9.0.0, the community worked together to close a record number of bugs and added quite a few last-minute improvements to new features. Here’s a summary of some of the community highlights:

SASL/Kerberos-based authentication was added to Kafka and will be included in the 0.9.0.0 release

The new Kafka Consumer has a client-side partition-assignment support, allowing consumer groups to implement their own partition assignment strategy, in addition to those provided in Apache Kafka. You can read the very detailed design document or take a look at the patch.

Huge improvements on the Copycat export/import feature – Copycat now works in distributed mode and there is a nice REST API too.

This is the month of the Kafka Meetup! New Kafka meetups are popping up in cities all over the world including Seattle, Austin and London. I encourage you to attend if you happen to be in one of those cities.

Remember that the Kafka Summit “Call for Proposals” is open so make sure you get your entry in before the January 11, 2016 deadline. If you’re planning to attend and have ideas of sessions you’d like to see on the program tweet us @ConfluentInc #kafkasummit to let us know.

If you are interested in contributing to Apache Kafka, check out our contributor guide to help you get started.

Did you like this blog post? Share it now

Subscribe to the Confluent Blog

More Articles Like This

Static Membership is an enhancement to the current rebalance protocol that aims to reduce the downtime caused by excessive and unnecessary rebalances for general Apache Kafka® client implementations. This applies ...