Kafka at Scale in Cloud

Kafka Summit 2016 | Operations Track

Speaker

Allen Wang, Senior Software Engineer, Netflix

Description:

Netflix changed its data pipeline architecture recently to use Kafka as the gateway for data collection for all applications which processes hundreds of billions of messages daily. This session will discuss the motivation of moving to Kafka, the architecture and improvements we have added to make Kafka work in AWS. We will also share the lessons learned and future plans.