SmyteDB: Poor Man's Distributed Database Built with Kafka and RocksDB

Description

Smyte is building a fraud and spam detection platform that analyzes all of the traffic running through busy consumer websites and mobile apps. In this talk I'm going to describe how we build our own distributed database, SmyteDB, by integrating Kafka with RocksDB. In our design, Kafka enables us to support database replication and linearization without reinventing distributed primitives. Meanwhile, RocksDB's unique data model allows us to customize the storage layer for a wide variety of operations such as counting and list membership.