Votes

0

Fans

4

Jobs

0

Votes

3

Hacker News, Reddit, Stack Overflow Stats

GitHub Stats

Description

What is
Kafka?

Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system, but with a unique design.

What is
Kestrel?

Kestrel is based on Blaine Cook's "starling" simple, distributed message queue, with added features and bulletproofing, as well as the scalability offered by actors and the JVM.

What is
RSMQ?

tl;dr: If you run a Redis server and currently use Amazon SQS or a similar message queue you might as well use this fast little replacement. Using a shared Redis server multiple Node.js processes can send / receive messages.

Want advice about which of these to choose?Ask the StackShare community!

Reviews of Kafka, Kestrel, and RSMQ

How developers use Kafka vs Kestrel vs RSMQ

Front-end messages are logged to Kafka by our API and application servers. We have batch processing (on the middle-left) and real-time processing (on the middle-right) pipelines to process the experiment data. For batch processing, after daily raw log get to s3, we start our nightly experiment workflow to figure out experiment users groups and experiment metrics. We use our in-house workflow management system Pinball to manage the dependencies of all these MapReduce jobs.