Category: latency

Ring Buffer – a Data Structure Behind Disruptor

Disruptor is a high-performance library for passing messages between threads, developed and open sourced some years ago by LMAX Exchange company. They created this piece of software to handle an enormous traffic (more than 6 million TPS) in their retail financial trading platform. In 2010 they surprised everyone how fast their system can be by…

Tail-Tolerance by Google

Recently, I have read an interesting paper entitled “The Tail at Scale” written by two experts from Google: Jeff Dean and Luiz Barroso. The authors defined what the latency tail-tolerant system is and how to implement it. Tail Latency What is Tail Latency? In the paper, the authors provide an example of the system where…