Improving the Responsiveness of Internet Services with Automatic Cache Placement

Improving the Responsiveness of Internet Services with Automatic Cache Placement

The backends of today’s Internet services rely heavily on
caching at various layers both to provide faster service to
common requests and to reduce load on back-end components.
Cache placement is especially challenging given the
diversity of workloads handled by widely deployed Internet
services. This paper presents FLUXO, an analysis technique
that automatically optimizes cache placement. Our experiments
have shown that near-optimal cache placements vary
significantly based on input distribution.