Uploaded November 2025 | Updated September 2026, 3 weeks ago
An Open Source Distributed Rate-limiting Service for Ceph-object and Other HTTP APIs - Jacques Heunis, Bloomberg
Join me to learn how real-world demands pushed us to transform Bloomberg’s internal S3 rate-limiting system from a simple IP-based throttle into a flexible open source framework for managing per-user resource usage for S3 and other HTTP APIs.
We’ll explore how our initial design, which was built around easily-customizable scripts, enabled us to grow from basic request limiting into a comprehensive, protocol-aware system. Today, it handles advanced use cases like cluster-wide dynamic bandwidth control, targeted limiting of expensive S3 operations, and support for Squid’s new STS keys. The result is a self-contained, adaptable system that will let operators apply precise usage limits along any axis that matters. It has been battle-tested in production and is ready to use today!
An Open Source Distributed Rate-limiting Service for Ceph-object and Other HTTP APIs - Jacques Heunis, Bloomberg
Join me to learn how real-world demands pushed us to transform Bloomberg’s internal S3 rate-limiting system from a simple IP-based throttle into a flexible open source framework for managing per-user resource usage for S3 and other HTTP APIs.
We’ll explore how our initial design, which was built around easily-customizable scripts, enabled us to grow from basic request limiting into a comprehensive, protocol-aware system. Today, it handles advanced use cases like cluster-wide dynamic bandwidth control, targeted limiting of expensive S3 operations, and support for Squid’s new STS keys. The result is a self-contained, adaptable system that will let operators apply precise usage limits along any axis that matters. It has been battle-tested in production and is ready to use today!
