In the Land of the Sizing, the One-Partition Kafka Topic is King by Ricardo Ferreira @StrangeLoopConf
In the Land of the Sizing, the One-Partition Kafka Topic is King by Ricardo Ferreira  @StrangeLoopConf
Uploaded October 2022 | Updated November 2026, 6 days ago
Every technology has that key concept that people struggle to understand. With databases, is which join to use for fetching data from multiple tables. With containers, is which storage type to use depending on the workload. With Apache Kafka, the absolute winner is how many partitions to set for a topic. Sizing the number of partitions correctly is a hot topic for Kafka practitioners since doing it wrong affects other aspects of the system, such as consistency, concurrency, and durability. Worse, it also affects how much load Kafka can handle. This talk will peel off the concept of partitions and, using a what-if presentation style, explain what happens with the other aspects of the system given a number. It will highlight the consequences of poor decisions and whether you will be able to recover from them.

Ricardo Ferreira
Senior Developer Advocate
@riferrei

Ricardo is Senior Developer Advocate at AWS, working in the developer relations team for North America. With +20 years of experience, he may have learned a thing or two about distributed systems, messaging, fast data analytics, databases, and observability. Before AWS, he worked for software vendors like Elastic, Confluent, and Oracle. Ricardo is well known for his remarkable ability to explain complex topics. He cunningly breaks them down into bite-sized pieces until anyone can understand. While not working, he loves barbecuing in his backyard with his family and friends, where he finally gets the chance to talk about anything unrelated to computers. He currently lives in North Carolina, USA, with his wife and son. Follow Ricardo on Twitter: @riferrei

------ Sponsored by: ------

Stream is the # 1 Chat API for custom messaging apps. Activate your free 30-day trial to explore Stream Chat. gstrm.io/tsl
In the Land of the Sizing, the One-Partition Kafka Topic is King by Ricardo FerreiraHedy: A Gradual programming language by Felienne Hermans (Strange Loop 2022)Diagrammar: Simply Make Interactive Diagrams by Pontus Granström (Strange Loop 2022)Didnt Chrome Already Have a Root Store? by David Adrian (Strange Loop 2023)Functional Composition by Chris Ford (2013)Of JavaScript Ahead-Of-Time Compilation Performance by Manuel Serrano (Strange Loop 2022)Fight AI Bias With… Bias by Noble Ackerson (Strange Loop 2022)Programmable Ink by Szymon Kaliski (Strange Loop 2022)Katie Stolee: To search or not to search: it depends on the questionUnmasking the Godfather - Reverse Engineering the Latest Android Banking Trojan by Laurie KirkRemote Workstations for Discerning Artists by Michelle BrennerNoether: Symmetry in Programming Language Design by Daira Hopwood (2013)
Strange Loop Conference |

"In the Land of the Sizing, the One-Partition Kafka Topic is King" by Ricardo Ferreira

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER