They made Kafka 80% faster by switching file systems @hnasr
They made Kafka 80% faster by switching file systems  @hnasr
Uploaded April 2024 | Updated November 2026, 3 hours ago
Allegro improved their Kafka produce tail latency by over 80% when they switched from ext4 to xfs. What I enjoyed most about this article is the detailed analysis and tweaking the team made to ext4 before considering switching to xfs. This is a classic case of how a good tech blog looks like in my opinion.

0:00 Intro
0:30 Summary
2:35 How Kafka Works?
5:00 Producers Writes are Slow
7:10 Tracing Kafka Protocol
12:00 Tracing Kernel System Calls
16:00 Journaled File Systems
21:00 Improving ext4
26:00 Switching to XFS

Blog

https://blog.allegro.tech/2024/03/kafka-performance-analysis.html

Fundamentals of Operating Systems
https://oscourse.win

Discovering Backend Bottlenecks: Unlocking Peak Performance
performance.husseinnasser.com


Fundamentals of Backend Engineering Design patterns udemy course (link redirects to udemy with coupon)
backend.husseinnasser.com

Fundamentals of Networking for Effective Backends udemy course (link redirects to udemy with coupon)
network.husseinnasser.com

Fundamentals of Database Engineering udemy course (link redirects to udemy with coupon)
database.husseinnasser.com

Follow me on Medium
medium.com/@hnasr/membership


Introduction to NGINX (link redirects to udemy with coupon)
nginx.husseinnasser.com

Python on the Backend (link redirects to udemy with coupon)
python.husseinnasser.com

Become a Member on YouTube
youtube.com/channel/UC_ML5xP23TOWKUcc-oAE_Eg/join

Buy me a coffee if you liked this
buymeacoffee.com/hnasr

Arabic Software Engineering Channel
youtube.com/channel/UChWZsjdoRvZ0T9QWZOD6UpA

🔥 Members Only Content
youtube.com/playlist?list=UUMO_ML5xP23TOWKUcc-oAE_Eg



🏭 Backend Engineering Videos in Order
backend.husseinnasser.com

💾 Database Engineering Videos
youtube.com/playlist?list=PLQnljOFTspQXjD0HOzN7P2tgzu7scWpl2

🎙️Listen to the Backend Engineering Podcast
husseinnasser.com/podcast

Gears and tools used on the Channel (affiliates)

🖼️ Slides and Thumbnail Design
Canva
partner.canva.com/c/2766475/647168/10068


Stay Awesome,
Hussein
They made Kafka 80% faster by switching file systemsGraceful shutdown is needed to scale backendsSync or Async?h1 Graceful ShutdownSpin an HTTP/3 Reverse Proxy (using mitmproxy)WebTransport is a Game Changer ProtocolCopy on Write needs page faultsLocalhost in IPv4 vs IPv6Kernel TLS | The Backend Engineering ShowWhats after postgres 18?select count(*) is expensiveHow a query optimization gave birth to Infinite scroll
Hussein Nasser |

They made Kafka 80% faster by switching file systems

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER