Streaming Attention Approximation via Discrepancy Theory @GoogleTechTalks
Streaming Attention Approximation via Discrepancy Theory  @GoogleTechTalks
Uploaded October 2025 | Updated November 2026, 12 hours ago
A Google TechTalk, presented by Ekaterina Kochetkova, 2025-10-23
ABSTRACT: The memory requirements of LLM inference grow rapidly with the context length due to the demands of attention computation. We present BalanceKV - an algorithm that leverages the geometric properties of the key-value cache to compress it without significantly affecting the quality of attention computation. BalanceKV has strong theoretical guarantees grounded in discrepancy theory and demonstrates empirically validated performance improvements over existing methods. The full paper is available at arXiv:2502.07861.

About the Speaker: Ekaterina Kochetkova is a third year CS PhD student at EPFL working with Michael Kapralov. She is broadly interested in applying theoretical insights to develop efficient algorithms for large-scale machine learning. Her recent work focuses on optimizing the memory/runtime of LLM inference and on sublinear graph clustering methods that utilize learned vertex features. More information is available at ekaterina-kochetkova.github.io/e_kochetkova.github.io/.
Streaming Attention Approximation via Discrepancy TheoryDifferentially Private Diffusion Models Generate Useful Synthetic ImagesDifferentially Private Diffusion ModelsNASA CARA - Air Traffic Control in SpaaaaaaaaceWorst-Case Membership Inference of Language ModelsStable Estimators for Fast Private Statistics2022 Blockly Developers Summit: Contributing to BlocklyCharles Hoskinson | CEO of Input Output Global | web3 talks | Apr 4th 2024 | MC: Marlon Ruiz2022 Blockly Developers Summit: Backwards ExecutionPrivacy Amplification for Correlated-Noise Mechanisms via b-Min-Sep SubsamplingCan LLMs Keep a Secret? Testing Privacy Implications of Language ModelsPrivate Adaptations of Large Language Models
Google TechTalks |

Streaming Attention Approximation via Discrepancy Theory

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER