Scalable Continuous Monitoring for Large scale A/B Experimentation @aicouncilconf
Scalable Continuous Monitoring for Large scale A/B Experimentation  @aicouncilconf
Uploaded May 2025 | Updated November 2026, 1 hour ago
[2025 - Day 1 - Data Science & Algos] Chenyu Qiu shares insights from building Uber's end-to-end continuous experiment monitoring platform, exploring how to overcome "peeking" problems and detect performance degradation across thousands of A/B experiments. This talk offers valuable perspectives on anytime-valid inference, eliminating noise while preserving true signals, and accelerating data-driven decisions at scale, crucial for teams scaling experimentation or implementing regression-adjusted estimators.

ABOUT THE SPEAKER:
Chenyu Qiu, Staff Scientist, Uber -

๐ŸŽŸ๏ธ GET YOUR TICKET TO AI COUNCIL 2026 ๐ŸŽŸ๏ธ
Meet the world's top AI infrastructure minds where architects of AI share what works. Three days of high-quality technical talks and meaningful interactions.

โ†’ aicouncil.com/sf-2026

โšก FIND US:
X: https://x.com/AICouncilConf
LinkedIn: linkedin.com/company/aicouncilconf
Website: aicouncil.com
Scalable Continuous Monitoring for Large scale A/B ExperimentationTrimming the Long Tail of Production Model Ownership at HingeAgents Break Data Security โ€” And Heres What You Do About It | SkyflowContext Engineering 2.0: Unifying MCP, Agentic RAG, and Memory | RedisBeyond the API: Modern Inference for Modern WorkloadsA SQL Based Metrics Layer for DuckDB and ClickHouseWhat does the whole orchestration and coordination layer look like from a tooling perspective?How a Netflix Side Project Became the Universal Standard for Data TablesThe Deconstructed Database at DatadogBuilding SOTA Search: Itโ€™s Ranking All the Way DownGoing Bayes: Shifting our Testing Methods to Reflect our PrioritiesThe Deconstructed Database and the Advent of the Open Data Lake
AI Council |

Scalable Continuous Monitoring for Large scale A/B Experimentation

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER