Beyond the API: Modern Inference for Modern Workloads @aicouncilconf
Beyond the API: Modern Inference for Modern Workloads  @aicouncilconf
Uploaded June 2026 | Updated November 2026, 1 hour ago
[2026 - Day 2 - KEYNOTE] Practitioners from the companies at the frontier of inference and model development sit down to unpack what application developers need to understand right now: why fine-tuning is quietly resurging under the name "RL," how smart teams are compressing inference costs by shaping smaller specialized models, who owns the model routing problem, and why inference capacity is structurally behind demand β€” possibly for years.

PANELISTS:
Tuomas Rintamaki - Research Scientist, NVIDIA
Charles Zedlewski - Chief Product Officer, Together AI
Charles Frye - Member of Technical Staff, Modal
Bryan Bischof - Head of AI, Theory Ventures (Moderator)

πŸ‘‰ Sign up for our "No BS" Newsletter to get the latest technical data & AI content: aicouncil.com/newsletter

ABOUT AI COUNCIL:
AI Council brings together the brightest minds in data to share industry knowledge, technical architectures and best practices in building cutting edge data & AI systems and tools.

FIND US:
Website: aicouncil.com
LinkedIn: linkedin.com/company/aicouncilconf
X: https://x.com/aicouncilconf
Beyond the API: Modern Inference for Modern WorkloadsA SQL Based Metrics Layer for DuckDB and ClickHouseWhat does the whole orchestration and coordination layer look like from a tooling perspective?How a Netflix Side Project Became the Universal Standard for Data TablesThe Deconstructed Database at DatadogBuilding SOTA Search: It’s Ranking All the Way DownGoing Bayes: Shifting our Testing Methods to Reflect our PrioritiesThe Deconstructed Database and the Advent of the Open Data LakeThe Future of Data Engineering in the Agent EraBuilding Blocks: Advanced Semantic Data Model LayeringHow we made Trail of Bits AI-Native (so far) | Trail of BitsEvals 101: Intro to Evals for Engineers | Braintrust
AI Council |

Beyond the API: Modern Inference for Modern Workloads

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER