Your Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAP @aiDotEngineer
Your Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAP  @aiDotEngineer
Uploaded November 2026 | Updated November 2026, 5 days ago
Coding agents fan out, retry and burst, and if they hit an LLM you host yourself, your inference layer will happily accept every request and bury the ones you needed first. Harshul Jain and Parv Khatri make the case for admission control: deciding what to refuse before it reaches the GPU. Drawing on a review of 55 systems papers and eight real production incidents, they share five questions to ask any admission policy before you deploy it, and a checklist you can use right away.

Harshul Jain, Audible: https://x.com/hj1393 | audible.com
Parv Khatri, SAP: sap.com
Your Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAPInside Arcas Long-Horizon Agents That Run the Business - Aman Singh, ArcaHow We Mapped a 35-Million-Line Mainframe in 4 Days - Stephen Chin, Neo4j & Neeraj Deshmukh, BlitzyEvals for High-Stakes AI Agents — Doneyli De Jesus & Annabell Schäfer, LangfuseAgents Made Code Free. Maintaining It Didnt Get Cheaper. - Dmitry Buykin, MaerskPlease… Enough with the Sloppy, One-Shot SaaS Replacements — Mahmoud Abdelwahab, RailwayHow OpenAI Built ChatGPT for Bankers and Analysts — Joseph Kim, OpenAIWithout Caching, Your AI Agent Costs 10x More - George Cameron, Artificial AnalysisYour AI Agent Is Hiding Its Mistakes From You - Ben Holmes, WarpYou Cant Tell Whats Real Anymore. Heres What Comes Next - Cristóbal Valenzuela, RunwayTeach Your Agent to Prove Its Done — Nick Nisi & Zack Proser, WorkOSScheduled Agents, Dreaming and Q&A: Claude Managed Agents (Part 3 of 4) — Anthropic
AI Engineer |

Your Self-Hosted LLM Needs to Say No - Harshul Jain & Parv Khatri, Audible & SAP

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER