How Open Source Became AIs Backbone | Inferact with a16z @a16z
How Open Source Became AIs Backbone | Inferact with a16z  @a16z
Uploaded August 2026 | Updated November 2026, 3 days ago
Elena Burger and Matt Bornstein are joined by Simon Mo, co-founder and CEO of Inferact, the open-source inference engine powering many of today's most advanced AI applications. Together, they explore how open-source AI evolved from a research project into critical infrastructure, why inference has become one of the most important layers of the AI stack, and what it takes to bring frontier intelligence to developers around the world.

The conversation covers vLLM's origins, the rise of open-weight models, why companies increasingly want control over their AI infrastructure, and how open-source inference enables the next generation of AI applications. They also discuss model licensing, the economics of open-weight AI, Kimi K3, distillation, AI infrastructure, and why Simon believes the gap between open and closed models is rapidly disappearing.

Timestamps:
00:00 - Intro
01:00 - What Is vLLM & Why Serving LLMs Is a Fundamentally Different Problem
05:10 - When Open Source Became Critical Infrastructure
08:26 - Where vLLM Sits in the Stack
13:35 - The Open Weights Letter & Why Open AI Development Must Be Protected
16:42 - K3 Economics: Bridging the Gap Between Open & Proprietary
19:57 - Licensing Evolution: From Apache 2 to Commercial Terms
28:51 - Why Open Source Inference Is the Only Way to Scale Agents
32:21 - The Hugging Face Incident & Why Guardrails Break Down
36:57 - Building a Company from an Open Source Project
43:32 - The Distillation Debate: Is It Critical or Incidental?

Resources:
Follow Simon Mo on X: https://x.com/simon_mo_
Follow Matt Bornstein on X: https://x.com/BornsteinMatt
Follow Elena Burger on X: https://x.com/VirtualElena
Follow Inferact: https://x.com/inferact

Stay Updated:
If you enjoyed this episode, be sure to like, subscribe, and share with your friends!

Find a16z on X: twitter.com/a16z

Find a16z on LinkedIn: linkedin.com/company/a16z

Listen to the a16z Show on Spotify: open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX

Listen to the a16z Show on Apple Podcasts: podcasts.apple.com/us/podcast/a16z-podcast/id842818711

Follow our host: https://x.com/eriktorenberg

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.
How Open Source Became AIs Backbone | Inferact with a16zMarc Andreessen on how the internet changed news, politics, and outrage | The a16z ShowHow AI Is Turning Figma’s Finance Team Into BuildersOpenAI’s Head of Health AI on Whether You Should Trust ChatGPTGoldman Sachs Chairman on Why Finance Adopts AI Differently | a16zWhy OpenAI Is Racing to Make Computer Use SuperhumanMark Zuckerbergs take on risk.What happens when youre a serial entrepreneurThe New Rule for Picking AI Winners | The a16z ShowBen Horowitz on a Great ProductCan Open Models Keep Up With OpenAI and Anthropic? | Nathan LambertAI Is Coming For These 3 Industries In 2026 (a16z Big Ideas)
a16z |

How Open Source Became AI's Backbone | Inferact with a16z

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER