Uploaded January 2024 | Updated September 2026, 56 minutes ago
Hey everyone! We are super excited to publish this podcast with Vinod Valloppillil and Bob van Luijt on Open-Source AI and future directions for RAG! The podcast begins by discussing Vinod's "Halloween Documents", a series of internal strategy writings at Microsoft related to the open-source software movement! The conversation continues to discuss the current state of Open-Source in AI. One of the major points Bob has been making about the business of AI models is that the models themselves are *stateless*, akin to an MP3 file. Vinod pushes back a bit on this definition and jointly it is then settled that these models neither fall into the pure stateful or stateless bucket, rather a "pre-baked" bucket -- presenting completely new opportunities to build business around software. The conversation then continues to discuss the particular details of how people are building RAG systems and many directions for how that may evolve!
Learn more about the Halloween documents: en.wikipedia.org/wiki/Halloween_documents.
RAG: arxiv.org/abs/2005.11401
Toolsformer: arxiv.org/abs/2302.04761
Chapters
0:00 Welcome Bob and Vinod!
1:40 Open-Source (The Halloween Documents)
4:22 The Business of Open-Source
7:50 Stateless Models Debate
15:24 Future Directions for RAG
27:00 Knowledge Graphs in RAG
34:18 New Ease of Data Parsing
40:28 How Vinod approaches new technologies
45:15 Future of AI
Hey everyone! We are super excited to publish this podcast with Vinod Valloppillil and Bob van Luijt on Open-Source AI and future directions for RAG! The podcast begins by discussing Vinod's "Halloween Documents", a series of internal strategy writings at Microsoft related to the open-source software movement! The conversation continues to discuss the current state of Open-Source in AI. One of the major points Bob has been making about the business of AI models is that the models themselves are *stateless*, akin to an MP3 file. Vinod pushes back a bit on this definition and jointly it is then settled that these models neither fall into the pure stateful or stateless bucket, rather a "pre-baked" bucket -- presenting completely new opportunities to build business around software. The conversation then continues to discuss the particular details of how people are building RAG systems and many directions for how that may evolve!
Learn more about the Halloween documents: en.wikipedia.org/wiki/Halloween_documents.
RAG: arxiv.org/abs/2005.11401
Toolsformer: arxiv.org/abs/2302.04761
Chapters
0:00 Welcome Bob and Vinod!
1:40 Open-Source (The Halloween Documents)
4:22 The Business of Open-Source
7:50 Stateless Models Debate
15:24 Future Directions for RAG
27:00 Knowledge Graphs in RAG
34:18 New Ease of Data Parsing
40:28 How Vinod approaches new technologies
45:15 Future of AI
