Uploaded April 2023 | Updated November 2026, 3 hours ago
LLMs are part of a larger class of models called foundation models. What are foundation models, how do they work, and how well do they generalize? Cal professor & Aqueduct co-founder Joey Gonzalez helps us understand the nuances of foundation models.
Aqueduct: github.com/aqueducthq/aqueduct
Aqueduct's Twitter: twitter.com/AqueductHQ
Joey's Twitter: twitter.com/profjoeyg
Vikram's Twitter: twitter.com/vsreekanti
0:00 Intro
1:01 What are foundation models?
4:00 How do foundation models fit into deep learning?
5:29 How do foundation models generalize?
7:59 What are the new frontiers of foundation modeling?
9:48 How hard is it to build a foundation model?
12:43 Will we see more fine tuning or more new models?
13:58 Conclusion
LLMs are part of a larger class of models called foundation models. What are foundation models, how do they work, and how well do they generalize? Cal professor & Aqueduct co-founder Joey Gonzalez helps us understand the nuances of foundation models.
Aqueduct: github.com/aqueducthq/aqueduct
Aqueduct's Twitter: twitter.com/AqueductHQ
Joey's Twitter: twitter.com/profjoeyg
Vikram's Twitter: twitter.com/vsreekanti
0:00 Intro
1:01 What are foundation models?
4:00 How do foundation models fit into deep learning?
5:29 How do foundation models generalize?
7:59 What are the new frontiers of foundation modeling?
9:48 How hard is it to build a foundation model?
12:43 Will we see more fine tuning or more new models?
13:58 Conclusion










