Uploaded November 2024 | Updated September 2026, 1 week ago
Prof. Gennady Pekhimenko - CEO of CentML joins us in this *sponsored episode* about AI system optimization and enterprise implementation of AI. From NVIDIA's technical leadership model to the rise of open-source AI, Pekhimenko bridges the gap between academic research and industrial applications. Learn about "dark silicon," GPU utilization challenges in ML workloads, and how modern enterprises can optimize their AI infrastructure. The conversation explores why some companies achieve only ~10% GPU efficiency and practical solutions for improving AI system performance. A must-watch for anyone interested in the technical foundations of enterprise AI and GPU hardware optimization.
CentML offers competitive pricing for GenAI model deployment, with flexible options to suit a wide range of models, from small to large-scale deployments. Cheaper, faster, no commitments, pay as you go, scale massively, simple to setup. Check it out!
centml.ai/pricing
SPONSOR MESSAGES:
MLST is also sponsored by Tufa AI Labs - tufalabs.ai
They are hiring cracked ML engineers/researchers to work on ARC and build AGI!
SHOWNOTES (diarised transcript, TOC, references, summary, best quotes etc)
dropbox.com/scl/fi/w9kbpso7fawtm286kkp6j/Gennady.pdf?rlkey=aqjqmncx3kjnatk2il1gbgknk&st=2a9mccj8&dl=0
TOC:
1. AI Strategy and Leadership
[00:00:00] 1.1 Technical Leadership and Corporate Structure
[00:09:55] 1.2 Open Source vs Proprietary AI Models
[00:16:04] 1.3 Hardware and System Architecture Challenges
[00:23:37] 1.4 Enterprise AI Implementation and Optimization
[00:35:30] 1.5 AI Reasoning Capabilities and Limitations
2. AI System Development
[00:38:45] 2.1 Computational and Cognitive Limitations of AI Systems
[00:42:40] 2.2 Human-LLM Communication Adaptation and Patterns
[00:46:18] 2.3 AI-Assisted Software Development Challenges
[00:47:55] 2.4 Future of Software Engineering Careers in AI Era
[00:49:49] 2.5 Enterprise AI Adoption Challenges and Implementation
3. ML Infrastructure Optimization
[00:54:41] 3.1 MLOps Evolution and Platform Centralization
[00:55:43] 3.2 Hardware Optimization and Performance Constraints
[01:05:24] 3.3 ML Compiler Optimization and Python Performance
[01:15:57] 3.4 Enterprise ML Deployment and Cloud Provider Partnerships
4. Distributed AI Architecture
[01:27:05] 4.1 Multi-Cloud ML Infrastructure and Optimization
[01:29:45] 4.2 AI Agent Systems and Production Readiness
[01:32:00] 4.3 RAG Implementation and Fine-Tuning Considerations
[01:33:45] 4.4 Distributed AI Systems Architecture and Ray Framework
5. AI Industry Standards and Research
[01:37:55] 5.1 Origins and Evolution of MLPerf Benchmarking
[01:43:15] 5.2 MLPerf Methodology and Industry Impact
[01:50:17] 5.3 Academic Research vs Industry Implementation in AI
[01:58:59] 5.4 AI Research History and Safety Concerns
Prof. Gennady Pekhimenko - CEO of CentML joins us in this *sponsored episode* about AI system optimization and enterprise implementation of AI. From NVIDIA's technical leadership model to the rise of open-source AI, Pekhimenko bridges the gap between academic research and industrial applications. Learn about "dark silicon," GPU utilization challenges in ML workloads, and how modern enterprises can optimize their AI infrastructure. The conversation explores why some companies achieve only ~10% GPU efficiency and practical solutions for improving AI system performance. A must-watch for anyone interested in the technical foundations of enterprise AI and GPU hardware optimization.
CentML offers competitive pricing for GenAI model deployment, with flexible options to suit a wide range of models, from small to large-scale deployments. Cheaper, faster, no commitments, pay as you go, scale massively, simple to setup. Check it out!
centml.ai/pricing
SPONSOR MESSAGES:
MLST is also sponsored by Tufa AI Labs - tufalabs.ai
They are hiring cracked ML engineers/researchers to work on ARC and build AGI!
SHOWNOTES (diarised transcript, TOC, references, summary, best quotes etc)
dropbox.com/scl/fi/w9kbpso7fawtm286kkp6j/Gennady.pdf?rlkey=aqjqmncx3kjnatk2il1gbgknk&st=2a9mccj8&dl=0
TOC:
1. AI Strategy and Leadership
[00:00:00] 1.1 Technical Leadership and Corporate Structure
[00:09:55] 1.2 Open Source vs Proprietary AI Models
[00:16:04] 1.3 Hardware and System Architecture Challenges
[00:23:37] 1.4 Enterprise AI Implementation and Optimization
[00:35:30] 1.5 AI Reasoning Capabilities and Limitations
2. AI System Development
[00:38:45] 2.1 Computational and Cognitive Limitations of AI Systems
[00:42:40] 2.2 Human-LLM Communication Adaptation and Patterns
[00:46:18] 2.3 AI-Assisted Software Development Challenges
[00:47:55] 2.4 Future of Software Engineering Careers in AI Era
[00:49:49] 2.5 Enterprise AI Adoption Challenges and Implementation
3. ML Infrastructure Optimization
[00:54:41] 3.1 MLOps Evolution and Platform Centralization
[00:55:43] 3.2 Hardware Optimization and Performance Constraints
[01:05:24] 3.3 ML Compiler Optimization and Python Performance
[01:15:57] 3.4 Enterprise ML Deployment and Cloud Provider Partnerships
4. Distributed AI Architecture
[01:27:05] 4.1 Multi-Cloud ML Infrastructure and Optimization
[01:29:45] 4.2 AI Agent Systems and Production Readiness
[01:32:00] 4.3 RAG Implementation and Fine-Tuning Considerations
[01:33:45] 4.4 Distributed AI Systems Architecture and Ray Framework
5. AI Industry Standards and Research
[01:37:55] 5.1 Origins and Evolution of MLPerf Benchmarking
[01:43:15] 5.2 MLPerf Methodology and Industry Impact
[01:50:17] 5.3 Academic Research vs Industry Implementation in AI
[01:58:59] 5.4 AI Research History and Safety Concerns
![Your Brain Doesnt Command Your Body. It Predicts It. [Max Bennett]](https://i.ytimg.com/vi/RvYSsi6rd4g/mqdefault.jpg "Your Brain Doesnt Command Your Body. It Predicts It. [Max Bennett]
Tim sits down with Max Bennett to explore how our brains evolved over 600 million years—and what that means for understanding both human intelligence and AI.
Max isnt a neuroscientist by training. Hes a tech entrepreneur who got curious, started reading, and ended up weaving together three fields that rarely talk to each other: comparative psychology (what different animals can actually do), evolutionary neuroscience (how brains changed over time), and AI (what actually works in practice).
*Your Brain Is a Guessing Machine*
You dont actually see the world. Your brain builds a simulation of what it *thinks* is out there and just uses your eyes to check if its right. Thats why optical illusions work—your brain is filling in a triangle that isnt there, or cant decide if its looking at a duck or a rabbit.
*Rats Have Regrets*
In a fascinating experiment called Restaurant Row, rats make choices about waiting for food. When they skip a short wait for something they like and end up stuck with a long wait for something they dont—you can literally watch their brain imagine eating the food they passed up. They regret their choice and make different decisions next time.
*Chimps Are Machiavellian*
The most gripping story is about two chimps, Rock and Belle. Belle learns where food is hidden. Rock figures out he can just follow her and steal it. So Belle starts hiding the food when she finds it. Then Rock starts *pretending* not to watch her, then sprinting to grab the food once she moves. This escalates into an arms race of deception and counter-deception—proof that apes can think about what others are thinking.
*Language Is the Human Superpower*
Other animals learn by watching each others actions. Humans can share whats happening *inside our minds*. You can describe a dream, plan a hunt with five other people, or warn someone about a snake you saw yesterday. This ability to share mental simulations is what lets knowledge accumulate across generations—and its arguably the singularity that already happened.
*Does ChatGPT Think?*
ChatGPT clearly has *a model* (it wouldnt work otherwise), but it doesnt have a *world model* in the way brains do. A real world model means you can form a hypothesis, test it, and update your beliefs based on what happens. GPT learns only from its training data—it cant run experiments or reject information it knows to be false.
Understanding how the brain evolved isnt just about the past. It gives us clues about:
- Whats actually different between human intelligence and AI
- Why were so easily fooled by status games and tribal thinking
- What features we might want to build into—or leave out of—future AI systems
Get Maxs book:
https://www.amazon.com/Brief-History-Intelligence-Humans-Breakthroughs/dp/0063286343
Rescript: https://app.rescript.info/public/share/R234b7AXyDXZusqQ_43KMGsUSvJ2TpSz2I3emnI6j9A
TIMESTAMPS:
00:00:00 Introduction: Outsiders Advantage & Neocortex Theories
00:11:34 Perception as Inference: The Filling-In Machine
00:19:11 Understanding, Recognition & Generative Models
00:36:39 How Mice Plan: Vicarious Trial & Error
00:46:15 Evolution of Self: The Layer 4 Mystery
00:58:31 Ancient Minds & The Social Brain: Machiavellian Apes
01:19:36 AI Alignment, Instrumental Convergence & Status Games
01:33:07 Metacognition & The IQ Paradox
01:48:40 Does GPT Have Theory of Mind?
02:00:40 Memes, Language Singularity & Brain Size Myths
02:16:44 Communication, Language & The Cyborg Future
02:44:25 Shared Fictions, World Models & The Reality Gap
REFERENCES:Person:
[00:00:05] Karl Friston (UCL)
https://www.youtube.com/watch?v=PNYWi996Beg
[00:00:06] Jeff Hawkins
https://www.youtube.com/watch?v=6VQILbDqaI4
[00:12:19] Hermann von Helmholtz
https://plato.stanford.edu/entries/hermann-helmholtz/
[00:38:34] David Redish (U. Minnesota)
https://redishlab.umn.edu/
[01:10:19] Robin Dunbar
https://www.psy.ox.ac.uk/people/robin-dunbar
[01:15:04] Emil Menzel
https://www.sciencedirect.com/bookseries/behavior-of-nonhuman-primates/vol/5/suppl/C
[01:19:49] Nick Bostrom
https://nickbostrom.com/
[02:28:25] Noam Chomsky
https://linguistics.mit.edu/user/chomsky/
[03:01:22] Judea Pearl
https://samueli.ucla.edu/people/judea-pearl/
Concept/Framework:
[00:05:04] Active Inference
https://www.youtube.com/watch?v=KkR24ieh5Ow
Paper:
[00:35:59] Predictions not commands [Rick A Adams]
https://pubmed.ncbi.nlm.nih.gov/23129312/
Book:
[01:25:42] The Elephant in the Brain
https://www.amazon.com/Elephant-Brain-Hidden-Motives-Everyday/dp/0190495995
[01:28:27] The Status Game
https://www.goodreads.com/book/show/58642436-the-status-game
[02:00:40] The Selfish Gene
https://amazon.com/dp/0198788606
[02:14:25] The Language Game
https://www.amazon.com/Language-Game-Improvisation-Created-Changed/dp/1541674987
[02:54:40] The Evolution of Language
https://www.amazon.com/Evolution-Language-Approaches/dp/052167736X
[03:09:37] The Three-Body Problem
https://amazon.com/dp/0765377063")
![Math vs AI: Who Decides Whats True? [Dr. Paul Lessard]](https://i.ytimg.com/vi/TBjCvB_4mdo/mqdefault.jpg "Math vs AI: Who Decides Whats True? [Dr. Paul Lessard]
In this episode, hosts Tim Scarfe and Keith Duggar welcome guest Paul Lessard, a mathematician who has transitioned into the world of machine learning, for a deep dive into the philosophy behind AI, mathematics, and the quest for true understanding.
INTERACTIVE TRANSCRIPT PLAYER:
https://app.rescript.info/public/share/_TAiM5iOOePzOGIqCGf69tASjP9bAHNf0tIUKanYIpY
They start by exploring a classic philosophical question: Is the universe built on fundamental, unchanging truths that we discover (a Platonic view), or is it more like were constantly building and creating structure as we go (a constructivist view)? Paul suggests a middle ground, arguing that while the world may be fundamentally constructive, we create the illusions of Platonism as a powerful problem-solving strategy.
This leads to a discussion about the nature of modern AI models. Tim introduces a powerful metaphor, describing deep learning models as sandcastles—structures that look impressive but lack a solid foundation and collapse easily when prodded. Paul challenges this, suggesting there is an emerging science to it, pointing to how benchmarks have historically been used to judge progress, though this method is now showing its limits.
So, how can we build more robust models? Keith asks how the highly abstract field of category theory can help. Paul explains it not as a specific tool, but as a powerful algebra for constructing systems. It provides a formal language to design and experiment with different model architectures in a principled way. He also draws an analogy between transformers and RNNs, framing a transformer as a parallelized, finite-depth version of an RNN.
The conversation then shifts to the human side of science and learning.
Culture Shock in Academia: Paul humorously contrasts the incredibly cautious and boring titles of pure math papers with the bombastic and authoritative titles common in machine learning.
The Walled Garden of Education: Keith shares a relatable story about the shock of discovering that, unlike school textbook problems, most real-world scientific problems dont have a neat, clean solution. Paul explains this is by design—education creates a walled garden to build a students confidence before they face the messy, unpredictable nature of true research.
The episode concludes with Paul sharing his current, overarching view of his work. He sees machine learning as the task of designing a fake physics. The goal is to build a system where the training process acts like a natural physical process, causing the model to settle into a low-energy state that effectively represents the data it was shown.
Position: Categorical Deep Learning is an Algebraic Theory of All Architectures
https://arxiv.org/abs/2402.15332
Bruno Gavranović, Paul Lessard, Andrew Dudzik, Tamara von Glehn, João G. M. Araújo, Petar Veličković
Paul Lessard:
https://www.linkedin.com/in/paul-roy-lessard/?originalSubdomain=au
TOC:
[00:00:00] Truth, Benchmarks, and Sandcastles
[00:00:45] Platonism vs. Constructivism
[00:05:00] The Role of Category Theory
[00:08:00] The Anything Goes Science
[00:12:50] Explaining Why Things Work
[00:16:56] Bombastic Academic Paper Titles
[00:18:18] Automatically Discovering Constraints
[00:29:17] The Walled Garden of Education
[00:35:26] From Math to Machine Learning
[00:43:47] Machine Learning as Fake Physics")
