Generating Conversation: MemGPT, Memory Management for LLMs - Charles Packer (Episode 9) @herald-dev
Generating Conversation: MemGPT, Memory Management for LLMs - Charles Packer (Episode 9)  @herald-dev
Uploaded October 2023 | Updated November 2026, 3 hours ago
Context window management has become a critical part of every LLM application — from the basics (embeddings models, vector DBs) to more advanced techniques (query rewriting, HyDE, summarization). MemGPT is a new tool from UC Berkeley built by Charles Packer that automates "memory" management for LLMs and creates a functionally infinite context window. Charles joins us this week to talk about MemGPT, the techniques behind it, and where the conversational AI space is headed.

MemGPT: github.com/cpacker/memgpt
Charles' Twitter: twitter.com/charlespacker

0:00 Intro
0:32 From AVs to conversational AI
1:55 Creative content generation with LLMs
4:53 The motivation behind MemGPT
8:19 When long context windows are enough
10:10 How MemGPT achieves longer contexts
14:38 How MemGPT relates to RAG
17:39 How MemGPT leverages function calling
21:20 Opportunities for OSS models to improve
22:59 Limitations of MemGPT
26:12 Future directions in conversational AI
28:37 Conclusion
Generating Conversation: MemGPT, Memory Management for LLMs - Charles Packer (Episode 9)RunLLM Introduction 2024-02RunLLM Introduction 2024-05LLMs for the Rest of Us (AI Camp SF, April 2023)Generating Conversation: Building a Business in Generative AI - Vik Singh (Episode 10)Foundation Models (Generating Conversation, Episode 2)Aqueduct Quickstart🧪 Ep 6 | Should You Still Fine-Tune Models for Your App? | LLMs on the Run⚡ Ep 10 | What’s Catching AI Researchers Attention Right Now? | LLMs on the Run🎓 Ep 18 | Has Academia Lost the AI Race? | LLMs on the Run⚖️ Ep 4 | Is AI Training More Efficient Or Just Shifting to Post-Training? | LLMs on the RunRunLLM Introduction
Herald |

Generating Conversation: MemGPT, Memory Management for LLMs - Charles Packer (Episode 9)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER