Uploaded September 2025 | Updated September 2026, 3 hours ago
Why does every RAG pipeline start with chunking? Because chunking defines what your vectors mean.
At its core, ๐ฐ๐ต๐๐ป๐ธ๐ถ๐ป๐ด is the preprocessing step of splitting texts into smaller pieces - and each chunk becomes the unit of information that gets vectorized and stored in your vector database.
In this short video, Femke breaks down simple chunking methods โ token, sentence, and document-based.
๐ย Get your copy of the free advanced RAG ebook: weaviate.io/ebooks/advanced-rag-techniques?utm_source=youtube&utm_campaign=rag&utm_content=680991368
Chapters:
00:00:00 - Why Large Docs Challenge AI Models
00:00:17 - Token-Chunking
00:00:29 - Sentence-Chunking for Better Context
00:00:45 - Document-Based Chunking Benefits & Limits
00:01:03 - Combining Chunking Methods
00:01:09 - Smarter Chunking Approaches
00:01:18 - Next Steps & Additional Resources
Paper review video: Late chunking improves context recall in RAG pipelines
youtube.com/watch?v=buzWGXOydD8
โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ CONNECT WITH US โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ
- Visit weaviate.io
- Star us on GitHub github.com/weaviate/weaviate
- Stay updated and subscribe to our newsletter: newsletter.weaviate.io
- Try out Weaviate Cloud Services for free here: https://console.weaviate.cloud/
Got a question?
- Forum: forum.weaviate.io
- Slack: weaviate.io/slack
Connect with us on
- Twitter: twitter.com/weaviate_io
- LinkedIn: linkedin.com/company/weaviate-io
Why does every RAG pipeline start with chunking? Because chunking defines what your vectors mean.
At its core, ๐ฐ๐ต๐๐ป๐ธ๐ถ๐ป๐ด is the preprocessing step of splitting texts into smaller pieces - and each chunk becomes the unit of information that gets vectorized and stored in your vector database.
In this short video, Femke breaks down simple chunking methods โ token, sentence, and document-based.
๐ย Get your copy of the free advanced RAG ebook: weaviate.io/ebooks/advanced-rag-techniques?utm_source=youtube&utm_campaign=rag&utm_content=680991368
Chapters:
00:00:00 - Why Large Docs Challenge AI Models
00:00:17 - Token-Chunking
00:00:29 - Sentence-Chunking for Better Context
00:00:45 - Document-Based Chunking Benefits & Limits
00:01:03 - Combining Chunking Methods
00:01:09 - Smarter Chunking Approaches
00:01:18 - Next Steps & Additional Resources
Paper review video: Late chunking improves context recall in RAG pipelines
youtube.com/watch?v=buzWGXOydD8
โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ CONNECT WITH US โฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌโฌ
- Visit weaviate.io
- Star us on GitHub github.com/weaviate/weaviate
- Stay updated and subscribe to our newsletter: newsletter.weaviate.io
- Try out Weaviate Cloud Services for free here: https://console.weaviate.cloud/
Got a question?
- Forum: forum.weaviate.io
- Slack: weaviate.io/slack
Connect with us on
- Twitter: twitter.com/weaviate_io
- LinkedIn: linkedin.com/company/weaviate-io
