Production RAG for Finance with NVIDIA Nemotron 3.5 Lightning: Fully Local Ollama + Qdrant (Live) @KGPTalkie
Production RAG for Finance with NVIDIA Nemotron 3.5 Lightning: Fully Local Ollama + Qdrant (Live)  @KGPTalkie
Uploaded August 2026 | Updated November 2026, 1 day ago
Build a production-grade RAG system for finance, live, end to end, and fully local with NVIDIA Nemotron 3.5 Lightning on Ollama. No OpenAI key, no cloud, everything runs on your own machine.

We take real SEC 10-K filings from Amazon, Alphabet and Meta and build a pipeline that answers questions with page-level citations, refuses what the documents do not contain, and streams every step of an agent as it works.

What we build in this session:
✅ PDF to markdown extraction and page-based chunking
✅ Local embeddings with Ollama (nomic-embed-text) and Qdrant in Docker
✅ Hybrid search (dense + BM25) with metadata filters: company, year, document type
✅ LLM-extracted metadata at ingest, per file
✅ Grounded answers with citations, and refusals when the answer is not in the corpus
✅ Model choice matters: why Nemotron 3.5 Lightning at ~180 tokens/sec beats Qwen3.6 27B for this pipeline
✅ Agentic RAG: the agent inspects the collection and decides the filters itself
✅ Streaming the agent loop: watch every tool call and result live
✅ Conversation memory with SQLite checkpointing
✅ A Chainlit chat UI over the same agent
✅ Exposing the whole pipeline as an MCP server for Claude

Stack: Python, LangChain, Ollama with NVIDIA Nemotron 3.5 Lightning (benchmarked against Qwen3.6 27B), Qdrant, RAGWire, Chainlit, MCP

RAGWire (open source): github.com/laxmimerit/ragwire

🔔 Subscribe for more hands-on AI engineering: youtube.com/@KGPTalkie
🌐 Website: kgptalkie.com
💼 LinkedIn: linkedin.com/in/laxmimerit

#RAG #Nemotron #LangChain #Ollama #Qdrant #LocalLLM #AIAgents #GenAI
Production RAG for Finance with NVIDIA Nemotron 3.5 Lightning: Fully Local Ollama + Qdrant (Live)Ryzen AI Halo vs DGX Spark: $700 Apart, Almost the Same Speed #shortsFine-Tune Gemma 3 270M on MacBook with Unsloth Studio (No Code)Hindi vs English Tokens: Why Hindi Needs 3x MoreMCP Tutorial 3 -  Create PPT Presentation Using PowerPoint MCP ServerWhy Transformers Replaced RNNs: 499 Steps vs Just One | LLM InterviewRun a Coding AI on Your Own Laptop (8B, No GPU) #shortsClaude Opus 5.5 vs GPT-6.1 Sol: 5 Real Coding Tests, Is the Expensive One Better?Nemotron 3.5 Lightning 33B vs Claude Haiku 5.5: 5 Real Coding Tests, RTX 5090 vs the CloudOllama Setup on Windows: Install and Run Qwen 3.8 Locally (No GPU Needed)Codex CLI Setup on Windows: Sign In with ChatGPTAI That Edits Its Own Memory: Context Language Models #shorts
Laxmi Kant | KGP Talkie |

Production RAG for Finance with NVIDIA Nemotron 3.5 Lightning: Fully Local Ollama + Qdrant (Live)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER