Uploaded May 2026 | Updated September 2026, 2 weeks ago
Local AI on your Unraid server isn't just chatbots, it's image generation, music, voice cloning, photo recognition, automatic transcription, and so much more, all running on hardware you already own. But where do you even start?
In this video I walk through the whole landscape of local AI for Unraid users. What it actually is, the two completely different types you can run, and what hardware you really need to get going. This isn't a setup guide. Think of it as your mental map of local AI, so when you do start installing things, you'll actually understand what you're doing and why.
We cover generative vs predictive AI, the three reasons people run AI locally (privacy, cost, control), real working examples on my own server, and a full walkthrough of the hardware tiers from CPU to high-end GPU, including which card I'd actually recommend you buy first and why.
*Key Links*
🔗 Frigate (open source NVR with AI object detection): frigate.video
🔗 Frigate live demo: demo.frigate.video
🔗 Speaches (Whisper + Kokoro container): speaches.ai
🔗 Ollama: ollama.com
🔗 Open WebUI: openwebui.com
🔗 ComfyUI: github.com/comfyanonymous/ComfyUI
▶️ Related videos on the channel.
🔗 A-Eye (local photo renaming with AI): youtu.be/_82_Z-R5dFQ
🔗 Paperless AI (auto-tagging your documents): youtu.be/Kv2oBjA-61A
💬 Want me to make a follow-up video benchmarking all of those GPUs with proper AI benchmark software? Drop a comment below and let me know.
*Hardware Recs*
USB Edge TPU ML Accelerator: amzn.to/4tMBlzV
NVIDIA RTX 3060 12GB: amzn.to/3PwVuM8
NVIDIA RTX 5070: amzn.to/3RizUvG
⏱️ *Timestamps*
0:00 - Cold open: what local AI can actually do
2:13 - Welcome and what this video is (and isn't)
2:20 - Everything you just saw was generated locally
2:33 - What is local AI? Privacy, cost, control
3:00 - Generative vs predictive AI explained
3:25 - Frigate demo (predictive AI in action)
5:02 - The Google Coral and edge AI
5:22 - Quick tip: USB Coral vs PCIe Coral
5:50 - A-Eye: when predictive AI does need a GPU
6:35 - Whisper + Kokoro in one container (Speaches)
7:53 - Web UIs vs APIs: how local AI tools chain together
8:18 - OpenClaw: my own voice assistant built on Signal
9:50 - Ollama and Open WebUI for chatbots
10:50 - ComfyUI for image generation
11:34 - So what hardware do you actually need?
12:00 - VRAM, RAM and RAM speed for AI
14:02 - CPU tier
15:08 - Integrated GPU tier
16:07 - Dedicated GPUs: the lineup on the bench
17:01 - Benchmark video CTA
18:38 - Why the RTX 3060 12GB is the sweet spot
20:22 - The other Nvidia cards (2060, 2080 Ti, 5070, 5090)
22:06 - AMD and ROCm
22:43 - Intel Arc Pro B-series for local AI
23:30 - Edge AI recap
24:15 - A little secret about this video...
What will you build with Unraid?
Get Started with Unraid in 15 minutes or less:
unraid.net/getting-started
Some of the links below are affiliate links, meaning we may earn a commission if you click through and make a purchase.
Local AI on your Unraid server isn't just chatbots, it's image generation, music, voice cloning, photo recognition, automatic transcription, and so much more, all running on hardware you already own. But where do you even start?
In this video I walk through the whole landscape of local AI for Unraid users. What it actually is, the two completely different types you can run, and what hardware you really need to get going. This isn't a setup guide. Think of it as your mental map of local AI, so when you do start installing things, you'll actually understand what you're doing and why.
We cover generative vs predictive AI, the three reasons people run AI locally (privacy, cost, control), real working examples on my own server, and a full walkthrough of the hardware tiers from CPU to high-end GPU, including which card I'd actually recommend you buy first and why.
*Key Links*
🔗 Frigate (open source NVR with AI object detection): frigate.video
🔗 Frigate live demo: demo.frigate.video
🔗 Speaches (Whisper + Kokoro container): speaches.ai
🔗 Ollama: ollama.com
🔗 Open WebUI: openwebui.com
🔗 ComfyUI: github.com/comfyanonymous/ComfyUI
▶️ Related videos on the channel.
🔗 A-Eye (local photo renaming with AI): youtu.be/_82_Z-R5dFQ
🔗 Paperless AI (auto-tagging your documents): youtu.be/Kv2oBjA-61A
💬 Want me to make a follow-up video benchmarking all of those GPUs with proper AI benchmark software? Drop a comment below and let me know.
*Hardware Recs*
USB Edge TPU ML Accelerator: amzn.to/4tMBlzV
NVIDIA RTX 3060 12GB: amzn.to/3PwVuM8
NVIDIA RTX 5070: amzn.to/3RizUvG
⏱️ *Timestamps*
0:00 - Cold open: what local AI can actually do
2:13 - Welcome and what this video is (and isn't)
2:20 - Everything you just saw was generated locally
2:33 - What is local AI? Privacy, cost, control
3:00 - Generative vs predictive AI explained
3:25 - Frigate demo (predictive AI in action)
5:02 - The Google Coral and edge AI
5:22 - Quick tip: USB Coral vs PCIe Coral
5:50 - A-Eye: when predictive AI does need a GPU
6:35 - Whisper + Kokoro in one container (Speaches)
7:53 - Web UIs vs APIs: how local AI tools chain together
8:18 - OpenClaw: my own voice assistant built on Signal
9:50 - Ollama and Open WebUI for chatbots
10:50 - ComfyUI for image generation
11:34 - So what hardware do you actually need?
12:00 - VRAM, RAM and RAM speed for AI
14:02 - CPU tier
15:08 - Integrated GPU tier
16:07 - Dedicated GPUs: the lineup on the bench
17:01 - Benchmark video CTA
18:38 - Why the RTX 3060 12GB is the sweet spot
20:22 - The other Nvidia cards (2060, 2080 Ti, 5070, 5090)
22:06 - AMD and ROCm
22:43 - Intel Arc Pro B-series for local AI
23:30 - Edge AI recap
24:15 - A little secret about this video...
What will you build with Unraid?
Get Started with Unraid in 15 minutes or less:
unraid.net/getting-started
Some of the links below are affiliate links, meaning we may earn a commission if you click through and make a purchase.
