Uploaded July 2025 | Updated September 2026, 8 hours ago
Watch as I compare DeepSeek-V3-0324, kimi-k2, and Qwen3-Coder at Q4_K_XL quant size on my local hardware. NOTE: I realized while editing this video that V3-0324 was using `cat` to read files. I was up till 3am editing and rather than re-shoot an hour and a half of footage and re-edit, I decided to just ship my mistake so you can appreciate an obsolete human LLM hallucinating and being whiny about it because he's tired.
0:00 Intro
1:03 System details
2:38 How to Utilize 96gb VRAM
9:11 Model File Size on Disk
11:26 V3-0324 Open WebUI
14:40 Agentic Audit Intro
20:35 DeepSeek-V3-0324
26:57 Kimi-K2
31:58 Qwen3-Coder
42:54 Outro
Previous videos:
adding blackwell 6000 pro youtu.be/vfi9LRJxgHs
ktransformers and 3090 GPU youtu.be/fI6uGPcxDbM
PC Build and CPU Only youtu.be/v4810MVGhog
Github project:
github.com/createthis/07_27_2025_agentic_audit_video
Amazon Affiliate Links:
NVD RTX PRO 6000 Blackwell Professional Workstation Edition Graphics Card for AI, Design, Simulation, Engineering - 96GB DDR7 ECC Memory - 4th Gen RT/5th Gen Tensor Core GPU - OEM Packaging
[amazon affiliate us]: amzn.to/4kNYXjU
Gigabyte MZ73-LM0 Motherboard Socket SP5 Extended ATX
[amazon affiliate us]: amzn.to/43YROaH
Corsair HX1500i Fully Modular Ultra-Low Noise ATX Power Supply - ATX 3.0 & PCIe 5.0 Compliant - Fluid Dynamic Bearing Fan - CORSAIR iCUE Software Compatible - 80 Plus Platinum Efficiency - Black
[amazon affiliate us]: amzn.to/42lzPcr
NEMIX RAM 384GB (12X32GB) DDR5 5600MHZ PC5-44800 1Rx4 1.1V CL46 288-PIN ECC RDIMM Registered Server Memory KIT
[amazon affiliate us]: amzn.to/42nzXJn
SAMSUNG 990 PRO Heatsink SSD 4TB, NVMe M.2, Speeds Up to 7,450MB/s Best for PlayStation® 5 (PS5 SSD) Console Expansion MZ-V9P4T0CW
[amazon affiliate us]: amzn.to/4lc60Uc
I have six of these on the case:
ARCTIC P14 PWM PST (5 Pack) - 140 mm Case Fan with PWM Sharing Technology (PST), Pressure-optimised, Computer, Fan Speed: 200-1700 RPM - Black
[amazon affiliate us]: amzn.to/3T6bVgQ
This is the one small fan at the back of the case:
ARCTIC F12 PWM PST (5 Pack) - 120 mm PWM PST Case Fan with PWM Sharing Technology (PST), Quiet Motor, Computer, Fan Speed: 230-1350 RPM - Black
[amazon affiliate us]: amzn.to/4jgJxDL
Watch as I compare DeepSeek-V3-0324, kimi-k2, and Qwen3-Coder at Q4_K_XL quant size on my local hardware. NOTE: I realized while editing this video that V3-0324 was using `cat` to read files. I was up till 3am editing and rather than re-shoot an hour and a half of footage and re-edit, I decided to just ship my mistake so you can appreciate an obsolete human LLM hallucinating and being whiny about it because he's tired.
0:00 Intro
1:03 System details
2:38 How to Utilize 96gb VRAM
9:11 Model File Size on Disk
11:26 V3-0324 Open WebUI
14:40 Agentic Audit Intro
20:35 DeepSeek-V3-0324
26:57 Kimi-K2
31:58 Qwen3-Coder
42:54 Outro
Previous videos:
adding blackwell 6000 pro youtu.be/vfi9LRJxgHs
ktransformers and 3090 GPU youtu.be/fI6uGPcxDbM
PC Build and CPU Only youtu.be/v4810MVGhog
Github project:
github.com/createthis/07_27_2025_agentic_audit_video
Amazon Affiliate Links:
NVD RTX PRO 6000 Blackwell Professional Workstation Edition Graphics Card for AI, Design, Simulation, Engineering - 96GB DDR7 ECC Memory - 4th Gen RT/5th Gen Tensor Core GPU - OEM Packaging
[amazon affiliate us]: amzn.to/4kNYXjU
Gigabyte MZ73-LM0 Motherboard Socket SP5 Extended ATX
[amazon affiliate us]: amzn.to/43YROaH
Corsair HX1500i Fully Modular Ultra-Low Noise ATX Power Supply - ATX 3.0 & PCIe 5.0 Compliant - Fluid Dynamic Bearing Fan - CORSAIR iCUE Software Compatible - 80 Plus Platinum Efficiency - Black
[amazon affiliate us]: amzn.to/42lzPcr
NEMIX RAM 384GB (12X32GB) DDR5 5600MHZ PC5-44800 1Rx4 1.1V CL46 288-PIN ECC RDIMM Registered Server Memory KIT
[amazon affiliate us]: amzn.to/42nzXJn
SAMSUNG 990 PRO Heatsink SSD 4TB, NVMe M.2, Speeds Up to 7,450MB/s Best for PlayStation® 5 (PS5 SSD) Console Expansion MZ-V9P4T0CW
[amazon affiliate us]: amzn.to/4lc60Uc
I have six of these on the case:
ARCTIC P14 PWM PST (5 Pack) - 140 mm Case Fan with PWM Sharing Technology (PST), Pressure-optimised, Computer, Fan Speed: 200-1700 RPM - Black
[amazon affiliate us]: amzn.to/3T6bVgQ
This is the one small fan at the back of the case:
ARCTIC F12 PWM PST (5 Pack) - 120 mm PWM PST Case Fan with PWM Sharing Technology (PST), Quiet Motor, Computer, Fan Speed: 230-1350 RPM - Black
[amazon affiliate us]: amzn.to/4jgJxDL
