Uploaded August 2025 | Updated November 2026, 2 hours ago
Can a local AI server actually replace the cloud at home? I’ve built a rack-friendly Threadripper rig and run some tests to see what it can do.
In the next video we will move to Proxmox, GPU passthrough and tuning across RTX 3090 and W7800. Subscribe so you don’t miss the virtualised tests and optimisations.
Home AI Server - Setting Up // I Created A Tool To Test AI. PART 2 - youtu.be/-TIp-6EWoEw
----------------------------------------------------------------------------------------------------------------------------------------------
Affiliate disclosure: as an Amazon Associate, we may earn commissions from qualifying purchases from Amazon at no extra cost to you. Thank you for your support!
ASUS Pro WS TRX50-SAGE WIFI
Amazon: geni.us/BbJLur
AMD Ryzen Threadripper 7970X
Amazon: geni.us/yzLlf
G.SKILL Zeta R5 NEO Series
Amazon: geni.us/nys6up
Noctua NH-D9 TR5-SP6 4U
Amazon: geni.us/zZOQ
AMD Radeon Pro W7800
Amazon: geni.us/cE0K
Palit RTX 3090 GamingPro
Unavailable
Kingston SA400S37/480G A400 SSD 480GB
Amazon: geni.us/yrssUBS
Kingston Fury Renegade G5
Amazon: geni.us/CRQPMA
Music from Artlist. Sign up and get 2 extra months for free: geni.us/a2k_artlist
Main Set:
Sit/Stand Ergonomic desk from Everdesk+
Our Gear
Main Camera
Amazon geni.us/ew4bW
Zoom lens:
Amazon: geni.us/po8arxf
Lazada: bit.ly/2HGJGnk
Wide angle lens:
Amazon: geni.us/GV1qFYY
Lazada: bit.ly/31Rlmq1
Mic
geni.us/mrkWeym
YouTube Management Tool - Tube Buddy
Sign up for free now! -tubebuddy.com/A2K
Follow us on Instagram:
instagram.com/a2kpage
Check out A2K blog: a2kmedia.net
Chapters:
00:00 - Intro
00:33 - Motherboard: ASUS Pro WS TRX50 Sage
01:00 - CPU: Threadripper 7970X
01:18 - GPU 1: RTX 3090
01:31 - GPU 2: Radeon Pro W7800
01:55 - Cooling: Noctua NH-D9 TR5-SP6
02:10 - Storage plan: Kingston SATA OS + Gen5 NVMe
02:41 - RAM: G.Skill Fury 128 GB DDR5-6400
03:18 - Build: board tour
04:56 - Installing the Threadripper
07:09 - NVMe placement: Gen4 vs Gen5 slots
09:33 - Cooler installation
12:47 - Memory install tips
14:29 - SATA OS drives, Windows now, Proxmox next
17:06 - W7800 vs chunky 3090
19:35 - Boot fix
20:21 - Cinebench multi-core results
22:27 - Gen5 RAID0 - CrystalDiskMark
23:35 - LM Studio small model GPTOSS
24:48 - Larger model offload: VRAM limits explained
26:37 - Wrap-up: Virtualisation and next steps
#AIhomeServer #aiserver #localllm
Can a local AI server actually replace the cloud at home? I’ve built a rack-friendly Threadripper rig and run some tests to see what it can do.
In the next video we will move to Proxmox, GPU passthrough and tuning across RTX 3090 and W7800. Subscribe so you don’t miss the virtualised tests and optimisations.
Home AI Server - Setting Up // I Created A Tool To Test AI. PART 2 - youtu.be/-TIp-6EWoEw
----------------------------------------------------------------------------------------------------------------------------------------------
Affiliate disclosure: as an Amazon Associate, we may earn commissions from qualifying purchases from Amazon at no extra cost to you. Thank you for your support!
ASUS Pro WS TRX50-SAGE WIFI
Amazon: geni.us/BbJLur
AMD Ryzen Threadripper 7970X
Amazon: geni.us/yzLlf
G.SKILL Zeta R5 NEO Series
Amazon: geni.us/nys6up
Noctua NH-D9 TR5-SP6 4U
Amazon: geni.us/zZOQ
AMD Radeon Pro W7800
Amazon: geni.us/cE0K
Palit RTX 3090 GamingPro
Unavailable
Kingston SA400S37/480G A400 SSD 480GB
Amazon: geni.us/yrssUBS
Kingston Fury Renegade G5
Amazon: geni.us/CRQPMA
Music from Artlist. Sign up and get 2 extra months for free: geni.us/a2k_artlist
Main Set:
Sit/Stand Ergonomic desk from Everdesk+
Our Gear
Main Camera
Amazon geni.us/ew4bW
Zoom lens:
Amazon: geni.us/po8arxf
Lazada: bit.ly/2HGJGnk
Wide angle lens:
Amazon: geni.us/GV1qFYY
Lazada: bit.ly/31Rlmq1
Mic
geni.us/mrkWeym
YouTube Management Tool - Tube Buddy
Sign up for free now! -tubebuddy.com/A2K
Follow us on Instagram:
instagram.com/a2kpage
Check out A2K blog: a2kmedia.net
Chapters:
00:00 - Intro
00:33 - Motherboard: ASUS Pro WS TRX50 Sage
01:00 - CPU: Threadripper 7970X
01:18 - GPU 1: RTX 3090
01:31 - GPU 2: Radeon Pro W7800
01:55 - Cooling: Noctua NH-D9 TR5-SP6
02:10 - Storage plan: Kingston SATA OS + Gen5 NVMe
02:41 - RAM: G.Skill Fury 128 GB DDR5-6400
03:18 - Build: board tour
04:56 - Installing the Threadripper
07:09 - NVMe placement: Gen4 vs Gen5 slots
09:33 - Cooler installation
12:47 - Memory install tips
14:29 - SATA OS drives, Windows now, Proxmox next
17:06 - W7800 vs chunky 3090
19:35 - Boot fix
20:21 - Cinebench multi-core results
22:27 - Gen5 RAID0 - CrystalDiskMark
23:35 - LM Studio small model GPTOSS
24:48 - Larger model offload: VRAM limits explained
26:37 - Wrap-up: Virtualisation and next steps
#AIhomeServer #aiserver #localllm










