Building an AI Home Server - Can LLMs Run Locally? PART 1 @A2KMedia
Building an AI Home Server - Can LLMs Run Locally? PART 1  @A2KMedia
Uploaded August 2025 | Updated November 2026, 2 hours ago
Can a local AI server actually replace the cloud at home? I’ve built a rack-friendly Threadripper rig and run some tests to see what it can do.

In the next video we will move to Proxmox, GPU passthrough and tuning across RTX 3090 and W7800. Subscribe so you don’t miss the virtualised tests and optimisations.

Home AI Server - Setting Up // I Created A Tool To Test AI. PART 2 - youtu.be/-TIp-6EWoEw

----------------------------------------------------------------------------------------------------------------------------------------------
Affiliate disclosure: as an Amazon Associate, we may earn commissions from qualifying purchases from Amazon at no extra cost to you. Thank you for your support!

ASUS Pro WS TRX50-SAGE WIFI
Amazon: geni.us/BbJLur

AMD Ryzen Threadripper 7970X
Amazon: geni.us/yzLlf

G.SKILL Zeta R5 NEO Series
Amazon: geni.us/nys6up

Noctua NH-D9 TR5-SP6 4U
Amazon: geni.us/zZOQ

AMD Radeon Pro W7800
Amazon: geni.us/cE0K

Palit RTX 3090 GamingPro
Unavailable

Kingston SA400S37/480G A400 SSD 480GB
Amazon: geni.us/yrssUBS

Kingston Fury Renegade G5
Amazon: geni.us/CRQPMA

Music from Artlist. Sign up and get 2 extra months for free: geni.us/a2k_artlist

Main Set:
Sit/Stand Ergonomic desk from Everdesk+


Our Gear


Main Camera
Amazon geni.us/ew4bW

Zoom lens:
Amazon: geni.us/po8arxf
Lazada: bit.ly/2HGJGnk

Wide angle lens:
Amazon: geni.us/GV1qFYY
Lazada: bit.ly/31Rlmq1


Mic
geni.us/mrkWeym



YouTube Management Tool - Tube Buddy
Sign up for free now! -tubebuddy.com/A2K

Follow us on Instagram:
instagram.com/a2kpage

Check out A2K blog: a2kmedia.net

Chapters:
00:00 - Intro
00:33 - Motherboard: ASUS Pro WS TRX50 Sage
01:00 - CPU: Threadripper 7970X
01:18 - GPU 1: RTX 3090
01:31 - GPU 2: Radeon Pro W7800
01:55 - Cooling: Noctua NH-D9 TR5-SP6
02:10 - Storage plan: Kingston SATA OS + Gen5 NVMe
02:41 - RAM: G.Skill Fury 128 GB DDR5-6400
03:18 - Build: board tour
04:56 - Installing the Threadripper
07:09 - NVMe placement: Gen4 vs Gen5 slots
09:33 - Cooler installation
12:47 - Memory install tips
14:29 - SATA OS drives, Windows now, Proxmox next
17:06 - W7800 vs chunky 3090
19:35 - Boot fix
20:21 - Cinebench multi-core results
22:27 - Gen5 RAID0 - CrystalDiskMark
23:35 - LM Studio small model GPTOSS
24:48 - Larger model offload: VRAM limits explained
26:37 - Wrap-up: Virtualisation and next steps

#AIhomeServer #aiserver #localllm
Building an AI Home Server - Can LLMs Run Locally? PART 1Speed up your laptop in 5 minutes! Quick upgrade guideOffice vs Gaming Chair from Okamura - Striker vs Contessa IIAMDs Power Color Red Devil RX 9070 and 9070 XT Thermals, Noise Levels And MoreAMD Ryzen 7950x 3D - Theres MORE To It Than You Think!Balanced AMD Build in Silverstone ALTA G1M CaseVilno Kneeling Chair - DID I Convert?More than just RGB upgrade - Fractal Meshify 2 Compact RGBRadeon 7900 XT vs. RTX 4080: Why Pay 33% MORE For Slightly More Performance?HUAWEI P50 Pro vs P50 Pocket vs Samsung S21 Ultra - Camera ReviewWhat A Way To END Z790 Series - ASUS ROG MAXIMUS Z790 DARK HEROBusiness At The Front, Party At The Back: TUF GAMING Z790-BTF Motherboard
A2K |

Building an AI Home Server - Can LLMs Run Locally? PART 1

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER