Containerised LLMs Make Testing Simple & Reliable - Strix Halo Toolboxes @Jims-Garage
Containerised LLMs Make Testing Simple & Reliable - Strix Halo Toolboxes  @Jims-Garage
Uploaded October 2025 | Updated November 2026, 3 hours ago
AMD Strix Halo Toolboxes is an awesome open-source project created by Donato Capitella. His solution provides a way to rapidly spin up and spin down LLMs without ever neeeing to modify the host thanks to the use of Podman. Go and check it out.

Attention: When deleting a Toolbox created as Root, it may also remove the weights.

Strix Halo Toolboxes Repo: github.com/kyuz0/amd-strix-halo-toolboxes

GitHub Video Instructions:
github.com/JamesTurland/JimsGarage/tree/main/StrixHaloToolboxes

Support this channel to get access to perks:
youtube.com/channel/UCUUTdohVElFLSP4NBnlPEwA/join
Discord: discord.gg/qW5vEBekz5
X: twitter.com/jimsgarage_
Bluesky: https://bsky.app/profile/jimsgarage.co.uk
Reddit: reddit.com/user/Jims-Garage
GitHub: github.com/JamesTurland/JimsGarage

00:00 - Introduction to the AMD Strix Halo Toolboxes
00:42 - Introduction from Donato Capitella
04:45 - Project Overview
06:12 - Prerequisites & Setup
12:45 - Deploying Models
19:20 - Testing LLMs
21:06 - Outro
Containerised LLMs Make Testing Simple & Reliable - Strix Halo ToolboxesSimple, Secure, and Free! Minecraft Server At HomeNordVPN Wireguard - Its So Fast!!!Upgrading CCTV and Testing Network CablesRecommended Hardware To Start Or Expand Your Homelab. Budget and Premium Options.Use Proxmox Cloud-Init to Deploy Your Virtual Machines! Kubernetes At Home - Part 2Homelab Monitoring Made Easy - Part 1: Tools Overview - Grafana, Prometheus, InfluxDB, TelegrafRunning LLMs Locally - MinisForum MS-S1 MAX ReviewPrivate Video Calls with MiroTalkProtecting Homelab Apps with BunkerWebTrueNAS Drive ReplacementInternet Upgrade Time, Its CRAZY Fast! (Nearly!)
Jims Garage |

Containerised LLMs Make Testing Simple & Reliable - Strix Halo Toolboxes

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER