Alex Ziskind | Itโs overโฆmy new LLM Rig @AZisk | Uploaded October 2024 | Updated October 2024, 1 hour ago.
This runs faster than a Thunderbolt eGPU
๐ Gear Links ๐
* ๐ช๐ช Favorite knife: amzn.to/3zIYrkZ
* ๐๐ฅ Oculink dock: amzn.to/3Na7s9F
* ๐ป๐ Mini PC with 32GB RAM: amzn.to/3ZJEwNs
* ๐ ๏ธ๐ My RTX4090: amzn.to/3zRMmtG
* ๐งโก Power supply 1200W: amzn.to/3Ya7WDh
* ๐ ๏ธ๐ 96GB RAM kit: amzn.to/3ZhQ4qR
* ๐งโก Great 40Gbps T4 enclosure: amzn.to/3JNwBGW
* ๐ ๏ธ๐ My nvme ssd: amzn.to/3YLEySo
โจ๏ธ๐ข Keyboard: keychron.com/products/keychron-q1-max-qmk-via-wireless-custom-mechanical-keyboard?ref=azisk
* ๐ฆ๐ฎ My gear: amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
* ๐ RAM torture test on Mac - youtu.be/l3zIwPgan7M
* ๐ ๏ธ FREE Local LLMs on Apple Silicon | FAST! - youtu.be/bp2eev21Qfo
* ๐ ๏ธ Set up Conda - youtu.be/2Acht_5_HTo
* ๐ค INSANE Machine Learning on Neural Engine - youtu.be/Y2FOUg_jo7k
* ๐ ๏ธ Developer productivity Playlist - youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
๐ AI for Coding Playlist: ๐ - youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
โ โ โ โ โ โ โ โ โ
๐ฑ ALEX ON X: twitter.com/digitalix
#machinelearning #llm #softwaredevelopment
CHAPTERS
0:00 Unboxing
1:14 Installing RTX 4090
2:00 Setting Up Power Supply
2:46 Assembling GPU Dock
5:49 Software Installation
7:13 Running LLMs
9:59 Testing Larger Models
12:25 Testing Stable Diffusion
This runs faster than a Thunderbolt eGPU
๐ Gear Links ๐
* ๐ช๐ช Favorite knife: amzn.to/3zIYrkZ
* ๐๐ฅ Oculink dock: amzn.to/3Na7s9F
* ๐ป๐ Mini PC with 32GB RAM: amzn.to/3ZJEwNs
* ๐ ๏ธ๐ My RTX4090: amzn.to/3zRMmtG
* ๐งโก Power supply 1200W: amzn.to/3Ya7WDh
* ๐ ๏ธ๐ 96GB RAM kit: amzn.to/3ZhQ4qR
* ๐งโก Great 40Gbps T4 enclosure: amzn.to/3JNwBGW
* ๐ ๏ธ๐ My nvme ssd: amzn.to/3YLEySo
โจ๏ธ๐ข Keyboard: keychron.com/products/keychron-q1-max-qmk-via-wireless-custom-mechanical-keyboard?ref=azisk
* ๐ฆ๐ฎ My gear: amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
* ๐ RAM torture test on Mac - youtu.be/l3zIwPgan7M
* ๐ ๏ธ FREE Local LLMs on Apple Silicon | FAST! - youtu.be/bp2eev21Qfo
* ๐ ๏ธ Set up Conda - youtu.be/2Acht_5_HTo
* ๐ค INSANE Machine Learning on Neural Engine - youtu.be/Y2FOUg_jo7k
* ๐ ๏ธ Developer productivity Playlist - youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
๐ AI for Coding Playlist: ๐ - youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
โ โ โ โ โ โ โ โ โ
๐ฑ ALEX ON X: twitter.com/digitalix
#machinelearning #llm #softwaredevelopment
CHAPTERS
0:00 Unboxing
1:14 Installing RTX 4090
2:00 Setting Up Power Supply
2:46 Assembling GPU Dock
5:49 Software Installation
7:13 Running LLMs
9:59 Testing Larger Models
12:25 Testing Stable Diffusion