Alex Ziskind | Cheap mini runs a 70B LLM ๐คฏ @AZisk | Uploaded September 2024 | Updated October 2024, 3 hours ago.
I put 96GB of RAM in this tiny mini PC and ran Llama 70B LLM on it.
Chair: Doro S100 Chair - enjoy 6%OFF: YTBZIS
USA&CA: sihoooffice.com/DoroS100-AlexZiskind
EU&UK: de.sihoooffice.com/DoroS100-AlexZiskind
Amazon๏ผamzn.to/3V9A5t8
๐ Gear Links ๐
* ๐๐ฅ K9 Mini with 32GB RAM: amzn.to/3ZiKjcp
* ๐ ๏ธ๐ 96GB RAM kit: amzn.to/3ZhQ4qR
* ๐ป๐ Renewed MacBook Air M1 Deal: amzn.to/45K1Gmk
* ๐งโก Great 40Gbps T4 enclosure: amzn.to/3JNwBGW
* ๐ ๏ธ๐ My nvme ssd: amzn.to/3YLEySo
* ๐ฆ๐ฎ My gear: amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
* ๐ RAM torture test on Mac - youtu.be/l3zIwPgan7M
* ๐ ๏ธ FREE Local LLMs on Apple Silicon | FAST! - youtu.be/bp2eev21Qfo
* ๐ ๏ธ Set up Conda - youtu.be/2Acht_5_HTo
* ๐ค INSANE Machine Learning on Neural Engine - youtu.be/Y2FOUg_jo7k
* ๐ ๏ธ Developer productivity Playlist - youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
๐ AI for Coding Playlist: ๐ - youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
โ โ โ โ โ โ โ โ โ
๐ฑ ALEX ON X: twitter.com/digitalix
#sihoo #sihoodoros100 #DefyGravityWithSihoo
#machinelearning #llm #softwaredevelopment
I put 96GB of RAM in this tiny mini PC and ran Llama 70B LLM on it.
Chair: Doro S100 Chair - enjoy 6%OFF: YTBZIS
USA&CA: sihoooffice.com/DoroS100-AlexZiskind
EU&UK: de.sihoooffice.com/DoroS100-AlexZiskind
Amazon๏ผamzn.to/3V9A5t8
๐ Gear Links ๐
* ๐๐ฅ K9 Mini with 32GB RAM: amzn.to/3ZiKjcp
* ๐ ๏ธ๐ 96GB RAM kit: amzn.to/3ZhQ4qR
* ๐ป๐ Renewed MacBook Air M1 Deal: amzn.to/45K1Gmk
* ๐งโก Great 40Gbps T4 enclosure: amzn.to/3JNwBGW
* ๐ ๏ธ๐ My nvme ssd: amzn.to/3YLEySo
* ๐ฆ๐ฎ My gear: amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
* ๐ RAM torture test on Mac - youtu.be/l3zIwPgan7M
* ๐ ๏ธ FREE Local LLMs on Apple Silicon | FAST! - youtu.be/bp2eev21Qfo
* ๐ ๏ธ Set up Conda - youtu.be/2Acht_5_HTo
* ๐ค INSANE Machine Learning on Neural Engine - youtu.be/Y2FOUg_jo7k
* ๐ ๏ธ Developer productivity Playlist - youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
๐ AI for Coding Playlist: ๐ - youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
โ โ โ โ โ โ โ โ โ
๐ฑ ALEX ON X: twitter.com/digitalix
#sihoo #sihoodoros100 #DefyGravityWithSihoo
#machinelearning #llm #softwaredevelopment