Digital Spaceport | NVIDIA Nemotron 70b Local AI Testing - The BEST Open Source LLM? @DigitalSpaceport | Uploaded October 2024 | Updated October 2024, 1 hour ago.
Nvidia has released the Nemotron 70b which which is now also on ollama so it we can run it in our Ai Homelab setup! It is rather good, but is it the new best Ai for your homelab?
AI Home Server Quad 3090 Build youtu.be/JN4EhaM7vyw
Quick Article blog.getbind.co/2024/10/17/llama-3-1-nemotron-70b-is-it-better-for-coding-compared-to-gpt-4o-and-claude-3-5-sonnet
QUAD 3090 AI SERVER BUILD
GPU Rack Frame geni.us/GPU_Rack_Frame
RTX 3090 24GB GPU (x4) geni.us/GPU3090
Gigabyte MZ32-AR0 Motherboard geni.us/mz32-ar0_motherboard
Kritical Thermal GPU Pads geni.us/Kritical-Thermal-Pads
256GB (8x32GB) DDR4 2400 RAM geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) geni.us/PCIe4_Riser_Cable
AMD EPYC 7702p geni.us/EPYC_7702p
iCUE H170i ELITE CAPELLIX geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
ARCTIC MX4 Thermal Paste geni.us/Arctic_ThermalPaste
CORSAIR HX1500i PSU geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4) geni.us/SFF8654_to_SFF8654
HDD Rack Screws for Fans geni.us/HDD_RackScrews
Chapters
0:00 AI benchmarking
1:34 Nemotron Ollama OpenWEBUI Setup
2:56 Nemotron Code - Flappybird Clone
6:48 Ethics - Armageddon with
10:19 Random Counting
10:49 Static Counting
11:15 Number Comparison
11:37 Recipe from Ingredients
13:48 Physical Fitness Coach
16:29 Counting Letters and Vowels
17:24 CatsTimeline
18:35 Mathematics Pi Decimals
Be sure to 👍✅Subscribe✅👍 for more content like this!
Join this channel youtube.com/@DigitalSpaceport/join
Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!
Digital Spaceport Website
🌐 digitalspaceport.com
🛒Shop (Channel members get a 3% or 5% discount)
Check out Shop.DigitalSpaceport.com for great deals on hardware and merch.
*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****
Nvidia has released the Nemotron 70b which which is now also on ollama so it we can run it in our Ai Homelab setup! It is rather good, but is it the new best Ai for your homelab?
AI Home Server Quad 3090 Build youtu.be/JN4EhaM7vyw
Quick Article blog.getbind.co/2024/10/17/llama-3-1-nemotron-70b-is-it-better-for-coding-compared-to-gpt-4o-and-claude-3-5-sonnet
QUAD 3090 AI SERVER BUILD
GPU Rack Frame geni.us/GPU_Rack_Frame
RTX 3090 24GB GPU (x4) geni.us/GPU3090
Gigabyte MZ32-AR0 Motherboard geni.us/mz32-ar0_motherboard
Kritical Thermal GPU Pads geni.us/Kritical-Thermal-Pads
256GB (8x32GB) DDR4 2400 RAM geni.us/256GB_DDR4_RAM
PCIe4 Risers (x4) geni.us/PCIe4_Riser_Cable
AMD EPYC 7702p geni.us/EPYC_7702p
iCUE H170i ELITE CAPELLIX geni.us/iCUE_H170i_Capellix
(sTRX4 fits SP3 and retention kit comes with the CAPELLIX)
ARCTIC MX4 Thermal Paste geni.us/Arctic_ThermalPaste
CORSAIR HX1500i PSU geni.us/Corsair_HX1500iPSU
4i SFF-8654 to 4i SFF-8654 (x4) geni.us/SFF8654_to_SFF8654
HDD Rack Screws for Fans geni.us/HDD_RackScrews
Chapters
0:00 AI benchmarking
1:34 Nemotron Ollama OpenWEBUI Setup
2:56 Nemotron Code - Flappybird Clone
6:48 Ethics - Armageddon with
10:19 Random Counting
10:49 Static Counting
11:15 Number Comparison
11:37 Recipe from Ingredients
13:48 Physical Fitness Coach
16:29 Counting Letters and Vowels
17:24 CatsTimeline
18:35 Mathematics Pi Decimals
Be sure to 👍✅Subscribe✅👍 for more content like this!
Join this channel youtube.com/@DigitalSpaceport/join
Please share this video to help spread the word and drop a comment below with your thoughts or questions. Thanks for watching!
Digital Spaceport Website
🌐 digitalspaceport.com
🛒Shop (Channel members get a 3% or 5% discount)
Check out Shop.DigitalSpaceport.com for great deals on hardware and merch.
*****
As an Amazon Associate I earn from qualifying purchases.
When you click on links to various merchants on this site and make a purchase, this can result in this site earning a commission. Affiliate programs and affiliations include, but are not limited to, the eBay Partner Network.
*****
