Uploaded June 2026 | Updated September 2026, 2 weeks ago
You guys can help me out over at Patreon, and that will help me keep my gear updated, and help me keep this quality content coming:
patreon.com/PaulMcWhorter
You can pick up a Jetson Orin Nano just like mine here:
amzn.to/4e61IuF
In this lesson I will show you how to get your Ollama LLMs running on the NVIDIA Jetson Orin Nano running under Jetpack 7.2 on the GPU. This is a follow on from our earlier lesson where we showed you how to install Ollama on the Orin. Today, we will do a deep dive and begin to look at performance, and investigate whether the models are running on GPU or CPU. For maximum performance it is imperative to get the work onto the GPU. I will show you how to understand this, then your benchmarks for different models
Leave a comment below. If you have the model leave a comment 'I am running with the Big Dogs Now? Also, be sure to complete the benchmark homework, and post your solution as a video on your channel, and in the description of your video, link back to this video.
You can get more resources on this lesson at our web site:
toptechboy.com/nvidia-jetson-orin-nano-secret-to-running-ollama-on-the-gpu
[Disclosure of Material Connection: I am a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to amazon.com. This means if you visit the link and purchase the item, I will receive an affiliate commission. Regardless, I only recommend products or services I use personally and believe will add value to my readers.]
#NVIDIA
#JetsonOrin
#EdgeAI *LEGAL DISCLAIMER:*
The code, hardware setups, circuit diagrams, mathematical calculations, and technical methods provided in this video are strictly for educational and demonstration purposes.
All math, code, and instructional content are provided "AS IS", without warranty of any kind, express or implied, including but not limited to guarantees of accuracy, completeness, or fitness for a specific purpose.
All hardware assembly, circuit wiring, and software execution are performed entirely at your own risk. The creator assumes no liability for equipment damage, component failure, data loss, or personal injury resulting from the use or implementation of any information or files presented in this content.
You guys can help me out over at Patreon, and that will help me keep my gear updated, and help me keep this quality content coming:
patreon.com/PaulMcWhorter
You can pick up a Jetson Orin Nano just like mine here:
amzn.to/4e61IuF
In this lesson I will show you how to get your Ollama LLMs running on the NVIDIA Jetson Orin Nano running under Jetpack 7.2 on the GPU. This is a follow on from our earlier lesson where we showed you how to install Ollama on the Orin. Today, we will do a deep dive and begin to look at performance, and investigate whether the models are running on GPU or CPU. For maximum performance it is imperative to get the work onto the GPU. I will show you how to understand this, then your benchmarks for different models
Leave a comment below. If you have the model leave a comment 'I am running with the Big Dogs Now? Also, be sure to complete the benchmark homework, and post your solution as a video on your channel, and in the description of your video, link back to this video.
You can get more resources on this lesson at our web site:
toptechboy.com/nvidia-jetson-orin-nano-secret-to-running-ollama-on-the-gpu
[Disclosure of Material Connection: I am a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to amazon.com. This means if you visit the link and purchase the item, I will receive an affiliate commission. Regardless, I only recommend products or services I use personally and believe will add value to my readers.]
#NVIDIA
#JetsonOrin
#EdgeAI *LEGAL DISCLAIMER:*
The code, hardware setups, circuit diagrams, mathematical calculations, and technical methods provided in this video are strictly for educational and demonstration purposes.
All math, code, and instructional content are provided "AS IS", without warranty of any kind, express or implied, including but not limited to guarantees of accuracy, completeness, or fitness for a specific purpose.
All hardware assembly, circuit wiring, and software execution are performed entirely at your own risk. The creator assumes no liability for equipment damage, component failure, data loss, or personal injury resulting from the use or implementation of any information or files presented in this content.
