Uploaded February 2020 | Updated September 2026, 2 weeks ago
CUDA stands for Compute Unified Device Architecture, and it’s the reason popular deep learning libraries like Tensorflow & PyTorch are considered “GPU-accelerated”. CUDA is Nvidia’s programming platform that enables developers to leverage the full parallel processng capabilities of GPUs for deep learning applications. Almost all of the major deep learning libraries use CUDA under the hood, but it’s not really something that most developers think about often. In this episode, I’ll demo some progressively more complex CUDA examples by Nvidia to show you how using CUDA results in algorithmic speedups. We’ll use Nvidia’s profiler to clock speeds, then we’ll analyze a pure-CUDA neural network by Sergey Bugrov to understand how a full neural pipeline on the GPU looks like. Enjoy!
TWITTER: bit.ly/2OHYLbB
WEBSITE: bit.ly/2OoVPQF
INSTAGRAM: bit.ly/312pLUb
FACEBOOK: bit.ly/2OqOhx1
Subscribe for more educational videos! It means a lot to me.
Notebook shown in the video can be found here. It’s kind of messy! It’s a compilation of various code samples by the Nvidia team + Sergey’s neural network. It’s also got the CUDA install steps for Colab:
bit.ly/2uzg9FZ
Nvidia’s CUDA Documentation:
docs.nvidia.com
Some awesome tutorials by Nvidia on CUDA that helped me:
cuda-tutorial.readthedocs.io/en/latest/tutorials/tutorial01
nvidia.com/docs/IO/116711/sc11-cuda-c-basics.pdf?ncid=afm-chs-44270&ranMID=44270&ranEAID=a1LgFw09t88&ranSiteID=a1LgFw09t88-KKE5_jWEjojhZ.2QlWJosA
devblogs.nvidia.com/even-easier-introduction-cuda
Are you a total beginner to machine learning? Watch this:
youtube.com/watch?v=Cr6VqTRO1v0
Learn Python:
youtube.com/watch?v=T5pRlIbr6gg
Live C Programming:
youtube.com/watch?v=giF8XoPTMFg
CUDA Explained:
youtube.com/watch?v=1cHx1baKqq0
Hit the Join button above to sign up to become a member of my channel for access to exclusive live streams!
Signup for my newsletter for exciting updates in the field of AI:
goo.gl/FZzJ5w
Credits:
Nvidia team
Sergei Bugrov
Image assets are from across the Web, i take no credit for them
And please support me on Patreon:
patreon.com/user?u=3191693 Join my AI community: chatgptschool.io Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz
CUDA stands for Compute Unified Device Architecture, and it’s the reason popular deep learning libraries like Tensorflow & PyTorch are considered “GPU-accelerated”. CUDA is Nvidia’s programming platform that enables developers to leverage the full parallel processng capabilities of GPUs for deep learning applications. Almost all of the major deep learning libraries use CUDA under the hood, but it’s not really something that most developers think about often. In this episode, I’ll demo some progressively more complex CUDA examples by Nvidia to show you how using CUDA results in algorithmic speedups. We’ll use Nvidia’s profiler to clock speeds, then we’ll analyze a pure-CUDA neural network by Sergey Bugrov to understand how a full neural pipeline on the GPU looks like. Enjoy!
TWITTER: bit.ly/2OHYLbB
WEBSITE: bit.ly/2OoVPQF
INSTAGRAM: bit.ly/312pLUb
FACEBOOK: bit.ly/2OqOhx1
Subscribe for more educational videos! It means a lot to me.
Notebook shown in the video can be found here. It’s kind of messy! It’s a compilation of various code samples by the Nvidia team + Sergey’s neural network. It’s also got the CUDA install steps for Colab:
bit.ly/2uzg9FZ
Nvidia’s CUDA Documentation:
docs.nvidia.com
Some awesome tutorials by Nvidia on CUDA that helped me:
cuda-tutorial.readthedocs.io/en/latest/tutorials/tutorial01
nvidia.com/docs/IO/116711/sc11-cuda-c-basics.pdf?ncid=afm-chs-44270&ranMID=44270&ranEAID=a1LgFw09t88&ranSiteID=a1LgFw09t88-KKE5_jWEjojhZ.2QlWJosA
devblogs.nvidia.com/even-easier-introduction-cuda
Are you a total beginner to machine learning? Watch this:
youtube.com/watch?v=Cr6VqTRO1v0
Learn Python:
youtube.com/watch?v=T5pRlIbr6gg
Live C Programming:
youtube.com/watch?v=giF8XoPTMFg
CUDA Explained:
youtube.com/watch?v=1cHx1baKqq0
Hit the Join button above to sign up to become a member of my channel for access to exclusive live streams!
Signup for my newsletter for exciting updates in the field of AI:
goo.gl/FZzJ5w
Credits:
Nvidia team
Sergei Bugrov
Image assets are from across the Web, i take no credit for them
And please support me on Patreon:
patreon.com/user?u=3191693 Join my AI community: chatgptschool.io Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz
