Uploaded March 2023 | Updated November 2026, 3 days ago
The official version PyTorch 2.0 just launched! In this video, I break down some of the updates and how you can use them in your PyTorch code.
Sign up for NVIDIA GTC March 2023 - nvda.ws/3GUZygQ
Details for giveaway - mrdbourke.com/pytorch-2
NVIDIA GTC sessions I'm going to:
Compile and train with 43% speedup using PyTorch 2.0 - dbourke.link/nvidia-gtc-2023-pytorch-2
Fireside Chat with Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future - dbourke.link/nvidia-gtc-2023-fireside-chat
Exploring next-generation methods for optimizing PyTorch models for inference with Torch-TensorRT - dbourke.link/nvidia-gtc-2023-torch-tensorrt
FP8 Mixed-Precision Training with Hugging Face Accelerate - dbourke.link/nvidia-gtc-2023-fp8-training
Generative AI Demystified - dbourke.link/nvidia-gtc-2023-generative-ai-demystified
PyTorch 2.0 resources:
PyTorch 2.0 technical overview - pytorch.org/get-started/pytorch-2.0
PyTorch 2.0 release notes - pytorch.org/blog/pytorch-2.0-release
PyTorch 2.0 on TIMM/Hugging Face models - pytorch.org/blog/Accelerating-Hugging-Face-and-TIMM-models
PyTorch 2.0 speedups on Diffusers - pytorch.org/blog/accelerated-diffusers-pt-20
Which GPU for deep learning by Tim Dettmers - timdettmers.com/2023/01/30/which-gpu-for-deep-learning
Make deep learning models go brrrr by Horace He - horace.io/brrr_intro.html
My PyTorch 2.0 code intro - github.com/mrdbourke/pytorch-deep-learning/blob/main/extras/pytorch_2_intro.ipynb
My PyTorch 2.0 benchmarks - github.com/mrdbourke/pytorch-deep-learning/tree/main/extras/pytorch_2_results
Other links:
Learn AI/ML (beginner-friendly courses I teach) - mrdbourke.com/ml-courses
AI/ML courses/books I recommend - mrdbourke.com/ml-resources
Read my novel Charlie Walks - charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
Twitter - twitter.com/mrdbourke
Twitch - twitch.tv/mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - Intro
0:10 - torch.compile()
0:53 - PyTorch 2.0 speedups
2:01 - PyTorch 2.0 new technologies
2:22 - Operator fusion
4:00 - Graph capture
5:14 - Other notable PyTorch 2.0 features
6:00 - GPU time
11:30 - NVIDIA GTC information and GPU giveaway details
#pytorch #ai
The official version PyTorch 2.0 just launched! In this video, I break down some of the updates and how you can use them in your PyTorch code.
Sign up for NVIDIA GTC March 2023 - nvda.ws/3GUZygQ
Details for giveaway - mrdbourke.com/pytorch-2
NVIDIA GTC sessions I'm going to:
Compile and train with 43% speedup using PyTorch 2.0 - dbourke.link/nvidia-gtc-2023-pytorch-2
Fireside Chat with Ilya Sutskever and Jensen Huang: AI Today and Vision of the Future - dbourke.link/nvidia-gtc-2023-fireside-chat
Exploring next-generation methods for optimizing PyTorch models for inference with Torch-TensorRT - dbourke.link/nvidia-gtc-2023-torch-tensorrt
FP8 Mixed-Precision Training with Hugging Face Accelerate - dbourke.link/nvidia-gtc-2023-fp8-training
Generative AI Demystified - dbourke.link/nvidia-gtc-2023-generative-ai-demystified
PyTorch 2.0 resources:
PyTorch 2.0 technical overview - pytorch.org/get-started/pytorch-2.0
PyTorch 2.0 release notes - pytorch.org/blog/pytorch-2.0-release
PyTorch 2.0 on TIMM/Hugging Face models - pytorch.org/blog/Accelerating-Hugging-Face-and-TIMM-models
PyTorch 2.0 speedups on Diffusers - pytorch.org/blog/accelerated-diffusers-pt-20
Which GPU for deep learning by Tim Dettmers - timdettmers.com/2023/01/30/which-gpu-for-deep-learning
Make deep learning models go brrrr by Horace He - horace.io/brrr_intro.html
My PyTorch 2.0 code intro - github.com/mrdbourke/pytorch-deep-learning/blob/main/extras/pytorch_2_intro.ipynb
My PyTorch 2.0 benchmarks - github.com/mrdbourke/pytorch-deep-learning/tree/main/extras/pytorch_2_results
Other links:
Learn AI/ML (beginner-friendly courses I teach) - mrdbourke.com/ml-courses
AI/ML courses/books I recommend - mrdbourke.com/ml-resources
Read my novel Charlie Walks - charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
Twitter - twitter.com/mrdbourke
Twitch - twitch.tv/mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - Intro
0:10 - torch.compile()
0:53 - PyTorch 2.0 speedups
2:01 - PyTorch 2.0 new technologies
2:22 - Operator fusion
4:00 - Graph capture
5:14 - Other notable PyTorch 2.0 features
6:00 - GPU time
11:30 - NVIDIA GTC information and GPU giveaway details
#pytorch #ai










![Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 2/2
You’ve made it to part 2 of the longest code-first learn TensorFlow and deep learning fundamentals video series on YouTube!
This part continues right where part one left off so get that Google Colab window open and get ready to write plenty more TensorFlow code.
Sign up for the full course - https://dbourke.link/ZTMTFcourse
Get all of the code/materials on GitHub - https://www.github.com/mrdbourke/tensorflow-deep-learning/
Ask a question - https://github.com/mrdbourke/tensorflow-deep-learning/discussions
See part 1 - https://youtu.be/tpCFfeUEGs8
TensorFlow Python documentation - https://www.tensorflow.org/api_docs/python/tf
Connect elsewhere:
Web - https://www.mrdbourke.com
Livestreams on Twitch - https://www.twitch.tv/mrdbourke
Get email updates on my work - https://www.mrdbourke.com/newsletter
Timestamps:
0:00 - Intro/hello/have you watched part 1? If not, you should
0:55 - 66. Non-linearity part 1 (straight lines and non-straight lines)
10:33 - 67. Non-linearity part 2 (building our first neural network with a non-linear activation function)
16:21 - 68. Non-linearity part 3 (upgrading our non-linear model with more layers)
26:40 - 69. Non-linearity part 4 (modelling our non-linear data)
35:18 - 70. Non-linearity part 5 (reproducing our non-linear functions from scratch)
49:45 - 71. Getting great results in less time by tweaking the learning rate
1:04:32 - 72. Using the history object to plot a model’s loss curves
1:10:43 - 73. Using callbacks to find a model’s ideal learning rate
1:28:16 - 74. Training and evaluating a model with an ideal learning rate
1:37:37 - [Keynote] 75. Introducing more classification methods
1:43:41 - 76. Finding the accuracy of our model
1:47:59 - 77. Creating our first confusion matrix
1:56:27 - 78. Making our confusion matrix prettier
2:10:28 - 79. Multi-class classification part 1 (preparing data)
2:21:04 - 80. Multi-class classification part 2 (becoming one with the data)
2:28:13 - 81. Multi-class classification part 3 (building a multi-class model)
2:43:52 - 82. Multi-class classification part 4 (improving our multi-class model)
2:56:35 - 83. Multi-class classification part 5 (normalised vs non-normalised)
3:00:48 - 84. Multi-class classification part 6 (finding the ideal learning rate)
3:11:27 - 85. Multi-class classification part 7 (evaluating our model)
3:25:34 - 86. Multi-class classification part 8 (creating a confusion matrix)
3:30:00 - 87. Multi-class classification part 9 (visualising random samples)
3:40:42 - 88. What patterns is our model learning?
#tensorflow #deeplearning #machinelearning Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 2/2](https://i.ytimg.com/vi/ZUKz4125WNI/mqdefault.jpg)