Uploaded May 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books
Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L19_seq2seq_rnn-transformers__slides.pdf
0:00 Introduction
0:29 BERT (Bidirectional Encoder Representations from Transformers)
1:44 BERT Inputs
4:18 BERT Pre-Training Task #1
9:47 BERT Pre-Training & Downstream Tasks
11:51 Transformer Training Approach
12:16 BERT Pre-Training & Fine-Tuning Approach
13:49 BERT vs GPT-v1 Performance
14:59 BERT Pre-Training & Feature-based Training
-------
This video is part of my Introduction of Deep Learning course.
Next video: youtu.be/BXv1m9Asl7I
The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51
A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html
-------
If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
Sebastian's books: sebastianraschka.com/books
Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L19_seq2seq_rnn-transformers__slides.pdf
0:00 Introduction
0:29 BERT (Bidirectional Encoder Representations from Transformers)
1:44 BERT Inputs
4:18 BERT Pre-Training Task #1
9:47 BERT Pre-Training & Downstream Tasks
11:51 Transformer Training Approach
12:16 BERT Pre-Training & Fine-Tuning Approach
13:49 BERT vs GPT-v1 Performance
14:59 BERT Pre-Training & Feature-based Training
-------
This video is part of my Introduction of Deep Learning course.
Next video: youtu.be/BXv1m9Asl7I
The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51
A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html
-------
If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
