L19.4.3 Multi-Head Attention @SebastianRaschka
L19.4.3 Multi-Head Attention  @SebastianRaschka
Uploaded May 2021 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

Slides: sebastianraschka.com/pdf/lecture-notes/stat453ss21/L19_seq2seq_rnn-transformers__slides.pdf

-------

This video is part of my Introduction of Deep Learning course.

Next video: youtu.be/tstbZXNCfLY

The complete playlist: youtube.com/playlist?list=PLTKMiZHVd_2KJtIXOW0zFhFfBaJJilH51

A handy overview page with links to the materials: sebastianraschka.com/blog/2021/dl-course.html

-------

If you want to be notified about future videos, please consider subscribing to my channel: youtube.com/c/SebastianRaschka
L19.4.3 Multi-Head AttentionL14.4.2 All-Convolutional Network in PyTorch   Code ExampleL3.1 About Brains and NeuronsDeep Learning News #8 Mar 20 2021L19.5.2.4 GPT-v2: Language Models are Unsupervised Multitask LearnersL3.2 The Perceptron Learning RuleA Visual Tour of Modern LLM ArchitecturesL19.0 RNNs & Transformers for Sequence-to-Sequence Modeling   Lecture OverviewConditional Ordinal Regression for Neural Networks (CORN) With Examples in PyTorchL15.3 Different Types of Sequence Modeling TasksL17.7 VAE Latent Space Arithmetic in PyTorch   Making People Smile (Code Example)L2.0 A Brief History of Deep Learning   Lecture Overview
Sebastian Raschka |

L19.4.3 Multi-Head Attention

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER