Uploaded June 2022 | Updated September 2026, 1 week ago
β€οΈ Become The AI Epiphany Patreon β€οΈ
patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community π¨βπ©βπ§βπ¦
discord.gg/peBrCpheKE
The second video in the ML coding series! The longest video I ever made!
In this video I do a code walkthrough of Facebook's DETR model from the "End-to-End Object Detection with Transformers" paper.
Let me know what you'd like me to cover next!
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
β DETR GitHub: github.com/facebookresearch/detr
β DETR Paper: arxiv.org/abs/2005.12872
β Mini COCO: github.com/giddyyupp/coco-minitrain
I edited the download/sampling scripts and ended up downloading a valid dataset that has only 100 images.
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 DETR model recap
00:07:30 DETR demo notebook
00:18:55 Visualizing attention notebook
00:29:50 Visualizing encoder attention
00:36:45 Going through the training script
00:38:45 Backbone construction
00:42:05 DETR construction
00:54:00 Data loading and nested tensors
01:02:30 Forward pass through ResNet backbone
01:09:00 Forward pass through the transformer
01:22:00 Hungarian matching algorithm
01:32:50 Loss calculation
01:40:50 Outro
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° BECOME A PATREON OF THE AI EPIPHANY β€οΈ
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#detr #transformers #coding
β€οΈ Become The AI Epiphany Patreon β€οΈ
patreon.com/theaiepiphany
π¨βπ©βπ§βπ¦ Join our Discord community π¨βπ©βπ§βπ¦
discord.gg/peBrCpheKE
The second video in the ML coding series! The longest video I ever made!
In this video I do a code walkthrough of Facebook's DETR model from the "End-to-End Object Detection with Transformers" paper.
Let me know what you'd like me to cover next!
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
β DETR GitHub: github.com/facebookresearch/detr
β DETR Paper: arxiv.org/abs/2005.12872
β Mini COCO: github.com/giddyyupp/coco-minitrain
I edited the download/sampling scripts and ended up downloading a valid dataset that has only 100 images.
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
βοΈ Timetable:
00:00:00 DETR model recap
00:07:30 DETR demo notebook
00:18:55 Visualizing attention notebook
00:29:50 Visualizing encoder attention
00:36:45 Going through the training script
00:38:45 Backbone construction
00:42:05 DETR construction
00:54:00 Data loading and nested tensors
01:02:30 Forward pass through ResNet backbone
01:09:00 Forward pass through the transformer
01:22:00 Hungarian matching algorithm
01:32:50 Loss calculation
01:40:50 Outro
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
π° BECOME A PATREON OF THE AI EPIPHANY β€οΈ
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany - patreon.com/theaiepiphany
One-time donation - paypal.com/paypalme/theaiepiphany
Huge thank you to these AI Epiphany patreons:
Eli Mahler
Petar VeliΔkoviΔ
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
πΌ LinkedIn - linkedin.com/in/aleksagordic
π¦ Twitter - twitter.com/gordic_aleksa
π¨βπ©βπ§βπ¦ Discord - discord.gg/peBrCpheKE
πΊ YouTube - youtube.com/c/TheAIEpiphany
π Medium - gordicaleksa.medium.com
π» GitHub - github.com/gordicaleksa
π’ AI Newsletter - aiepiphany.substack.com
β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬β¬
#detr #transformers #coding
