Uploaded August 2025 | Updated November 2026, 22 hours ago
My food tracker needs a barcode scanner, my barcode scanner needs a neural network, my neural network needs to be trained, training needs convolutions, convolutions need gradients, gradients are vanishing. What will we ever do?
Please consider supporting. This content WILL end some day, but every dollar I make pushes that day further out
Join on youtube for happy hour vods youtube.com/channel/UCXzL31BCxf8En1KT34gSK6g/join
Or on patreon patreon.com/sphaerophoria
Or on twitch twitch.tv/sphaerophoria
Or sponsor me on github (no benefits) github.com/sponsors/sphaerophoria
00:00 Intro
08:40 Visualize gradients
01:28:10 Debug small grads
02:02:45 Fix vanishing gradients
My food tracker needs a barcode scanner, my barcode scanner needs a neural network, my neural network needs to be trained, training needs convolutions, convolutions need gradients, gradients are vanishing. What will we ever do?
Please consider supporting. This content WILL end some day, but every dollar I make pushes that day further out
Join on youtube for happy hour vods youtube.com/channel/UCXzL31BCxf8En1KT34gSK6g/join
Or on patreon patreon.com/sphaerophoria
Or on twitch twitch.tv/sphaerophoria
Or sponsor me on github (no benefits) github.com/sponsors/sphaerophoria
00:00 Intro
08:40 Visualize gradients
01:28:10 Debug small grads
02:02:45 Fix vanishing gradients










