Neural network training just gives up sometimes @sphaerophoria
Neural network training just gives up sometimes  @sphaerophoria
Uploaded August 2025 | Updated November 2026, 22 hours ago
My food tracker needs a barcode scanner, my barcode scanner needs a neural network, my neural network needs to be trained, training needs convolutions, convolutions need gradients, gradients are vanishing. What will we ever do?

Please consider supporting. This content WILL end some day, but every dollar I make pushes that day further out

Join on youtube for happy hour vods youtube.com/channel/UCXzL31BCxf8En1KT34gSK6g/join
Or on patreon patreon.com/sphaerophoria
Or on twitch twitch.tv/sphaerophoria
Or sponsor me on github (no benefits) github.com/sponsors/sphaerophoria

00:00 Intro
08:40 Visualize gradients
01:28:10 Debug small grads
02:02:45 Fix vanishing gradients
Neural network training just gives up sometimesA hot take I guess...event loops, item pools, bitsets, oh myTHATS NOT INTERPOLATION PIL... WHAT ARE YOU DOING?Isolating barcodes from larger imagesWriting the worlds worst parser generatorMocking a USB controller one byte at a timeAbusing ICC profiles, and it actually worksTCP echo with io uringOpening an MP4... the hard wayGPU programming is weird and hardzero dependency animated gif viewer
sphaerophoria |

Neural network training just gives up sometimes

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER