Uploaded July 2026 | Updated November 2026, 1 hour ago
Please consider supporting. This content WILL end some day, but every dollar I make pushes that day further out
Join on youtube for happy hour vods youtube.com/channel/UCXzL31BCxf8En1KT34gSK6g/join
Or on patreon patreon.com/sphaerophoria
Or on twitch twitch.tv/sphaerophoria
Or sponsor me on github (no benefits) github.com/sponsors/sphaerophoria
00:00 Intro
06:45 What are tokens?
12:45 vocab.txt
37:37 Write tokenizer
01:00:25 mask??
01:11:20 Check our impl against original
01:38:22 Golden golden golden golden
01:47:46 Dashes are evil
Please consider supporting. This content WILL end some day, but every dollar I make pushes that day further out
Join on youtube for happy hour vods youtube.com/channel/UCXzL31BCxf8En1KT34gSK6g/join
Or on patreon patreon.com/sphaerophoria
Or on twitch twitch.tv/sphaerophoria
Or sponsor me on github (no benefits) github.com/sponsors/sphaerophoria
00:00 Intro
06:45 What are tokens?
12:45 vocab.txt
37:37 Write tokenizer
01:00:25 mask??
01:11:20 Check our impl against original
01:38:22 Golden golden golden golden
01:47:46 Dashes are evil










