Uploaded July 2025 | Updated September 2026, 1 hour ago

---

So this one’s been a while in the making. Honestly I’ve been pretty keen to truly get my head around vision transformers and figured this project could be the one. It took a month and a half to get it to this point and ton of banging my head against the keyboard to finally get it working (I’m looking at you ColorJitter 😒).

I want to keep this one going as a live project so i’ll be monitoring any issues you guys have a bit more closely. If you get stuck let me know and I’ll make as many updates as I can. Anyway, hope you enjoy it guys!

Code: github.com/nicknochnack/ViTCandlesticks

👨‍💻 Sign up for the Full Stack course and use YOUTUBE50 to get 50% off:
coursesfromnick.com/bundles/fullstackml

Stuff I found useful:
Albumentations: albumentations.ai/docs
CutMix/Mixup: docs.pytorch.org/vision/main/auto_examples/transforms/plot_cutmix_mixup.html
Lucid Rains ViT for PyTorch: github.com/lucidrains/vit-pytorch/tree/main/vit_pytorch

Oh, and don't forget to connect with me!
LinkedIn: bit.ly/324Epgo
Facebook: bit.ly/3mB1sZD
GitHub: bit.ly/3mDJllD
Patreon: bit.ly/2OCn3UW
Join the Discussion on Discord: bit.ly/3dQiZsV

Happy coding!
Nick