Uploaded August 2021 | Updated November 2026, 4 days ago
An actually-open-AI model is available for you to download the weights to and tinker with, GPT-J. It's a 6 billion parameter large language model that can do long-form natural language generation, do programming, be a chatbot, do translations, and much more.
GPT-J Text examples: pythonprogramming.net/GPT-J-6b-parm-transformer
GPT-J Github: github.com/kingoflolz/mesh-transformer-jax
The Pile paper: arxiv.org/pdf/2101.00027.pdf
GPT-J Web demo: 6b.eleuther.ai
EleutherAI: eleuther.ai
Multimodal Few-Shot Learning with
Frozen Language Models: arxiv.org/pdf/2106.13884.pdf
Neural Networks from Scratch book: nnfs.io
Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join
Discord: discord.gg/sentdex
Reddit: reddit.com/r/sentdex
Support the content: pythonprogramming.net/support-donate
Twitter: twitter.com/sentdex
Instagram: instagram.com/sentdex
Facebook: facebook.com/pythonprogramming.net
Twitch: twitch.tv/sentdex
An actually-open-AI model is available for you to download the weights to and tinker with, GPT-J. It's a 6 billion parameter large language model that can do long-form natural language generation, do programming, be a chatbot, do translations, and much more.
GPT-J Text examples: pythonprogramming.net/GPT-J-6b-parm-transformer
GPT-J Github: github.com/kingoflolz/mesh-transformer-jax
The Pile paper: arxiv.org/pdf/2101.00027.pdf
GPT-J Web demo: 6b.eleuther.ai
EleutherAI: eleuther.ai
Multimodal Few-Shot Learning with
Frozen Language Models: arxiv.org/pdf/2106.13884.pdf
Neural Networks from Scratch book: nnfs.io
Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join
Discord: discord.gg/sentdex
Reddit: reddit.com/r/sentdex
Support the content: pythonprogramming.net/support-donate
Twitter: twitter.com/sentdex
Instagram: instagram.com/sentdex
Facebook: facebook.com/pythonprogramming.net
Twitch: twitch.tv/sentdex










