ChatGPT: Zero to Hero @CodeEmporium
ChatGPT: Zero to Hero  @CodeEmporium
Uploaded September 2023 | Updated November 2026, 3 hours ago
ChatGPT from zero to hero.

ABOUT ME
⭕ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: medium.com/@dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 🔎] Transformer Neural Networks video: youtube.com/watch?v=TQQlZhbC5ps
[2 🔎] ChatGPT blog: openai.com/blog/chatgpt
[3 🔎] Proximal Policy Optimization is how ChatGPT makes use of human rankings to update model parameters and make it more "safe" and "truthful": openai.com/blog/openai-baselines-ppo
[4 🔎] Here is a paper that shows how Reinforcement learning through human feedback actually helps: arxiv.org/pdf/2009.01325.pdf
[5 🔎] Every timestep, a subword token is generated. Here is some more information on this process with BPE: towardsdatascience.com/byte-pair-encoding-subword-based-tokenization-algorithm-77828a70bee0
[6 🔎] Basic Concepts in Reinforcement Learning: baeldung.com/cs/ml-policy-reinforcement-learning
[7 🔎] What is GPT-3.5? beta.openai.com/docs/model-index-for-researchers
[8🔎] GPT-3 Main Paper: arxiv.org/pdf/2005.14165.pdf
[9 🔎] GPT-2 Main Paper: d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf
[10 🔎] GPT original paper: s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
[11 🔎] A very Nice intuitive understanding of GPT-3 architecture: https://dugas.ch/artificial_curiosity/GPT_architecture.html
[12 🔎] Why Does GPT-3 write non-sensical stuff that sounds legit? alignmentforum.org/posts/BgoKdAzogxmgkuuAt/behavior-cloning-is-miscalibrated
[13 🔎] Main paper for instructGPT (the model ChatGPT was modeled after): arxiv.org/pdf/2203.02155.pdf
[14 🔎] Likert Scale: youtube.com/watch?v=Tf_71r1Ve5w
[15 🔎] Human feedback used in training ChatGPT: arxiv.org/pdf/2009.01325.pdf
[16 🔎] Reinforcement Learning explained : karpathy.github.io/2016/05/31/rl
[17 🔎] Example to show how the policy backward step is only called when an episode (a sequence of actions that is complete response in ChatGPT) is complete: gist.github.com/karpathy/a4166c7fe253700972fcbc77e4ea32c5
[18 🔎] Dictionary of Terms in Reinforcement Learning: towardsdatascience.com/the-complete-reinforcement-learning-dictionary-e16230b7d24e


RESOURCES

PLAYLISTS FROM MY CHANNEL
⭕ ChatGPT Playlist of all other videos: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
⭕ Transformer Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
⭕ The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
⭕ Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
⭕ Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD


MATH COURSES (7 day free trial)
📕 Mathematics for Machine Learning: imp.i384100.net/MathML
📕 Calculus: imp.i384100.net/Calculus
📕 Statistics for Data Science: imp.i384100.net/AdvancedStatistics
📕 Bayesian Statistics: imp.i384100.net/BayesianStatistics
📕 Linear Algebra: imp.i384100.net/LinearAlgebra
📕 Probability: imp.i384100.net/Probability

OTHER RELATED COURSES (7 day free trial)
📕 ⭐ Deep Learning Specialization: imp.i384100.net/Deep-Learning
📕 Python for Everybody: imp.i384100.net/python
📕 MLOps Course: imp.i384100.net/MLOps
📕 Natural Language Processing (NLP): imp.i384100.net/NLP
📕 Machine Learning in Production: imp.i384100.net/MLProduction
📕 Data Science Specialization: imp.i384100.net/DataScience
📕 Tensorflow: imp.i384100.net/Tensorflow

0:00 Introduction
0:47 Fundamental Concepts
7:35 Overview of ChatGPT working
10:18 Step 1: GPT in ChatGPT
23:06 Step 2: Rewards Model
37:37 Step 3: Use Reinforcement Learning to fine tune ChatGPT
48:47 Conclusion
ChatGPT: Zero to HeroHistory of text summarizationWhat is word2vec?Perceptron - Explained!Did SAM Kill YOLO?BERT: How to construct input embeddings? #deeplearning #machinelearninggenAI vs ChatGPT vs LLMs - Buzzwords Explained!what are sentence transformersResidual Error vs Irreducible Error in Linear Regression #deeplearning #machinelearningMatrices in Linear Regression #machinelearningElements of Reinforcement LearningWhat is ELMo? #bert #chatgpt #deeplearning
CodeEmporium |

ChatGPT: Zero to Hero

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER