The Origin of Language Models (like ChatGPT) @CodeEmporium
The Origin of Language Models (like ChatGPT)  @CodeEmporium
Uploaded May 2023 | Updated November 2026, 1 day ago
SPONSOR
Get 20% off and be apart of a Premium Software Engineering Community for career advice and guidance: jointaro.com/r/ajayh486

ABOUT ME
⭕ Subscribe: youtube.com/c/CodeEmporium?sub_confirmation=1
📚 Medium Blog: medium.com/@dataemporium
💻 Github: github.com/ajhalthor
👔 LinkedIn: linkedin.com/in/ajay-halthor-477974bb

RESOURCES
[1 🔎] Claude Shanon's 1948 Publication that introduced ngrams and information theory: https://people.math.harvard.edu/~ctm/home/text/others/shannon/entropy/entropy.pdf
[2 🔎] Blog that shows how Claude Shanon linked Language to Math: linkedin.com/pulse/claude-shannons-information-theory-language-models-luis-lastras
[3 🔎] Section 3.9 talks more about ngram model: https://web.stanford.edu/~jurafsky/slp3/3.pdf
[4 🔎] This paper improves ngram, allowing it to predict words it has never seen before via smoothing: www-i6.informatik.rwth-aachen.de/publications/download/951/Kneser-ICASSP-1995.pdf


PLAYLISTS FROM MY CHANNEL
⭕ Transformers from scratch playlist: youtube.com/watch?v=QCJQG4DuHT0&list=PLTl9hO2Oobd97qfWC40gOSU8C0iu0m2l4
⭕ ChatGPT Playlist of all other videos: youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ
⭕ Transformer Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE
⭕ Convolutional Neural Networks: youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74
⭕ The Math You Should Know : youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h
⭕ Probability Theory for Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V
⭕ Coding Machine Learning: youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD
The Origin of Language Models (like ChatGPT)Traditional Time Series methods vs Machine Learning Methods #deeplearning  #machinelearningELMo vs BERTReinforcement Learning through Human Feedback - EXPLAINED! | RLHFBERT Pretaining in Detail #deeplearning  #machinelearningThis AI segments ANYTHING ... even VIDEO!Sequece to Sequence Recurrent Neural Networks #deeplearning #machinelearningSemantic Segmentation explained #deeplearning #machinelearningResNet - Explained!Paradigms of Machine Learning: Reinforcement LearningHyper parameters - EXPLAINED!Informer embeddings - EXPLAINED!
CodeEmporium |

The Origin of Language Models (like ChatGPT)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER