Finetuning Open-Source LLMs @SebastianRaschka
Finetuning Open-Source LLMs  @SebastianRaschka
Uploaded October 2023 | Updated September 2026, 2 weeks ago
Sebastian's books: sebastianraschka.com/books

This video offers a quick dive into the world of finetuning Large Language Models (LLMs). This video covers

- common usage scenarios for pretrained LLMs
- parameter-efficient finetuning
- a hands-on guide to using the 'lit-GPT' open-source repository for LLM finetuning

#FineTuning #LargeLanguageModels #LLMs #OpenAI #DeepLearning

Useful links to resources discussed in this video:

Code for the LLM classifier: github.com/rasbt/LLM-finetuning-scripts/tree/main/conventional/distilbert-movie-review

Lit-GPT repository: github.com/Lightning-AI/lit-gpt

NeurIPS LLM efficiency challenge: llm-efficiency-challenge.github.io

My latest articles on LLM research: magazine.sebastianraschka.com

---

To support this channel, please consider purchasing a copy of my books: sebastianraschka.com/books

---

twitter.com/rasbt
linkedin.com/in/sebastianraschka
Finetuning Open-Source LLMsL9.4 Overfitting and UnderfittingL9.5.2 Custom DataLoaders in PyTorch  Code Example13.1 The Different Categories of Feature Selection (L13: Feature Selection)L13.0 Introduction to Convolutional Networks   Lecture OverviewL19.5.2.1 Some Popular Transformer Models: BERT, GPT, and BART   OverviewL5.7 Training an Adaptive Linear Neuron (Adaline)L19.4.1 Using Attention Without the RNN   A Basic Form of Self-AttentionL8.4 Logits and Cross EntropyManaging Sources of Randomness When Training Deep Neural NetworksL16.3 Convolutional Autoencoders & Transposed ConvolutionsLLMs: A Journey Through Time and Architecture
Sebastian Raschka |

Finetuning Open-Source LLMs

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER