Low Rank Adaptation (LoRA) - How to search for a needle in a much smaller haystack @SerranoAcademy
Low Rank Adaptation (LoRA) - How to search for a needle in a much smaller haystack  @SerranoAcademy
Uploaded August 2026 | Updated November 2026, 1 day ago
When you want to fine-tune a model with many parameters and you want to do it fast and effectively, Low Rank Adaptation (LoRA) is there to help you.
With LoRA, you trust that the base model is in a good state, and so you assume there may already be many dependencies among the parameters. Thus, you look for better parameters in a much smaller dimensional space.
Learn all about LoRA in this friendly video!

CORRECTION: (thanks @ryanhewitt9902!) At 30:14 the vector on the right should be [pa, qa, ra, sa, ta], instead of [p/a, q/a, r/a, s/a, t/a].
Low Rank Adaptation (LoRA) - How to search for a needle in a much smaller haystackTriple BAM! Live with Jon Krohn, Josh Starmer, and Luis Serrano!Did AI just solve a $1,000,000 math problem?Decision trees - A friendly introductionHow do Transformer Models keep track of the order of words? Positional EncodingA Friendly Introduction to Machine LearningThe worlds smallest attention mechanismStable Diffusion - How to build amazing images with AITalk about AI Agents live with Miguel Otero, Josh Starmer, Luis Serrano @TheNeuralMaze @statquestSupport Vector Machines (SVMs): A friendly introductionYou are much better at math than you thinkThe three steps to make a reliable chatbot: Preamble, Fine-tuning, and RAG
Luis Serrano Academy |

Low Rank Adaptation (LoRA) - How to search for a needle in a much smaller haystack

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER