Uploaded November 2017 | Updated November 2026, 2 days ago
CORRECTION: at 13:41, the probability is 6.1e-5 and not 4.8e-4 (however, the entropy is 1.75, which is correct). Thank you @dlyChimi!
Learn Shannon entropy and information gain by playing a game consisting in picking colored balls from buckets.
Announcement: New Book by Luis Serrano! Grokking Machine Learning. bit.ly/grokkingML
40% discount code: serranoyt
Accompanying blog post: medium.com/p/5810d35d54b4
0:00 Shannon Entropy and Information Gain
2:22 What ball will we pick?
4:33 Quiz
5:06 Question
5:14 Game
7:17 Probability of Winning
7:45 Products
11:00 What if there are more classes?
12:34 Sequence 2
13:44 Sequence 3
14:57 Naive Approach
15:34 Sequence 1
19:44 General Formula
CORRECTION: at 13:41, the probability is 6.1e-5 and not 4.8e-4 (however, the entropy is 1.75, which is correct). Thank you @dlyChimi!
Learn Shannon entropy and information gain by playing a game consisting in picking colored balls from buckets.
Announcement: New Book by Luis Serrano! Grokking Machine Learning. bit.ly/grokkingML
40% discount code: serranoyt
Accompanying blog post: medium.com/p/5810d35d54b4
0:00 Shannon Entropy and Information Gain
2:22 What ball will we pick?
4:33 Quiz
5:06 Question
5:14 Game
7:17 Probability of Winning
7:45 Products
11:00 What if there are more classes?
12:34 Sequence 2
13:44 Sequence 3
14:57 Naive Approach
15:34 Sequence 1
19:44 General Formula









![Low Rank Adaptation (LoRA) - How to search for a needle in a much smaller haystack
When you want to fine-tune a model with many parameters and you want to do it fast and effectively, Low Rank Adaptation (LoRA) is there to help you.
With LoRA, you trust that the base model is in a good state, and so you assume there may already be many dependencies among the parameters. Thus, you look for better parameters in a much smaller dimensional space.
Learn all about LoRA in this friendly video!
CORRECTION: (thanks @ryanhewitt9902!) At 30:14 the vector on the right should be [pa, qa, ra, sa, ta], instead of [p/a, q/a, r/a, s/a, t/a]. Low Rank Adaptation (LoRA) - How to search for a needle in a much smaller haystack](https://i.ytimg.com/vi/Gy9jrVQTY4Q/mqdefault.jpg)
