StatQuest with Josh StarmerThe concepts behind linear regression, fitting a line to data with least squares and R-squared, are pretty darn simple, so let's get down to it! NOTE: This StatQuest comes with a companion video for how to do linear regression in R: youtu.be/u1cc1r_Y7M0 You can also find example code at the StatQuest github: github.com/StatQuest/linear_regression_demo
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 0:37 The Main Ideas!!! 1:12 Review of fitting a line to data 4:00 Review of R-squared 12:13 R-squared for a multivariable model 14:16 Why adding variables will never reduce R-squared 16:08 Calculating a p-value for R-squared 25:26 The F-distribution
Correction: 25:39 I should have (Pfit - Pmean) instead of the other way around.
Linear Regression, Clearly Explained!!!StatQuest with Josh Starmer2022-11-18 | The concepts behind linear regression, fitting a line to data with least squares and R-squared, are pretty darn simple, so let's get down to it! NOTE: This StatQuest comes with a companion video for how to do linear regression in R: youtu.be/u1cc1r_Y7M0 You can also find example code at the StatQuest github: github.com/StatQuest/linear_regression_demo
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 0:37 The Main Ideas!!! 1:12 Review of fitting a line to data 4:00 Review of R-squared 12:13 R-squared for a multivariable model 14:16 Why adding variables will never reduce R-squared 16:08 Calculating a p-value for R-squared 25:26 The F-distribution
Correction: 25:39 I should have (Pfit - Pmean) instead of the other way around.
#statquest #regressionHuman Stories in AI: Khushi JainStatQuest with Josh Starmer2024-03-18 | In this episode we have special guest Kushi Jain, who works in Data Analytics Development at John Deere and in the Master’s in Computer Science - Data Science at the University of Illinois. Having recently graduated with her bachelor’s, Kushi participated in the data science club and also completed several internships at John Deere.
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestHuman Stories in AI: Achal DixitStatQuest with Josh Starmer2024-03-04 | In this episode we have special guest Achal Dixit, a Data Scientist at Delhivery, the largest fully integrated logistics services in India. Achal solves problems using Data, statistics, and machine learning with a focus on business and people. Before Delhivery, Achal was a Business Technology Analyst at ZS. And before that, Achal was a research assistant at Imperial College London.
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestHuman Stories in AI: Rick MarksStatQuest with Josh Starmer2024-02-19 | In this episode we have special guest Rick Marks, a professor at the University of North Carolina Chapel Hill School of Data Science and Society. Before UNC, Rick was a director at Google's Advanced Technology and Projects group, exploring new interaction approaches for ambient computing environments. And before that, Rick founded the PlayStation Magic Lab at PlayStation R&D.
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestEssential Matrix Algebra for Neural Networks, Clearly Explained!!!StatQuest with Josh Starmer2023-12-11 | Although you don't need to know matrix algebra to understand the ideas behind neural networks, if you want to code them or read the latest manuscripts about the field, then you'll need to understand matrix algebra. This video teaches the essential topics in matrix algebra and shows how a neural network can be written as a matrix equation, and then shows how understand PyTorch documentation, error messages and the equations for Attention, which is the fundamental concept behind ChatGPT.
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 2:35 Introduction to linear transformations 5:57 Linear transformations in matrix notation 7:34 Matrix multiplication 11:03 Matrix multiplication consolidates a sequence of linear transformations 13: 46 Order matters for matrix multiplication 15:18 Transposing a matrix 16:37 Matrix notation and equations 18:51 Using matrix equations to describe a neural network 24:26 nn.Linear() documentation explained 26:38 1-D vs 2-D error messages explained 27:17 The matrix equation for Attention explained
#StatQuest #neuralnetworks #matrixalgebraWord Embedding in PyTorch + LightningStatQuest with Josh Starmer2023-11-06 | Word embedding is the first step in lots of neural networks, including Transformers (like ChatGPT) and other state of the art models. Here we learn how to code a stand alone word embedding network from scratch and with nn.Linear. We then learn how to load and use pre-trained word embedding values with nn.Embedding.
NOTE: This StatQuest assumes that you are already familiar with Word Embedding, if not, check out the 'Quest: youtu.be/viZrOnJclY0
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:53 Importing modules 2:48 Encoding the training data 6:55 Word Embedding from scratch 16:54 Graphing the embedding values 21:17 Printing out predicted words 20:37 Word Embedding with nn.Linear 28:12 Loading and using pre-trained Embedding values with nn.Embedding
#StatQuest #neuralnetworks #transformersThe Golden Play Button, Clearly Explained!!!’StatQuest with Josh Starmer2023-10-07 | The Golden Play Button is usually super confusing. In this video, we break it down and walk you through it one-step-at-a-time. By the end of this StatQuest, you'll completely understand The Golden Play Button.Another 3 lessons from my Pop!!!StatQuest with Josh Starmer2023-09-04 | Since September 4th is Global Frank Starmer Day (and also his birthday), I thought we'd celebrate by talking about another three lessons that influenced my older sister and my older brothers.
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 0:52 To solve problems, draw a picture 2:46 To remember, draw a picture 4:24 To solve a problem, start.
#StatQuestDecoder-Only Transformers, ChatGPTs specific Transformer, Clearly Explained!!!StatQuest with Josh Starmer2023-08-28 | Transformers are taking over AI right now, and quite possibly their most famous use is in ChatGPT. ChatGPT uses a specific type of Transformer called a Decoder-Only Transformer, and this StatQuest shows you how they work, one step at a time. And at the end (at 32:14), we talk about the differences between a Normal Transformer and a Decoder-Only Transformer. BAM!
If you're interested in learning more about the SoftMax function, check out: youtu.be/KpKog-L9veg
If you're interested in learning more about Word Embedding, check out: youtu.be/viZrOnJclY0
If you'd like to learn more about calculating similarities in the context of neural networks and the Dot Product, check out: Cosine Similarity: youtu.be/e9U0QAFbfLI Attention: youtu.be/PSs6nxngL6k
If you'd like to learn more about Normal Transformers, see: youtu.be/zxQyTK8quyY
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:34 Word Embedding 7:26 Position Encoding 10:10 Masked Self-Attention, an Autoregressive method 22:35 Residual Connections 23:00 Generating the next word in the prompt 26:23 Review of encoding and generating the prompt 27:20 Generating the output, Part 1 28:46 Masked Self-Attention while generating the output 30:40 Generating the output, Part 2 32:14 Normal Transformers vs Decoder-Only Transformers
#StatQuestTransformer Neural Networks, ChatGPTs foundation, Clearly Explained!!!StatQuest with Josh Starmer2023-07-24 | Transformer Neural Networks are the heart of pretty much everything exciting in AI right now. ChatGPT, Google Translate and many other cool things, are based on Transformers. This StatQuest cuts through all the hype and shows you how a Transformer works, one-step-at-a time.
If you're interested in learning more about the SoftMax function, check out: youtu.be/KpKog-L9veg
If you're interested in learning more about Word Embedding, check out: youtu.be/viZrOnJclY0
If you'd like to learn more about calculating similarities in the context of neural networks and the Dot Product, check out: Cosine Similarity: youtu.be/e9U0QAFbfLI Attention: youtu.be/PSs6nxngL6k
...buying my book, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... statquest.org/statquest-store
...or just donating to StatQuest! paypal: paypal.me/statquest venmo: @JoshStarmer
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:26 Word Embedding 7:30 Positional Encoding 12:53 Self-Attention 23:37 Encoder and Decoder defined 23:53 Decoder Word Embedding 25:08 Decoder Positional Encoding 25:50 Transformers were designed for parallel computing 27:13 Decoder Self-Attention 27:59 Encoder-Decoder Attention 31:19 Decoding numbers into words 32:23 Decoding the second token 34:13 Extra stuff you can add to a Transformer
#StatQuest #Transformer #ChatGPTWhat is a Logit?StatQuest with Josh Starmer2023-06-19 | I used to see references to logit values or logits, and was like, "What the heck are those?". Well, now I've got everything cleared up with this song. BAM!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestLogistic vs Logit FunctionsStatQuest with Josh Starmer2023-06-12 | Gosh, here are some terms that I could never get straight. But now I have this sweat tune to get stuck in my head and help me remember the difference between the Logistic and Logit functions. BAM!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestAttention for Neural Networks, Clearly Explained!!!StatQuest with Josh Starmer2023-06-05 | Attention is one of the most important concepts behind Transformers and Large Language Models, like ChatGPT. However, it's not that complicated. In this StatQuest, we add Attention to a basic Sequence-to-Sequence (Seq2Seq or Encoder-Decoder) model and walk through how it works and is calculated, one step at a time. BAM!!!
NOTE: This StatQuest is based on two manuscripts. 1) The manuscript that originally introduced Attention to Encoder-Decoder Models: Neural Machine Translation by Jointly Learning to Align and Translate: arxiv.org/abs/1409.0473 and 2) The manuscript that first used the Dot-Product similarity for Attention in a similar context: Effective Approaches to Attention-based Neural Machine Translation arxiv.org/abs/1508.04025
NOTE: This StatQuest assumes that you are already familiar with basic Encoder-Decoder neural networks. If not, check out the 'Quest: youtu.be/L8HKweZIOmg
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 3:14 The Main Idea of Attention 5:34 A worked out example of Attention 10:18 The Dot Product Similarity 11:52 Using similarity scores to calculate Attention values 13:27 Using Attention values to predict an output word 14:22 Summary of Attention
#StatQuest #neuralnetwork #attentionLikelihood vs ProbabilityStatQuest with Josh Starmer2023-05-15 | In everyday life, we might act like Likelihood and Probability are the same, but in Statistics, Machine Learning and Data Science, they are two distinct concepts. This little song helps me keep them straight.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestp-valuesStatQuest with Josh Starmer2023-05-15 | p-values are always a little more than people expect, and this song does everything it can to remind me and everyone of that fact. BAM!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestSequence-to-Sequence (seq2seq) Encoder-Decoder Neural Networks, Clearly Explained!!!StatQuest with Josh Starmer2023-05-08 | In this video, we introduce the basics of how Neural Networks translate one language, like English, to another, like Spanish. The ideas is to convert one sequence of things into another sequence of things, and thus, this type of neural network can be applied to all sort so of problems, including translating amino acids into 3-dimensional structures.
NOTE: This StatQuest assumes that you are already familiar with... Long, Short-Term Memory (LSTM): youtu.be/YCzL96nL7j0 ...and... Word Embedding: youtu.be/viZrOnJclY0
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 3:43 Building the Encoder 8:27 Building the Decoder 12:58 Training The Encoder-Decoder Model 14:40 My model vs the model from the original manuscript
#StatQuest #seq2seq #neuralnetworkMatrix MultiplicationStatQuest with Josh Starmer2023-04-16 | Before writing this song, I could never remember if, when we multiplied to matrices together, we multiplied rows by columns or the other way around. Now I'll never forget that we multiple the rows in the first matrix by the columns in the second matrix. BAM!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestMatrix NotationStatQuest with Josh Starmer2023-04-16 | Before writing this song, I could never remember what an m-by-n matrix was. Now I will never forget that it has 'm' rows and 'n' columns. BAM!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestThe Ukulele: Clearly Explained!!!StatQuest with Josh Starmer2023-04-01 | This year's April Fools' (April 1st) StatQuest tackles one of the biggest mysteries in the whole world - what is an ukulele??? In this video, we use the latest technology, BamGPT, to help us understand what an ukulele is one step at a time. BAM!!!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:00 What is an Ukulele? 1:36 More details about the Ukulele. 2:16 Even more information about the Ukulele
#StatQuest #DubbedWithAloudPCA EigenvaluesStatQuest with Josh Starmer2023-03-21 | Before writing this song, I had a hard time remembering how the PCA Eigenvalues were calculated. Now I'll never forget.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestPCA EigenvectorsStatQuest with Josh Starmer2023-03-20 | Before writing this song, I had a hard time remembering what the Eigenvectors were in PCA. Now I'll never forget.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestNormalized DataStatQuest with Josh Starmer2023-03-20 | Before writing this song, I could never remember what it meant when you normalized your data. Now I'll never forget.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuest #normalized #bamStandardized DataStatQuest with Josh Starmer2023-03-20 | Before writing this song, I could never remember what it meant when you standardized your data. Now I'll never forget.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuest #standardized #bamType 2 ErrorsStatQuest with Josh Starmer2023-03-20 | Before writing this song, I could never remember what a Type 2 Error was. Now I'll never forget.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuest #Type2Error #FalseNegativeType 1 ErrorsStatQuest with Josh Starmer2023-03-20 | Before writing this song, I could never remember what a Type 1 Error was. Now I'll never forget.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuest #Type1Error #FalsePositiveWord Embedding and Word2Vec, Clearly Explained!!!StatQuest with Josh Starmer2023-03-13 | Words are great, but if we want to use them as input to a neural network, we have to convert them to numbers. One of the most popular methods for assigning numbers to words is to use a Neural Network to create Word Embeddings. In this StatQuest, we go through the steps required to create Word Embeddings, and show how we can visualize and validate them. We then talk about one of the most popular Word Embedding tools, word2vec. BAM!!!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 4:25 Building a Neural Network to do Word Embedding 8:18 Visualizing and Validating the Word Embedding 10:42 Summary of Main Ideas 11:44 word2vec 13:36 Speeding up training with Negative Sampling
#StatQuest #word2vecThe AI Buzz, Episode #5: A new wave of AI-based products and the resurgence of personal applicationsStatQuest with Josh Starmer2023-03-07 | In this episode, Luca and I talk about Sarah Guo's advice to AI Entrepreneurs, Aligning models to customer needs, Luca's predictions about the future of AI and Programing without Programming, or Automation for Everyone. Also, if you want to learn more, check out our Read Log: https://lightningai.notion.site/The-AI-Buzz-with-Luca-and-Josh-Episode-5-a38f05cd60c1495586997f68930c3096
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestCatBoost Part 2: Building and Using TreesStatQuest with Josh Starmer2023-03-06 | Just like we saw in CatBoost Part 1, Ordered Target Encoding, we're going to use the training data one row at a time to build and calculate the output values from trees. This is part of CatBoot's determined effort to avoid leakage like there is no tomorrow. We'll also learn how CatBoost makes predictions once the trees made.
English This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:10 Building the first tree 6:05 Quantifying the effectiveness of the first threshold 6:56 Testing a second threshold 9:05 Building the second tree 10:21 The main idea of how CatBoost works 12:15 Making predictions 13:02 Symmetric Decision Trees 14:56 Summary of the main ideas
Corrections: 2:05 Red should have gone into bin 0 instead of bin 1. 7:23 I should have said that the cosine similarity was 0.71.
#StatQuest #CatBoost #DubbedWithAloudCatBoost Part 1: Ordered Target EncodingStatQuest with Josh Starmer2023-02-27 | One of the defining features of CatBoost is its concerted effort to avoid data leakage at all costs. In this video, we'll see how it eliminates a potential threat in Target Encoding by ordering the data and encoding it sequentially. This ordered approach is central to everything CatBoost does and we'll see it again in Part 2 when we talk about how it builds trees.
English This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:56 A slight problem with k-fold target encoding 3:42 Ordered Target Encoding
Corrections: 4:09 It is also worth noting that if there were more than 2 target values, for example, if Loves Troll 2 could be 0, 1 and 2, then, when calculating the OptionCount for a sample with Loves Troll 2 = 1, we would include rows that had Loves Troll 2 = 1 and 2.
#StatQuest #CatBoost #dubbedwithaloudThe AI Buzz, Episode #4: ChatGPT + Bing and How to start an AI company in 3 easy steps.StatQuest with Josh Starmer2023-02-21 | In this episode, Luca and I talk about ChatGPT + Bing, Google vs Microsoft, Artificially learning high order logic, and how to start an AI company in 3 easy steps. Also, if you want to learn more, check out some of our sources here: https://lightningai.notion.site/Readlog-21-Feb-2023-eb0f44e895ce4c81b5777e6360f1324e
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuest #ChatGPT #AIBuzzOne-Hot, Label, Target and K-Fold Target Encoding, Clearly Explained!!!StatQuest with Josh Starmer2023-02-13 | In theory, discrete variables, or features, are easy to use with machine learning algorithms. However, in practice, it's not always so easy and we often have to transform discrete values, like favorite colors, into numbers. There are lots of ways to do this, and this video walks you through 3 of the most popular methods.
English This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:24 One-Hot Encoding 3:25 Label Encoding 4:39 Target Encoding 6:27 Target Encoding with a Weighted Mean, or Bayesian Target Encoding 9:56 K-Fold Target Encoding
#StatQuest #DubbedWithAloudThe AI Buzz, Episode #3: Constitutional AI, Emergent Abilities and Foundation ModelsStatQuest with Josh Starmer2023-02-07 | The AI Buzz is a conversation about the latest trends in AI between me and Luca Antiga, the Chief Technology Officer at Lightning AI. In this episode, we talk about Constitutional AI, the ability of a model to train itself not to say bad words, Emergent Abilities, Foundation Models and Siri vs Foundation Models.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestMutual Information, Clearly Explained!!!StatQuest with Josh Starmer2023-02-06 | Mutual Information is metric that quantifies how similar or different two variables are. This is a lot like R-squared, but R-squared only works for continuous variables. What's cool about Mutual Information is that it works for both continuous and discrete variables. So, in this video, we walk you through how to calculate Mutual Information step-by-step. BAM!
English This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 2:39 Joint and Marginal Probabilities 6:19 Calculating the Mutual Information for Discrete Variables 13:00 Calculating the Mutual Information for Continuous Variables 14:10 Understanding Mutual Information as a way to relate the Entropy of two variables.
#StatQuest #MutualInformation #DubbedWithAloudCosine Similarity, Clearly Explained!!!StatQuest with Josh Starmer2023-01-30 | The Cosine Similarity is a useful metric for determining, among other things, how similar or different two text phrases are. I'll be honest, the first time I saw the equation for The Cosine Similarity, I was scared. However, it turns out to be really quite simple, and this StatQuest walks you through it, one-step-at-a-time. BAM!!!
English This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:46 Visualizing the Cosine Similarity for two phrases 6:19 The equation for the Cosine Similarity
#StatQuest #DubbedWithAloudLong Short-Term Memory with PyTorch + LightningStatQuest with Josh Starmer2023-01-24 | In this StatQuest we'll learn how to code an LSTM unit from scratch and then train it. Then we'll do the same thing with the PyTorch function nn.LSMT(). Along the way we'll learn two cool tricks that Lightning gives us that make our lives easier: 1) How to add more training epochs without starting over and 2) How to easily visualize the training results to determine if you need to do more training or are done.
English This video has been dubbed using an artificial voice via aloud.area120.google.com to increase accessibility. You can change the audio track language in the Settings menu.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 4:25 Importing the modules 5:39 An outline of an LSTM class 6:56 init(): Creating and initializing the tensors 9:09 lstm_unit(): Doing the LSTM math 12:25 forward(): Make a forward pass through an unrolled LSTM 13:42 configure_optimizers(): Configure the...optimizers. 14:00 training_step(): Calculate the loss and log progress 16:40 Using and training our homemade LSTM 20:43 Evaluating training with TensorBoard 23:22 Adding more epochs to training 26:18 Using and training PyTorch's nn.lstm()
#StatQuestThe AI Buzz, Episode #2: Big data, Reinforcement Learning and Aligning ModelsStatQuest with Josh Starmer2023-01-24 | The AI Buzz is a conversation about the latest trends in AI between me and Luca Antiga, the Chief Technology Officer at Lightning AI. We talk about what's new and why it has the potential to change everything. And, because it's StatQuest, we'll go the extra mile to make sure everything is clearly explained!!!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestThe AI Buzz, Episode #1: ChatGPT, Transformers and AttentionStatQuest with Josh Starmer2023-01-11 | The AI Buzz is a conversation about the latest trends in AI, plus Q&A, between me and Luca Antiga, the Chief Technology Officer at Lightning AI. We talk about what's new and why it has the potential to change everything. And, because it's StatQuest, we'll go the extra mile to make sure everything is clearly explained!!!
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestDesign Matrices For Linear Models, Clearly Explained!!!StatQuest with Josh Starmer2022-11-18 | In order to use general linear models (GLMs) you need to create design matrices. At first, these can seem intimidating, but this StatQuest puts together a bunch of examples and illustrats them all so that they are clearly explained.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestUsing Linear Models for t tests and ANOVA, Clearly Explained!!!StatQuest with Josh Starmer2022-11-18 | This StatQuest shows how the methods used to determine if a linear regression is statistically significant (covered in part 1) can be applied to t-tests and ANOVA. It also introduces the concept of a "design matrix".
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
Correction: 7:40 There should be parentheses around the SS differences in the F-statistics to have correct equations; (SS(mean)-SS(fit))/(p_fit-p_mean)
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestMultiple Regression, Clearly Explained!!!StatQuest with Josh Starmer2022-11-18 | This StatQuest shows how the exact same principles from "simple" linear regression also apply multiple regression. At the end, I show how to test if a multiple regression is better than a simple regression.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestR-squared, Clearly Explained!!!StatQuest with Josh Starmer2022-11-18 | R-squared is one of the most useful metrics for understanding how two quantitate things, like weight and height, are related.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestLong Short-Term Memory (LSTM), Clearly ExplainedStatQuest with Josh Starmer2022-11-07 | Basic recurrent neural networks are great, because they can handle different amounts of sequential data, but even relatively small sequences of data can make them difficult to train. This is where Long Short-Term Memory (LSTM) saves the day. Long Short-Term Memory is a type of recurrent neural network that can handle much larger sequences of data without those pesky exploding/vanishing gradient problems that plague basic recurrent neural networks.
Spanish Este video ha sido doblado al español con voz artificial con aloud.area120.google.com para aumentar la accesibilidad. Puede cambiar el idioma de la pista de audio en el menú Configuración.
Portuguese Este vídeo foi dublado para o português usando uma voz artificial via aloud.area120.google.com para melhorar sua acessibilidade. Você pode alterar o idioma do áudio no menu Configurações.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song, introduction and main ideas 4:19 The sigmoid and tanh activation functions 5:58 LSTM Stage 1: The percent to remember 9:25 LSTM Stage 2: Update the long-term memory 12:42 LSTM Stage 3:Update the short-term memory 14:33 LSTM in action with real data
#StatQuest #LSTM #DubbedwithaloudThe Cosine Similarity for NLP and CatBoostStatQuest with Josh Starmer2022-11-01 | On the last live stream I said I'd keep talk about out CatBoost, and we will by talking about the Cosine Similarity. This metric is also widely used in Natural Language Processing (NLP) so we'll get two birds with one stone by covering this topic. There will (hopefully) also be time for Questions and Answers. BAM! :)
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestHappy Halloween (Neural Networks Are Not Scary)StatQuest with Josh Starmer2022-10-31 | I hope everyone has a happy Halloween today! My hope is that even though Neural Networks are not scary, people will still dress up in Neural Network costumes today. BAM!!!
NOTE: This little ditty was original composed for Kate Strachnyi's channel, youtube.com/c/DATAcated , as part of her "Data is not Scary" promotion for the month of October.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestHandmade Pasta, Clearly Explained!!!StatQuest with Josh Starmer2022-10-25 | October 25 is World Pasta Day, and to celebrate, I'm sharing my tips for handmade pasta. I know this seems odd to have cooking tips on StatQuest, which usually focuses on Statistics, Data Science and Machine Learning, but there are so many bad handmade pasta recipes out there, and I've been making it since I was kid, and my very first video ever was a cooking video, so I thought I'd do it, but just this one time.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
0:00 Awesome song and introduction 1:32 Mixing the dough 2:54 Flattening the dough into sheets 5:11 Cutting and cooking the noodles
#StatQuest #Pasta #HandmadeLive Stream - More details about Target Encoding/AMA/Silly SongsStatQuest with Josh Starmer2022-10-18 | Over the years a lot of people have asked me to talk about a machine learning method called CatBoost. One CatBoot's things is to use a unique approach to Target Encoding. Today we'll (hopefully) talk about that method, but if not, at least we'll take a big step towards talking about it.
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: twitter.com/joshuastarmer
#StatQuestLive Stream - Target Encoding/AMA/Silly Songs!!!StatQuest with Josh Starmer2022-10-05 | A lot of machine learning algorithms can not deal with categorical data (like "favorite color" or "country code") directly. As a result, we have translate them into some sort of numerical value. The most common practice is to use something called One-Hot-Encoding, which is fine if you don't have many options for each category. However, if you have a lot of options, things get out of hand quickly. This is where methods like Target Encoding really start to shine, so that's what we'll talk about today. We'll also have time for any question you might have for me and maybe even a few silly songs! TRIPLE BAM!!!