Uploaded August 2019 | Updated September 2026, 2 weeks ago
Regression Trees are one of the fundamental machine learning techniques that more complicated methods, like Gradient Boost, are based on. They are useful for times when there isn't an obviously linear relationship between what you want to predict, and the things you are using to make the predictions. This StatQuest walks you through the steps required to build Regression Trees so that they are Clearly Explained.
NOTE: This StatQuest assumes you already know about...
The bias/variance tradeoff: youtu.be/EuBBz3bI-aA
Decision Trees: youtu.be/7VeUPuFGJHk
Linear Regression: youtube.com/watch?v=nk2CQITm_eo
ALSO NOTE: This StatQuest is based on the definition of Regression Trees found on page 328 to 331 of the Introduction to Statistical Learning. statlearning.com
For a complete index of all the StatQuest videos, check out:
statquest.org/video-index
If you'd like to support StatQuest, please consider...
Patreon: patreon.com/statquest
...or...
YouTube Membership: youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
statquest.org/statquest-store
...or just donating to StatQuest!
paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
twitter.com/joshuastarmer
0:00 Awesome song and introduction
0:41 Motivation for Regression Trees
2:19 Regression Trees vs Classification Trees
7:11 Building a Regression Tree with one variable
18:59 Building a Regression Tree with multiple variables
20:54 Summary of concepts and main ideas
#statquest #regression #tree
Regression Trees are one of the fundamental machine learning techniques that more complicated methods, like Gradient Boost, are based on. They are useful for times when there isn't an obviously linear relationship between what you want to predict, and the things you are using to make the predictions. This StatQuest walks you through the steps required to build Regression Trees so that they are Clearly Explained.
NOTE: This StatQuest assumes you already know about...
The bias/variance tradeoff: youtu.be/EuBBz3bI-aA
Decision Trees: youtu.be/7VeUPuFGJHk
Linear Regression: youtube.com/watch?v=nk2CQITm_eo
ALSO NOTE: This StatQuest is based on the definition of Regression Trees found on page 328 to 331 of the Introduction to Statistical Learning. statlearning.com
For a complete index of all the StatQuest videos, check out:
statquest.org/video-index
If you'd like to support StatQuest, please consider...
Patreon: patreon.com/statquest
...or...
YouTube Membership: youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
statquest.org/statquest-store
...or just donating to StatQuest!
paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
twitter.com/joshuastarmer
0:00 Awesome song and introduction
0:41 Motivation for Regression Trees
2:19 Regression Trees vs Classification Trees
7:11 Building a Regression Tree with one variable
18:59 Building a Regression Tree with multiple variables
20:54 Summary of concepts and main ideas
#statquest #regression #tree
