Regression Trees, Clearly Explained!!!

Regression Trees are one of the fundamental machine learning techniques that more complicated methods, like Gradient Boost, are based on. They are useful for times when there isn't an obviously linear relationship between what you want to predict, and the things you are using to make the predictions. This StatQuest walks you through the steps required to build Regression Trees so that they are Clearly Explained.

NOTE: This StatQuest assumes you already know about...

For a complete index of all the StatQuest videos, check out:

If you'd like to support StatQuest, please consider...

Buying The StatQuest Illustrated Guide to Machine Learning!!!

...or...

...a cool StatQuest t-shirt or sweatshirt:

...buying one or two of my songs (or go large and get a whole album!)

...or just donating to StatQuest!

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:

0:00 Awesome song and introduction
0:41 Motivation for Regression Trees
2:19 Regression Trees vs Classification Trees
7:11 Building a Regression Tree with one variable
18:59 Building a Regression Tree with multiple variables
20:54 Summary of concepts and main ideas

#statquest #regression #tree

[pralhadkulkarni]

Who came here after paying for ML courses on Udemy???? This explanation is far far better than those paid courses.

[altus]

Screw Udemy, this guy explains better than my Machine Learning professor. You are the Bob Ross of statistics.

[LMessii]

Added more value than a fricking Harvard or Standford course in less than 15 minutes. Great job, I am forever greatful Josh !

[carlossouza]

Dude, you are a gifted teacher... well done, keep it up!

[dvirginz]

You are just something else, I just can't believe how every time I return here, things that I used for years become suddenly clear.

[jcatlantis]

This is the best channel ever! I am a postdoc enjoying every single video ;)

[aggelosdidachos]

Honestly, after every video I watch, I feel like I want to express gratitude. Clearly, you know how to explain clearly.

[dtn]

A picture (or video) is worth a thousand words. After scratching my head from looking at written formulas of how regression trees are created, this instantly cleared things up. Thank you!

[siddharth]

I have completed the whole series on Trees till XGBoost! These are real treasure in teaching ML and trust me I have read a lot of books, ESL, Gilbert Strang, Larry Wasserman to name a few. I truly appreciate what you are doing and I will join your patreon!

[whqjobt]

John, I just bought your book. Not because I need it, but because you deserve it. God bless you, you are godsent. you explain ML 10 times better than my professor

[breopardo]

In Josh we trust!
What an awesome video Josh, you make ML understanding a pleasure...you are a gifted person and I am so happy you actually share.

[jeternity]

This was a better explanation by like 100 folds compared to explanation in my data science course for which I paid money.

[asdkazmi]

OMG, I don't have words to appreciate this lecture. This is an impressive lecture I found for the Decision Trees algorithm. Thank you dear for your effort. I'm pretty sure you would come to need a lot of work to prepare for this lecture.

[Sripooja.Mahavadi]

Statquest! Statquest!
Can you note that you are the best!
I have always hated statistics
But now I love it coz of your tricks
standard deviation and standard error
After you taught it's no brainer
I know these lines are cheesy
But somehow you have made life easy :)

[jamesang]

The search ends here. THere is no need to watch multiple videos to understand regression trees. this is the perfect video. Thank you JOsh!

[tanuj]

This has got to be one of the most entertaining educational videos ever made! You're just fabulous! <3

[ruslanjabrayilov]

Immaculate teaching style. I love how you give a detailed intuition behind these otherwise complex topics!

[COMREdesign]

Today only I got to know "why decision trees". Your teaching is the best. blessings!

[VishalVerma-gcpr]

I have almost never commented or liked any videos on youtube but you are the one who made me proud to like your videos. you have beaten up all those paid and much-marketed course on machine learning and statistics A very thank you josh Starmer and tbh those bams do stick into people's head no lie.

[rohitnath]

man i know that decision trees are easiest machine learning concepts but you made them way easier than what it actually it is. Hats off