XGBoost Part 1 (of 4): Regression

preview_player
Показать описание
XGBoost is an extreme machine learning algorithm, and that means it's got lots of parts. In this video, we focus on the unique regression trees that XGBoost uses when applied to Regression problems.

NOTE: This StatQuest assumes that you are already familiar with...

Also note, this StatQuest is based on the following sources:

For a complete index of all the StatQuest videos, check out:

If you'd like to support StatQuest, please consider...

Buying The StatQuest Illustrated Guide to Machine Learning!!!

...or...

...a cool StatQuest t-shirt or sweatshirt:

...buying one or two of my songs (or go large and get a whole album!)

...or just donating to StatQuest!

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:

0:00 Awesome song and introduction
2:35 The initial prediction
3:11 Building an XGBoost Tree for regression
4:07 Calculating Similarity Scores
8:23 Calculating Gain to evaluate different thresholds
13:02 Pruning an XGBoost Tree
15:15 Building an XGBoost Tree with regularization
19:29 Calculating output values for an XGBoost Tree
21:39 Making predictions with XGBoost
23:54 Summary of concepts and main ideas

Corrections:
16:50 I say "66", but I meant to say "62.48". However, either way, the conclusion is the same.
22:03 In the original XGBoost documents they use the epsilon symbol to refer to the learning rate, but in the actual implementation, this is controlled via the "eta" parameter. So, I guess to be consistent with the original documentation, I made the same mistake! :)

#statquest #xgboost
Рекомендации по теме
Комментарии
Автор

Corrections:
16:50 I say "66", but I meant to say "62.48". However, either way, the conclusion is the same.
22:03 In the original XGBoost documents they use the epsilon symbol to refer to the learning rate, but in the actual implementation, this is controlled via the "eta" parameter. So, I guess to be consistent with the original documentation, I made the same mistake! :)

statquest
Автор

I got my first job in Data Science because of the content you prepare and share.
Can't thank you enough Josh. God bless :)

pulkitkapoor
Автор

I'm starting writing my Master Thesis and there were still some things I needed to make clear before using XGBoost for my classification problem. God Bless You

giannislazaridis
Автор

Can I just say I LOVE STATQUEST! Josh does the intuition of a complex algorithm and the math of it so well and then to make it into an engaging video that is so easy to watch is just amazing! I just LOVE this channel. You you boosted the gradient of my learning on machine learning in an extreme way. Really appreciate these videos

nikilisacrow
Автор

I am a graduate student at Duke, since some of the materials are not covered in the class, I always watch your videos to boost my knowledge. Your videos help me a lot in learning the concepts of these tree models!! Great thanks to You make a lot of great videos and contribute a lot in online learning!!!!

guoshenli
Автор

This dude puts the STAR in starmer. You are an international treasure.

johnhutton
Автор

After watching your video, I understood the concept of 'understanding'.

DonDon-gsnm
Автор

I wanted to watch this video last week, but you sent me on a magical journey through adaboost, logistic regression, logs, trees, forests, gradient boosting.... Good to be back

andreitolkachev
Автор

Wow, I am really interested in Bioinformatics and was learning Machine Learning techniques to apply to my problems and out of curiosity, I checked your LinkedIn profile and turns out you are a Bioinformatician too. Cheers

moidhassan
Автор

In my heart, there is a place for you! Thank you Josh!

breopardo
Автор

Hey Josh! This is fantastic. As an aspiring data scientist with a couple of job interviews coming up, this really helped!

gawdman
Автор

Hi Josh,
I just bought your illustrated guide in PDF. This is the first time I've supported someone on social media. Your video helped me a lot with my learning. Can't express how grateful I'm with these learning materials. You broke down monster maths concepts and equation to baby monster that I can easily digest. I hope by making this purchase, you get the most contribution out of my support.
Thank you!

ChingFungChan-bl
Автор

I just LOVE your channel! Such a joy to learn some complex concepts. Also, I've been trying to find videos that explain XGBoost under the hood in detail and this is the best explanation I've come across. Thank you so much for the videos and also boosting them with an X factor of fun!

shhdeshp
Автор

I have never seen an data science video like this....good informative, very clear, super explanation of math and wonderful animation and energetic voice....Learning many things very easily....thank you so much!!

kamalamarepalli
Автор

Nowadays I write a "bam note" for important notes for algorithms.

prasanshasatpathy
Автор

Man, the quality and passion put into this. As well as the sound effects! I'm laughing as much as I'm learning. DAAANG.

You're the f'ing best!

mainhashimh
Автор

I had left all hope of learning machine learning owing to its complexity. But because of you I am still giving it a shot..and so far I am enjoying...

tusharsub
Автор

An incredible job of clear, concise and non-pedantic explanation. Absolutely brilliant!

PauloBuchsbaum
Автор

I've never I had so much fun learning something new! Not since I stared at my living room wall for 20min and realized it wasn't pearl, but eggshell white! Thanks for this!

RidWalker
Автор

Fantastic explanation for XGBoost. Josh Starmer, you are the best. Looking forward to your Neural Network tutorials.

pavankumar