Let’s Write a Decision Tree Classifier from Scratch - Machine Learning Recipes #8

Hey everyone! Glad to be back! Decision Tree classifiers are intuitive, interpretable, and one of my favorite supervised learning algorithms. In this episode, I’ll walk you through writing a Decision Tree classifier from scratch, in pure Python. I’ll introduce concepts including Decision Tree Learning, Gini Impurity, and Information Gain. Then, we’ll code it all up. Understanding how to accomplish this was helpful to me when I studied Machine Learning for the first time, and I hope it will prove useful to you as well.

You can find the code from this video here:

Books!

[dabmab]

Why can't all professors explain things like this? My professor: "Here is the idea for decision tree, now code it"

[nbamj]

In nearly 10 min, he explained the topic extremely well
Amazing job.

[FacadeMan]

Thanks a lot, Josh. To a very basic beginner, every sentence you say is a gem. It took me half hour to get the full meaning of the first 4 mins of the video, as I was taking notes and repeating it to myself to grasp everything that was being said.

The reason I wanted to showcase my slow pace is to say how important and understandable I felt in regard to every sentence.

And, it wasn't boring at all.

Great job, and please, keep em coming.

[donking]

I am crying tears of joy! How can you articulate such complex topics so clearly!

[cbrtdgh]

This is the best single resource on decision trees that I've found, and it's a topic that isn't covered enough considering that random forests are a very powerful and easy tool to implement. If only they released more tutorials!

[georgevjose]

Finally after a year. Pls continue this course.

[WilloftheWinds]

Welcome back Josh, thought we would never get another awesome tutorial, thanks for your good work.

[anupam]

Thanks, was really looking for this series...nice to see you back

[TomHarrisonJr]

One of the clearest and most accessible presentations I have seen. Well done! (and thanks!)

[sundayagu]

As a beginner, this work has given me hope to pursue a career in ML. I have red and understood the concepts of Decision Tree. But the code becomes a mountain which has been levelled. Jose, thank you my brother and may God continue to increase you 🙏.

[hbunyamin]

I have already known the concept; however, when I have to translate the concept into code ... I find it quite difficut and this video explains that smoothly.

Thank you so much for the explanation!

[mindset]

I've never seen any other channels like this. So deep and perfect.

[BestPromptHub]

You have no idea how your videos helped me out on my journey on Machine Learning. thanks a lot Josh you are awesome.
回复

[BlueyMcPhluey]

loving this series, glad it's back

[gautamgadipudi]

Thank you Josh! This is my first encounter with machine learning and you made it very interesting.

[falmanna]

Please keeps this series going.
It's awesome!

[debanjandhar]

Awesome video, helped me lot.... Was struggling to understand these exact forward to the continuing courses.

[alehandrs]

In the most simple and comprehensive way. Great job!

[AyushGupta-kpxf]

So much value in just 10 mins, this is Gold

[sajidbinmahamud]

Long time!
i've been waiting for so long