Decision Trees

Fundamentals of the decision trees model in machine learning

[nad]

Man I don't know how to thank you for all you videos. You make knowledge clear, accessible and free. All heros don't wear cape

[Helena-rqqx]

Thank you for such a clear explanation! I appreciate that you break down the calculations in an easy to digest and intuitive way

[t_geek]

I like your explanation. It's very cool and a little bit fishy. I've noticed that there are 3 kinds of explantions for decision trees: some people focus on entropy and information gain, others focus more on reducing impurity and gini coefficient and in this video I found third possible explanation of decision tree. It always amazes me how can we end up with the same solution using different methods. Thank you!

[vivienvuong]

This is so, so helpful. Thank you so much for sharing this!

[SuperMtheory]

Great video. Could you follow up by creating a similar example that isn't as symmetric? Also, are you using Bayes' Theorem?

[mamahuhu_one]

Great video! Do you have a reference explaining this and further?

[Fat_Cat_Fly]

so great!!! thanks!!! love your video!!!

[TheLameFlameYT]

Wouldn't we get a higher accuracy if we were just to say that if a fish is short it's a Salmon and if it's long it's a Tuna? That should give us a 75% accuracy, right? (80% in the case we're splitting by weight)

[olistiktok]

For the (25/100)(25/100) reasonning, do you actually mean that it comes from the 25Tvs.75T (= "knowing that it is short) times the 25Tvs.75S (prob that it is a thuna and not a salmon) ? The added symetry in the quantities you chose confuses me i admit..😅 thx

[chenqu]

Great tutorial. However I still coun't get how you did the conditional probability calc using that formula. I knew only that famous formula for conditional probability as P(A|B) = P(AB)/P(B) but you did not use that.

[jayantachakraborty]

I didn't really understand why its (25/100)(25/100) and similarly (75/100)(75/100). Can someone clarify?

[bungaIowbill]

It doesn't change the main point, but there's no real reason to randomize the predictions within the nodes -- if there are 75 salmon and 25 tuna in the node, just guessing salmon is preferable. This gives a probability of being correct of 3/4, which is better than 5/8.