Linear Algebra Basics Required for Logistic Regression || Lesson 67 || Machine Learning ||

#machinelearning#learningmonkey

In this class, we discuss Linear Algebra Basics Required for Logistic Regression.
For understanding Logistic regression we need to have Linear Algebra Basics Required for Logistic Regression.

Let's take a two-dimensional coordinate system.

Here we will have a line.

In the three-dimensional coordinate systems, we will have a plane.

In the same way, we will have a hyperplane in an N-dimensional coordinate system.

The equation is given below.

w1x1 + w2x2 + .... wnxn + w0.

w0 is the intercept.

In the above equation W= [w1,w2,....wn] we call it normal to the plane.

Normal means a vector perpendicular to the plane.

Vector perpendicular to the plane means if we take any vector on the plane This W is perpendicular.

Such that dot product is equal to zero.

Two vectors are perpendicular if the dot product is zero.

A.B is given as A transpose B.

Take any two points on the plane. we get a vector as Q-P.

Ending point minus starting point we get a vector PQ.

Take any vector on the plane substitute point p in the plane we get a value -b.

The same way substitute q in the equation we get value -b.

WT(Q-P) gives us WTQ - WTP.

we got -b - -b.

Which is equal to zero.

So W is normal ie perpendicular to any vector on the plane.

The distance of a point from the plane is given as WTx1 +b/ Norm W.

We can calculate the distance of a point from the plane by the above equation.

The concepts which we discussed in this class are used in the understanding of logistic regression.

We use the distance concept for writing the optimization problem of logistic regression.

and the concepts we discussed previously are also used in logistic regression.

Link for playlists:

[kamalamarepalli]

Excellent presentation and clarity on each and every small math behind it. Very good.

[Laxmikumari-bdsy]

Thank you sir after watching so many videos I came across your videos and loved it

[francaellerman]

4:51 for start of logistic regression-related concepts

[cavidanabdullayev]

First of all, thank you a lot for such an excellent content and explanation!!! Could you please suggest me some textbooks on machine learning to read?

[sameerpandey]

Must have video to learn logistic regression. Thanks for this excellent lecture

[dipanwitamitra]

sir, could you please give the link where the positive and negative distance have been proved? I have searched a lot for it in your playlist, however, could not get it.

[hemangdhanani]

sir, W is perpendicular to plane instead of taking W if we take a unit vector of W then what will be the impact ??

[tusharsub]

Sir, Any good book you recommend to study Logistic regression and other machine learning models