Tutorial 6- Pyspark With Python-Introduction To Pyspark Mlib

In this video we are going to discuss about Pyspark MLib and we will implement a simple regression algorithm.

Subscribe my vlogging channel
Please donate if you want to support the channel through GPay UPID,

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more

Connect with me here:

[garvitmehta]

Hey Krish.... superb series that you are doing, I am trying to learn as much I can from your videos. Please do continue this good work. 👍

[usaikiran]

Hi Krish. Kudos to all your efforts for this good work. Kindly make a video on how to perform clustering, apply clustering algorithms, do topic modelling, apply NLP using PySpark. Really need it. Thank you

[alihaiderabdi]

superb sir, we are waiting for end-to-end development and deployment using pyspark. Keep going!!!! Thanks a lot sir!!!

[abhayjain]

You are doing great work. So easy to understand yout tutorials.

[ashishbhatnagar]

awesome simply awesome. Thanks a lot for sharing

[samimtu]

big fun bro. it is all clear when you speak, please prepare a
video on multimodal meme detection

[vipulbharadwaj]

Hi Krish, great video, just wanted to ask why can't we use sklearn ML algorithm with pyspark dataframe?... that way we can use spark data handling capabilities along with highly optimized sklearn ML algorithms

[hardikvegad]

Krish can you show us...HOW WE CAN USE PYSPARK IN A DISTRIBUTED NETWORK?....Thank you.

[fairuzshadmanishishir]

please make videos on distributed training

[tketzue]

randomsplit is not working, showin NoneType' object has no attribute 'randomSplit'

[meenakshipandey]

Hi Krish. How can I populate table in RDS from glue pyspark job..I have one table in RDS MySQL Arora db
Now I want to insert some record in that table but using glue spark job

[ajaysaikiranpenumareddy]

'function' object has no attribute 'read' this is error i am getting when trying to read data set

[thourayasboui]

Hi ! I got this error when executing age does not exist, available: name, age..., any help ??

[shaik]

I wan talk to you how will i approach to you please reply

[darshanayenkar]

error: [WinError 10061] No connection could be made because the target machine actively refused it

[shaik]

I wan talk to you how will i approach to me please reply

[vashistnarayansingh]

Can anyone tell me why there is 2 coeficent as y = mx+c has only one coeficent M and one intercept C?