Using when-otherwise in PySpark | Populating Boolean values without when | Realtime Scenario

preview_player
Показать описание
Hi Friends,

In this video, I have explained a Realtime scenario in PySpark for using when-otherwise and also, how to populate Boolean values without using when-otherwise conditions.

Please subscribe to my channel for more interesting learnings.
Рекомендации по теме
Комментарии
Автор

Hi Sravana, could you please let me know that how do I separate out only the duplicate rows in a separate dataframe? So that this DF only contains the duplicate rows. Any idea thank you!!

sudippandit
Автор

Please make video for data ingestion from any RDBMS database by spark

deepakroy
Автор

Hi Sravana, PLease guide me One real time example of salting technique for data skewness.
Thanks Advance!

rakeshdash
Автор

Hi Sravana,
can't we give > 5000 instead of f.lit(50000) ?

AnandKumar-dcbf
Автор

Hi, I am new to pyspark, I have been given a project. Can you tell how to write codes for dynamic values instead of static values. Any other way i can contact to clear my doubts?

bhabanitripathy
Автор

How to Convert rows to columns in Pyspark without using pivot function

Avoid pivot and need to use groupBy RDD and map groupBy SSID , split dept values to rows eg (maths, science, civil, mech) as new columns having values as (scores )

TirumalaAbburi