Class 14 - Spark Data Frames - Processing data using Data Frame APIs

As part of this session I have covered overview of important string and date manipulation functions.

Date Functions: current_date, current_timestamp, date_add, date_sub, add_months, datediff, year, month, dayofyear, dayofmonth, dayofweek, trunc, date_trunc, date_format, from_unixtime, unix_timestamp

String Manipulation Functions: substring, split, lower, upper, initcap, trim, rtrim, ltrim, lpad, rpad, length, regexp_replace, translate

Connect with me or follow me at

[pankajdubey]

You forgot end at the last for me it worked df.withColumn('res', expr("case when clr ='red' then 0 when clr='Green' then 1 else 3 end")).show()

[subramanyammani]

Sir can u please share me earlier videos linked pls