Lect 6: withColumn() function when working with sparks DF | pyspark | UDF | Big Data |Data Engineer

In this video you will be learning about with time spans:
00:00 - Intro .
00:50 - Specifying our agenda for the lecture.
01:25 - About help() function in python.
01:41 - Creating our Data Frame using in spark.
04:52 - Computing our clusters in Data Bricks community edition.
06:20 - Attaching cluster to our working notebook.
07:20 - Using help() function on withColumn() function.
07:30 - Reading the documentation of withColumn() function.
09:45 - Takeaways from the documentation.
11:09 - Listing the major usages of withColumn() function.
13:47 - Usage -1 Altering the data type using withColum() function.
15:56 - Usage-2 Updating the column using withColum() function.
20:24 - Usage-3 Creating a new column using withColum() function.
24:01 - Usage-4 Adding a literal value as a new column using withColum() function.
26:45 - Usage-5 Replacing an old column using withColum() function..
32:11 - Revising what we have learnt.

#spark #pyspark #bigdata #bigdatahadoop #python #databricks #cluster #apachespark