Applying Header Dynamically to a Dataframe | Spark With Scala | With example

Hi Friends, in this video, we are going to lean how to read a properties file which has a header and then applying that to a dataframe without hardcoding the schema.
There is a small mistake in the video, lets see who finds it :)

Happy Learning

[narayanareddy]

Great. explanations is good. could you please help on how to handle dynamically changing headers in csv . everyday we are getting different columns in particular file.

[reenageorge]

Hi Saravana, Good video, Can you tell me how do we handle if the headers are stored in a config table or in another data frame as rows

[sravankumar]

Nics explanation sravana, can u please explain how can we write in pyspark