Create DataFrame from Nested JSON | Spark DataFrame Practical | Scala API | Part 4 | DM | DataMaking

Code used in this video tutorial is available here:

[DataMaking]

Code used in this video tutorial is available here:

[AmitSingh-gbcq]

It showing error in else if please guide me

[PankajKumar-tylk]

Appreciate your effort. Can you please share the code, the link is not working

[pshar]

What if json data is in csv file in a column along with other columns and some of the json data is malformed? Consider 5 columns and 3rd column is json. How to read csv and ignore rows which have malformed json data?

[kwamesefah]

Could you provide the code and the data to try it out. The link you provided has error. Thanks

[TirumalaAbburi]

@DataMaking Can you provide solution how you resolved the " json_data_df.schema.names" getting error " Value names us not a member of

[sureshu]

json_data_df.schema.names is not resolving in main function. can you please help on this. is resolving but returning only top level field in json

[ping-sidd]

Hello, great video. can you make a video on the same but with parsing xml with nested dataframes, and how would you explode if the tags of the xml are empty. Also can you please share this code in pysaprk if possible.

[vamshi]

Hi DataMaking, voice was not clear, also you didn't showed code completely.
i written code how much i saw by seeing video but i got one error for one field got ambiguous error.
i think for struct type and array type in both cases one field added twice in the List. but i don't know how it worked in your case?

[mahammadshoyab]

Hi DataMaking, I have Multi array nested json, let say i have 5 level json, is this code work for that?

[NsTmEntertainment]

Any one please share me the same code in pyspark

[mahammadshoyab]

if you provide mail id, i will share the issue, which i am facing to access your code link