Azure Data Factory - Parse JSON file using Copy Activity

This video shows couple of json files with different structure and the steps to parse them.

[vignesh-dz]

Video was so helpful and understandable. Good job.

[subhajyotibhattacharyya]

hi i have a json file which has a table name before starting the array. how to remove the table name

[hdlkqxu]

Thanks for the neat & simple explanation mam,

[amitkamble]

I have one problem, my column header is in cdm. JSON file and data coming in csv from dynamic 365, How do I map both files?

[azureadf]

I need to create JSON files from API URL. But in API, file format is XML but need to create file in JSON format. Whether we can achieve this in Copy activity alone.

[nirmal_kumar]

Is it possible to parse a complex json source and push into 3 different tables?. e.g Assume a json with Students Array and Each Student JSON object has Skills json array. Does ADF supports to parse this in a PK/FK fashion to push to 2 different tables?. Student and StudentSkills Table.?.

[skselva]

while I was loading JSON files to the SQL server only one record only inserted, how can I resolve the issue mam could you please assist me?

[sdhilip]

Thanks a lot mam. please upload with dataflow as well.

[SaiShireeshKamasani]

hello mam! please help me out here
I just need to convert nested json file dynamically to parquet format what would be the best solution available ? Is it possible to do with ADF ( dataset r dataflow) or we need to go for any other solution. If yes please share the references or help me here.

And while copying data from my source (Blob storage) to ADLS Gen2, i am getting
deserializing source JSON file like
Error reading JObject from JsonReader. Current JsonReader item is not an object: StartArray. Path '[0]'

Because i have json file like

[
[
{
"createOn": 0,
"customProperties": [],
"description": "Default group for collectors",
"id": 1,
"numOfCollectors": 0,
"userPermission": "read"
},
{
"createOn": 1624892090,
"customProperties": [
{
"name": "hsdjcompany.name",
"value": "Accra Care, Inc."
},
{
"name": "vd.companyid",
"value": "41433"
},
{
"name": "hjasvxb.industrytype",
"value": "Health Care"
},
{
"name": "hsc .clientnumber",
"value": "789009"
}
],

and ending with
}
]
]

[damn]

Why am I getting only the first record in the json file. What am I doing wrong

[skselva]

Got it Mam Thank you so much for your grate 🤩

[crazylal]

Mam i am not able to preview the json file data

[adityasaini]

How can I read data from json file and write in a data lake by azure data factory

[vedantshirodkar]

hi mam, the video was very informative.
However, what should one do if we were supposed to insert the json text as a whole string object in a single column in database table