36. How to Extract distinct elements from an array of complex object using mapping dataflow

In this video we learnt how to Extract distinct elements from an array of complex object using mapping dataflow
Input dataset1:
{
"id": 1234,
"items": [
{
"id": 1,
"name": "A",
"owners": [
"Bob",
"Steve"
]
},
{
"id": 2,
"name": "B",
"owners": [
"Mike"
]
},
{
"id": 3,
"name": "A",
"owners": [
"Bob",
"Mike"
]
}
]
}

Expected output:
{
"id": 1234,
"itemNames": ["A", "B"],
"itemOwners": ["Bob", "Steve", "Mike"]
}

#adf #azuredatafactory #dataengineer #datafactory #synapseanalytics #azuresynapseanalytics #microsoft #cloud #cloudcomputing #azuredataengineer #dataengineering #etltesting #etl #dataengineeringessentials #azurecontentannu

[capoeiracordoba]

Thanks for you content, is very helpfull

[kirankumar]

Thanks. Is that possible by using adf, can we move files from blob to Multiple VMs.

[SKumar-ngyp]

Could you please explain how can we remove hierarchy of complex data type column dynamically.
Without selecting sub columns in flattern transformation.