77. How to read JSON output of one Activity in to another Activity in Azure Data Factory

In this video, I discussed about reading JSON output of one activity in to another activity in azure data factory.

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

#Azure #ADF #AzureDataFactory

[avaniheriss]

Thank you for all the hard Work. Please show how to store this Json Output to the Blob Storage. Thanks you

[srinivaselluri]

Thanks a lot Brother for your tutorials. I have a question - How to handle the special character in JSON (source) field names? Pipeline is failing with an error saying - input json format has special characters. and I am calling the json data using API(get). Please advise.
Eg:
{"customer (name) " : "abc"}

[baladenmark]

Fantastic tutorial. Thank you. How do I write the failed output of a copy activity into a file?

[diveshs]

Very good content. Nice Videos. I am looking for more such videos.
How can we log pipeline errors in a blob storage file?

[rohithnamani]

Thanks for the video. I have a use case, Im trying to load JSON(Simple format) from an API to a single column(data type variant) in a SQL table through a copy activity in ADF. When im trying to do that the keys are splitting and number of columns mismatch error appears. May I know if there is any solution for this use case?

[JL-qcgq]

I want to pass the JSON output of the web activity into databricks activity. I need the whole JSON output since databricks will process the whole output. How do we do that in adf?

[ts]

can you make a video on copy data activity ? copy json from one activity to other pls

[zfold]

@WafaStudies, are you available to do one ADF POC?

[aliaksandr]

how to parse without foreach activity. I do get metadata inside foreach and get metadata always will return 1 file

[rahulparmar]

The children array that you got from get metadata activity... i want to store all the children data in mongodb... how can i do that????

[dharmveerchaudhary]

Pls give any idea, how to kill infinite loop created inside the until activity in azure data factory

[hrpproductions]

But how to handle if it's an object instead of being an array

[Rafian]

Hello techies, I am generating json code using teradata sql code and I want to send this data to a web application using api call. How should I go about it. I am completely new to adf and just started exploring it. So any help will be of great value.

[surendrasuri]

I am unable to read the web activity JSON response.getting property selection not supported on values of type String

[premgcp]

Hello guru gaaru,

how do I loop through this json for ingestion. I tried using lookup activity but unable to access child items. Can you please help anna.

I want to use copy activity and pass the below items inside tablelist. to ingest data.

{

"tablelist": [
{
"tblname": "rbf",
"secretkey": "xyz",
"container": "migration",
"cpath": "dev01"
},
{
"tblname": "abcd",
"secretkey": "abcd",
"container": "migration",
"cpath": "dev02/"
}
]

}

[babluprajapat]

I have Only one json file in Azure blob storage which is containing millions of Json object.
My question is how read the that file and extract and upload million of single single json document instead of one.
Any idea ?

[sivasudarsan]

Hi, I want adf to extract content of text file (from storage) and based on value it should trigger another pipeline.

[realcontent]

I have stored all expressions in one config table to make everything dynamic here you are fetching only one type of variable... I have thousands type of variable
How to fetch each of them into pipeline variable any body has that logic i don't want to use multiple times filter activity and set variable

[michelepotenzateixeira]

the videos are very good but as i'm from Brazil and i don't have good english i need subtitles. It would be possible? Thanks

[bhawnabedi]

Please do tell about yourself as well we would love to know you