48. How to Copy data from REST API to Storage account using Azure Data Factory | #adf #datafactory

In this video, I discussed about how to copy data from REST API to ADLS gen2 storage account or SQL table using Azure data factory.

Link for PySpark Playlist:

Link for PySpark Real Time Scenarios Playlist:

Link for Azure Synapse Analytics Playlist:

Link to Azure Synapse Real Time scenarios Playlist:

Link for Azure Data bricks Play list:

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

Link for Azure Logic Apps playlist

#adf #datafactory #azure #azuredatafactory #etl #WafaStudies #maheer #restapi #adf #datafactory

[AHMEDALDAFAAE]

Thank you so much! I learnt a lot from this short video.

[saketsrivastava]

Thanks buddy for such a insightgul video

[ibm_etl_datastage]

You have great content explaining ADF ! Can you please create a video on how we can pull multiple excel files from Microsoft Teams and another video on Sharepoint as source and loading to some file or database after doing some transformation. There are videos available but I like the way you make it simple.

[saisudha]

Make a video for interview questions and also what are the challenges u have faced in adf with examples please.

[UmarKhan-bxjy]

Thanks brother, it was really useful. I really appreciate it.

[BharatHiralal-lbpq]

Hi, The requirement is to Truncate the Salesforce Table first using ADF and then load the table using ADF. How can we do this? Any idea ?

[mayanksharma]

Awesome tutorial. Is there a way to divide PDF in chunks while copying from source to sink ? Like copying a 500 page PDF to 5 PDFs 100 page each ?

[azhi]

how can control dev and prod variables in ADF ?.

[YaminiRajeev]

If the API retrieves the CSV format file instead of json, how to copy the data into the synapse table?

[ravindranathchowdaryalapat]

I have 10 jsons same as above scenario, Then how to load them in single for each activity by using dynamic column mapping, Can you please explain this

[MaDmAxLoCaL]

we got a request in our project to egress data from ADLS location to REST API using ADF, is that possible? if so please provide your guidance

[stoyyeti]

Is there any option to dynamically specify unroll column in flatten transform . Pls reply

[itversityitversity]

I have one requirement this topic? I want to call API and this API contains 5 CSV format files and want to move these 5 files into destination (table format) . Can you please help me how to do ??

[yashwanthv]

How to copy table from one storage account to another storage account in synapse

[vinuthab-zwnj]

Same requirement with incremental data required. call watermark table col_Name 'ApiUrl', based on 'LastExportDt' data should be increment. Please make one Video

[cosmocracy]

You only got HALF of your data. You ignored the real-world challenge of pagination. The attributes indicate that you need to perform subsequent fetches to get all 12 rows.

[joserfjunior]

Make Use Web, set variable, to copy data !

[mayanksharma]

Awesome tutorial. Is there a way to divide PDF in chunks while copying from source to sink ? Like copying a 500 page PDF to 5 PDFs 100 page each ?