32. Copy data from REST API which sends response in Pages using Azure data factory

In this video, I discussed about how to make REST API call which supports paginations and store response in to files or table using Azure data factory.

Link to dummy REST API Used:

Link for Azure Synapse Analytics Playlist:

Link for Azure Databricks Play list:

Link for Azure Functions Play list:

Link for Azure Basics Play list:

Link for Azure Data factory Play list:

Link for Azure Data Factory Real time Scenarios

Link for Azure LogicApps playlist

#Azure #AzureDatafactory #DataFactory

[ganubikash]

your sentence - "what it will do NA" - it gives feel that we are sitting at class room in front of a teacher. Good job. Keep it up.

[jayantbishnoi]

this is so useful! these tutorials are gold!

[HiYurd]

This is excellent video on how to loop through a REST API with pages. Thanks Maheer!

[franksomto]

Thanks Maheer, really insightful. Any update on the next video you promised to make?

[sr_newchannel]

Thanks Maheer for sharing not only these but other tutorials, its very useful !!
At the end of the video you mentioned about pagination, Were you able to create any video on this scenario of API returning __next?

[bindrarawat]

Thanks for the video. My question is how can we achieve the same result when continuation token is being generated and we have to use that token to get the whole data. In that scenario we will not get any total pages property in JSON output

[sunilbailwal]

Thanks Maheer, there is pagination rule in copy activity which will write all the pages in one file. Can you please provide an example? Thanks

[anamariabahudu]

Can you please make the video on how to create the pagination for APIs that have next links? Thank you!

[mustafakamal]

Thank you very much for creating this, this is really valuable and helpful!! However I was wondering how can we achieve the opposite scenario- posting json data from blob storage to rest api ? Please advise..

[subhashkumar]

Hi Maheer, you said that you will prepare a video in future and the same content we achieved here can be done using pagination in ADF. Could you please prepare a video on that?

[errajinoura]

hello and thank you for all this explanations, pleease can you answer me about how can I Copy data from multiples REST API which sends response in a sql server table using Azure data factory ?

[dilipmevada]

Hi Maheer, How can we make post API request with dynamic field for Paging?

[liyaspasha]

HI Maheer, Can you please create a Video on configure Multiple Rest APIS along with incremental load.

[epuriraghavendra]

can we put sink as rest api and post the data to api ?

[AHMEDALDAFAAE]

Thank you so much! However, Pagination rule can help to make it easier without setting parameters

[azurelearner]

Hello

Can we copy the data from powerbi to azure storage please advise

[NawazShareefMohammed]

hello, can we connect dataroma to adlsgen2 and import data from adls to dataroma?

[pbhaskar]

Hi Maheer .. your videos are very helpful to us.. Could you please post the video like how to ingest csv file data from datalake to oracle cloud fusion using ADF and also target side is rest API post method

[narendras]

Hi Maheer
I have one doubt can u copy the file from SharePoint to Adls what is the process can u please tel me

[carpediem]

Where is the linke to the next video of using Copy ACtivity using Pagination Rules ?