Thanks for the video. My question is how can we achieve the same result when continuation token is being generated and we have to use that token to get the whole data. In that scenario we will not get any total pages property in JSON output
Hi Maheer, you said that you will prepare a video in future and the same content we achieved here can be done using pagination in ADF. Could you please prepare a video on that?
Hi, Im facing one issue, Client give one API (SAP data), every API call got only 1000 rows we get data every 15 mins 10000+ data we have 2 API, one is get the total row count and other one is actual data I need to assign 1st API count to one parameter please help me how to will do it. based on this parameter need to set number of loops.
Hi, please suggest how can I do reverse of this? i.e from ADF Azure SQL table, I want to push the data to on prem SQL Server DB for which I have the REST API link given to this on prem SQL DB , through POST call ? TIA
Thanks Maheer for sharing not only these but other tutorials, its very useful !! At the end of the video you mentioned about pagination, Were you able to create any video on this scenario of API returning __next?
hello and thank you for all this explanations, pleease can you answer me about how can I Copy data from multiples REST API which sends response in a sql server table using Azure data factory ?
Hi Maheer .. your videos are very helpful to us.. Could you please post the video like how to ingest csv file data from datalake to oracle cloud fusion using ADF and also target side is rest API post method
Hello, I am using ADF - Copy Activity - Rest API call (with hapikey) to HubSpot to fetch records... the response provided me the next records URL but it does not have hapikey. Can you kindly provide step by step guide on how to get this working? I have been trying options but none of them seems to work. Also, HubSpot API does not give me how many pages I need to iterate so I really can not use For Loop as you have shown in the above example. I know similar topics are discussed in many forums but are not able to get an exact step-by-step guide on how to achieve them. I really appreciate your videos and explanations as they are easy to follow and do clarify the majority of doubts. Thank you in advance.
Thank you very much for creating this, this is really valuable and helpful!! However I was wondering how can we achieve the opposite scenario- posting json data from blob storage to rest api ? Please advise..
your sentence - "what it will do NA" - it gives feel that we are sitting at class room in front of a teacher. Good job. Keep it up.
This is excellent video on how to loop through a REST API with pages. Thanks Maheer!
Thank you 😊
Thanks for the video. My question is how can we achieve the same result when continuation token is being generated and we have to use that token to get the whole data. In that scenario we will not get any total pages property in JSON output
this is so useful! these tutorials are gold!
Thanks Maheer, there is pagination rule in copy activity which will write all the pages in one file. Can you please provide an example? Thanks
Valuble learning
Thanks Maheer
Welcome 🤗
Did you end up creating a video with pagination?
Yes kindly check part 48 of same playlist
you make adf so simple, thank you
Helped me a lot Bro.
thanks a ton
Hi Maheer, you said that you will prepare a video in future and the same content we achieved here can be done using pagination in ADF. Could you please prepare a video on that?
Did he make new video on pagination in ADF?
Hi Maheer
I have one doubt can u copy the file from SharePoint to Adls what is the process can u please tel me
i want to load both the two pages in single file .how can i do this
Hi Maheer, How can we make post API request with dynamic field for Paging?
Can you do the same example for a data flow with pagination? It is diffetent than for copy activity
Sure dan. I will try plan that soon.
@@WafaStudies Thanks! There is not much info on the internet
Very helpful 😊 Thanks
Thank you 😊
Hi,
Im facing one issue, Client give one API (SAP data), every API call got only 1000 rows
we get data every 15 mins 10000+ data
we have 2 API, one is get the total row count and other one is actual data
I need to assign 1st API count to one parameter
please help me how to will do it. based on this parameter need to set number of loops.
hello, can we connect dataroma to adlsgen2 and import data from adls to dataroma?
Hey @WafaStudies , Whats the difference between API and Rest API ?
Hello
Can we copy the data from powerbi to azure storage please advise
Hi, please suggest how can I do reverse of this? i.e from ADF Azure SQL table, I want to push the data to on prem SQL Server DB for which I have the REST API link given to this on prem SQL DB , through POST call ? TIA
Hi, Did you get a solution for this scenario?
can we put sink as rest api and post the data to api ?
Awesome Bro...
Where is the linke to the next video of using Copy ACtivity using Pagination Rules ?
How to load rest api data incrementally ? Can you please make a video on it
I created this but after successful debug its showing only one record copied. Two files created in Sink side but only one one record in each files.
Thanks Maheer, really insightful. Any update on the next video you promised to make?
Can you please make the video on how to create the pagination for APIs that have next links? Thank you!
Thanks Maheer for sharing not only these but other tutorials, its very useful !!
At the end of the video you mentioned about pagination, Were you able to create any video on this scenario of API returning __next?
hello and thank you for all this explanations, pleease can you answer me about how can I Copy data from multiples REST API which sends response in a sql server table using Azure data factory ?
Hi Maheer .. your videos are very helpful to us.. Could you please post the video like how to ingest csv file data from datalake to oracle cloud fusion using ADF and also target side is rest API post method
Thank you. Oracle fusion environment i can't get it. But i try something posting data to api in sink. That may useful
@@WafaStudies Thank you so much..
and also is there any way to convert CSV file to base64 format using ADF?
Hello, I am using ADF - Copy Activity - Rest API call (with hapikey) to HubSpot to fetch records... the response provided me the next records URL but it does not have hapikey. Can you kindly provide step by step guide on how to get this working? I have been trying options but none of them seems to work. Also, HubSpot API does not give me how many pages I need to iterate so I really can not use For Loop as you have shown in the above example. I know similar topics are discussed in many forums but are not able to get an exact step-by-step guide on how to achieve them. I really appreciate your videos and explanations as they are easy to follow and do clarify the majority of doubts. Thank you in advance.
@vikaskumarbrahmbhatt3452 Did you manage to figure this out ?
Thank you so much! However, Pagination rule can help to make it easier without setting parameters
HI Maheer, Can you please create a Video on configure Multiple Rest APIS along with incremental load.
Thank you very much for creating this, this is really valuable and helpful!! However I was wondering how can we achieve the opposite scenario- posting json data from blob storage to rest api ? Please advise..
Excelente!
Thank you 😊
try to post how to call coupa API from ADF