Copy data from ADLS to Azure SQL using Azure Data Factory
ฝัง
- เผยแพร่เมื่อ 8 ก.ย. 2024
- .
00:00:01 Brief description about the project
00:02:49 Deploy resource group
00:06:18 Deploy Azure Storage Account
00:12:11 Deploy Azure Data Factory
00:18:13 Deploy Azure SQL Database
00:26:17 Create Blob Container
00:29:24 Create Linked Services in Azure Data Factory
00:39:39 Create DataSet in Azure Data Factory
00:45:19 Create Data Flow Job in Azure Data Factory
00:59:25 Develop and Rune Pipeline Job in Azure Data Factory
01:07:36 Create Trigger to automatically run the pipeline
This video will help you understand the following components using a simple project.
Azure Data Lake Storage
Azure Data Factory
Azure SQL
Please check my Udemy course www.udemy.com/...
Please fee free to reach out hadoopengineering@gmail.com if you have any queries.
Sir u can plan" Hadoop admin training "
& Linux Schell script online training
With the vast knowledge u have
Many people will be benefit from you
Hi!
I am a newbie in the data engineering world, and your video has been super helpful.
Please can you provide the link to your dataset.
Thanks.
I did all the same, but getting below error, when i test the connection its working fine, but when i run the pipeline it immidiately terminates with the below error:
Input Payload is invalid, validation result - '["Connector or activity name: ADLS_GEN2_LINKEDSERVICE, connector or activity type: AzureBlobFS, error: Calling partner RP EvaluatePolicyAsync returned an invalid status code 'Conflict', ReasonPhrase Conflict","Connector or activity name: AzureSqlDatabaseScalez, connector or activity type: AzureSqlDatabase, error: Calling partner RP EvaluatePolicyAsync returned an invalid status code 'Conflict', ReasonPhrase Conflict"]'
Hello sir,
Can you suggest general issue facing in your cluster as Hadoop Admin 🙏🏻
Please reply 😇
Azure SQL can be substituted by the Azure SQL DATABASE for Postgres?
how to transfer data from adls to sql server? can u do video on that it will helpful to us
Sir r u giving any online trainings if any are there please provide your details
You can check my course in Udemy www.udemy.com/course/azure-data-engineer-real-world-projects/?referralCode=D5569983A4ED7E87CB62 . I have uploaded similar projects in that course.