I hope you all enjoy this video, I have spent multiple days in making this tutorial since my main intention is to cover almost all the topics in the most detailed way so that even an absolute beginner can understand the complete functionality of the CI/CD pipeline. I would highly appreciate if you could give a Like to this video and subscribe to my YT channel which will motivate me to make more such videos in the future. To get the YAML files used in this tutorial, please do the below as a token of support :) 1. Please follow my Instagram channel : mrk_talkstech (and) 2. Send me an message in Instagram with your email asking for the YAML code ( I will send you the files) ***Please Follow**** What else should I cover in my upcoming videos? Please let me know in the comments :)
Thanks for the details, I have one question please - In this example Azure data bricks is invoked from Azure data factory, lets suppose If there are any changes to ADF and ADB , how to use the CICD approach to deploy both azure resource(ADF and ADB) to higher environment
Hi sir I humbly request you to teach us or let us know how to create the notebooks - Bronze to Silver and Silver to Gold respectively. We have not been taught it in that end to end project. I am confused whether the containers - bronze, silver, gold are merged together? If yes then how? Or are the two different notebooks merged into one? If yes then how? I have spent a whole day learning them from every possible source where I could reach but it is yet to be understood. Kindly help me I am a non-cs background enthusiast Thank you so much
This is amazing content! I have a questions for you. Whats the point in updating the collaboration branch by PR , if the CI/CD pipeline trigger will pull latest code from Dev to Production environment? I thought it would pull the changes from the collaboration branch.
It would still PULL from the collaboration branch, before that it would first deploy the changes to the DEV workspace and the same code will be pushed to PROD as well (so DEV, PROD shares the exact same code as Main)
HI Sir, I have question, Both DE1 & DE2 created their feature branchs at the same time and updated code. DE 1 removed some part of code and added new code where DE2 updated existing code. so when DE1 PR request completed main branch will have changes made from DE1 but now DE2 tries to PR .. as some code removed by DE . there would be some confilict. how can this contradicts handles in team with 10 developers
Hi, if they are working in different notebooks then there won't be any merge conflicts, but if there is a need to work in the same notebook, then proper communications should be done before merging the changes to the main, so that the other DE's can pull the latest changes from the main branch before merging to overcome the merge conflicts.
Hi sir, I have got a project in which I have to merge data from different sources in Azure cloud and then after applying some transformation using data flow , load the data in databricks then further do some data transformation steps in it. Then using Azure ML need to build and deploy the model, Basically it's a combined project of Azure data engineering and Azure mlops. Could you please make a playlist on this, this seems to be an interesting task.
I hope you all enjoy this video, I have spent multiple days in making this tutorial since my main intention is to cover almost all the topics in the most detailed way so that even an absolute beginner can understand the complete functionality of the CI/CD pipeline.
I would highly appreciate if you could give a Like to this video and subscribe to my YT channel which will motivate me to make more such videos in the future.
To get the YAML files used in this tutorial, please do the below as a token of support :)
1. Please follow my Instagram channel : mrk_talkstech (and)
2. Send me an message in Instagram with your email asking for the YAML code ( I will send you the files) ***Please Follow****
What else should I cover in my upcoming videos? Please let me know in the comments :)
Hi Mr. K, it's really very easy to understand any layman user. Thanks for providing the complete series.
Clear explanation made it easy to understand. Please upload next video soon. Thank you for the video
Thank you so much :) Just uploaded :)
You teach this really well, and that's rare. I just learned DevOps.
Thank you so much :)
Great explanation sir. Waiting for the next part.
Thank you so much :) Just uploaded :)
superb explanation
Thank you so much :)
great and well explained, you made it easy to understand the fascinating terminologies which one think might be an Alien type of thing. :)
😀
Thank you so much :)
i cant wait your video
Thank you so much :) Just uploaded :)
I like this breakdown
Superr Boss, Loved all your videos, great efforts and thanks for making such a good content, Keep going boss, best wishes
Thank you soo much :)
Hi Mr. K Talks. Thank you for this video. You're a very good teacher. Can you let me know where I can find Part 2?
Thank you so much :) Just uploaded :)
Excellent, Please....Please..make next videos ASAP
Thank you so much :) Just uploaded :)
NICE EXPLAINATION
Good content 👍
Thank you so much :)
Thanks for the details, I have one question please - In this example Azure data bricks is invoked from Azure data factory, lets suppose If there are any changes to ADF and ADB , how to use the CICD approach to deploy both azure resource(ADF and ADB) to higher environment
Waiting for next video
Just uploaded :)
Hi sir
I humbly request you to teach us or let us know how to create the notebooks - Bronze to Silver and Silver to Gold respectively. We have not been taught it in that end to end project. I am confused whether the containers - bronze, silver, gold are merged together? If yes then how? Or are the two different notebooks merged into one? If yes then how?
I have spent a whole day learning them from every possible source where I could reach but it is yet to be understood.
Kindly help me I am a non-cs background enthusiast
Thank you so much
great video
Thank you so much :)
This is amazing content! I have a questions for you. Whats the point in updating the collaboration branch by PR , if the CI/CD pipeline trigger will pull latest code from Dev to Production environment? I thought it would pull the changes from the collaboration branch.
It would still PULL from the collaboration branch, before that it would first deploy the changes to the DEV workspace and the same code will be pushed to PROD as well (so DEV, PROD shares the exact same code as Main)
Awesome video
Hey, big fan, and following your videos. Could you please make a video on REST API and how to use it in Azure.
Thank you so much :) Sure, will do :)
HI Sir, I have question, Both DE1 & DE2 created their feature branchs at the same time and updated code.
DE 1 removed some part of code and added new code where DE2 updated existing code. so when DE1 PR request completed main branch will have changes made from DE1 but now DE2 tries to PR .. as some code removed by DE . there would be some confilict. how can this contradicts handles in team with 10 developers
Hi, if they are working in different notebooks then there won't be any merge conflicts, but if there is a need to work in the same notebook, then proper communications should be done before merging the changes to the main, so that the other DE's can pull the latest changes from the main branch before merging to overcome the merge conflicts.
Very useful
Hi sir,
I have got a project in which I have to merge data from different sources in Azure cloud and then after applying some transformation using data flow , load the data in databricks then further do some data transformation steps in it. Then using Azure ML need to build and deploy the model,
Basically it's a combined project of Azure data engineering and Azure mlops.
Could you please make a playlist on this, this seems to be an interesting task.
Or if possible, please provide some sources to get the idea for this project
Hi can you please show how to deploy workflows to higher environment using cl/cd please
Sure, will be uploaded in the future parts, please stay tuned :)
Can we use ci/cd pipeline in service now??
Please create CI/CD video for ADF as well
Sure :)
how about testing?
Hi is it good to have knowledge of devops concepts to become data engineer
It's a very good knowledge to have as a Data Engineer :)
crack!