Microsoft Azure Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)
ฝัง
- เผยแพร่เมื่อ 11 มิ.ย. 2024
- Join My Data Engineering Course Here: datavidhya.com/courses
In this video, we will talk about how to become an Azure Data Engineer, the complete roadmap, top services to learn, and how to prepare for a certificate, I hope you find it useful.
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
Resources mentioned in the video - datawithdarshil.notion.site/A...
Timestamp
0:00 Why this is best time to learn Microsoft Azure?
1:45 Top Azure Services for Data Engineers
9:27 How To Learn Microsoft Azure Cloud from Scratch (Complete Roadmap)
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / darshilparmarr
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: amzn.to/3HQJDyP
👀Deep Work: amzn.to/3IParkk
💼Rework: amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: amzn.to/3CiFVwC
📺LG 22 Inch Monitor: amzn.to/3zk0Dts
🎥Sony ZV1: amzn.to/3hRpSMJ
🎙Maono AU-A04: amzn.to/3Bnu53n
⽴Tripod Stand: amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete...
👉Data Engineering Project Series: • Data Engineering Proje...
👉Become Full-Time Freelancer: • Best Freelancer Series...
👉Data With Darshil Podcast: • Podcast Series - Data ...
✨ Tags ✨
learn azure data engineering, become Microsoft data engineer, master azure for data engineering, azure data engineering certification guide
✨ Hashtags ✨
#dataengineering #azure #microsoft
Suggest some good video topics that you want to see in future, Also Don't forget to hit LIKE BUTTON :)
More GCP project and services to focus on, python libraries used in data engineering
PLEASE POST IN THE COMMENTS OR BELOW THE VIDEOS >>> LISTS OF THINGS YOU TALK ABOUT IN YOUR VIDEOS... THIS WOULD BE MUCH APPRECIATED👍 AND VERY HELPFUL!!!! THANK YOU FOR YOU EFFORTS HELPING US ALL OUT! BLESSINGS!🙏🙏
similar video on gcp services
We are expecting azure databrcks projects and Gcp projects
System Administrator Road Map
Thanks Darshil for the roadmap I have cleared DP900 & DP203 Exams last month was confused how to explore these concepts, your video made it simpler for me to explore more.
Darshil, you are a star, your videos are super helpful to understand Azure Data services. I was just going in circle until now , and was not sure how should i plan my learnings of Azure data services but this video is really making things quite clear. thank you so much.
U explained very well bro, but small thing u forgot, try to make blurr on ur T-shirt AWS Logo while u explaining Azure or other providers....
Hi , what kind of challenges faced while working on azure data engineer project (databricks,ADF, Pyspark)and how do you resolve it?
Thannks Harshil. Please make same video for AWS and GCP. Great work.
I love the way Microsoft offers the services to market. Extremely easy to use, I also can create simple data pipeline within 1 hour. Thanks for sharing this video!
You are welcome
What are the resources if someone wants to learn this from scratch
Hi Darshil, please do more videos on end to end projects, want to know the kind of projects you work...
love when you're talkin about azure with aws hoodie lmao
Bhai ye hi search kr r tha and turant aapka video aa gya.
Thanks bhai.
🔥🔥🔥🔥
do freshers get hired as data engineers? or is it necessary for them to work as data analyst in order to get some experience and then move to data enginerring roles after a couple of yrs?
Hey Darshil, do confirm whether Synapse is actually used in the market as much as Databricks. Since Synapse is a lot more expensive, industry leaders tend to not use it and are currently using ADF + databricks as a combination for most of their use cases. Could you just confirm if market trend still dictates Synapse as a requirement?
Hi Darshil, please do similar video for AWS and GCP also that would be so helpful.
Noted
Hey bro, found your video very informative. Do one video regd Data engineering using AWS services. What are the python libraries needed to learn data engineering
Well presented important Azure data platform services
And explained structured way to learn these services with cerificatipn
Good Job 👍
Glad it was helpful!
Can you please update full course with all content along with project on Azure data engineering
Hi Darshil,
Can I start directly by learning cloud services instead of on prime services, will that be good.
Hey darshil, what is the tentative launch date for Spark Course? Expecting it to have some complex projects. We know you have a lot of things on the plate and congrats on 100k.
I am going to release early access this month for existing students
Please do a video on Azure DP-100 certification, how to learn and get certified. Looking forward to it. Thanks ❤️
Thank you man
hi..Can you make a video of complete roadmap to become Azure cloud engineer in few months and become ready for cracking job interview
WE want more vidéo of azure thanks aws and loading end to end project and spark tutorial. Thanks darshil for efforts
I will do my best to bring new content
Superb young man, keep going ❤
Thank you, I will
Azure security, monitor and health. Should be included as security in data level is highly important.
Please make a similar video for AWS too🙏🏼
Can you also put some lights on One Lakes services provided by azure
Bro make a video on how to set up Python for pyspark in Pycharm IDE on mac and windows.
I believe scala and pyspark knowledge is required to crack the dp-203 exam as well, not sure if they updated that.
very nice explanation , please post video of python in association with power bi analytics.
Please make a video for Aws as well
Darshal, give insights on data engineering and product manager combination. As i am currently planning to switch from business program manager to data product manager positons
what's role and resp. of a data prod manager bhai
Can you make a video about AWS? Thanks
Bro, Which path do you recommend for a high package salary, first learning the spark, airflow, hadoop, kafka etc and then getting into a specific cloud or can I start directly with a cloud platform?
Order doesn't really matter, you can start with cloud too, all you need to hear is START!
Thanks mate🎉
You are welcome
hi darshil please do one video for gcp data engineering and pls do explain one end to end project using gcp services
Sure, I will see what I can do
@DarshilParmar, when are you launching the remaining courses on modern data engineering?
Spark will be launched soon
Hi I have 6 years java experience, I want switch to data engineer role is is best option or not
As always great content. 2 requests for next time: 1) end to end project you suggested doesn't connect to Power BI. You might want to generate that last part of the project so it's truly an end to end.
2) would be very nice to have a second part for that same project where you show how we deal with inbound and outbound data in other to show how it actually work in an industry level escenario. Maybe a few made up needs from different areas of a fake business so we provide them solutions and show how to stablish the logics tailor made for those.
Keep it up🎉
PowerBI part is challenge that you guys have to do
Nice
something-went-wrong-and-were-unable-to-retrieve-the-draft
Hello Darshil, can I start Azure DE as a beginner?
and whats the difference between data engineer and Azure data engineer? from where to start as a beginner to became a data Engineer?
Give me response, I shall be very thankful to you for this act of kindness :)
There is no difference between Data Engineer and Azure Data Engineer, as a data engineer you need to know one cloud platform, being an Azure Data Engineer means you know azure data services and things around it
I have few courses to get started - datavidhya.com/courses
This will help you to get started, I am building more courses
Without any degree can I become data engineer or cloud engineering devops with certificate course
Hi Darshil Please also make video on GCP Data Engineering Complete Roadmap
Putting this on list
Hi bro I have 12 yrs IT experience in FMGC organization I'm has a IT operation so its possibilities to do azure data engineer
Hello sir! I am new to data engineering and I recently got Microsoft certificate of DP-203, do you have a suggestion on how to make it in this field? and I would like if you make a video project on azure eventhub and power BI
I have a project on Azure, you can check that, other than that there are so many good projects available on TH-cam, you just need to search for it
Tshirt aws and making for azure
Great try your Microsoft Fabrics cover as a Data Engineer with strong Use case of project
Sure
Nice and informational video... I want to know what are the prerequisites for DP203?
I have talked about it here - th-cam.com/video/Gh7v6XCHNxU/w-d-xo.html
Hi Darahil,
I want to know that how much important to learn the coding language before starting the microsoft azure data engineer.
I want to know the sequence which should i start learning 1st python language or Microsoft Azure data engineer services.
Please it will helpful yout advise
Thanks
@Darshil waiting for your guidance
Sir please tell me which one i do azure data engineer or snowflake with aws data engineer which one is best for present and future. Which one i study.
All of them are different AWS and Azure are cloud computing platform and Snowflake is a Database.
You can learn one cloud and snowflake, I have a course where I teach with AWS
datavidhya.com/courses/datawarehouse
Yes I know but azure data engineer is best or snowflake data engineer is best for current market.which is more in demand.
Darshil, pls do the same for GCP pls...
I will put this in my list
Is this roadmap will work for the person with 3 years of experience in other domain and want to switch to Azure?
Yes, this roadmap is for everyone
I am beginner can i start?
How can i learn?
bahiya is it possible for fresher to get in data engineer.
Hey Darshil, Is this learning path suitable for college freshers?? I have been trying for job from last 6 months after following your content. please reply
Yes ,you can start with this
Darshil Sir, as you said... For entry level engineers, we need to know just the use cases of Machine Learning service on Azure right??? Or do we need to dig deeper into it?
Just basic understanding is fine
@@DarshilParmar ok sir... Just one more thing.... I am preparing for AZ-900 & DP-900... will those be a good addition to my career transition as an Azure DE?
Yes
@@DarshilParmar Thank you sir
Explaining Azure services with AWS t-shirt😂
Hi, darshil
cloud training is available is mostly generic , not specific like Azure devoops, or data engineer etc
Coursera course is good
Sir , Please make a detailed video on Google cloud dataengineerimg
I will put this on my list
can we call Data Engineer as bigdata Engineer
Superr insightful video, I think the coursera azure data engineering course is not free for audit....can you check & reply plz
It is free for audit, to get labs and certification you need to make purchase
@@DarshilParmar I am still finding some money need to be paid, can you verify/I hav verified two times
I switched from Azure cloud to Aws cloud las month , Was that a good decision ? or did I make a mistake?
No, you’ll learn more
Azure data engineering or IICS -> which is better?
The university has purchased a new cloud-based software solution to help with student applications that needs integrated with our student record system. and we need to provide a data integration solution to this.. what would you suggest ? doing it with azure services including factory, databricks.. datalake and synapse.. or use Kafka and Java?
please suggest me the best way to do so ?
It depends on usecase, Kafka is mainly for real-time data streaming, I feel for university application that will be needed, start with very basic stuffs
Do POC using Azure services if you are going with that, DataFactory can work on this case
@@DarshilParmar ok..so should I start with migrating the on prem to data factory and create data warehouse and utilize that using azure ?
How does the testing and support be done after data integration then? Can you provide a little bit of an approach to it.
Get some sample of data that you think needed for project, build some test pipeline from DF to Data Warehouse, if things goes fine then think about how you will do migration from Onpremp to Cloud and then replicate same steps
@@DarshilParmar Hello Darshil , I am really confused at zure data engineer and azure devops engineer , i am not good at coding, programming , currently working in cognizant completed 2 yrs, but i got project in july, wokrin in devops ci cd pipelines, just have az900 yet but i feel nothing is easy here. please help
Azure promotion wearing AWS T-Shirt :)
Bro, Does this roadmap do it for the college final years as well? or do we need experience in the industry
You can do this, good for college guys, you'll have something to show when you get in the industry
Thank You!@@DarshilParmar
Please make vidio on aws ..
Sure
Data engineer vs devops vs web development more job opening more package future growth
Please make for AWS
Putting this on list
Can you please do one for GCP'
Will do it
wearing aws , teaching azure
Which azure certifications we have to do??????
It have talked about it at the end
Is azure free for learning as AWS is free for a year?
Check website
what about making the playlist of Microsoft azure?
I have a project, I will make more of them in future
@@DarshilParmar that would be great 👍
microsoft purview
Good click bait
Learning TH-cam game slowly
UNITY CATALOG
What's for a fresher with no internship experience?
You can do this to build your resume
Whether BCA graduates can become data engineers or BE/BTech graduates can become data engineers?
Yes
BCA or engineering students?
My man promoting Microsoft Azure by wearing an AWS hoodie on a google platform.
haha, planned it
Cloud agnostic 😂
Make a course on azure cloud
This will be done in future
Web development vs data engineer vs devops more job opening more package future growth
DE > DevOps > WebDev
All of them are equal tbh, not much difference, you can make good money if you become 1% on any of these
You should include timestamps...
Okay
Aws and GCP certification
On it!
I'm in love with this content. I read a book with similar content, and I'm in love with it. "Mastering AWS: A Software Engineers Guide" by Nathan Vale
gcp please
I will put this in my list
Please reply sir
it is funny that you are wearing an AWS sweat shirt and promote Azure.
looks like the voice is changed, u did some edit i guess
Got the new mic
AWS ki hoodie aur tareef Azure ki🤣🤣😂😂
Planned 🤣🤣🤣🤣
You promoting AWS using AZURE. lil bit confusing, sound like not genuine because it's look like you try to grab attention on your video not for helping others.
See, you wear AWS tshirt that feel us confusing. Because in you r❤️ you loving AWS.
Please clear this thought point. It's really hard to follow AZURE.
I followed you from last 8 month. Please make us clear.
It’s just a joke, i have visited multiple events so I get these shirts and hoodies that’s it
Also this is a roadmap for Azure for people who want to learn azure but I tell people to learn AWS because I started with that
At the end it doesn’t matter which one you learn as it is same
@@DarshilParmar please pinned this for others also. Thanks to let us know.
That unibrow is incredibly distracting