Thank you, Jash, for creating this amazing data engineering roadmap! Your clear guidance and structured explanation are incredibly helpful . Keep up the great work!
Thank you very much for this video sir . Please make one detailed video about machine learning engineering or ai engineering role as well. It’s a humble request 🙏🏻
I'm a data analyst now and feeling saturated just with the skill of sql in my current job. Please guide me how can i jump ahead and make a good portfolio 🙏
I didn't create any 2024 plans. If you were following the one that i created in 2022, then you will find overlap, for such case you can stick to it and see what new topics are added in this one to work on those topics.
Crazy timing sirji! I recently got placed in fedex as data engineer.l and was looking to learn more abt the role and technologies to study. Thank you so much for this in depth roadmap! I will try to cover as much as possible before my job starts.
Hey Jash, thanks for the informtive video. For a beginner (with basic SQL and basic Python knowledge) what would be a realistic timeline to get through the entire roadmap?
Hi Jash, I'm currently working as a tester and looking to switch my career to data engineering. I've watched your previous videos and got a clear idea of what steps to take- thank you for that! Could you please share if certifications are necessary for this transition, or would building relevant projects be enough to land a data engineering role? Your guidance would be greatly appreciated!
Thank you! Yes, I'd recommend certifications. Aim to get a couple of certificated in any cloud platform. For example, in AWS, go for sol arch and data specialized certs. This will surely add value. All the best!
Hii Jash I was following your previous video of data engineering.Just started 2-3 weeks ago..Have a basic knowledge of python and sql now.Should i focus on this roadmap now or should i continue with the previous one?
Hi @jash what will be usual salary ranges for a data engineer with 1 year experience and how is rhe market for data enginers with 1 yoe or fresher off campus
In general software market is not as great as it was 2 years ago but it's improving. For 1 YOE, the range totoally depends on which company you work for. It can range from 6 to 35 LPA
I don't understand how can 1 person learn so many tools and languages. Each product in market has so many features and it is nearly impossible for anyone to keep pace with so much constant knowledge and architecture. It will take ages. Not possible in this lifetime
This takes 1 year even if you start from literally 0, not ages.. Also this doesn't even have all tools. These are mostly 1 tool from each category. Fly or die 🫡 Also languages? There is literally only 1 programming language I am talking about.
@@JashRadiaPython, Linux scripting, SQL are all different languages each having their own syntax and complex command and functions, isnt it? Each tool has its own architecture. I was referring in that sense. Even I learn things theoretically, until one gets practical hands-on in real projects, one cannot claim to be an expert. Also when we go to get a new project, everyone demand hands on on the tool.So in a way, it will take lot of years to claim oneself to be an expert. And then by that time there are are 10 new products which become the hot thing to know. I think it is better for anyone to pick 1-2 areas or skills in your list and become a pro instead of knowing everything but being master of none
I am working in a data governance company. Will it be a good move to move to data engineer role because I know how the data is being used by them. How can I make with this for a job search ? What are the things I need to work on more to get deep into the data engineering field? Thanks!!
Yes, most of the roles in engineering are better than product roles in terms of pay (generally) and security. So if you're interested in data, this can be a good move. You need to learn the skills first with this roadmap and then do at least 2-3 projects and list it on your github. You might not get data engineering roles directly but look for data analysis kind of role to get in this field and then eventually make a move to be a DE. It's a long road.
@@diyagupta9572 of course there are many off campus opportunities as well man. Also career swtiches. Switching domains in tech has been done by millions of engineers. You just gotta start learning and stop doubting.
Following this, we can become a great data engineer. But is it really gonna help us land a good job? Because I think this map has too many things to focus on whereas landing a DE job would need us to focus on 4 to 5 skills mainly.
Not really. System design round itself requires you to have many skills like orchestration, real time and batch bug data processing, queue systems, cloud and devops. And that is also a round whwre many people fail. Having said that, this will ensure that you become a good engineer. Becoming good at interview will be a byproduct of this. It's not the only goal of this roadmap
Hi jash, what about apache pinot and sql mesh for Data engineering, we are trying to implement it in our system will it be useful for a data engineer. Thank you
Yes Pinot is a good open source tool for clickstream data OLAP. But while following this roadmap, you will learn more OLAP systems during cloud computing courses and data warehouse anyway, didn't want to add pinot separately to reduce redundancy. There are many such tools that are not covered in this video because their alternatives were already covered.
Thank you for watching! We have made a full circle with this video and hope you like it ❤ let's talk!
Thank you for the roadmap.
Can you do roadmap on azure data engineer
the goat is back. thank you for your data engineering content. it help me to get a data engg job.
All the best!
Thank you, Jash, for creating this amazing data engineering roadmap! Your clear guidance and structured explanation are incredibly helpful . Keep up the great work!
Top notch! Really loved from scratch to depth! Thanks for the highly informative video❤️
I asked for this in your previous roadmap video.. and you put a video.. thanks!!
🫡
most awaited video 😁 thank you for sharing resources along with 🙂🙂
Thank you :D
Thanks bhaiya 😊
This gonna help new commers a lot 😅
Love your videos ,
Simplicity with nice explanation and a handsome man 😅
Very informative content as always 👏🏼
Thank you!
thank you sir for your data engineering content it helped me
All the best in your journey!
Very helpfull video, Thank you sir.
what about databricks? I have registered for one certification and about to take the exam.
Databricks spark certification is one the most valued one. Go for it!
Hi Jash, could you please make a video on open source for data engineers. Love your content ❤️
Sure, many tools I am talking about in this video are open source, but thanks foe suggestion and support!
Sir what is the future of data analytics is it good carrier option in 2025 , can Ai replace data analytics?
Not really. Checkout my AI related video to know why: th-cam.com/video/3ihrsGN266k/w-d-xo.html
Thank you very much for this video sir . Please make one detailed video about machine learning engineering or ai engineering role as well. It’s a humble request 🙏🏻
Thabks for watching! This video covers most important parts of AI: th-cam.com/video/3ihrsGN266k/w-d-xo.html
I'm a data analyst now and feeling saturated just with the skill of sql in my current job.
Please guide me how can i jump ahead and make a good portfolio 🙏
I am following 2024 Path and when compared to 2025 the path is completely changed now , which one I have to choose now
I didn't create any 2024 plans. If you were following the one that i created in 2022, then you will find overlap, for such case you can stick to it and see what new topics are added in this one to work on those topics.
@ thank you for the reply actually I am following
2024 ultimate roadmap plan
Crazy timing sirji! I recently got placed in fedex as data engineer.l and was looking to learn more abt the role and technologies to study. Thank you so much for this in depth roadmap! I will try to cover as much as possible before my job starts.
Hey Jash, thanks for the informtive video. For a beginner (with basic SQL and basic Python knowledge) what would be a realistic timeline to get through the entire roadmap?
I think anywhere between 4-8 months, depending on how much you put in every day
Hi Jash, I'm currently working as a tester and looking to switch my career to data engineering.
I've watched your previous videos and got a clear idea of what steps to take- thank you for that! Could you please share if certifications are necessary for this transition, or would building relevant projects be enough to land a data engineering role? Your guidance would be greatly appreciated!
Thank you! Yes, I'd recommend certifications. Aim to get a couple of certificated in any cloud platform. For example, in AWS, go for sol arch and data specialized certs. This will surely add value. All the best!
Hii Jash
I was following your previous video of data engineering.Just started 2-3 weeks ago..Have a basic knowledge of python and sql now.Should i focus on this roadmap now or should i continue with the previous one?
Basics are the same in this and that one as you'd have noticed. Pick the rest from this one.
@JashRadia We dont have to fo hadoop now?Can go directly with spark?
Hi @jash what will be usual salary ranges for a data engineer with 1 year experience and how is rhe market for data enginers with 1 yoe or fresher off campus
In general software market is not as great as it was 2 years ago but it's improving. For 1 YOE, the range totoally depends on which company you work for. It can range from 6 to 35 LPA
@@JashRadia Thanks
I don't understand how can 1 person learn so many tools and languages. Each product in market has so many features and it is nearly impossible for anyone to keep pace with so much constant knowledge and architecture. It will take ages. Not possible in this lifetime
This takes 1 year even if you start from literally 0, not ages.. Also this doesn't even have all tools. These are mostly 1 tool from each category. Fly or die 🫡
Also languages? There is literally only 1 programming language I am talking about.
@@JashRadiaPython, Linux scripting, SQL are all different languages each having their own syntax and complex command and functions, isnt it? Each tool has its own architecture. I was referring in that sense. Even I learn things theoretically, until one gets practical hands-on in real projects, one cannot claim to be an expert. Also when we go to get a new project, everyone demand hands on on the tool.So in a way, it will take lot of years to claim oneself to be an expert. And then by that time there are are 10 new products which become the hot thing to know. I think it is better for anyone to pick 1-2 areas or skills in your list and become a pro instead of knowing everything but being master of none
How to get calls for Data Engineering job without any job experience.
If I learn data engineer course can I get a job as a fresher
is,it relevent to a Fresher ! anyone please.
I am working in a data governance company. Will it be a good move to move to data engineer role because I know how the data is being used by them. How can I make with this for a job search ? What are the things I need to work on more to get deep into the data engineering field? Thanks!!
What is your current role?
@ product engineer
Yes, most of the roles in engineering are better than product roles in terms of pay (generally) and security. So if you're interested in data, this can be a good move. You need to learn the skills first with this roadmap and then do at least 2-3 projects and list it on your github. You might not get data engineering roles directly but look for data analysis kind of role to get in this field and then eventually make a move to be a DE. It's a long road.
@@JashRadiaThank you so much for sharing!!!
is fresher get a job directly as a data engineering role ?
I did through campus placement
@@JashRadia yah, only campus placement; is there any chance like through referral or off campus?
Can we just switch into the data engineer field after becoming experienced in any tech field/domain?
@@diyagupta9572 of course there are many off campus opportunities as well man. Also career swtiches. Switching domains in tech has been done by millions of engineers. You just gotta start learning and stop doubting.
@@JashRadia ok great, I'll start learning. Thankyou so much for replying
Graduated in 2024 still didn't get full time no openings for freshers mostly for senior 2-5 years.
Data engineer vs backened developer who earn more after five years of experience and which language is best for backened java vs python vs JavaScript
There is no clear winner. Both have similar pay ranges generally.
Following this, we can become a great data engineer. But is it really gonna help us land a good job? Because I think this map has too many things to focus on whereas landing a DE job would need us to focus on 4 to 5 skills mainly.
Not really. System design round itself requires you to have many skills like orchestration, real time and batch bug data processing, queue systems, cloud and devops. And that is also a round whwre many people fail.
Having said that, this will ensure that you become a good engineer. Becoming good at interview will be a byproduct of this. It's not the only goal of this roadmap
@JashRadia Thank you, could you make a video on how to choose companies/job profiles and how to get an interview for them.
Hi Jash Bhaiyya, can you please make a video on road map for becoming Cloud Data engineer and how to get selected in Google for same role
Hey, this roadmap is same as cloud data engineer role because it includes cloud as well.
HI can you make a video on collage 1st year what to do and not to do pls
I am focused on data engineering topics, but sure, it can be a future video!
Doordash office Tour karo bhaiya
make more content videos bhyaa
Yes sir, trying 😅
Hi jash, what about apache pinot and sql mesh for Data engineering, we are trying to implement it in our system will it be useful for a data engineer.
Thank you
Yes Pinot is a good open source tool for clickstream data OLAP. But while following this roadmap, you will learn more OLAP systems during cloud computing courses and data warehouse anyway, didn't want to add pinot separately to reduce redundancy.
There are many such tools that are not covered in this video because their alternatives were already covered.
Please upload the same kind of roadmap for experienced data engineers