My parents are super old school Mexican in their 80s. All they know is "I work with computers" 🤣 It's super hard to explain when they don't even know how to use smart phones or computers.
On January of this year (2023) after I took a time off university I watched this video, loved so much and started studying this field with everyday from morning to night watching, reading, coding and adventuring on cloud. And I can say, after 9 Months, I got my first job on tech as Data Engineer. Thank You AltexSoft ❣ Without this I would be nothing 🙏
First of all, congratulations for your steady obsession which led you to your job.🎉🎉 Can you give us the rough roadmap of what you did during those precious 9 months ? Again, congratulations ❤
@@ShapeShowdown-0It's a long story, I recommend taking a look at Data Engineering Zoomcamp, it will start January 15th and it talks about everything a Data Engineer need (free, on TH-cam)
Hi AltexSoft! I comment here not because I watched this video, but just to thank you for the amazing content! You've helped me a lot in understanding many things about software engineering in a much interesting manner compared to lecturers. I'm glad I found this channel regardless of the number of views because you making amazing content!
These videos are like movies. Well scripted, picturized and to the point . Loved watching them thoroughly. I like the background music change as the topic of content changes
I'm trying to transition from Data Analyst to Data Engineer. I already understand some of the concepts, but this video took it to the next level! Awesome content! 👌
Startet in Excel, I guess I am both the Data Engineer and the data scientist of our team know. Had no idea these things were called what they were, I just kind of do it. Brb, have to update my CV :D
currently i am working as a informatica developer what would be next best option for me to become a data engineer I am confused. do I need to go for cloud providers data engineer certificates..?
I am a Data Engineer and I cant tell you how much sense this video makes. Felt like we, Data Engineers got validation for the work we do! Next time some asks what do you do, I am going to send them this video link. Thank you :) Also special call for creativity and pun
It couldn't have been explained any better. You earned a sub. Also, I've got a question. I used to be an ELT developer and I think Data Engineering evolved like: 1. ETL 2. ELT 3. Big data ETL pipelines. But now there's a fourth evolution as well. I've been seeing companies moving from old traditional ETL techniques to Cloud based Data Engineering. Am I correct or the cloud based DE is also considered Big data ETL? These two are definitely different, right? If they are could you explain what is cloud based data Engineering?
Well, most cloud vendors have very flexible platforms. So, if you're running data pipelines in the cloud, it doesn't necessarily mean that you work with big data processing. You can use traditional ETL and ELT subsystems, warehouse and analytics pipelines in the cloud. But most cloud platforms (AWS, Azure, and GCP) do have their own services to build big data ETL/ELT pipelines, from ingestion to consumption within a big data architecture. So, cloud data engineering can entail both traditional ETL/ELT and big data processing.
I think I just fell in love with that video. It was truly mind-blowing. Not only did you guys manage to illustrate the different relationships between data systems and data discipline on a hight level but the way you visualised it made it so easy to comprehend that even people new to the subject would get it. Amazing! With topics like Data Engineering the true difficulty lies in simplifying things. And just just nailed that
Before starting as DE : i will write ETL pipelines, work on distributed systems, spark, write python code to load data,etc. . . After joining as DE : i should call my self as DBA.
Really interesting video! It definitely relates to what I am working on currently. I work in IT recruiting. I'm always looking for a data engineers for my jobs and this video helps me understand a little more about what data engineers have to face in their field. Thank you!
Amazing explanation!! Now I know what's the difference and the relationship between all these terms and professions! Thank you so much for the content producer!
Necessary and sequenced topics to understand Data Engineering very well.👍🏻👍🏻 I am watching this video second time and would probably refer to this video in future too.
hello, I'm starting in data engineering, is it possible to create a startup/company, so I can earn more? I see salaries from 100 to 180k as an entrepreneur it would be possible to reach 250,350k??
Data Scientist seem to be the easiest job available. Their job is so straightforward and simple. Unlike having to learn how to actually have hard skills, all they need is stats skills. Think they need a more apt title. I’ll call it Business Enquirer. Since all they do is give ambiguous biz predictions to product managers and enquire the engineers to do the tough job. End of the day only to take the credit for having done nothing as tough as the DEs. Given how DEs are so talented and hardworking, they can easily over take a data scientist/ business enquirer, going straight to and from the product manager.
Great effort! a minute addition would be to spice up the cartoons with a percentage of black-skinned cartoons, this would go a long way to program minds of the next generation that, well, it's okay to work along with black-skinned people at any level of the company. Better and even powerful than destructive demonstrations on the streets. Pardon me if it sounds offensive to anyone. thanks!
Only things I want to say, at 1:50 the decision to implement automation before the analyst burns out is sadly rarely true. Source: I was the analyst that burned out.
Hi, does it make sense that the data ingested by Kafka is processed by Spark before it enters the data lake, I thought the data scientists wanted access to the raw data? or does spark simply pass it to the lake without processing it?
In the middle of the night when you fetch your phone to make sure your decision on the Data Engineering boot camp is right, such videos are very reassuring. I don’t know how much I should appreciate this channel for this video in particular. You have earned a sincere Subscriber now.
I am a Data Engineer and now I know what I do :D
You.. Whuuuuuuuuuuut?.. XD
What should someone learn or know before entering into Data Engineering job.In what platform should they prepare for that ??
me too
LOL XD
Only non programmers would be surprised by this comment
This video deserves an Emmy award
Second that
agreed
I approve
Seriously true...!!
absolutely!
I have never seen such a beautiful video on Data Engineering topic. It covered everything what a 400 pages book can't do. Appreciate your efforts
After 8 years of trying to explain to my parents what I do, this does it in 14 minutes. Thanks!
I can imagine how the initial conversation went with your parents
“No dad I’m not help desk, I do things to move data”
My parents are super old school Mexican in their 80s. All they know is "I work with computers" 🤣 It's super hard to explain when they don't even know how to use smart phones or computers.
Lol.... I can imagine.
It’s frustrating job? does it pay well? Pls answer back, adding more details will even help.
@@MrBoomBoom225 Dad: That's what I'm saying. You move data from one desk to another desk😂😂
This video is the single malt of all youtube videos explaining data engineering. This deserves an award for sure.
One of the best technical explanation videos I’ve ever seen in 25 years in the business. Bravo, well done.
Thanks =)
I'm working as a data engineer for 15 years and this is the best explanation of my work I have ever seen :)
Hi sir iam new to this field... Can you explain me your project
@@rajageetha1936 lmao how can he explain all that in one comment
any other such kind of videos on each topic of data engineering?
On January of this year (2023) after I took a time off university I watched this video, loved so much and started studying this field with everyday from morning to night watching, reading, coding and adventuring on cloud. And I can say, after 9 Months, I got my first job on tech as Data Engineer. Thank You AltexSoft ❣ Without this I would be nothing 🙏
Thanks for sharing. We are glad that our video helped you in your journey
First of all, congratulations for your steady obsession which led you to your job.🎉🎉
Can you give us the rough roadmap of what you did during those precious 9 months ?
Again, congratulations ❤
@@ShapeShowdown-0It's a long story, I recommend taking a look at Data Engineering Zoomcamp, it will start January 15th and it talks about everything a Data Engineer need (free, on TH-cam)
Hi AltexSoft! I comment here not because I watched this video, but just to thank you for the amazing content! You've helped me a lot in understanding many things about software engineering in a much interesting manner compared to lecturers. I'm glad I found this channel regardless of the number of views because you making amazing content!
Now I have a better understanding of data engineering! Thanks for the video!
Amazing. A really good high-level explanation of Data Engineering!
These videos are like movies. Well scripted, picturized and to the point . Loved watching them thoroughly. I like the background music change as the topic of content changes
I am having an lol moment when the data scientist responds ... It depends...........ON QUALITY DATA
I'm trying to transition from Data Analyst to Data Engineer. I already understand some of the concepts, but this video took it to the next level! Awesome content! 👌
Any news?
Any news?
One of the best videos I came across, with great explanation and animation. Enjoyed watching it! Thanks!
Startet in Excel, I guess I am both the Data Engineer and the data scientist of our team know. Had no idea these things were called what they were, I just kind of do it.
Brb, have to update my CV :D
currently i am working as a informatica developer what would be next best option for me to become a data engineer
I am confused. do I need to go for cloud providers data engineer certificates..?
It is nice. BTW. Which software is used to make such great animation and video?
Thank you. We use products from Adobe Creative Cloud.
I am a Data Engineer and I cant tell you how much sense this video makes. Felt like we, Data Engineers got validation for the work we do! Next time some asks what do you do, I am going to send them this video link. Thank you :) Also special call for creativity and pun
It couldn't have been explained any better.
You earned a sub.
Also, I've got a question. I used to be an ELT developer and I think Data Engineering evolved like:
1. ETL
2. ELT
3. Big data ETL pipelines.
But now there's a fourth evolution as well. I've been seeing companies moving from old traditional ETL techniques to Cloud based Data Engineering.
Am I correct or the cloud based DE is also considered Big data ETL? These two are definitely different, right? If they are could you explain what is cloud based data Engineering?
Well, most cloud vendors have very flexible platforms. So, if you're running data pipelines in the cloud, it doesn't necessarily mean that you work with big data processing. You can use traditional ETL and ELT subsystems, warehouse and analytics pipelines in the cloud.
But most cloud platforms (AWS, Azure, and GCP) do have their own services to build big data ETL/ELT pipelines, from ingestion to consumption within a big data architecture.
So, cloud data engineering can entail both traditional ETL/ELT and big data processing.
@@AltexSoft Thanks, it's far more clear now.
Thank you for this master piece. It's Insanely Cool
I think I just fell in love with that video. It was truly mind-blowing. Not only did you guys manage to illustrate the different relationships between data systems and data discipline on a hight level but the way you visualised it made it so easy to comprehend that even people new to the subject would get it. Amazing! With topics like Data Engineering the true difficulty lies in simplifying things. And just just nailed that
great video! really appreciate your work. the visualization looks pretty clear.
can you tell us what's software are you using for the visualization?
lol, i don't these even i clear hadoop and spark, really appreciated:)
Ah... So _thiiiis_ is what I do for a living 🤔 it all makes sense, now
Don't mind my comment, I'm just giving some extra work to the data engineers out there.
can someone recommend a TH-cam video on data engineering courses
Before starting as DE : i will write ETL pipelines, work on distributed systems, spark, write python code to load data,etc.
.
.
After joining as DE : i should call my self as DBA.
Cant believe you cleared so many doubts at once in 15 min video! This was amazing work.
The most meaningful explanation about Data Engineering I've ever seen.
This is an amazing video, summarized everything I have been researching in just one video. Thank you!
Really interesting video! It definitely relates to what I am working on currently. I work in IT recruiting. I'm always looking for a data engineers for my jobs and this video helps me understand a little more about what data engineers have to face in their field. Thank you!
Amazing explanation!! Now I know what's the difference and the relationship between all these terms and professions! Thank you so much for the content producer!
Superb explanation, thank you!
You got my subscription just after this one video! Such rich content!
Welcome aboard =)
This might be the best video on the internet explaining data engineer role
this was awesome. can you please make a video on how to train data engineers?
PS.: So basically a DE is a particular kind of SW engineer, isn't?
This video is so good! I will share it in my next video!
Concise and perfect! Soothing voice too! This video really deserves an award.
Necessary and sequenced topics to understand Data Engineering very well.👍🏻👍🏻
I am watching this video second time and would probably refer to this video in future too.
After watching this video , I feel like I have more experience in Data engineering now. Thank you
Best ever , simple and clear
The video is so instructive and fun at the same time
That was an amazing video, beautiful done!! Thank you very much, hope you have an amazing week!!!
Just 1 Video gave complete picture of Data engineering, thanks for posting !! Subscribing right away ....Good Job ..
This team who made this video truly deserves an award.
So simple yet so profoundly explained.
Thanks for your efforts
This is fabulous. So much good information summed up in a short package. Very easy to understand. Thank you!
Thank you for making it so easy to understand these concepts.
I really loved the video.
Explain is insane , thanks
hello, I'm starting in data engineering, is it possible to create a startup/company, so I can earn more? I see salaries from 100 to 180k as an entrepreneur it would be possible to reach 250,350k??
great video❤.....I will replace spark with Apache Flink in 2024 in a pipeline
Data Scientist seem to be the easiest job available. Their job is so straightforward and simple. Unlike having to learn how to actually have hard skills, all they need is stats skills. Think they need a more apt title. I’ll call it Business Enquirer. Since all they do is give ambiguous biz predictions to product managers and enquire the engineers to do the tough job. End of the day only to take the credit for having done nothing as tough as the DEs. Given how DEs are so talented and hardworking, they can easily over take a data scientist/ business enquirer, going straight to and from the product manager.
3 years I've been trying to explain what I do - now Ill just show this video😭
So lucky I just got 10 explain vids before this! Tysm
How can i support more ? I have already liked and subscribed. What an amazing video, beautiful !
After watching this I realized the data I work with is child's play.
Great effort! a minute addition would be to spice up the cartoons with a percentage of black-skinned cartoons, this would go a long way to program minds of the next generation that, well, it's okay to work along with black-skinned people at any level of the company. Better and even powerful than destructive demonstrations on the streets. Pardon me if it sounds offensive to anyone. thanks!
Im in love with this video, thank you for the thorough explanation
This is the most brilliant explanation I have watched of data engineering. The most worthwhile 15 mins of my life today 😅
Thanks, we'll continue to do our best ❤️
This is a useful video about Data Engineering, currently. Thanks for the effort.
This is exactly how, lectures should be. This is ideal. Nothing can be enough when I want to appreciate it. Thanks
the better way, with funny pics :). greetings from Bolivia (southamerica)
absolutely amazing works, the animation is just perfect
I always dreamed of using the SMACK stack but now I see I'm totally out of my depth.
Only things I want to say, at 1:50 the decision to implement automation before the analyst burns out is sadly rarely true.
Source: I was the analyst that burned out.
Epic. What an awesome video. Especially under the guise of the pretty graphics.
very insightful and give you a brief history of data engineering/architecture.
What an amazing explanation. Thank you so much for this video
It was one of the best IT video I come across. any such videos on each topic of data engineering ?
Awesome video. Thanks TH-cam for recommending this.
Also my thoughts watching this video "how does it KNOW"
this is the exact experience
Excellent explanation! Thank you!
Glad you enjoyed it 😊
Hi, does it make sense that the data ingested by Kafka is processed by Spark before it enters the data lake, I thought the data scientists wanted access to the raw data? or does spark simply pass it to the lake without processing it?
ohh my god the animation is too good and video is amazing
Thanks ❤️
Very well explained
Wow! It is soooo good! It turns a stiff data engineering subject into a sexy subject! Congrats!
Thank you for such exquisite video! Just subscribed!
you explain it really well, the dumb me understand. it was amazing
This video is incredible. thank you for making it. Perfect explanation.
This is the best video that I have watched covering all aspects of data engineering in a simple, funny and engaging manner. It is a great work 👏 👍 👌
This video is so well produced and informative! Thanks!
This video is really amazing. I approciate your effort
very well explained; gave me an entry point that I was craving for
This is the best and most beautiful explanatory video I've seen on data 😍💘
In the middle of the night when you fetch your phone to make sure your decision on the Data Engineering boot camp is right, such videos are very reassuring. I don’t know how much I should appreciate this channel for this video in particular. You have earned a sincere Subscriber now.
Amazing, really amazing video. Thank you guys.
Fascinating. One of the best video I have ever watched about data engineering topic'
It blows my mind. Thank you so much AltexSoft
damnnn you explain every things so clearly and easily to enderstand and help me a lot ( started learn data engineer )
It was so clear and best ever explanation of DA,DE & DS
Such an amazing video well explained. Thank you
Are the people figures in this cartoon big because they are “big data scientists”? 😜
Great video!
Wow!! Explanation is simple and Content is great 👍
This is by far the best video explaining the word of data science.
I just realize i have worked as a data engineer being paid as a database administrator engineer. lol
I lost it at 6:49 lmao
This makes it sound knowable ( : Very nice Thank you.