Data Modeling - Why Data Engineers Need To Understand It - An Introduction To Data Engineering
ฝัง
- เผยแพร่เมื่อ 28 พ.ย. 2023
- As a data engineering, understanding data modeling is key to building reliable data systems.
But today I wanted to start from the beginning.
What is data modeling, what is denormalization, let's start with the basics
If you enjoyed this video, check out some of my other top videos.
Top Courses To Become A Data Engineer In 2022
• Top Courses To Become ...
What Is The Modern Data Stack - Intro To Data Infrastructure Part 1
• What Is The Modern Dat...
If you would like to learn more about data engineering, then check out Googles GCP certificate
bit.ly/3NQVn7V
If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.
seattledataguy.substack.com/
Or check out my blog
www.theseattledataguy.com/
And if you want to support the channel, then you can become a paid member of my newsletter
seattledataguy.substack.com/s...
Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio
_____________________________________________________________
Subscribe: / @seattledataguy
_____________________________________________________________
About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.
*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. - บันเทิง
If you guys want to learn more about data engineering, then sign up for my newsletter here seattledataguy.substack.com/ or join the discord here discord.gg/2yRJq7Eg3k
would be awesome to see example of conceptual data modelling. There are tons of materials about logical and physical, but not about the conceptual. At the interviews people really like to ask how you are going to gather business requirements. Would be even better if you can record an interview-cracking video. I couldn't find anything decent on youtube for conceptual modelling.
Yessss very excited about your next video on data modelling. Seeing actual examples will be incredibly useful, especially things like when to use one big table vs kimball etc.
Yup! It'll be coming in the next one, probably in january
Absolutely love your videos!!! Thanks for paving the way for millions of people to get their hands into data engineering and land a job. If I land any data engineering job, you definitely provided a major chunk of guidance !!
Glad I could help! Thank you for all your support!
Looking forward to the follow-up videos to this! 👍🏻
thank you! I have got an intro to data warehousing in the works and then another one that i am going to try to film soon.
Benjamin, thank you for sharing these insights! This is an off-topic question but essential for me to - if I want to know more about data engineering/data modeling, what courses would you recommend? I am not a data person, these topics are becoming increasingly interesting to me, so I thought I could change my career
This is the best explanation on the internet
you're too kind!
What is the difference between data modelling for data storage compared to data modeling as in applying ML models to data? Thank you so much
great video, please talk about data modeling more
I am planning to! Aiming for January
thanks for solid intro. I found it very useful. I'd like to provide feedback in that studies have shown that all caps are more difficult to read so I'd recommend sentence case for your slides. Also, the yellow and black contrast on the slides is a little jarring but I love the content!
Thanks for watching, I have stopped using the yellow in black in my new videos
This is beautiful!!!!
Thank you!
serve data in a useable way - thats pretty much how i've always explained what i like to do. Doubt i'll ever manage to get into a data modeler role though
thank you
You're welcome
Excellent video. Where can I see the video of Joe that is mentioned?
the video should be here - th-cam.com/video/g82HUtjTPMg/w-d-xo.html
Do you recommend a tool to create diagrams for data models?
Imo, not all entities require to be extracted out as a table. Sometimes the business value is not there, even though the business folks might talk about it. The perfect model doesn't exist, that is why migration exists when changes happen.
It is the products or the production process that generate the data, checking how the product and process work will reveal more than what the business folks might talk about. Just my 2 cents.
I know that data engineers have to learn python but how much python is utilized for data engineering? What I'm saying is, do I need to know python inside out or should i direct it as specific aspects used for data engineering
Hi ! I’m a junior analytics engineer, and I’m building my first data warehouse. What’s your opinion about the books from Kimball “The data warehouse toolkit, 3rd edition” ?
Is it good to understand the therocial part data modeling, or is it obsolete ?
Thanks
Data Engineering with Dbt: A Practical Guide to Building a Cloud-based, Pragmatic, and Dependable Data Platform with SQL
@@FunctionalOdyssey thanks ! I’ll look into it
Thanks for another fine video. But the yellow backgrounds just want to make my eyes explode!
I did recently stop with the yellow..
Thanks for the nice information, if you could decrease your talking speed around 10% then it'll help more to non-native english speaking guys like me :)
Thanks for the tip, I am trying!
SHare the tool you used to create the database tables visualization models
Please? 😂
8:46
hard to understand
lol things table. Is atoms table too far?