Do You REALLY Need A Data Warehouse - What Are The Benefits Of A Data Warehouse?
ฝัง
- เผยแพร่เมื่อ 31 ก.ค. 2024
- Recently several consulting calls started with people asking, “Do we need a data warehouse?”
This isn’t a question about whether you need data warehouse consultants, but instead whether you should event start a data warehouse project. Which is a very fair question. Not every company needs a data warehouse.
That being said data warehouses can provide a lot of benefits.
They help centralize data, provide an easy access layer for data analysts and more. But they aren’t always a worthwhile investment. Our team has helped some companies develop far lighter weight solutions in order to keep costs low.
If your company is trying to answer the question, do you need a data warehouse, then set up a consultation call with me today!
calendly.com/ben-rogojan/cons...
I wrote an article to help answer that question as well here
www.theseattledataguy.com/do-...
If you enjoyed this video, check out some of my other top videos.
Top Courses To Become A Data Engineer In 2022
• Top Courses To Become ...
What Is The Modern Data Stack - Intro To Data Infrastructure Part 1
• What Is The Modern Dat...
If you would like to learn more about data engineering, then check out Googles GCP certificate
bit.ly/3NQVn7V
If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.
seattledataguy.substack.com/
Or check out my blog
www.theseattledataguy.com/
And if you want to support the channel, then you can become a paid member of my newsletter
seattledataguy.substack.com/s...
Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio
_____________________________________________________________
Subscribe: / @seattledataguy
_____________________________________________________________
About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.
*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you. - บันเทิง
If you guys want to learn more about data engineering, then sign up for my newsletter here seattledataguy.substack.com/ or join the discord here discord.gg/2yRJq7Eg3k
@Seattle Data Guy, at 14:02 you refer to a graphic to support decision making, but it's not shown. Where can we find it?
Thank you very much!🙏
Thanks for the video!
you're welcome!
Hi guys, i'm confused about spark setup in multi node..
Let's say i have 3 VM, do i needed to install hadoop in multi node first to have spark to run on multi node?
And why do i need/ not need hadoop with the multi node setup?
Excellet content
If you were building a data platform from the beginning wanting to build from basic SQL servers to AWS. What would you recommend? I know a loaded question but some basics
It's very tricky, as there are tons of services fitted for usecase. Some example
1. S3 > Glue Carwler>Athena >Quicksight
2. S3 > Glue job>Redshift>Quicksight
3. DMS > S3 > Any above ^^
Its not one size fits all. As mentioned in the video not everyone needs a DWH. I have worked with a company bn plus revenue doesn't use any DWH they just use data virtualization technology only such as Athena/Startburst
Just for context, I am a CTO for AI/ML company mainly focus on machine learning on production systems
I’m wondering if there are any data engineering / data related conferences that would be recommended for existing or aspiring data engineers? Would love to get more immersed in this field and network with other professionals!
Did you research any? Thanks!
Was super helpful for me, but I went to a local one in Sweden.
I think the next question is Do you need a dedicated DWH or a data lake can a serve as DWH?
You can use virtualization - but you pay per use and the cost can be very high if your queries are optimised or use alot as you usually pay per data processed
Thanks, can you become a Data Warehouse engineer without learning programming? I just want to learn SQL
That will be hard, there are some GUI based tools and dbt is mostly SQL but why not learn how to code?
I will have to @@SeattleDataGuy