Thanks for this video! In our project we were loading data from oracle db to Teradata stg tables using informatica one to one mapping and after loading to stg tables were doing transformations and loading dimension and fact tables so it was ELT process.
Can MongoDB, with its analytical engine and Time Series collections, be considered a hybrid DB/Warehouse? Would it be inherently wrong to store e.g. historical sales transactions of a shop and current transactions within a Time Series Collections on Mongo? If not, which alternative would you consider for it? Thank you so much for your video 👏🏻👏🏻
can we use Oracle also as data warehouse because as far I know Teradata is also database only. so any database available in market, we can use that as data warehouse. Am I correct?
While technically u could use but this would be at the cost of performance. Please note that traditional databases works on rows where as typical DWH database is configured to operate in columnar fashion.
Can we use ELT for datawarehouse ? Ca we store log file as it in datawarehouse if yes then what's exactly different between data warehouse and data lake?
No in data warehouse we can not store log file as it is unstructured data. but in data lake we can have unstructured and structure data that's the difference exactly
So what happens is when you have data in a database then on regular intervals we move this data from database to a datawarehouse using an ETL tool. So the data flows from your database -> then ETL tool ~> then a datawarehouse. The frequency at which you move data from a database to a data warehouse is generally suggested by the clients or the business users
Are datawarehouse and data lake different sections of the same set up? For example if we have a snowflake DW, can the data lake be also within the same snowflake set up but an isolated environment?
Snowflake is created/hosted on any of the three clouds we have. So as per my understanding, snowflake is data warehouse but it can be used as a datalake as well. When used as a datawhere house it stores the data in snowflake itself but when you use it as a data Lake, it keeps or make use of Amazon S3 for example bucket for storage
The idea behind developing data warehouses is to keep historical data you can relate it with a normal datawhere house people are using to store goods so it's a kind of storing huge amount of data
![ลองสั่งของจากแอพ temu ถูกจริงหรอ?? [โกงไหมครับ ep.88 ] | DOM](http://i.ytimg.com/vi/RTcZSQTiDZw/mqdefault.jpg)
Checkout the Big Data course details here: trendytech.in/?referrer=youtube_bd12
Tried looking for defination in many videos but the way you explained really made it easy to understand. Thanks for sharing knowledge 🙏
Got this question in Amazon DE interview round 1
it was a much needed session
Happy that you found the session useful!
Very thorough and helpful! Easy to understand. Thanks
It was simple and clear, thank you
Very well explained, especially the ETL Vs ELT, Thank you Sumit!
Nice one!!
Thanks!
You made this easy to understand, Thank you sir.
Happy to hear that!
What an amazing explanation sir!!! Superb!! Love it!!! You are great sir!!!
Thanks a ton. Keep watching
Thanks for this video! In our project we were loading data from oracle db to Teradata stg tables using informatica one to one mapping and after loading to stg tables were doing transformations and loading dimension and fact tables so it was ELT process.
Perfect explication! Thanks!!!
You changed my mind about this subject.
Now I understand better
Super awesome
Thank you for the wonderful explanation. It was simple and crisp
Can MongoDB, with its analytical engine and Time Series collections, be considered a hybrid DB/Warehouse? Would it be inherently wrong to store e.g. historical sales transactions of a shop and current transactions within a Time Series Collections on Mongo?
If not, which alternative would you consider for it?
Thank you so much for your video 👏🏻👏🏻
can we use Oracle also as data warehouse because as far I know Teradata is also database only. so
any database available in market, we can use that as data warehouse. Am I correct?
Yup.. We have used oracle as dwh
While technically u could use but this would be at the cost of performance.
Please note that traditional databases works on rows where as typical DWH database is configured to operate in columnar fashion.
Your explanation 100% very clear and understanding.....
Superb & Informative! nicely articulated.
Can we use ELT for datawarehouse ?
Ca we store log file as it in datawarehouse if yes then what's exactly different between data warehouse and data lake?
No in data warehouse we can not store log file as it is unstructured data. but in data lake we can have unstructured and structure data that's the difference exactly
If we cannot store historical data in data base then how we will copy those data to a data warehouse to do analysis.
So what happens is when you have data in a database then on regular intervals we move this data from database to a datawarehouse using an ETL tool. So the data flows from your database -> then ETL tool ~> then a datawarehouse.
The frequency at which you move data from a database to a data warehouse is generally suggested by the clients or the business users
Bro your video helped me a lot. Thanks man
Extremely useful. Thanks for this video and all the valuable information
Good explanation..!
Great explanation and very esay to follow!👍 Thanks!
Sumit sir really hats off to you.
Is Google Cloud Storage a database or a data lake?
Very well explained thanks a lot
Are datawarehouse and data lake different sections of the same set up? For example if we have a snowflake DW, can the data lake be also within the same snowflake set up but an isolated environment?
Snowflake is created/hosted on any of the three clouds we have. So as per my understanding, snowflake is data warehouse but it can be used as a datalake as well. When used as a datawhere house it stores the data in snowflake itself but when you use it as a data Lake, it keeps or make use of Amazon S3 for example bucket for storage
Please correct for better understanding
I have a doubt , does datawarehouse supports acid properties? Also is only historical data stored in datawarehouse?
The idea behind developing data warehouses is to keep historical data you can relate it with a normal datawhere house people are using to store goods so it's a kind of storing huge amount of data
Thanks for the amazing content :)
excellent,got Deep knowledge!
Nice explanation
Loved the explanation
Awesome
Can a database become a datawarehouse and visa versa?
both have certain limitations as discussed in the video.
Why cost of storing data in database is high?
May be onpremises storaege . now due to cloud the storage cost comes down. Pls comment it is correct or not. THanks.
Wonderful explanation