Thank you 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me. I really liked the statement "Snowflake Spiderman". Do let me know what you liked most about my content and also share what you specifically want to learn and know more about database administrator. Snowflake really does not need any DBA, they rather need DataOps team to monitor the resources. This will help me to focus building my next contents. 📒 📚 📒 📚 📒 📚 📒 📚 📒 📚 I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. And please share your constructive feedback so I can improvise my content and help the snowflake and data engineering community. 🚀 Complete Guide + Question Dump + Revised Syllabus 🚀 ------------------------------------------------------- 🌐 SnowPro Guide -> bit.ly/35S7Rcb 🌐 Revised Jan 2021 Syllabus -> bit.ly/3tqOkJb 🌐 SnowPro Practice Test Playlist of 300 questions -> bit.ly/2ZLQm9E 🚀 You can also follow Data Engineering Channel 🚀 -------------------------------------------------- 🌐 Twitter -> twitter.com/de_simplified 🌐 Facebook -> fb.me/dataengineeringsimplified 🌐 GitHub -> github.com/TopperTips 🌐 Website -> toppertips.com
@@DataEngineering hi sir, I am having doubt like create table table name query will trigger a warehouse from suspended state to resume... Or not ... And why?.. Please reply i don't know under which video i need to ask so asked here...
Great job! and happy to get the feedback that this playlist is helping you and many others... feel free to share your experience and if you find any GAP.
Your videos work as a brush-up to snowflake concepts which are really helping in understanding each & every concept. I would only suggest you apart from just explaining what is written in the snowflake doc, elaborate in 1 or 2 lines what the concept is. E.g when you have explained the Transient and Temporary table also tell what's the difference between the two. I have to google separately about it. Also, divide the long video into small videos like Udemy to attract more people to your short videos.
Great Suggestion. Ch07 is very high leve, and each concept is explained ch-08 on, so you follow and watch other chapters, you would understand them in much more detail. However, a good advice, will keep it in mind for future videos.
My pleasure! -------- and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge.. These contents are available in udemy.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command... 1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/ 2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/
Thanks for your note, will make a separate video to have a side by side comparison... if you would like to more about the entire playlist, there are lot of real life example and you can learn about them by seeing their utilization, you can download this summary sheet in PDF version that has detail for all the chapters in one single file. Snowflake End To End Guide Cheat Sheet - bit.ly/43t5IPB
All good stuff!!! But small correction at 38:55, Timezone can be changed at the session level in Oracle atleast. I believe others allow too. I'm sorry. just wanted to correct it.
Hello, I am going through your Snowflake video session's. And it very useful and you have spent a good amount of energy, time and appreciate your good work. Can you share the tree maps used in the courses for all the chapters, it would be useful for our reference and quick recall on the topics.
Thank you for this detailed and helpful video. Please help me to understand a bit confusing data flow. I am well aware of the purpose of external tables in snowflake but can you please tell me if external tables can be used as first layer/staging layer in a data warehouse and then stored proc and tasks can be used to move the data to next layer of tables?
Very interesting question and many large enterprise or data projects has this query as it looks obvious to have an external table created and get the data. Yes, the external table can be considered as stage or landing zone, and many ETL or ELT project follows that approach. A couple of issues when it comes to speed and cost which may change your opinion or think to reconsider this approach 1. Querying external table increases WH cost (for large tables, it is very very slow and if they are being queried frequently, your storage cost or redundant cost will be much lower than the compute cost) 2. Querying the external table is slow as the encryption and micro partition + optimization is not applied 3. You can not apply the time travel for any issue identification. 4. If an external table is in a different cloud provider ( like S3 to Azure blob), it may have network cost ( I personally have not seen this case, but could be considered) 5. Stream on the external table has limitation and it was in preview, and snowflake will enhance it further. I hope this gives better clarity. I will make a video around it, this is an interesting topic. Thank you @Tanya Mandal 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me.
Thank you 🙏 @Sra for watching my video and your word of appreciation really means a lot to me. Do let me what part of content you liked most and why, this helps me to build better content. 📒 📚 📒 📚 📒 📚 📒 📚 📒 📚 I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. And please share your constructive feedback so I can improvise my content and help the snowflake and data engineering community. 🚀 Complete Guide + Question Dump + Revised Syllabus 🚀 ------------------------------------------------------- 🌐 SnowPro Guide -> bit.ly/35S7Rcb 🌐 Revised Jan 2021 Syllabus -> bit.ly/3tqOkJb 🌐 SnowPro Practice Test Playlist of 300 questions -> bit.ly/2ZLQm9E 🚀 You can also follow Data Engineering Channel 🚀 -------------------------------------------------- 🌐 Twitter -> twitter.com/de_simplified 🌐 Facebook -> fb.me/dataengineeringsimplified 🌐 GitHub -> github.com/TopperTips 🌐 Website -> toppertips.com
Hi, It is a great learning Snowflake, especially for a beginner. Totally enjoying it. You have explained in a very simple, easy-to-understand way. I would be happy if you could share the datasets or the links, like the nyc weather json.
This time you went by fast, especially later half of the part. creating the staging and going to sql so on and so forth, I could not catch up with the speed. I watched multiple times. But who will give this much info anyway. 😊. Thanks. I could understand the concept. I will finish all in a day or two.
Sorry! Will try to do slow.. my other videos are taking care of this feedback and I go slow.... if you watch other videos in this playlist, things will be more clear to you.. thanks for you note and feedback.
Very Informative viedeo's and really helped me to understand most of the functionalities very easily.. You are really an excellent teacher. Can you please share the tree maps used for this course..as they are really helpful for exam preparation and can be used as a quick reference guide. Thank you...
Your Videos on snowflake is tremendous and enjoying the study of snowflake beginner. Thanks for your effort!! few suggestion on technical query : in chap7, staging area, my question is... only one table can be placed in the mentioned staging or more files....coz the in the select .....from @my_stg is mentioned but there is no file name mentioned....pls clarify
Thanks .. and glad you enjoyed the videos.. you can place many files in the stage location.. try watching the entire playlist and you would understand it .. if you would like to understand more about stages.. watch following chapters - External Stages - th-cam.com/video/w9BQsOlJc5s/w-d-xo.html - Loading multiple csv files in snowflake - th-cam.com/video/Kix9aIcRX3g/w-d-xo.html - The entire loading playlist - th-cam.com/play/PLba2xJ7yxHB6NPEv8pp7j3zWibLZzwjvO.html
Hi sir, Recently started learning snowflake from your channel. Thanks making it easy and accessible to all. Also help how to get get the hierarchy document your showing on explanation.
Thanks for your note... no.. you can not create external table on internal stage. --- and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge.. These contents are available in udemy.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command... 1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/ 2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/
Your videos are very great. very thankfull. this helped me to get up to level into my new job. thanks a lot. keep it going. Anything in informatika software?
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. Informatica is not in my radar, may be in future but now my focus is only snowflake. Informatica is still a populate DW system in your organization? ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
Thanks for your videos. Can't we load the data in WEB UI by writing copy command instead of using Snow SQL? Also how json data formatted into tabular format is not clear..
you can load data data from via WebUI using copy command and copy will always refer to internal or external stage. See episode 11 for more detail. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI
Thank you for providing such valuable content on Snowflake. I have a question related to bulk loading data. In my recent experience, I created a Snowflake stage called 'test_stage' and successfully used the query 'COPY INTO test_load FROM @test_stage' to transfer data from the stage into the 'test_load' table. Afterward, I deleted all records from the 'test_load' table. Surprisingly, when I tried to rerun the same copy query, the data didn't transfer from the stage to the table and not getting any error as well. Can you help me understand what might be causing this issue?
Great Tutorial, I always enjoy, whenever watch.. As per your comments I am not able to find SQL script in description section. Can you please share SQL scripts used?
there could be 3 possibilities... either user-id is incorrect or password is incorrect The 3rd one is that your URL is incorrect.. if you can share the screenshot to my insta or facebook page.. the it will be more easy to help. 🚀🚀 How To Connect ✏ Instagram: instagram.com/learn_dataengineering/ ✏ Medium Blog: medium.com/@data-engineering-simplified ✏ Exclusive Snowflake Facebook Group: facebook.com/groups/627874916138090/
Your tutorial is awesome and so easy to follow, thanks for creating this tutorial. I like your Tree Map and shich is awesome. How do downlod that Tree Map.
I understood the hierarchy that ACCOUNT->DATABASE->SCHEMA-> objects (table,view etc) . Here where warehouse is coming ? is it before account ? or within account? Please give the hierarchy for warehouse also . Thanks
Warehouse is account level object and they don't come under database. Database is primarily for storage objects. Watch ch-12 (th-cam.com/video/NE07Jx6V4UA/w-d-xo.html) that covers warehouse concept in detail.
Weldone, I am confused on the views part when you used Variant v and started using columns and double columns to select can you explain further it's quite confusing
Great session. Thanks for doing this. If snowflake accepts duplicates for Primary key and unique key column, then we are losing meaning of PK and Unique right? Can you please explain how to maintain unique values.
Yes, you are right and snowflake allows them in definitino but not enforce them. Snowflake is distributed computing system and having PK or FK is kind of difficult (read more about CAP theorem toppertips.com/cap_theorem) You have to build a custom logic to maintain it.
@@DataEngineering Sorry to ask you one more question. During time travel, if we don't know update statement queryid, how can we find out before snapshot? In this case one of my team member would have executed update statement few months ago.
@@dharmeswaranparamasivam5498 You will have to search up that query in the Query History. From there, you can get the query ID. To filter down your results, you can apply where commands to the User or the time when the query was executed
One query, how is the date and time saved and how is it displayed (is it UTC or ltz?) the reason for asking the question is that when inserting the date in pacific timezone, we saw PT in the select query and time was displayed according to PT. However, after changing the timezone to Japan and then inserting the record, the time for only 3rd record was shown in Japan timezone, earlier 2 records were shown in PT. if the time stored is in UTC then all of it showed get converted to current timezone at the time of select ortherwise, it looks like that time is saved in ltz. Please help understand.
Yes, you can. Either make your s3 public (read only) or add IAM key to access it. Not recommended by Snowflake for production environment but for your personal trial, you can do it. Watch Ch-11 for complete external table function th-cam.com/video/w9BQsOlJc5s/w-d-xo.html
Thank you so much 😀 🚀If you have not yet downloaded the master cheat sheet, then you can download from following link. It has all the video description available along with timestamp. 🚀 ➥ Complete Snowflake Tutorial rebrand.ly/maj4l6x ➥ Complete Snowflake JSON Guide rebrand.ly/d52cef
Thank you 🙏 @Shiva Tadakamalla for watching my video and your word of appreciation really means a lot to me. ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
Absolutely nice video excellent work. As per your comments I am not able to find SQL script in description section. Can you please share SQL scripts used?
@DataEngineering Please share the datasets and scripts, I would wish to execute these commands and learn by following the video. Really appreciate great content.
That could be recording issue. .. you can ignore it.. thanks for your note.. In general snowflake objects are not case sensitive unless the object is created using double quotes... hope this helps..
I am planning to re-organize them in a different platform, will soon update you, for now they are missing and really sorry for that. (They are not slides, so it will be difficult to get them as they are seen in the video, they are rich media contents)
for free trial account, you can consume upto $400 credit.. so as long as it is with in limit... it should not be an issue.. and it will not cost you anything
Thanks @Tong Dai for sharing your query. When you say continous means there will be no skip and it will really follow the nextvalue as per incremental defintion. I have never tried this myself but I assume unless otherwise the seq.nextvalue is called only by batch program, it will never skip any value and it will have continous value. We can try this using a insert as select statement and simulate it with a large table. I really loved your question. Learning a lot from your experience too.
Let me check about the SQL script and will try to have the tree map also available in my website. Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
Thank you for such amazing and detailed content. You are an Amazing teacher. I want the topic tree map that you use for exam prep. can you please share the link...I tried all the links in description. don't seem to find it
Hey, just checking if you find the way to share the topic tree.. What kind tool did you use to make this? Appreciate your response.. This one is the most excellent snowflake content I have come across.. Thank you so much..
Snowflake has native support for structured and semi-structured data and does not support unstructured data like media files or customer file formats.. so it is not fully used as data lake... and use more like a data warehouse.. but there are work around via which .. you can build data lake the way it is build in hadoop or S3 object storage... datalake is a pattern than a technology... so the previous use cases are also application as long as you can store the data and process it.. hope this clarify.. if you need more specific detail.. pls drop a note to my instragram.. (instagram.com/learn_dataengineering/)
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. Will make the JSON file available. ⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡ I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. 🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI 🌐 SnowPro Guide ➥ bit.ly/35S7Rcb 🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq 🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
Thanks for the feedback. Need more elaboration on "speed in the video is not good" . what do you mean by speed? you can change the speed from youtube configuration..
Thank you 🙏 @M obulu Reddy for watching my video and your word of appreciation really means a lot to me. Can you check this link again www.toppertips.com
as a beginner, I found tough undersatdning in the later section as there was no explnation among types of tables as well as the DDL statemnets related to them.
while loading the data in a table from a file, is there any way we can limit the no of rows, let say we have 10000 records in a CSV file but in the table, I want only the half, is it possible by web UI or snowsql?
Interesting use case.. I don't see any immediate solution which can be applied while loading data from WebUI or SnowSQL.... Here is my thought 1. Load the file in internal or external stage (internal stage has external table issue) 2. Create a file format with delimiters (for csv, command is default) 3. Use copy command by having file format and apply limit on select statement on your stage file (this can be done even without creating an external table) If the file need to skip 1st 500 rows or n roles from top.. in that case, you can specify the skip rows in the file format. Let me know if this make sense, but I will certainly try that out if you share the file with sample records via google drive.
Will upload soon. if you are comfortable using instagram, and If you need it early, drop me a note in instragram.. so I can share the jpg instagram.com/learn_dataengineering/
Many thanks for such a informative lecture, this video helps a lot for beginners....But couldn't found SQL scripts link.... Kindly help by sharing script link used for this lecture......
Thanks @labib8aug, Sorry for not sharing the link.. here you go www.toppertips.com/snowflake-database-schema-table-container-rierarchy/ Thank you 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me. 📒 📚 📒 📚 📒 📚 📒 📚 📒 📚 I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. And please share your constructive feedback so I can improvise my content and help the snowflake and data engineering community. 🚀 Complete Guide + Question Dump + Revised Syllabus 🚀 ------------------------------------------------------- 🌐 SnowPro Guide -> bit.ly/35S7Rcb 🌐 Revised Jan 2021 Syllabus -> bit.ly/3tqOkJb 🌐 SnowPro Practice Test Playlist of 300 questions -> bit.ly/2ZLQm9E 🚀 You can also follow Data Engineering Channel 🚀 -------------------------------------------------- 🌐 Twitter -> twitter.com/de_simplified 🌐 Facebook -> fb.me/dataengineeringsimplified 🌐 GitHub -> github.com/TopperTips 🌐 Website -> toppertips.com
You are like a "Snowflake Spiderman" please send more video's on SnowPro Advanced: Database Administrator.. Thanks
Thank you 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me. I really liked the statement "Snowflake Spiderman".
Do let me know what you liked most about my content and also share what you specifically want to learn and know more about database administrator. Snowflake really does not need any DBA, they rather need DataOps team to monitor the resources. This will help me to focus building my next contents.
📒 📚 📒 📚 📒 📚 📒 📚 📒 📚
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. And please share your constructive feedback so I can improvise my content and help the snowflake and data engineering community.
🚀 Complete Guide + Question Dump + Revised Syllabus 🚀
-------------------------------------------------------
🌐 SnowPro Guide -> bit.ly/35S7Rcb
🌐 Revised Jan 2021 Syllabus -> bit.ly/3tqOkJb
🌐 SnowPro Practice Test Playlist of 300 questions -> bit.ly/2ZLQm9E
🚀 You can also follow Data Engineering Channel 🚀
--------------------------------------------------
🌐 Twitter -> twitter.com/de_simplified
🌐 Facebook -> fb.me/dataengineeringsimplified
🌐 GitHub -> github.com/TopperTips
🌐 Website -> toppertips.com
@@DataEngineering Can u help me to get a script for these snowflake videos?
@@DataEngineering hi sir,
I am having doubt like create table table name query will trigger a warehouse from suspended state to resume... Or not ... And why?..
Please reply i don't know under which video i need to ask so asked here...
Beginner of Snowflake, it's been going great so far, at chapter 9 now, already feeling great with the learning. Thank you.
Great job! and happy to get the feedback that this playlist is helping you and many others... feel free to share your experience and if you find any GAP.
Awesome lecture you are providing. I have also cleared certification and your videos helped me a lot. Thanks for all the content.
Congratulation... Glad to hear that and thanks for sharing your note and success.. it helps other to follow and this guidance certainly helps all..
Thank you so much for the scripts, Sir. You are indeed our savior🙇♀🙌
So nice of you
Great explanation and walk through. I do presentations at work and I can understand the hard work you have put in, much appreciated!!
Glad it was helpful! And thanks for your observation.
Your videos work as a brush-up to snowflake concepts which are really helping in understanding each & every concept. I would only suggest you apart from just explaining what is written in the snowflake doc, elaborate in 1 or 2 lines what the concept is. E.g when you have explained the Transient and Temporary table also tell what's the difference between the two. I have to google separately about it. Also, divide the long video into small videos like Udemy to attract more people to your short videos.
Great Suggestion.
Ch07 is very high leve, and each concept is explained ch-08 on, so you follow and watch other chapters, you would understand them in much more detail.
However, a good advice, will keep it in mind for future videos.
Thanks a lot for the engrossing tutorial. Keep it up! 👍🏻
My pleasure!
--------
and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge..
These contents are available in udemy.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command...
1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/
2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/
Great explanation. Thank you so much for explaining the concepts in great detail and such a nice way.
Glad it was helpful!
You're an ace teacher 👏
Thank you 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me.
Nice! Please tell us the differences between the different types of objects, the pros, and cons, and when to use what.
Thanks for your note, will make a separate video to have a side by side comparison...
if you would like to more about the entire playlist, there are lot of real life example and you can learn about them by seeing their utilization, you can download this summary sheet in PDF version that has detail for all the chapters in one single file.
Snowflake End To End Guide Cheat Sheet - bit.ly/43t5IPB
Good series for beginners
Great Learning and easy to follow. Thank you
Glad it was helpful!
All good stuff!!! But small correction at 38:55, Timezone can be changed at the session level in Oracle atleast. I believe others allow too. I'm sorry. just wanted to correct it.
Excellent walk through and really the tree map diagram the best
thanks
Can you provide this tree map?
Hello,
I am going through your Snowflake video session's. And it very useful and you have spent a good amount of energy, time and appreciate your good work.
Can you share the tree maps used in the courses for all the chapters, it would be useful for our reference and quick recall on the topics.
I'm very glad I found your tutorial in TH-cam. How can I have the table I created in sandbox auto refresh daily?
Very useful information. Lot to learn from this video.
So nice of you
Thank you for this detailed and helpful video. Please help me to understand a bit confusing data flow. I am well aware of the purpose of external tables in snowflake but can you please tell me if external tables can be used as first layer/staging layer in a data warehouse and then stored proc and tasks can be used to move the data to next layer of tables?
Very interesting question and many large enterprise or data projects has this query as it looks obvious to have an external table created and get the data.
Yes, the external table can be considered as stage or landing zone, and many ETL or ELT project follows that approach. A couple of issues when it comes to speed and cost which may change your opinion or think to reconsider this approach
1. Querying external table increases WH cost (for large tables, it is very very slow and if they are being queried frequently, your storage cost or redundant cost will be much lower than the compute cost)
2. Querying the external table is slow as the encryption and micro partition + optimization is not applied
3. You can not apply the time travel for any issue identification.
4. If an external table is in a different cloud provider ( like S3 to Azure blob), it may have network cost ( I personally have not seen this case, but could be considered)
5. Stream on the external table has limitation and it was in preview, and snowflake will enhance it further.
I hope this gives better clarity. I will make a video around it, this is an interesting topic.
Thank you @Tanya Mandal 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me.
@@DataEngineering Thanks a lot for the explanation. Got a better understanding on this area. Thumbs up for all your videos!
@@tanayamandal111 you are most welcome.
@@DataEngineering please share script notes for pracrice purpose
Really a great tutorial .Thank you a lot for sharing it very useful🙏
Thank you 🙏 @Sra for watching my video and your word of appreciation really means a lot to me. Do let me what part of content you liked most and why, this helps me to build better content.
📒 📚 📒 📚 📒 📚 📒 📚 📒 📚
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. And please share your constructive feedback so I can improvise my content and help the snowflake and data engineering community.
🚀 Complete Guide + Question Dump + Revised Syllabus 🚀
-------------------------------------------------------
🌐 SnowPro Guide -> bit.ly/35S7Rcb
🌐 Revised Jan 2021 Syllabus -> bit.ly/3tqOkJb
🌐 SnowPro Practice Test Playlist of 300 questions -> bit.ly/2ZLQm9E
🚀 You can also follow Data Engineering Channel 🚀
--------------------------------------------------
🌐 Twitter -> twitter.com/de_simplified
🌐 Facebook -> fb.me/dataengineeringsimplified
🌐 GitHub -> github.com/TopperTips
🌐 Website -> toppertips.com
Thank you so much for your video content. It is a boon for beginners like me. God Bless.
Glad it was helpful!
Hi, It is a great learning Snowflake, especially for a beginner. Totally enjoying it. You have explained in a very simple, easy-to-understand way. I would be happy if you could share the datasets or the links, like the nyc weather json.
You're very welcome!. Will soon provide link on the video description.
This time you went by fast, especially later half of the part. creating the staging and going to sql so on and so forth, I could not catch up with the speed. I watched multiple times. But who will give this much info anyway. 😊. Thanks. I could understand the concept. I will finish all in a day or two.
Sorry! Will try to do slow.. my other videos are taking care of this feedback and I go slow.... if you watch other videos in this playlist, things will be more clear to you.. thanks for you note and feedback.
Very Informative viedeo's and really helped me to understand most of the functionalities very easily.. You are really an excellent teacher. Can you please share the tree maps used for this course..as they are really helpful for exam preparation and can be used as a quick reference guide. Thank you...
You are most welcome and glad to hear that you liked the content.
Will see how can i publish the tree map via my website.
Your Videos on snowflake is tremendous and enjoying the study of snowflake beginner. Thanks for your effort!!
few suggestion on technical query : in chap7, staging area, my question is... only one table can be placed in the mentioned staging or more files....coz the in the select .....from @my_stg is mentioned but there is no file name mentioned....pls clarify
Thanks .. and glad you enjoyed the videos..
you can place many files in the stage location.. try watching the entire playlist and you would understand it ..
if you would like to understand more about stages.. watch following chapters
- External Stages - th-cam.com/video/w9BQsOlJc5s/w-d-xo.html
- Loading multiple csv files in snowflake - th-cam.com/video/Kix9aIcRX3g/w-d-xo.html
- The entire loading playlist - th-cam.com/play/PLba2xJ7yxHB6NPEv8pp7j3zWibLZzwjvO.html
Hi sir,
Recently started learning snowflake from your channel.
Thanks making it easy and accessible to all.
Also help how to get get the hierarchy document your showing on explanation.
Thanks a lot for such great videos...can we create external table on internal stage?
Thanks for your note... no.. you can not create external table on internal stage.
---
and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge..
These contents are available in udemy.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command...
1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/
2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/
Your videos are very great.
very thankfull.
this helped me to get up to level into my new job.
thanks a lot.
keep it going.
Anything in informatika software?
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. Informatica is not in my radar, may be in future but now my focus is only snowflake. Informatica is still a populate DW system in your organization?
⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them.
🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI
🌐 SnowPro Guide ➥ bit.ly/35S7Rcb
🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq
🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
Great explanation thanks a lot sir
Thanks for your videos. Can't we load the data in WEB UI by writing copy command instead of using Snow SQL? Also how json data formatted into tabular format is not clear..
you can load data data from via WebUI using copy command and copy will always refer to internal or external stage. See episode 11 for more detail.
🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI
@@DataEngineering okay, thank you so much for your response.
Yes
Thank you for providing such valuable content on Snowflake. I have a question related to bulk loading data.
In my recent experience, I created a Snowflake stage called 'test_stage' and successfully used the query 'COPY INTO test_load FROM @test_stage' to transfer data from the stage into the 'test_load' table. Afterward, I deleted all records from the 'test_load' table. Surprisingly, when I tried to rerun the same copy query, the data didn't transfer from the stage to the table and not getting any error as well. Can you help me understand what might be causing this issue?
Great Tutorial, I always enjoy, whenever watch.. As per your comments I am not able to find SQL script in description section. Can you please share SQL scripts used?
Great overview thank you!
Glad it was helpful!
Awesome Video..... Thanks
Hi Thank you so much for your explanation..
some how i am not able to connect to SnowSQL
can you please help with it
there could be 3 possibilities...
either user-id is incorrect
or password is incorrect
The 3rd one is that your URL is incorrect.. if you can share the screenshot to my insta or facebook page.. the it will be more easy to help.
🚀🚀 How To Connect
✏ Instagram: instagram.com/learn_dataengineering/
✏ Medium Blog: medium.com/@data-engineering-simplified
✏ Exclusive Snowflake Facebook Group: facebook.com/groups/627874916138090/
Thank you making this awesome videos!!!!
Can you provide this sheet?
you are simply amazing
Thank you so much 😀
Your tutorial is awesome and so easy to follow, thanks for creating this tutorial. I like your Tree Map and shich is awesome. How do downlod that Tree Map.
I understood the hierarchy that ACCOUNT->DATABASE->SCHEMA-> objects (table,view etc) . Here where warehouse is coming ? is it before account ? or within account? Please give the hierarchy for warehouse also . Thanks
Warehouse is account level object and they don't come under database. Database is primarily for storage objects.
Watch ch-12 (th-cam.com/video/NE07Jx6V4UA/w-d-xo.html) that covers warehouse concept in detail.
@@DataEngineering Thanks for your prompt reply and clarifications. Without creating schema
, can we create table after creating database?
Very nice tutorial and material. Is it possible to share the material that you are presenting in this series.
Will upload soon
Great content. One question while loading data using insert statement don't we need to specify ' file format' option along with insert command?
Yes, we need to specify file format, else it will consider csv as default.
Weldone, I am confused on the views part when you used Variant v and started using columns and double columns to select can you explain further it's quite confusing
pls watch chapter-9, ch-10, ch-11 to get more clarity
HI am very happy about your videos and following your videos from part-1 onwards can u explain us how u connected snow sql whats the excat command
Sure I will.. this playlist is still incomplete.. will do it after it is done..
Great session. Thanks for doing this.
If snowflake accepts duplicates for Primary key and unique key column, then we are losing meaning of PK and Unique right? Can you please explain how to maintain unique values.
Yes, you are right and snowflake allows them in definitino but not enforce them. Snowflake is distributed computing system and having PK or FK is kind of difficult (read more about CAP theorem toppertips.com/cap_theorem)
You have to build a custom logic to maintain it.
@@DataEngineering Thanks you. This help. I'm really enjoying your playlist to learn snowflake from basic.
@@DataEngineering Sorry to ask you one more question. During time travel, if we don't know update statement queryid, how can we find out before snapshot? In this case one of my team member would have executed update statement few months ago.
@@dharmeswaranparamasivam5498 You will have to search up that query in the Query History. From there, you can get the query ID. To filter down your results, you can apply where commands to the User or the time when the query was executed
Very useful. Would it be possible to include the statements you are using in the description as an attachment (or) a git link?It will really help.
Running out of time.. have planned but somehow could not allocate time to do it.. will do it soon and drop you a note.
@@DataEngineering Appreciate it.
One query, how is the date and time saved and how is it displayed (is it UTC or ltz?) the reason for asking the question is that when inserting the date in pacific timezone, we saw PT in the select query and time was displayed according to PT. However, after changing the timezone to Japan and then inserting the record, the time for only 3rd record was shown in Japan timezone, earlier 2 records were shown in PT. if the time stored is in UTC then all of it showed get converted to current timezone at the time of select ortherwise, it looks like that time is saved in ltz. Please help understand.
if nothing is set, all the date and timezone is UTC and you can set session level parameter to make sure that date/timezone is consistent.
@@DataEngineering thanks a lot !
Thanks for you videos.
Can we load data to stage from external storage like S3 without Integration Object ?
Yes, you can. Either make your s3 public (read only) or add IAM key to access it. Not recommended by Snowflake for production environment but for your personal trial, you can do it.
Watch Ch-11 for complete external table function th-cam.com/video/w9BQsOlJc5s/w-d-xo.html
@@DataEngineering thanks for the reply.
Excellent
Thank you so much 😀
🚀If you have not yet downloaded the master cheat sheet, then you can download from following link. It has all the video description available along with timestamp. 🚀
➥ Complete Snowflake Tutorial rebrand.ly/maj4l6x
➥ Complete Snowflake JSON Guide rebrand.ly/d52cef
it was great video's
Thank you 🙏 @Shiva Tadakamalla for watching my video and your word of appreciation really means a lot to me.
⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them.
🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI
🌐 SnowPro Guide ➥ bit.ly/35S7Rcb
🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq
🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
Absolutely nice video excellent work. As per your comments I am not able to find SQL script in description section. Can you please share SQL scripts used?
very nice and detailed video to quick start. Could you please share scripts used in these videos.
Thank you for all the efforts.
I have one query like what's the stage ?and any necessity of stage ?
@DataEngineering Please share the datasets and scripts, I would wish to execute these commands and learn by following the video.
Really appreciate great content.
Here you go data-engineering-simplified.medium.com/snowflake-database-schema-table-container-hierarchy-d72f945fc5f3
video section 19.03 table creation with mixed case. you said table created but in output it says error table already exists. ples comment
That could be recording issue. .. you can ignore it.. thanks for your note.. In general snowflake objects are not case sensitive unless the object is created using double quotes... hope this helps..
please continue add the quiz because this quiz is most important test our knowledge each lesion. how much knowledge again
Will do and it will up live soon.
Finished watching
thank you...
Hi Sir,
Really Good Videos.
Could you please share all study material like diagram,snowflake queries and slides ?
Thanks!
I am planning to re-organize them in a different platform, will soon update you, for now they are missing and really sorry for that. (They are not slides, so it will be difficult to get them as they are seen in the video, they are rich media contents)
Using a free trial account and we create a database and warehouse then we have to pay money or not?
for free trial account, you can consume upto $400 credit.. so as long as it is with in limit... it should not be an issue.. and it will not cost you anything
Great content! One question, when autoincrement on ID field, I don't think the record will be true continuous if I insert multiple batch
Thanks @Tong Dai for sharing your query.
When you say continous means there will be no skip and it will really follow the nextvalue as per incremental defintion. I have never tried this myself but I assume unless otherwise the seq.nextvalue is called only by batch program, it will never skip any value and it will have continous value.
We can try this using a insert as select statement and simulate it with a large table.
I really loved your question. Learning a lot from your experience too.
This is a great tutorial.. Could you please provide the Topic map tree link and SQL scripts used for Hands-on?
Let me check about the SQL script and will try to have the tree map also available in my website.
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me.
⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them.
🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI
🌐 SnowPro Guide ➥ bit.ly/35S7Rcb
🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq
🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
Hi, Could you share the code snippets used in sessions?
Fantastic job in making these videos, please continue this work....👍👏
Thank you for such amazing and detailed content. You are an Amazing teacher. I want the topic tree map that you use for exam prep. can you please share the link...I tried all the links in description. don't seem to find it
Noted, will see how can make that tree map available.
Hey, just checking if you find the way to share the topic tree.. What kind tool did you use to make this? Appreciate your response.. This one is the most excellent snowflake content I have come across.. Thank you so much..
It seems WEBUI is not available in current version right ?
How do we load a json file to the S3 storage account so it can be copied later to the Snowflake stage?
Hi! Your videos are quite helpful! Can you share code used in all of your videos of Snowflake Tutorial For Beginners playlist?
Yes, sure. some of the items are missing.. will review and publish it.
U did not told wher ch7.csv file was there....was it in local desktop folder or AWS bucket....plz reply
Can you make a video on snowflake data lake and their use cases.......Thanks
Snowflake has native support for structured and semi-structured data and does not support unstructured data like media files or customer file formats.. so it is not fully used as data lake... and use more like a data warehouse.. but there are work around via which .. you can build data lake the way it is build in hadoop or S3 object storage... datalake is a pattern than a technology... so the previous use cases are also application as long as you can store the data and process it..
hope this clarify.. if you need more specific detail.. pls drop a note to my instragram.. (instagram.com/learn_dataengineering/)
Amazing tutorial sir. Where can I find the JSON files which you have used to load from S3 bucket to snowflake? That would really help.
Thank you 🙏 for watching my video and your word of appreciation really means a lot to me. Will make the JSON file available.
⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡⚡
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them.
🌐 Snowflake Complete Guide Playlist ➥ bit.ly/3iNTVGI
🌐 SnowPro Guide ➥ bit.ly/35S7Rcb
🌐 Snowflake SQL Series Playlist ➥ bit.ly/3AH6kCq
🌐 SnowPro Question Dump (300 questions) ➥ bit.ly/2ZLQm9E
Is there any datatype similar to UUID?
No... as of now there is no UUID data type.. at the end of the day.. it is a string
Excellent work on snowflakes.
But the speed in the vedio is not good .
Thanks for the feedback. Need more elaboration on "speed in the video is not good" . what do you mean by speed? you can change the speed from youtube configuration..
Hi Thank you for this videos. The description link was not working right now.Can check and fix if is there any issue.
Thank you 🙏 @M obulu Reddy for watching my video and your word of appreciation really means a lot to me.
Can you check this link again www.toppertips.com
as a beginner, I found tough undersatdning in the later section as there was no explnation among types of tables as well as the DDL statemnets related to them.
This chapter is at very high level.. I rerquest you to watch all other chapters which explain each part in depth.
Excellent. How to download or print the treemap?
I am planning to re-organize them in a different platform, will soon update you, for now they are missing and really sorry for that.
@@DataEngineering No worries. Thanks a lot!
Hi sir, I am not getting the option for classic console web UI in snowsight. web UI
...Please help me
for new free account, Legacy WebUI is not more available. you need to learn more and more on snowsight
Hello, Can you please share the link where all the SQL scripts available which are used in video. Also from where i can access the tree map. Thanks
Will upload soon
where I can see flowcharts @3:05.. Can some one pls help..
Flow chart is not published anywhere.
Hi, Where can I find the SQL Script, I couldn't find it. Please advise.
Working on them and will soon will make it part of video description.
@@DataEngineering Thank you so much
@@DataEngineering Pls share the path to the files and scripts
while loading the data in a table from a file, is there any way we can limit the no of rows, let say we have 10000 records in a CSV file but in the table, I want only the half, is it possible by web UI or snowsql?
Interesting use case.. I don't see any immediate solution which can be applied while loading data from WebUI or SnowSQL....
Here is my thought
1. Load the file in internal or external stage (internal stage has external table issue)
2. Create a file format with delimiters (for csv, command is default)
3. Use copy command by having file format and apply limit on select statement on your stage file (this can be done even without creating an external table)
If the file need to skip 1st 500 rows or n roles from top.. in that case, you can specify the skip rows in the file format.
Let me know if this make sense, but I will certainly try that out if you share the file with sample records via google drive.
@@DataEngineering thanks for the suggestion, let me try , and I will get back to you.
@@ketanrehpade9150 great
From where I can get all queries which is used in lecture.
where can i find the query sheet? i am unable to find it from description link
can i get the treemap u use in all videos?
Need to check if I have a copy of it.. these videos were published long back
@@DataEngineering Any update?
Nice video . Appreciate your effort . Could you please share the tree map link ?
Will upload soon.
if you are comfortable using instagram, and If you need it early, drop me a note in instragram.. so I can share the jpg
instagram.com/learn_dataengineering/
If I need the SQL statements which you run for practice purpose... Where can I get it.
Here you go
toppertips.com/snowflake-database-schema-container-hierarchy
Many thanks for such a informative lecture, this video helps a lot for beginners....But couldn't found SQL scripts link.... Kindly help by sharing script link used for this lecture......
Looks my website is having some issue.. will fix it soon and let you know.
@@DataEngineering - Any Update on this please, I am also not able to find SQL scripts
How can I get the info about snowsql...could you please elaborate...Thanks
will add some video about it..
Hi Team,
Where can i find the Slides and also the scripts used for explanation.
Please help me on this.
Will upload them soon... pls wait..
Thank you for your content but I don't find the script . help us pls .
Thanks @labib8aug, Sorry for not sharing the link.. here you go
www.toppertips.com/snowflake-database-schema-table-container-rierarchy/
Thank you 🙏 for watching my video and sharing your feedback and your word of appreciation really means a lot to me.
📒 📚 📒 📚 📒 📚 📒 📚 📒 📚
I have already published other knowledge series and snowflake certification videos and if you are interested, you can refer them. And please share your constructive feedback so I can improvise my content and help the snowflake and data engineering community.
🚀 Complete Guide + Question Dump + Revised Syllabus 🚀
-------------------------------------------------------
🌐 SnowPro Guide -> bit.ly/35S7Rcb
🌐 Revised Jan 2021 Syllabus -> bit.ly/3tqOkJb
🌐 SnowPro Practice Test Playlist of 300 questions -> bit.ly/2ZLQm9E
🚀 You can also follow Data Engineering Channel 🚀
--------------------------------------------------
🌐 Twitter -> twitter.com/de_simplified
🌐 Facebook -> fb.me/dataengineeringsimplified
🌐 GitHub -> github.com/TopperTips
🌐 Website -> toppertips.com
@@DataEngineering Unable ot access the link. Please upload and share data files and scripts
i have installed snow sql cli in windows not able to put the .csv file to stage could you help me how can load csv file ?
if you can help with the issue.. or share it via my instagram account
instagram.com/learn_dataengineering/
Could you please confirm limit on file size via web UI? The snowflake documents says 50MB.
Let me check and confirm.
Hello Sir, can you please share the link for tree diagram (Streem app )
Do you have the script file? I wanted to replicate these steps and practice.
Let me check, it must be available in the website. Will share it soon.
great tutorial, can you share the files that are used in the videos
Hi Sir ...Where Can i find tree map? I can't find the link..
Will upload soon
@@DataEngineering Thanks you so much...
Most welcome @@raghumajji2685
Can you please provide sub topic tree map?
Sir we need script or notes of your classes please🙏🙏🙏
Can you check toppertips.com/ .. some of the scripts are missing.. I am working on it...
Is there a link for the SQL code in this tutorial?
will check and publish it..
Script is missing. Thanks!
Where is the link for code u have used in tutorial?
Let me review... and if possible.. will make it available.
From where we can access this sql code
here you go
medium.com/@data-engineering-simplified/snowflake-database-schema-table-container-hierarchy-d72f945fc5f3
From where i can get the script for SQL here!?
Need to check if blog for this video is published .. if not ..then will publish it soon.
please share the pdfs and ppt it help us everyone to brush up the things easily and it's very is easy remember