วีดีโอ

Hi Anupam thank for sharing this video. Couple of questions, 1) can i use the existing file name with different content for auto injest. 2) is the any internal view to montor the snowpipe sqs. Raju

how much = INR Rupees this core certification will be?

Hello Anupam, Great Insight for us aspiring data engineers. Just have a request could you please create a video regarding auto ingestion from Google cloud storage in snowflake just as you have done for this AWS.

great explaination!!

Thanks a lot, very helpful

I think there should be update sex instead of update salary statement that's why there is error showing,you should try this or remove this video as it might get confused others.

for ingesting multiple different tables to multiple different stages

Any voucher code available to take this exam?

nice

Explained in kind manner - Snowflake Data Governance Features

please do a vedio on latest ui it will be helpfull

I'm new to Snowflake and have zero hands-on experience with it, I need to complete its certification by the end of the month, would I be able to get certified after watching the complete playlist?

Thank you for the video. It is short but has enough information. I have two questions: How does snowflake detect duplicate files? Is there any query to identify those duplicated files processed in Snowflake ?

Thanks sir can i create snowpipe on internal named stage

you have explained it in a very nice and simple way. Demo is very best. Keep up the good job. Thanks

for that sns. do we need to make anew sns in our aws account to so that it works or that sns is alreayd provided by aws, and also do we need to change trust policy of s3 bucket or add any policy

hi, where can i find the previous video? You are mentioning that in the last session ..

Hi Sir, I am trying to automate the file transfer ( AUTO-INGEST ) process but its not working. here is the steps and script i took so far. My Event notification is not working . when ever a new file come to folder its not able to detect that. //CREATED TABLE CREATE OR REPLACE TABLE SPOTIFY_DB.PUBLIC.ALBUM ( album_id string, name string, release_date string, total_tracks int, url string) // create integration link between s3 and snowflake create or replace storage integration s3_init_spotify TYPE = EXTERNAL_STAGE STORAGE_PROVIDER = S3 ENABLED = TRUE STORAGE_AWS_ROLE_ARN = '<ARN ROLE>' STORAGE_ALLOWED_LOCATIONS = ('s3://Spotify_data/transformed_data') COMMENT = 'Creating connection to S3' DESC integration s3_init_spotify -- ( from this i created IAM role and provided the 'STORAGE_AWS_IAM_USER_ARN' and 'STORAGE_AWS_EXTERNAL_ID' //make connection by creating the STAGE CREATE OR REPLACE stage MANAGE_DB.external_stages_schema.SPOTIFY_Album URL = 's3://Spotify_data/transformed_data/album_data' STORAGE_INTEGRATION = s3_init_spotify FILE_FORMAT = MANAGE_DB.file_format_schema.csv_fileformat LIST @MANAGE_DB.external_stages_schema.SPOTIFY_Album //Creating the PIPE and STAGE for Automating the file transfer part create or replace schema manage_db.pipes create or replace pipe manage_db.pipes.Album_pipe AUTO_INGEST =TRUE as COPY INTO SPOTIFY_DB.PUBLIC.ALBUM FROM @MANAGE_DB.external_stages_schema.SPOTIFY_Album Project Execution Flow Lambda Trigger (every week) -> Run spotify_api_data_extract code (Extract Data from Spotify Top 50 - Global Playlist using spotipy library) -> Stores Raw Data in AWS S3 -> Trigger Transform Function -> Run spotify_transformation_load_function code (Transforms the data) -> Stores Transformed Data in AWS S3(Which then sends event notification to snowpipe) -> Triggers the Snowpipe which then extracts the data from transformation buckets and loads them in respective tables in Snowflake -> Data stored in snowflake can be queried for Analysis Will you please help me on that?

Thank you for this video. I appreciate your effort for sharing knowledge .Can you please make some video on Acryl Datahub ,DataHub ,metadata, glossary , domain, data lineage out of the data by ingesting them

SIr, Theroy ke saath sath practiacal dikha dete to concept samajh ne me aasani hoti ....ye seer ke uper se gaya ,, bahut bada bouncer..

Hello Anupam, Do we have to create the sqs queue in AWS frst or does creating snow pipe directly creates the queue?

How much coding python, javascript are using here

Hi , Can you please share stream and task videos also

Thank you works like a charm.

How to find the size of each database in snowflake?

how to find that, when table is last refresh in snowflake for tables without date field

i have done everything but data isn't showing in the table

What are skills needed for Snowflake to get job as snowflake data engineer, do i need to learn python??, do i need to learn DBT??, do i need to learn matillion ??, lot of questions in my mind Sql+ snowflake is the good combination or i need to learn more before attending for interviews because i have to show some experience in it

I have a question here please, you have defined a parameter for key and secretid in external stage creation, but where did you define those credentials in snowflake? Can I know please?

Bro any free certificate

Have you deleted you snowflake question dump playlist?

Have you deleted you snowflake question dump playlist?

Excellent resource !!!

Thank you for the video, I have a doubt Suppose the source file deleted I mean the file in S3 so are we still able to get the rows when we querying the data ..the select * from <tablename> ??

Hello, i'm pursuing my PG in data analytics should I do It? I'm a fresher in Data analytics?

Thanks for the video . I have a small doubt, lets say if we are using a internal stage and there are couple of different files i.e., employee,salary,dept. All are of type csv. Now if i have to load them to their respective tables in snowflake i.e, employee, salary, dept using pipe, is it possible ? if yes what will be the notification channel?

Thanks

Thanks for the video, that's very informative :). However I have a doubt.. Let's say my csv file has more no of columns than in the table and since AUTO_INGEST = True, So in this case will it load the data into table or it won't process the file?. If it doesn't process , is there any log file which keeps a track of it?

how to load multiple files with diffrent meta data using one single pipe and single stage its possible ?

Very informative video. Thank you.

Hi.what is the difference between the cluster key maximized cluster warehouse

Hello, is there any repository from where we can get the code you execute? SnowSQL and Snowpark. Thanks

Hi Anupam, how can I get the snowflake COF-C02 guide ??

Thank u

Forget about classic 😢..they have decom

Pls make more videos about snowflake with python and more sir thnk u

Wel explains sir

Pleas share more videos now snowflake changed with new web UI sir

sir how to load data from internal storage i.e laptop ,csv file?

Hi Bro, I need to configure create pipe connector, especially copy statement; please help me