Glad it was helpful! and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge.. These contents are available in discounted price for limited time.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command... 1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/?couponCode=NEWYEAR50 2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/?couponCode=NEWYEAR35
I'm encountering an error when I try to validate Parquet files using the COPY INTO command with the validation mode. copy into account master from @stg_sav/sav_customer/ file_format =sav_parquet validation_mode =return_errors 2nd option copy into account master from @stg_sav/sav_customer/ file_format =sav_parquet match_by_column_name =case_sensitive validation_mode =return_errors Please let me how to fix it.
I am getting this error "Invalid argument [Provided job UUID not for a COPY job] for table function. Table function argument is required to be a constant.". Not sure why? I am executing following query: select * from table(validate(EMP_VALIDATION, job_id=>'01aa1e26-3200-a39c-0002-3c3e000293ca'));
You might have copied the incorrect query id, the query id should belong to copy command and it should have executed a real copy not a copy with validation.
Your viedows are great and I am learnign a lot from these learning videows. I have having issue while loading "01/01/2020 12:28:15 AM' this data into table, I have declare data type timestamp or Datetime or timextamp_tz nothing is work always getting "Timestamp '01/01/2020 12:28:15 AM' is not recognized" error. Appreciate if you could yuou please help me on this
while loading raw data.. have it mapped to text.. and then try to convert it.. else use cast with format text to solve the problem.. and before that.. try to solve the problem with one single value in worksheet..
Wow! Wonderful training video with an excellent explanation.
Thank you for providing such an informative video on snowflake.
Glad it was helpful!
and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge..
These contents are available in discounted price for limited time.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command...
1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/?couponCode=NEWYEAR50
2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/?couponCode=NEWYEAR35
It will be helpful if you provide the data set used in u r videos, so that we can also practice it. Thanks a lot.
How to do same with S3 bucket
can you please provide the data source files too @Data Engineering Simplified
thank you bro
You're welcome!
validation mode is not working for parquet file format - any suggestion to handle error records while copying data from parquet file to Snowflake?
I'm encountering an error when I try to validate Parquet files using the COPY INTO command with the validation mode. copy into account master from @stg_sav/sav_customer/
file_format =sav_parquet
validation_mode =return_errors
2nd option
copy into account master from @stg_sav/sav_customer/
file_format =sav_parquet
match_by_column_name =case_sensitive
validation_mode =return_errors
Please let me how to fix it.
I am getting this error "Invalid argument [Provided job UUID not for a COPY job] for table function. Table function argument is required to be a constant.". Not sure why? I am executing following query:
select * from table(validate(EMP_VALIDATION, job_id=>'01aa1e26-3200-a39c-0002-3c3e000293ca'));
You might have copied the incorrect query id, the query id should belong to copy command and it should have executed a real copy not a copy with validation.
Your viedows are great and I am learnign a lot from these learning videows. I have having issue while loading "01/01/2020 12:28:15 AM' this data into table, I have declare data type timestamp or Datetime or timextamp_tz nothing is work always getting "Timestamp '01/01/2020 12:28:15 AM' is not recognized" error. Appreciate if you could yuou please help me on this
while loading raw data.. have it mapped to text.. and then try to convert it.. else use cast with format text to solve the problem..
and before that.. try to solve the problem with one single value in worksheet..
INDEED VIDEOS OF EVERY "SNOWFLAKE DEVELOPER"
thanks dear.. share the videos with other folks who wants to learn and gain knowlege..
@@DataEngineering definitely i will share. its Our responsibility to publish our hero to viewers
@@m.s.krishnamurthykitta thank you so much for you support and love. I really appreciate.