Configuring a Snowflake Storage Integration to Access Amazon S3

แชร์
ฝัง
  • เผยแพร่เมื่อ 13 ธ.ค. 2024

ความคิดเห็น • 26

  • @satyajit2007
    @satyajit2007 2 ปีที่แล้ว +1

    you mentioned in first minute, you had a video where you created Snowflake Stage by providing S3 bucket and secret keys . Can you share that video link please

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      Hello CrimeMasterGogo , you can check this video , here i have created the stage using access key & secret key--
      Generating S3 pre-signed URLs using Snowflake with Indepth Intuition
      th-cam.com/video/JhDjvA-KATk/w-d-xo.html
      Hope this will be helpful. Happy Learning :-)

  • @srinivasch5661
    @srinivasch5661 2 ปีที่แล้ว +1

    Hi, I tried to execute the copy command however it is throwing errors as Number of columns in file (4) does not match that of the corresponding table (3), even tried option "error_on_column_count_mismatch=false" still data is not loading.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      This error is indicating that the file you are trying to load don't have same no, of columns as of destination snowflake table , please make sure no. of columns in source s3 (or any other external stage) is same as of the table structure

  • @madhubanti123
    @madhubanti123 10 หลายเดือนก่อน

    Hello...Could you please suggest how to avoid expose of iam arn directly into the snowflake code ?

  • @shilpajaiswal4993
    @shilpajaiswal4993 2 ปีที่แล้ว +1

    Very well explained,Thanks

  • @rameshyatham9695
    @rameshyatham9695 2 ปีที่แล้ว +2

    Nice its useful and working for me. thanks for the video.

  • @raoazurecloud3775
    @raoazurecloud3775 2 ปีที่แล้ว +1

    How can I connect with you? I need your help

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      Hello Rao azurecloud, please check this doc (doc.clickup.com/37466271/d/h/13qc4z-104/d4346819bd8d510) , for any Snowflake related topic explanations , if your require any topic which is not available or doubt not solved , then please post your doubt here , If I know I will surely try my best to help you asap.

  • @deepthichebrolu4803
    @deepthichebrolu4803 2 ปีที่แล้ว +1

    you just made my day. thanks for teh solution

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      Glad to see such inspiring comment Deepthi Chebrolu! It made my day 😄✌Happy Learning & have a great new year ahead !

    • @deepthichebrolu4803
      @deepthichebrolu4803 2 ปีที่แล้ว

      @@KnowledgeAmplifier1 i tried the same but my external stage is always showing empty

    • @deepthichebrolu4803
      @deepthichebrolu4803 2 ปีที่แล้ว

      @@KnowledgeAmplifier1 don't know where iam making mistake

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      @@deepthichebrolu4803 do you really have any file in external stage ?

    • @deepthichebrolu4803
      @deepthichebrolu4803 2 ปีที่แล้ว +1

      @@KnowledgeAmplifier1 hi, i just figured it out...the policy file had few issues

  • @tej8442
    @tej8442 2 ปีที่แล้ว

    Snowflake storage integration object for secure access to aws s3 external stage location. getting this error SQL execution error: Error assuming AWS_ROLE. Please verify the role and external Id are configured correctly in your AWS policy. i have updated external id and aws aen of snowflake generated in trusted entity of aws roles

    • @tej8442
      @tej8442 2 ปีที่แล้ว

      @knowledge amplifier looking forward to hear from you little bit urgent

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      @@tej8442 if you followed the video properly but still getting error , then please check whether the s3 data is kms encrypted or not , if kms encryption is there , you need to provide kms decryption policy to the created role also ...

    • @tej8442
      @tej8442 2 ปีที่แล้ว

      @@KnowledgeAmplifier1 my S3 bucket doesn't have any data and default encryption was disabled still facing same issue

  • @abdullahsiddique7787
    @abdullahsiddique7787 3 ปีที่แล้ว +1

    Pls give the file git hub path

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 ปีที่แล้ว

      Hello Abdullah Siddique , the code is available in the description box of the video , not explicitly uploaded in Github , but sharing the Github link if it helps for other Data Engineering related topics -- github.com/SatadruMukherjee/Data-Preprocessing-Models Happy Learning

  • @satendra9rathore
    @satendra9rathore 2 ปีที่แล้ว +1

    awesome bro