Snowflake - Data Loading and Transforming while Loading

แชร์
ฝัง
  • เผยแพร่เมื่อ 15 ธ.ค. 2024

ความคิดเห็น • 69

  • @mohammedvahid5099
    @mohammedvahid5099 11 หลายเดือนก่อน +8

    🙏ur real man who seen on market and good person sir ❤ ఇంత సబ్జెక్ట్ ఎవరు ఫ్రీ గా చెప్పరు sir meeru always happy ga ఉండాలి ❤ our blessings always with u❤️

    • @mrjana520
      @mrjana520  11 หลายเดือนก่อน +2

      Thanks brother for wishes, I wish you all the very best.

    • @saicharan8495
      @saicharan8495 4 หลายเดือนก่อน

      th-cam.com/video/zAbPfpqyTVs/w-d-xo.html

  • @charlesa9431
    @charlesa9431 9 หลายเดือนก่อน +2

    You are very good at what you teach please keep it going.

  • @pretty_pets_07
    @pretty_pets_07 5 หลายเดือนก่อน +1

    Excellent ga explain cheysyaru anna everyone will like your presentation. Keep explaining on more topics. God bless you anna🙏🙏🙏

    • @saicharan8495
      @saicharan8495 4 หลายเดือนก่อน

      th-cam.com/video/zAbPfpqyTVs/w-d-xo.html

  • @jagadeeswarareddynetapalli3662
    @jagadeeswarareddynetapalli3662 ปีที่แล้ว +3

    Great Effort.Nice explanation

  • @yamunau.yamuna5189
    @yamunau.yamuna5189 ปีที่แล้ว +1

    Crystal clear explination thanks bro

  • @saereddy
    @saereddy ปีที่แล้ว +2

    Super Anna,,, mind lo dhigindhi.

    • @saicharan8495
      @saicharan8495 4 หลายเดือนก่อน

      th-cam.com/video/zAbPfpqyTVs/w-d-xo.html

  • @azada.k958
    @azada.k958 10 หลายเดือนก่อน +1

    Great Sir,

  • @SudiptaTripathy
    @SudiptaTripathy ปีที่แล้ว +1

    Nicely explained :). Very helpful

  • @atlasrinu2215
    @atlasrinu2215 2 ปีที่แล้ว +1

    Nice Video. Please make a demo on how to migrate database/schema/tables from Dev to Test environments.

  • @ranganatho707
    @ranganatho707 ปีที่แล้ว +1

    Great videos, please share details on snow pro core certification in our country

  • @Jessalsar
    @Jessalsar 3 หลายเดือนก่อน

    can we use put command to load data into tables difference put and copy command..?

    • @mrjana520
      @mrjana520  3 หลายเดือนก่อน

      Put is to push the files from on-premise to internal stages, Copy is to load data from external or internal stages

  • @m.s.krishnamurthykitta
    @m.s.krishnamurthykitta 2 ปีที่แล้ว +1

    TQ....ANNA

  • @nagaa225
    @nagaa225 หลายเดือนก่อน

    Who will takecare of archiving file once it is loaded into snowflake table

    • @mrjana520
      @mrjana520  หลายเดือนก่อน

      You can set up auto archive mechanism from cloud side or you can manually do it in regular intervals.

  • @UPavan07
    @UPavan07 ปีที่แล้ว

    sir during the time of creation of free trail i have selected Azure instead of AWS is there any way to change it now

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      Not possible, but you can create another account with AWS

    • @UPavan07
      @UPavan07 ปีที่แล้ว

      @@mrjana520 ok sir

  • @ranjith335
    @ranjith335 ปีที่แล้ว

    While creating external storage, facing below error:
    Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)]

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      Send the queries you are using to my mail id - jana.snowflake2@gmail.com

  • @Satyanandan_D
    @Satyanandan_D ปีที่แล้ว +1

    If I want to load data every day without my intervention, Can I run this copy command everyday using any scheduling tool? or Do we need to keep this command in script?

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      You can use tasks for scheduling queries, tasks is an inbuilt feature of Snowflake

  • @krishanajangid1763
    @krishanajangid1763 2 หลายเดือนก่อน

    Can you see publicly S3 bucket files ?

    • @mrjana520
      @mrjana520  2 หลายเดือนก่อน

      No

  • @mayanknema3007
    @mayanknema3007 2 ปีที่แล้ว

    Can ypu please tell me if there is an issue with data loading because of size & many users? How we can deal with this situation?

    • @mrjana520
      @mrjana520  2 ปีที่แล้ว

      There is no limit on file sizes, but Snowflake recommends to split and process the larger files. and coming to many users there will be no issue if you are using a multi clustered warehouse.

    • @mayanknema3007
      @mayanknema3007 2 ปีที่แล้ว

      @@mrjana520 ..but what to do when there is a performance issue with Snowflake?

  • @praveen5281
    @praveen5281 ปีที่แล้ว

    in case2 and case3 copy command you used s.$1,s.$2. what 's' refers to. can we use $1,$2 directly

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      You can use directly, s is just alias name

  • @ashokrajann9351
    @ashokrajann9351 ปีที่แล้ว

    Hi sir
    My understanding is
    Bulk load can be done using an external stage and we need VW for that
    Continuous load can be done using internal stage by using snowpipe feature
    Snowflake itself offer/support snowpipe
    Please correct me if am wrong

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      That is not correct, watch external stages and internal stages videos as well, you will get answers

    • @ashokrajann9351
      @ashokrajann9351 ปีที่แล้ว +1

      @@mrjana520 sir
      Bulk load can be done either by external or internal stage. Bulk load needs VW and no snowpipe to process huge data
      Continuous load processes small amount of data and does not need VW
      It requires a snowpipe which is a serverless feature (it has a separate cost)
      Now my understanding is correct sir?

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      Yup

  • @sudhakarkunchala7928
    @sudhakarkunchala7928 ปีที่แล้ว

    What is stage? Onve the schema is created again stage created that means stage is like table?

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      No, watch full video of external stages and internal stages video for full details on stages.

    • @sudhakarkunchala7928
      @sudhakarkunchala7928 ปีที่แล้ว

      @@mrjana520 thanks nenu chusathanu,if I want to became the data enginer,what skill need to learn?

  • @Buddy14143
    @Buddy14143 ปีที่แล้ว

    Bro I have a doubt in this video regarding 5 th case ,in SQL we have set identity insert on/off option .In snowflake also is it working or not?

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      AUTOINCREMENT and IDENTITY are synonyms in Snowflake, you can use either of these.

    • @Buddy14143
      @Buddy14143 ปีที่แล้ว

      @@mrjana520
      Thanks for replying janardhan garu
      Thank you so much

  • @ATIFKHAN-mz4fp
    @ATIFKHAN-mz4fp ปีที่แล้ว

    thanks sir can you able to post snowflake vacancy videos its more help full

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      I am not aware of vacancies

  • @Nenuhappy
    @Nenuhappy ปีที่แล้ว

    Hi sir
    Can we directly load the data from S3 to Snowflake with out creating the External stage and Storage integration?In your example you have directly loaded the data

    • @mrjana520
      @mrjana520  ปีที่แล้ว +1

      Yes, pls watch the video fully, you will get answer for your question..

  • @RK-wf7re
    @RK-wf7re 2 ปีที่แล้ว +1

    Nice content. Is Snowflake can be used as a ETL tool also like informatica, abinitio?

    • @mrjana520
      @mrjana520  2 ปีที่แล้ว

      Not completely, but supports most of the extract transform and load operations

    • @RK-wf7re
      @RK-wf7re 2 ปีที่แล้ว +2

      @@mrjana520 Thank you. So it is mainly used as database only.

  • @NitinKumar_up_se
    @NitinKumar_up_se 7 หลายเดือนก่อน

    how to create url like s3://

    • @mrjana520
      @mrjana520  7 หลายเดือนก่อน

      Watch AWS integration video for details

  • @divityvali8454
    @divityvali8454 6 หลายเดือนก่อน

    Can you paste this workshets in description

    • @mrjana520
      @mrjana520  6 หลายเดือนก่อน

      there is a limitation on Description, can't paste entire PPT or code.
      You can get all snowflake Videos, PPTs, Queries, Interview questions and Practice files in my Udemy course for 499 rupees.. I will be updating this content and will be uploading all new videos in this course. And you will have lifelong access to these videos and materials.
      My Snowflake Udemy Course:
      www.udemy.com/course/snowflake-complete-course-for-clearing-interviews/?couponCode=0C8E557D4EB94D407F5A
      Use the coupon below to get it for 499 rupees.
      Coupon: 0C8E557D4EB94D407F5A

  • @skdonsingh
    @skdonsingh ปีที่แล้ว

    Thanks Janardhan for your videos. Its very helpful and your knowlege and teching skill is excellent. I have already subsribed your channel. Apart from subsribed ,there is option of Join . I want to know how can I join and what would be its benefits.

    • @mrjana520
      @mrjana520  ปีที่แล้ว

      Hi currently there are no benefits of joining the channel as I am providing videos publicly, not only to members

  • @mohammedvahid5099
    @mohammedvahid5099 ปีที่แล้ว

    Bro CSV files ఇవ్వండి practice కోసం మరియు ఎలా s3 bucket లో csv files load చేసి roles మరియు policies create చేసి arn attach చెయ్యాలి చూపించండి 🙏

    • @mrjana520
      @mrjana520  ปีที่แล้ว +1

      That part was explained in AWS-Snowflake integration, please watch that video.
      I have uploaded videos on all concepts, follow snowflake playlist in the order.

    • @mohammedvahid5099
      @mohammedvahid5099 11 หลายเดือนก่อน

      Thnk u❤ sir

  • @mohammedvahid5099
    @mohammedvahid5099 ปีที่แล้ว

    Sir please give me the CSV files to practice 🙏

    • @mrjana520
      @mrjana520  ปีที่แล้ว +1

      I can be reachable on jana.snowflake2@gmail.com

  • @vinodbarma2858
    @vinodbarma2858 ปีที่แล้ว

    please upload videos in sequence, its hard to understand for new learners

    • @mrjana520
      @mrjana520  ปีที่แล้ว +1

      All videos are in order in my Snowflake playlist..