What is ETL with a clear example - Data Engineering Concepts

แชร์
ฝัง
  • เผยแพร่เมื่อ 26 มิ.ย. 2024
  • Do you want to know what ETL (Extract, Transform & Load) process is? How it looks and what really happens in it? In this video, understand the 5 key things when it comes to ETL:
    1️⃣ What is ETL?
    2️⃣ ETL vs. ELT
    3️⃣ Real-world example of ETL
    4️⃣ ETL tools & platforms
    5️⃣ A demo of ETL on my computer
    ⏱ IN THIS VIDEO 👇
    ================
    0:00 - Introduction to ETL
    0:18 - What is ETL?
    2:14 - ETL vs. ELT - the main difference
    2:50 - A real-world example of ETL
    6:17 - Examples of ETL operations
    7:27 - What tools are used for ETL?
    9:22 - ETL Demo (with SQL)
    13:14 - Closing remarks (and one more ETL for you)
    😍 MORE EXPLANATIONS OF DATA CONCEPTS:
    ========================================
    Loving the style of this video? You are going to enjoy below videos too. They are in the same style and demystify critical data concepts.
    💡 Know the difference between Database, Data Warehouse and Data Lake - • KNOW the difference be... (350k+ views)
    😎 Top 20 Data & Business Intelligence Terms - • Top 20 Data & BI terms...
    🤩 What is SQL and how to use it? • SQL Basics for people ...
    ⭐ What is Star Schema? • How to setup a Star Sc...
    Important Data Concepts & Skills (playlist) - • Important Skills for D...
    ~
    Why did the restaurant owner fire ETL developer?
    Because she kept joining the wrong tables 🤣
    ~
    #etl #data
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 86

  • @aahsankhan4502
    @aahsankhan4502 ปีที่แล้ว +38

    Sir, this is a Superb Explanation.

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      Glad you liked it

  • @freedomofspeech122
    @freedomofspeech122 8 หลายเดือนก่อน +11

    I liked the clever pun "Enjoyed? Then Like" (ETL) 😁

  • @hazmannaim705
    @hazmannaim705 2 หลายเดือนก่อน +1

    I like how you show us the real-world example. Make the learning more understandable!

  • @yqhanliving
    @yqhanliving 7 หลายเดือนก่อน

    I'm a beginner to data analysis and was hearing about ETL for the first time in one of my SQL projects. This video has explained ETL very clearly to me. Thanks Chandoo!

  • @ArenitaHernandez
    @ArenitaHernandez 4 หลายเดือนก่อน +2

    What an eloquent manner to describe these concepts. I greatly appreciate it. 🙏🏽

  • @AllisonSadin-cq2wt
    @AllisonSadin-cq2wt หลายเดือนก่อน

    This is the video I have been searching for! I was so confused about how ETL could be defined... if ETL only happened using ETL tools, or if you could build your own ETL pipeline without the common tools! Thank you!

  • @stevenvanveldhoven4368
    @stevenvanveldhoven4368 12 วันที่ผ่านมา

    Thanks Chandoo. I always enjoy learning from you.

  • @joshuabretana
    @joshuabretana ปีที่แล้ว +3

    I like how you explain topics, they never get anymore complicated

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      Thanks Joshua...

  • @raghukoduri2018
    @raghukoduri2018 ปีที่แล้ว +8

    Neither Ramarao nor RamCharan, you are my Superhero!! God bless you with long life Anna. Thank you so much for the great content

    • @carcrazynishant
      @carcrazynishant ปีที่แล้ว

      Wow respect man… most people pay obeisances to actors from who we get entertained and not educated

    • @chaitanyakumar3023
      @chaitanyakumar3023 ปีที่แล้ว

      Wonder to see actor comparison in comments for ETL !

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      That is so sweet. Thanks Raghu 😍

  • @kehindefayomi7417
    @kehindefayomi7417 ปีที่แล้ว

    Am always happy seeing you solving problems...kudos my mentor

  • @chijiokeijezie969
    @chijiokeijezie969 ปีที่แล้ว +2

    Your videos and teachings are top notch!!! Simply good at what you do

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      Glad you like them!

  • @suck-myballs1152
    @suck-myballs1152 5 หลายเดือนก่อน +3

    This was a GREAT video! Simple, informative, and with a real-world example!

  • @NaisDeis
    @NaisDeis ปีที่แล้ว +1

    Man, this clarifies everything, thank you so much!

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      Glad it was helpful!

  • @tamirbahalker16
    @tamirbahalker16 5 หลายเดือนก่อน

    Thank you for a great explanation, we need more of you in this world😄

  • @djenobthemixbane1146
    @djenobthemixbane1146 2 หลายเดือนก่อน

    Thank you so much for this. It helped clarify a lot about ETL and its tools

  • @pcandy468
    @pcandy468 6 วันที่ผ่านมา +1

    The whole video was very helpful! I did chuckle at the ETL/like the video joke 🤭

    • @chandoo_
      @chandoo_  5 วันที่ผ่านมา

      Glad it helped!

  • @nukestrom5719
    @nukestrom5719 2 หลายเดือนก่อน

    What a great mentor.

  • @victorbegnini5754
    @victorbegnini5754 5 หลายเดือนก่อน

    Amazing explanation!!
    Thanks for that 🎉

  • @juliamavis2830
    @juliamavis2830 2 หลายเดือนก่อน

    I’m looking into pivoting my career into data engineering and this video really was informative. Thank you

  • @chrism9037
    @chrism9037 ปีที่แล้ว

    Nice work Chandoo, thank you!

  • @PavanMS87
    @PavanMS87 8 หลายเดือนก่อน

    Thanks a ton . Invaluable

  • @pillslifestylereviews6714
    @pillslifestylereviews6714 2 หลายเดือนก่อน

    Thank You So Much. You put a lot of effort into this vid!

  • @alfredtomiamubiaya3330
    @alfredtomiamubiaya3330 ปีที่แล้ว

    Many thanks Chandoo.You are awesome.

  • @Prabhakaran-hp1to
    @Prabhakaran-hp1to ปีที่แล้ว

    Thank you so much!

  • @surajmane5481
    @surajmane5481 หลายเดือนก่อน

    It's Wow! The way you explain...….

  • @loybiz
    @loybiz 4 หลายเดือนก่อน

    Great job. Thanks a ton

  • @VivekKBangaru
    @VivekKBangaru 3 หลายเดือนก่อน

    Really enjoyed it. Thanks bro

  • @shivaratribikshapathilinus5985
    @shivaratribikshapathilinus5985 3 วันที่ผ่านมา

    Am learning the ETL

  • @aparnapandravada5073
    @aparnapandravada5073 ปีที่แล้ว

    Awesome, very useful

  • @arjundev4908
    @arjundev4908 ปีที่แล้ว +1

    I watched in 13 minutes. But the pain behind to shoot this video with all those props. Amazing efforts chandoo sir😮😊

    • @chandoo_
      @chandoo_  ปีที่แล้ว +1

      Thanks Arjun :) It was a fun video to make.

  • @balutaalex6694
    @balutaalex6694 10 หลายเดือนก่อน

    ASMR, amazing explanation!

  • @andrewjason3756
    @andrewjason3756 ปีที่แล้ว +2

    You are doing such good work. Keep it up.😊

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      You are welcome Andrew. 😀

  • @idreeskhan5129
    @idreeskhan5129 9 หลายเดือนก่อน

    wow this is so amazing .

  • @aiasaiascon3894
    @aiasaiascon3894 ปีที่แล้ว

    Super cool explanations - I like the paper concept

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      Glad you liked it!

  • @kirandeepmarala5541
    @kirandeepmarala5541 ปีที่แล้ว +1

    Awesome Video Chandoo Annaya 💌👏

  • @ajayyaleti6197
    @ajayyaleti6197 ปีที่แล้ว

    Thank you ❤

  • @learn_ai_with_us
    @learn_ai_with_us 11 หลายเดือนก่อน

    last ETL concept was great ...

  • @Nash0303
    @Nash0303 5 หลายเดือนก่อน

    Fantastic!!

  • @tariqhussain1497
    @tariqhussain1497 3 หลายเดือนก่อน

    Good morning, and thats the nice to explain with a small data set

  • @CaribouDataScience
    @CaribouDataScience ปีที่แล้ว

    Thanks.

  • @nikki_siddi
    @nikki_siddi ปีที่แล้ว

    Great video!!

  • @hukkuhukku6208
    @hukkuhukku6208 4 หลายเดือนก่อน

    👏🏻awesome

  • @KiranYadavOG
    @KiranYadavOG 9 หลายเดือนก่อน

    thank you!

  • @jagatkrishna1543
    @jagatkrishna1543 ปีที่แล้ว

    Thanks 🙏 SIR, God Bless You

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      Most welcome

  • @Sandeepindiamyself
    @Sandeepindiamyself ปีที่แล้ว

    Nicely explained sir😊...!!! Please make a complete video of Microsoft 365.

  • @edwindsouza7157
    @edwindsouza7157 4 หลายเดือนก่อน

    Very good explanation power

  • @AdalgrimTook
    @AdalgrimTook 28 วันที่ผ่านมา +2

    Came here thinking I know nothing about this but turns out it's my daily job lol

  • @easterntoronto
    @easterntoronto หลายเดือนก่อน

    Great

  • @markpatterson766
    @markpatterson766 8 หลายเดือนก่อน

    I enojyed that. Countless examples without actual specific examples like this.

  • @skrejaulhaque
    @skrejaulhaque ปีที่แล้ว +1

    Thank you, first comment

  • @rockky-zz8ii
    @rockky-zz8ii ปีที่แล้ว

    Hi Chandoo, can you help me in one issue I'm facing like. I have one Item number xyx00001 but for that 3departments are working but when I have created a Measure formula of variance e.g. (calculate Sum(total hour) - Sum(actual hours))in measure result I'm getting 3 different value instead on same on in each row any logic can you provide. and yes there is no relationship issue for that can you help

  • @nandiniagarwal9201
    @nandiniagarwal9201 ปีที่แล้ว

    Pls make a video on how to upload a dashoboard on linkedin

  • @rajatthakur6444
    @rajatthakur6444 ปีที่แล้ว

    bring end to end ETL project Sir

  • @nviknesh8112
    @nviknesh8112 5 หลายเดือนก่อน

    Hi Chandoo, Happy new Year 2024. I have experience in Oracle PLSQL and MSSQL database's and i wish to switch my career to datawarehouse projects. Kindly guide me the path to proceed like what course should i start..

  • @janauppara
    @janauppara 7 หลายเดือนก่อน

    Any ETL tool recommendation to start with?

  • @NavneetKaur-kd6bd
    @NavneetKaur-kd6bd ปีที่แล้ว +1

    Sir , i wanted to ask you that if i wanted to be a Business Analyst and Data analyst should i pursue MBA after having the skill set of Data analyst.
    And if i pursue MBA , should i do specialisation in Business Analyst or Normal MBA would do?
    Thank you ❤️

    • @chandoo_
      @chandoo_  ปีที่แล้ว +1

      MBA is not requirement to be either Business or Data Analyst. If you have a strong background in the industry, you can get in to these positions. MBA often helps in speeding up the process (for example it might take 4-5 years of experience to get the role, but with MBA you might get the same in 1-2 years).

  • @trueman5948
    @trueman5948 ปีที่แล้ว

    Sir do we need sqlserves ,ssis,azure, To learn powerbi and to get job on it.

  • @ppy0019
    @ppy0019 ปีที่แล้ว

    Hello sir , please make a full course in SQL ...please sir

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      I have a detailed SQL video here - th-cam.com/video/l8DCPaHc5TQ/w-d-xo.html

  • @transworld8005
    @transworld8005 ปีที่แล้ว

    😃

  • @daminitripathi913
    @daminitripathi913 ปีที่แล้ว

    sir can you share data so that we can practice the same query

    • @chandoo_
      @chandoo_  ปีที่แล้ว

      You can use the dataset and SQL shared in this video - th-cam.com/video/l8DCPaHc5TQ/w-d-xo.html

  • @BhuvaaneshRavi
    @BhuvaaneshRavi หลายเดือนก่อน

    SHouldnt it be if(sum(s.amount)>1000,1,0)

  • @JagdishDive123
    @JagdishDive123 ปีที่แล้ว

    Is ETL dev job will replace by AI.? How can freshers tackle this ? 😢

  • @mukeshvarma8662
    @mukeshvarma8662 ปีที่แล้ว

    Chandoo, i have a problem. I need ur help. I have a excel files in share point . Which has query connection with other excel files. I need to refresh all in a excel file. Without opening the file manually. Because that file is connected to power bi

    • @mikatu
      @mikatu ปีที่แล้ว +1

      forget it!
      you need to delete the main file and run a progress report. the report will delete the setup and then you insert the fileload which will allow for a refresh on demand.

  • @prrrrince
    @prrrrince ปีที่แล้ว

    First

  • @whothefcares2687
    @whothefcares2687 17 วันที่ผ่านมา

    ETL is just data entry then? WTF😂

  • @akashgautam1909
    @akashgautam1909 ปีที่แล้ว

    Hello Sir,
    Could you please help me know what skills are required to become a data analyst?
    I've watched tons of videos including yours on this topic and got confused.
    To give a brief idea,
    I have an intermediate level of knowledge of Excel, SQL, Python (Including Numpy, Pandas, Matplotlib, and Seaborn), Power BI ( PQ, Data Modeling, DAX, Dashboarding), and Statistics.
    When I go to any job portals, it says you need to know machine learning, and deep learning too. 🥲
    Can I get a job with these skills?