Data Pipelines Explained

แชร์
ฝัง
  • เผยแพร่เมื่อ 15 มิ.ย. 2022
  • Learn more about Data Pipelines → ibm.biz/BdPEPM
    Data is a lot like water; it often needs to be refined as it travels between a source and its final destination. That’s where data pipelines come in - they merge, filter, and summarize raw data, providing the end user with a clean product to analyze. Luv Aggarwal, a Data Solution Engineer at IBM, explains how several processes often embedded within data pipelines - like ETL, replication, virtualization, machine learning, and batch processing - help generate actionable business intelligence.
    Get started with IBM Cloud free of charge → ibm.biz/BdPEPS
    Subscribe to see more videos like this in the future → ibm.biz/subscribe-now
    #Data #DataPipelines #DataAnalyses #DataIntegration #BusinessIntelligence #ETL

ความคิดเห็น • 61

  • @Geeee33
    @Geeee33 ปีที่แล้ว +36

    Now that's one of the best explanations with the simplest examples for data pipelines! Thank you

  • @vishalk02
    @vishalk02 2 ปีที่แล้ว +8

    Explained simply & effectively. I would like to see more elaborate content on big data & data science fields.

  • @victorgromov1548
    @victorgromov1548 ปีที่แล้ว +4

    Great explanation with easy to follow examples!

  • @balakrishnanr7149
    @balakrishnanr7149 ปีที่แล้ว +3

    Very precise explanations with simple examples. 👏👏👏

  • @emrepiristine7967
    @emrepiristine7967 ปีที่แล้ว +1

    Thank you very much, it was the most explanatory and beautifully explained video I've ever watched.

  • @well9851
    @well9851 ปีที่แล้ว +2

    Greatly explained. Easy to understand and clearly.

  • @saikiranmahajan5981
    @saikiranmahajan5981 ปีที่แล้ว +1

    Awesome Luv! You made it simple for the Sales guys.

  • @alexpishvanov736
    @alexpishvanov736 2 ปีที่แล้ว +40

    I think, Data Virtualization would be a great topic for the next educational video from this instructor.

    • @carsonmasterson
      @carsonmasterson 2 ปีที่แล้ว

      Hey Alex -- check this out: th-cam.com/video/2XB4UaBIvNI/w-d-xo.html

    • @1apocalyps
      @1apocalyps ปีที่แล้ว +1

      Yes I agree. When I hear virtualization, I get locked into is it based off data models, Is it "place holder data"? I'm assuming we have no information about the data without the transformations

  • @peterluo1776
    @peterluo1776 ปีที่แล้ว +1

    This is some good work.
    Well done.
    Thanks for sharing 👍

  • @Flankymanga
    @Flankymanga 2 ปีที่แล้ว +20

    I would like to know how the Data Virtualization works. At first i thought that it is just "faking" a real data source in order to test data pipeline configuration?

  • @Manav-zo9bn
    @Manav-zo9bn ปีที่แล้ว +2

    such a Quality content . Very well explained

  • @harshalh3513
    @harshalh3513 ปีที่แล้ว +1

    Greatly explained , would be more great if you could explain a few more processes to build pipelines in a breif

  • @LeonidAndrianov
    @LeonidAndrianov ปีที่แล้ว +1

    Nice analogy and explanation!

  • @ChanceMinus
    @ChanceMinus ปีที่แล้ว +1

    Thank you. Extremely helpful.

  • @keviin077
    @keviin077 ปีที่แล้ว +1

    Thanks for the amazing explanation

  • @davidallyn1818
    @davidallyn1818 7 หลายเดือนก่อน

    Beautiful tutorial!!

  • @sabry5106
    @sabry5106 5 วันที่ผ่านมา

    Amazing simple explanation

  • @obiradaniel7391
    @obiradaniel7391 2 ปีที่แล้ว +16

    Nice video, just when you think you have heard it all, here comes "Data Virtualization". If possible that could be elaborated more.

    • @kikitauer
      @kikitauer 2 ปีที่แล้ว +8

      My company uses data virtualization when rendering a final picture from our car configurator. It doesn't physically download the pictures, it just calls for the chosen color, wheels, accessories interiors etc and caches them - stores them in the temporary storage.

    • @pritamdaware9674
      @pritamdaware9674 ปีที่แล้ว

      Does this technology use all automobile industry?

  • @user-uh6vk2zl1k
    @user-uh6vk2zl1k ปีที่แล้ว +1

    This is excellent!

  • @suck-myballs1152
    @suck-myballs1152 2 หลายเดือนก่อน +1

    I love these IBM videos. No organizations simplifies things the way they do.

  • @hasanmougharbel8030
    @hasanmougharbel8030 ปีที่แล้ว +3

    Hey dear, god bless your efforts in this channel.
    I have a general enquiry as a new sql learner.
    How could i create a pipeline to extract and load data from existing accounting program into our SQL server instances.
    How can i know if the export mechanism in the software permits me to undertake this extraction process, and how can i know if an application have an api?
    Thanks for taking care of my enquires.
    Looking forward to gain more knowledge from you

  • @msbthedataengineer
    @msbthedataengineer 2 ปีที่แล้ว +1

    Good Explanation!!.....

  • @alaad1009
    @alaad1009 10 หลายเดือนก่อน

    Excellent analogy

  • @Trendykid
    @Trendykid 11 หลายเดือนก่อน

    Cant wait for data virtualization video.

  • @Eyenn_n
    @Eyenn_n ปีที่แล้ว

    Awesome video!

  • @surabhijagadish5210
    @surabhijagadish5210 2 หลายเดือนก่อน

    Awesome explaination.

  • @aniruddhabhosale6715
    @aniruddhabhosale6715 5 หลายเดือนก่อน

    Explained really well
    .👊🔥💖✨💯

  • @f-alzahraa_Ahmed
    @f-alzahraa_Ahmed ปีที่แล้ว

    thanks, realy usful

  • @uwalakab
    @uwalakab 2 ปีที่แล้ว +3

    Great analogy. 👍🏿👍🏿👍🏿

  • @claudiusdsouza2379
    @claudiusdsouza2379 ปีที่แล้ว +1

    well explained

  • @babasahebmane3473
    @babasahebmane3473 ปีที่แล้ว

    Well explained

  • @chuachua-hj9zd
    @chuachua-hj9zd 9 หลายเดือนก่อน

    Very good example quote using examples

  • @explorertribe
    @explorertribe ปีที่แล้ว +1

    Data virtualization is something looks interesting

  • @jpmccrossan6807
    @jpmccrossan6807 11 วันที่ผ่านมา

    Wonderful video and explanation- I'm just trying to work out, if he's writing on glass, how is he able to write backwards so well- for us to view it as 'non reversed'.
    *Edit: Got it- flipped video :)*

  • @evanshlom1
    @evanshlom1 2 ปีที่แล้ว +2

    I WILL IMPLEMENT STREAMING MACHINE LEARNING AT WORK VERY SOON

  • @pudgewars6447
    @pudgewars6447 2 ปีที่แล้ว +4

    I would like to know how does your screen board work? Are you writing iin inverted xd?

    • @Lilwar195
      @Lilwar195 2 ปีที่แล้ว +7

      I believe they are writing normally but the video is inverted post production

    • @Tordekh
      @Tordekh 4 หลายเดือนก่อน

      th-cam.com/video/wCOuu0-o5YI/w-d-xo.html Lightboard videos

  • @Helloimtheshiieet
    @Helloimtheshiieet 10 หลายเดือนก่อน

    In a roundabout way this is why ERP systems are so popular

  • @vansf3433
    @vansf3433 ปีที่แล้ว

    Your l English language is ambiguous because streaming data and transforming data are 2 different process. Streaming data is to make it concise or compacted, while transforming data can be changing it into another form to make it suitable for a certain purpose

  • @dxwallace55
    @dxwallace55 หลายเดือนก่อน

    Off topic, but how are you typing backwards/reverse?

  • @splashoui3760
    @splashoui3760 8 หลายเดือนก่อน

    How this kind of videos are made? Typing to the screen and it shows up on camera? What is the tech behind this?

    • @IBMTechnology
      @IBMTechnology  8 หลายเดือนก่อน +1

      See ibm.biz/write-backwards

    • @splashoui3760
      @splashoui3760 8 หลายเดือนก่อน

      Thanks!@@IBMTechnology

  • @faisalk.7520
    @faisalk.7520 ปีที่แล้ว +1

    How was this video made? How are the words not backwards lmao. This is crazy

  • @user-xx1sw1dj9o
    @user-xx1sw1dj9o 9 หลายเดือนก่อน

    yooo i just relaized this man just wrote all those letters and words backwards so we can see it normally....... right ? or is this some camera trick

    • @IBMTechnology
      @IBMTechnology  9 หลายเดือนก่อน

      See ibm.biz/write-backwards

  • @rohannair4039
    @rohannair4039 6 หลายเดือนก่อน

    how is he writing in reverse

  • @ScriptureFirst
    @ScriptureFirst ปีที่แล้ว +1

    Whiteboards suck. Spring for the full blown motion graphic. Too slow (even at 2x) didn’t finish

  • @samwelemmanuel7976
    @samwelemmanuel7976 8 หลายเดือนก่อน

    My only question is why do they always ask lefties to do these videos?

    • @IBMTechnology
      @IBMTechnology  8 หลายเดือนก่อน

      See ibm.biz/write-backwards --they're actually righties.

  • @dharanik7530
    @dharanik7530 10 หลายเดือนก่อน

    worst experience guy

  • @vansf3433
    @vansf3433 ปีที่แล้ว

    Your explaining chart is nonsense because you do not need to clean water from a lake or river for agricultural activities

    • @temitopekade590
      @temitopekade590 หลายเดือนก่อน +1

      Appreciate efforts. This explanation is basic and it does not mean there are no other use cases like the agriculture you mentioned. He is talking obout end use of water in this case. Majority of us understood this. Be more positive!