How To DESIGN YOUR First DATA PIPELINE ??🔥 15 Minutes BASIC STEPS

แชร์
ฝัง
  • เผยแพร่เมื่อ 7 ก.ย. 2024
  • ⭐ Subscribe to Hindi Channel - / @datawalebhaiya219
    ⭐ Download Cambly App To Improve English ► bit.ly/3LWa21A
    ⭐ Use Coupon Code - "22elb"
    🔅Follow Me On Instagram - / _shashank_219
    🔴 Join My JOB GUARANTEED BigData Course - bit.ly/3TrpK7J
    🔴 Use Code SHASHANK30 to get 30% Discount
    𝗝𝗼𝗶𝗻 𝗺𝗲 𝗼𝗻 𝗦𝗼𝗰𝗶𝗮𝗹 𝗠𝗲𝗱𝗶𝗮:🔥
    🔅Shashank LinkedIn - / shashank219
    🔅Shashank Instagram - / _shashank_219
    🔅Telegram Group - LearningBridge
    ⭕Discord Server - discord.io/sha...
    🔴Join for 1x1 Mentorship, Mock Interviews, Career Guidance, Resume Building, Interview roadmap and resources to crack tech, BigData/Data Engineering tutorials from scratch :
    / @shashank_mishra
    #datascience #design #bigdata

ความคิดเห็น • 60

  • @shashank_mishra
    @shashank_mishra  ปีที่แล้ว +14

    Happy Diwali 😍 Also, watch the full video and complete the task which I have given in the end of this video✌

    • @prashikpatil2830
      @prashikpatil2830 ปีที่แล้ว

      Same to you sir ..

    • @vaishnavibarapatre7736
      @vaishnavibarapatre7736 ปีที่แล้ว

      Hi...... I m a data analyst and want to switch in data engineering....can you suggest should I prepare for this ?

  • @gauravtales04
    @gauravtales04 ปีที่แล้ว +4

    I love that swastik which you have made on TH-camplay button ...this shows how humble you are...lots of love sir...💕

  • @akritigupta9709
    @akritigupta9709 ปีที่แล้ว +3

    hello Shashank...
    It's really great learning toward data engineering pipeline. I am beginner towards data engineer domain. I can't wait to implement this basic pipeline using tools like spark and airflow. Eagerly waiting for this solution part of given task.😊

  • @shananwar3199
    @shananwar3199 หลายเดือนก่อน +1

    Please make a data engineering project course with atleast 10 end to end projects.

  • @dhainik.suthar
    @dhainik.suthar ปีที่แล้ว +1

    This one is one of the best video on channel. Thank you so much shashank and I am also waiting for your programming implementation of this data pipelines.

  • @ashishshetty6489
    @ashishshetty6489 ปีที่แล้ว +2

    Hi, thank you for the detailed explanation. I was curious to know if you can share some more detailed points before deciding on whether to use Spark or Flink as a processing engine. Since both

  • @saeed-khan-cs
    @saeed-khan-cs ปีที่แล้ว +1

    Simple but wonderful explanation with example. Thanks a lot, for such amazing contents!

  • @manvika
    @manvika ปีที่แล้ว

    We need more of these kinds of series from you Shashank. Great Job!!!! I want to transition to data engineering and want to learn & build basic to complex data pipelines practically. I'm targeting around 1-2 months of time to learn practically.

    • @gojosatoru805
      @gojosatoru805 11 หลายเดือนก่อน

      Have you switched to data engineering field?

  • @seshadrinitesh2566
    @seshadrinitesh2566 ปีที่แล้ว +2

    Hello Shashank Happy Diwali. It's really a great guide I can't wait to implement this basic pipeline using tools like spark and airflow. Eagerly waiting for you to teach the Topics🙂🙂🙂🙂

  • @aviksaha6636
    @aviksaha6636 ปีที่แล้ว +1

    Informative one , I am currently using Control-M for job scheduling

    • @mayurpatil2984
      @mayurpatil2984 ปีที่แล้ว

      Hey avik I am also using control-M for jon scheduling ..can it be helpful in data engineering... Airflow is just like control-M???

  • @khanaffan4833
    @khanaffan4833 ปีที่แล้ว

    ya brother .....more video on this🔥🔥🔥.....infact start making playlist of course on DE basic to pro😅

  • @harivilas2660
    @harivilas2660 ปีที่แล้ว +1

    Keep making such videos, very less resources regarding same

  • @swapnilpande2775
    @swapnilpande2775 ปีที่แล้ว +3

    Where does informatica fits in this?? Why informatica is used in etl?? I am beginner so can you plz tell what is the use of informatica in this entire process you explained.
    Must reply if you read this comment .
    Thanks

  • @sandeepnarwal8782
    @sandeepnarwal8782 6 หลายเดือนก่อน

    One of the best videos on youtube :)

  • @swaragupta7932
    @swaragupta7932 ปีที่แล้ว

    Very good video. Good content. I like your way of giving practical examples.

  • @nayandeshmukh6034
    @nayandeshmukh6034 ปีที่แล้ว +3

    Iam currently frontend developer what step should I follow

  • @jonathanlazarte5975
    @jonathanlazarte5975 ปีที่แล้ว

    I subscribe for the thumbnail hahaha
    Great content!

  • @nayandeshmukh6034
    @nayandeshmukh6034 ปีที่แล้ว +2

    Happy diwali Shashank

  • @rohitshelar2602
    @rohitshelar2602 ปีที่แล้ว +6

    Have enrolled in your Big Data Bootcamp 2.0.Looking forward to a wonderful learn journey with you Shashank 😊.
    Good intro the layman in this domain. Thank you: )

    • @bhagyasree981
      @bhagyasree981 ปีที่แล้ว +1

      Hi how is the course?

    • @rohitshelar2602
      @rohitshelar2602 ปีที่แล้ว

      @@bhagyasree981 Hello! The course is conducted on the weekends, 3hrs per day, and two hours doubt resolution post that. Regarding content, i personally find it very useful coming from non-cs background as all fundamentals are covered from scratch. Shashank is resourceful and positive man; and i believe we get real industry insights owing to his experience at best companies.
      Regards

  • @krushnonjaypatil4684
    @krushnonjaypatil4684 ปีที่แล้ว +2

    Happy Diwali

  • @abhinavtiwari6925
    @abhinavtiwari6925 ปีที่แล้ว +2

    Please make a solution video please

  • @vivekjuwar
    @vivekjuwar ปีที่แล้ว +1

    Very very helpful 👍

  • @kamiluddinahmed3892
    @kamiluddinahmed3892 ปีที่แล้ว

    What a fabulous lecture.

  • @venkateswarareddypagadala3398
    @venkateswarareddypagadala3398 ปีที่แล้ว

    Very good and informative 🙏🙏🙏🙏🙏🙏🙏

  • @varunrithvikgudluru4904
    @varunrithvikgudluru4904 ปีที่แล้ว +1

    Hey Shashank great project idea ....but how to get the data set that changes automatically day by day ???

  • @monicakherajani5840
    @monicakherajani5840 ปีที่แล้ว

    Please make videos on new technologies and work u r currently doing in expedia

    • @sumans420
      @sumans420 ปีที่แล้ว

      Haan, tab jaake Bhai ko notice milegi.

  • @robingujjar7568
    @robingujjar7568 ปีที่แล้ว

    Very helpful👍

  • @akshayraj7743
    @akshayraj7743 ปีที่แล้ว

    Please provide the implementation part in a later video. Thank you

  • @kavipreya9117
    @kavipreya9117 5 หลายเดือนก่อน

    Thanks!

  • @jyothikamatham98
    @jyothikamatham98 ปีที่แล้ว

    Thanks a lot sir

  • @rahulbhardwaj9130
    @rahulbhardwaj9130 ปีที่แล้ว

    Bro How to Get Enrolled in your Bootcamp.
    I am fresher non
    CS background.

  • @Adityaaaar366
    @Adityaaaar366 ปีที่แล้ว

    Gr8 course

  • @soumyaranjandash3597
    @soumyaranjandash3597 ปีที่แล้ว +4

    We want Part - 2

  • @kirankapuriya8160
    @kirankapuriya8160 ปีที่แล้ว

    Hello shashank sir i want to do Cousching of data science kindly tell your institute name

  • @uttamshukla4768
    @uttamshukla4768 ปีที่แล้ว

    sir, can you tell the code for the question given in the video

  • @jofiajoe1680
    @jofiajoe1680 ปีที่แล้ว

    Hello, do you know about Data analytics course provided by Edubridge India ? Are they genuine ?

  • @rocknur
    @rocknur ปีที่แล้ว

    Hi shashank..
    I have enrolled for the big data engineer bootcamp 2.0
    Hoping for a great experience 🙂..

    • @biswaranjanadhikary6589
      @biswaranjanadhikary6589 ปีที่แล้ว

      How is your experience for this course

    • @G-Deepanshukaushik_
      @G-Deepanshukaushik_ ปีที่แล้ว

      how was ur experience with the course bro? how did the journey go ? can u please share?

  • @Gautam_Buddh_Motivation55
    @Gautam_Buddh_Motivation55 ปีที่แล้ว

    Tell me which is best data analyst pay after Placement course? Which is legal or job oriented please tell me

    • @akj3344
      @akj3344 ปีที่แล้ว

      lol

  • @vascanor6085
    @vascanor6085 ปีที่แล้ว

    Best guide for noob like me

  • @Ana-vd1rl
    @Ana-vd1rl ปีที่แล้ว

    Tell me anything where I don't have to do coding but i can earn high🙂🙂

  • @DeepikaAnipini
    @DeepikaAnipini 18 วันที่ผ่านมา

    Has anyone completed the task?

  • @manibaddireddy5477
    @manibaddireddy5477 ปีที่แล้ว

    Is it spark is same as pyspark

    • @hiteshwadhwani629
      @hiteshwadhwani629 ปีที่แล้ว

      In python we use pyspark

    • @manibaddireddy5477
      @manibaddireddy5477 ปีที่แล้ว

      @@hiteshwadhwani629 can I use pyspark instead of spark

    • @ramcan7291
      @ramcan7291 ปีที่แล้ว

      It's the same Spark is the framework which is being run with the help of python language hence called pyspark only spark refers to the one run with scala language

  • @bhojrajjadhav3488
    @bhojrajjadhav3488 ปีที่แล้ว

    *****