These Data Engineering Projects Give You An Unfair Advantage

แชร์
ฝัง
  • เผยแพร่เมื่อ 15 ม.ค. 2025

ความคิดเห็น • 110

  • @DarshilParmar
    @DarshilParmar  ปีที่แล้ว +29

    Going To Upload End-To-End Project soon once I reach 100k📈 Don't forget to Hit that LIKE button and Subscribe if you are here!!!

    • @ashutoshrastogi5381
      @ashutoshrastogi5381 ปีที่แล้ว +1

      Thanks for guiding us, with the simplest approach possible.... 🤩

    • @AkashBiswas-r2l
      @AkashBiswas-r2l ปีที่แล้ว

      101k subscriber, congrats, expecting a new project video

  • @PrathameshMawlankar
    @PrathameshMawlankar ปีที่แล้ว +13

    Thank you for the video. It was essential during these hard times in the tech industry. Have learnt Data Engineering/ETL & Analytics process from your Uber Data GCP video! Can’t thank you enough for making such awesome content for Data domain knowledge.

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว +1

      Glad you found my content helpful Prathamesh

  • @prasanthbugga8381
    @prasanthbugga8381 ปีที่แล้ว +8

    Bought the combo of python and SQL for DE, excited to learn and implement the projects, pls bring one Google Cloud End to End Data Engineering project (ingestion, transformation, loading).

  • @hritikapal683
    @hritikapal683 ปีที่แล้ว +7

    Once again you're here with quality content, loved the way you structured the content this was helpful, waiting for more end to end projects!💫

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว +2

      Thank you Hritika, more to come!

  • @enovateinc4352
    @enovateinc4352 29 วันที่ผ่านมา

    You're the best my friend. Can't wait to join your course.

  • @mobinansarivlog9126
    @mobinansarivlog9126 ปีที่แล้ว +1

    You never disappoint. Great work 👏

  • @adityaraghavendrap
    @adityaraghavendrap ปีที่แล้ว +1

    You are providing tremendous amount of knowledge, keep up the great work. May we all grow together!

  • @mojito1216
    @mojito1216 ปีที่แล้ว +1

    One of the best video 💯❤️

  • @stefantodorovikj6165
    @stefantodorovikj6165 ปีที่แล้ว +1

    You are insane mate , props to you

  • @TechyBuild
    @TechyBuild ปีที่แล้ว +4

    this channel is a blessing to me. thanks you Darshil!

  • @victors9585
    @victors9585 ปีที่แล้ว +1

    You rock, bro!!! 🔥👍🔥👍🔥👍🔥👍🔥 Please don't stop!!! 🙏🙏🙏 Thank you so much for your brilliant content!!! 🙏🙏👍💪🚀🌟

  • @aryamathew2273
    @aryamathew2273 ปีที่แล้ว

    Thanks for the amazing content!

  • @anchalsinha5952
    @anchalsinha5952 ปีที่แล้ว +2

    Currently struggling for a job in DE field but such video motivates me alot to work on more n more project. Thanks for all such insightful contents

  • @sajidhaabdulla5486
    @sajidhaabdulla5486 ปีที่แล้ว +2

    Thankyou so much. This video is just perfect for my situation. I am in my final year and applying to companies. Clearly there are more jobs for freshers for the data analysts and data scientists roles compared to data engineering. I really wish to get a data engineering role itself. Any advices? Btw your videos are really guiding me from long. Please keep going. Thankuu

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Try to do cloud certifications and build projects, that's the best way!

  • @aalamaram7680
    @aalamaram7680 ปีที่แล้ว +1

    Thanks for this video .❤🤝💯

  • @teamxipratikop9247
    @teamxipratikop9247 9 หลายเดือนก่อน

    Really very good content.loved it.only knowledgeable talks no timepass at all in video thanks

  • @gunjankothari7471
    @gunjankothari7471 ปีที่แล้ว +1

    U just set level high for content of data engineering field to others.
    Very gud step step by guide to build projects. 👍👍👍

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว +1

      Glad you found my content helpful

  • @TomasMorales-d7r
    @TomasMorales-d7r 11 หลายเดือนก่อน

    love you bro thanks a lot!!!

    • @DarshilParmar
      @DarshilParmar  11 หลายเดือนก่อน

      You're welcome!

  • @prateekdaniels
    @prateekdaniels ปีที่แล้ว +1

    Thanks for supporting the community. Keep up the good work.

  • @padmalochan1103
    @padmalochan1103 ปีที่แล้ว +1

    Thanks brother for this amazing video❤🎉

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      You are welcome

    • @padmalochan1103
      @padmalochan1103 ปีที่แล้ว

      Please make a video on clearing the coding round,and how to prepair for that🙏

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      I have a video on this, please check here - th-cam.com/video/gAk9m_d27yk/w-d-xo.html

  • @rohitkharat2610
    @rohitkharat2610 ปีที่แล้ว

    Thank you Darshil bhai!

  • @nikhil1303
    @nikhil1303 9 หลายเดือนก่อน

    I really appreciate the content in this video, especially as someone who's starting in data engineering.

  • @vinayakjaiswal9976
    @vinayakjaiswal9976 ปีที่แล้ว +1

    Can you please also make a video on behaviour questions they ask in the interview?

  • @shivarajhalageri2513
    @shivarajhalageri2513 ปีที่แล้ว +1

    Loved it ❤

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Thank you

    • @shivarajhalageri2513
      @shivarajhalageri2513 ปีที่แล้ว

      @@DarshilParmar Wanted to ask can we represent our experience in other domain as data engineering experience in resume while transitioning into data engineering?

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Yes, you can!

    • @shivarajhalageri2513
      @shivarajhalageri2513 ปีที่แล้ว

      @@DarshilParmar Thanks!

  • @adityalakkad8795
    @adityalakkad8795 ปีที่แล้ว +1

    Hey Darshil, First of all fantastic video, So many of these projects use cloud tools, we can use that once but can not keep it active as it will cost money and we are students :) , so my question is how we should present this projects in our portfolio.

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว +1

      Put it on GitHub with script, architecture and other things that needed for project and add link in resume

  • @sohamshah4666
    @sohamshah4666 ปีที่แล้ว

    This 28 mins of video are worth it and helpful ❤🙌🏻🤝🏻

  • @priyankkumar89
    @priyankkumar89 ปีที่แล้ว

    Hi Darshil, amazing guidance, amazing work and amazing contribution to the society. Bless you. You come up as a person, who's like DK Goel or T S Grewal for accountancy students, whosoever starts his/her journey with accountancy, cannot simply go without these 2 authors (accountancy students will relate with me). Anyone stepping-in in DE domain, cannot simply go without doing your projects.
    Please let me know, whatever projects we make, how can we show them to the recruiters during interview. Like, when I used to give interviews for Power BI role, I used to show them the dashboards, either published on my portfolio website or any other way. So what about DE work. Also, same question for any SQL or python/pandas project.
    Thanks.

  • @Thinurihewakoon
    @Thinurihewakoon 8 หลายเดือนก่อน

    Thankuuu ❤

  • @deb1995
    @deb1995 ปีที่แล้ว

    Hi darshil pls make a full series on online data base to data engineering project.

  • @xx-pn7it
    @xx-pn7it ปีที่แล้ว +2

    Bhaiya data engineering ka internship ka roadmap bnao taki internship le sake Or use agee Or sekh sake

  • @fbravoc9748
    @fbravoc9748 10 หลายเดือนก่อน

    In which course do you think this ? The sql or the python ?

  • @wardaraees4887
    @wardaraees4887 ปีที่แล้ว

    Where are your courses you mentioned in the video?

  • @akshaymuktiramrodge3233
    @akshaymuktiramrodge3233 ปีที่แล้ว

    Hi Darshil thank you for this quality content really appreciate your work
    .... Can you please mention aws services required for data engineering??

  • @wiss1998
    @wiss1998 ปีที่แล้ว

    waiting for more GCP and DBT end to end projects! 💫

  • @WonderGurl
    @WonderGurl 8 หลายเดือนก่อน

    Make video on data analytics project

  • @vinayakjaiswal9976
    @vinayakjaiswal9976 ปีที่แล้ว +1

    Hey darshil , are questions of linked list , stack , queue , array and string along with some approaches like dynamic programming, greedy enough to clear coding round?

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      I have a video on this, please check here - th-cam.com/video/gAk9m_d27yk/w-d-xo.html

  • @avinash7003
    @avinash7003 ปีที่แล้ว

    Airflow is important ? can you explain more about it?

  • @zouhair8161
    @zouhair8161 ปีที่แล้ว +1

    Thanks you

  • @raghuls1030
    @raghuls1030 8 หลายเดือนก่อน

    The projects that u mentioned are from free tier right or is it to be paid for the services while building following projects

  • @cOnfidentialcOrp
    @cOnfidentialcOrp ปีที่แล้ว

    The title feels a little misleading since the video is technically about how "Data Engineering works in depth" vs "data engineering projects"
    Regardless , its still a good video

  • @prasadmuthyala9625
    @prasadmuthyala9625 3 หลายเดือนก่อน

    I have 2.7 years of experience in Salesforce development and I learn data engineering by myself. Added 1 years experience in DE in resume with snowflake, PySpark, aws, postgresql related projects. How is the market now in India is it good time to shift to another company.???

  • @sharathreddy6423
    @sharathreddy6423 ปีที่แล้ว

    teaching is extremely Superb ... can u please share the Pdf or ppt for reference

  • @sumit4agrawal
    @sumit4agrawal 11 หลายเดือนก่อน

    Hi Darshil, hope you are doing well.May I know, what skills are crucial for azure data engineer role and how long does it take to learn them, roadmap to follow? Another question, as a data engineer, do I need to learn data modelling, designing fact and dimension table,snowflake etc.

  • @prathittijare2825
    @prathittijare2825 ปีที่แล้ว +1

    Please share Data Analytics Project for Data Analyst Job(( for Beginners) ( using SQL, Power BI, Excel)

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Check the link in the description, you'll find many

  • @Aditya..............
    @Aditya.............. ปีที่แล้ว +1

    Hello Sir, Sir these Cloud Services requires credit card. I tried with paytm debit card but was not able to make it... is there any other alternatives for the cloud services??

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว +1

      You can use your local pc and install the same things there

  • @iktrn794
    @iktrn794 ปีที่แล้ว

    thank you mr. Darshil for this amazing video! just one question though, in the last section which is building ETL project using AWS, what's the point of using Amazon S3 here? let's say we loaded the data already and is available on the RDS, can we just use that data as our source for Glue tasks without having to load them onto S3 first? thanks!

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Yes you can as this is single source but in real world you’ll mostly have multiple sources so S3 can act as a centralised source (datalake)

    • @iktrn794
      @iktrn794 ปีที่แล้ว

      @@DarshilParmarah I see that makes sense. thanks a lot! appreciate it

  • @JustBigdata
    @JustBigdata ปีที่แล้ว

    These are conceptual projects. I don’t see how creating the most general ETL pipeline gives me “unfair advantage “ . These projects may help a fresher but not anyone who have had some experience in industry

  • @sanketkumar01
    @sanketkumar01 ปีที่แล้ว

    Mere Pass 3 CSv file thi maine python ki help se mysql me ek database create kr diya.. kya ye data model process bss itni hi thi ??

  • @samipdave1589
    @samipdave1589 3 หลายเดือนก่อน

    Hello brother ,
    way of your explaining is amazing and i am looking forward to enrolling for the course but just have one confusion i am from non-IT field and don't know lanuages so is it ok for me to go with this and can learn this skills ?

    • @DarshilParmar
      @DarshilParmar  3 หลายเดือนก่อน +1

      Yes, you will learn Python in the course only

    • @samipdave1589
      @samipdave1589 3 หลายเดือนก่อน

      ok thanx for the reply

  • @kratos_gow610
    @kratos_gow610 ปีที่แล้ว

    Isn't dimension modeling about determining the fields which are to be part of the ETL/ELT pipeline? Do correct me if I am wrong.

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Yes, it is, more of an iterative approach, it keeps changing but this is a portfolio project so might be one time thing here

    • @kratos_gow610
      @kratos_gow610 ปีที่แล้ว

      @@DarshilParmar thanks

  • @niranjankashyap5452
    @niranjankashyap5452 11 หลายเดือนก่อน

    Bro make a video on how to set up Python for pyspark in Pycharm IDE on mac and windows.

  • @shinghinlee7401
    @shinghinlee7401 ปีที่แล้ว

    @DarshilParmar
    Thank you for the video! Just want to have some advises from you. As I come from a computer engineering background, is it necessary to have a master degree to become a data engineer?

  • @MOHDAKRAM21543
    @MOHDAKRAM21543 ปีที่แล้ว +1

    Best TH-cam channel to learn python for data engineering?

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Check out my course, it’s one of the best designed for data engineering

  • @TechyBuild
    @TechyBuild ปีที่แล้ว

    i noticed that, you didnt design a data model on the Uber data anallytics end - to - end. you only designed a dimensional model.

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Yes, I mentioned that in video also

  • @AMI_1111
    @AMI_1111 ปีที่แล้ว

    Hiii...I am from a Nontech background and I want to become a data engineer, ik that for non tech ppl data analyst is the first step, there are so many resources for SQL, python n all...I am literally confused that where should I learn as I will always feel like whether I am in the right direction or no ..or whether I am referring good resources? These are the doubts that come to my mind, so can you please help Nontech ppl to switch in tech and which resources to refer

  • @adityakalwar267
    @adityakalwar267 ปีที่แล้ว

    Hi Darshil ,
    I am working in different domain need to transit in data engineering but i don't have prior experience in data engineering currently working as consultant and have done my MCA from NIT raipur 2023 will i get interview call if i do some of the projects after doing your projects?
    I mean will it be difficult or usually people get transit into data engineerin

  • @amankhandelwal8293
    @amankhandelwal8293 ปีที่แล้ว

    Hi Darshil, Can I tell this in my 4 years experience data engineer interview?

  • @orlandocastellanos9263
    @orlandocastellanos9263 ปีที่แล้ว

    Gcp?

  • @dhanasekarank1743
    @dhanasekarank1743 ปีที่แล้ว

    Hai Bro,
    Please help me with the below requirement.
    To read data from S3, perform transformations using the Medallion architecture, and load the transformed data into Amazon Redshift using dbt.

  • @471gohil3
    @471gohil3 ปีที่แล้ว

    Are you from gujarati Medium i m also from gujarati medium. How do you learn from efficiently. We are from same school

  • @urvpatel2003
    @urvpatel2003 ปีที่แล้ว

    Is there any College degree required to earn money from upwork and fiverr?

  • @tokyochannel5684
    @tokyochannel5684 ปีที่แล้ว +1

  • @Bhavanikotta-s7h
    @Bhavanikotta-s7h ปีที่แล้ว

    I have paid 1299 for data engineer with python but you didn't give access to course

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว

      Hi,
      Please email me at info@datawithdarshil.com

  • @patricia19800
    @patricia19800 หลายเดือนก่อน

    Please put translate for portuguese too..i dont speak english but i need learning

  • @Bhavanikotta-s7h
    @Bhavanikotta-s7h ปีที่แล้ว

    I have dropped email as well you didn't rply

  • @darshilarsey1937
    @darshilarsey1937 ปีที่แล้ว

    Hi Bhai maira naam bhi darshil hai

  • @New_rocstar
    @New_rocstar ปีที่แล้ว +2

    I actually thought you were gonna create a project and explain it through a practical example. Disappointed here

    • @DarshilParmar
      @DarshilParmar  ปีที่แล้ว +3

      Check description and you’ll find 8 of them

    • @elkinhuertas2137
      @elkinhuertas2137 11 หลายเดือนก่อน

      Ungrateful fck.

  • @the_gamer2416
    @the_gamer2416 7 หลายเดือนก่อน

    Bhai tujhe hindi m bolne m koi prblm h ..

    • @DarshilParmar
      @DarshilParmar  7 หลายเดือนก่อน +2

      nahi par mera audiance 60% international hai toh english me bolta hu aur mera hindi Mumbai wala tapori jaisa hai
      Aur data engineering me ho toh English aana important hai kyu ki sari cheeze english me he hai

    • @the_gamer2416
      @the_gamer2416 7 หลายเดือนก่อน

      @@DarshilParmar bhai ek humble request h.. Hindi m bhi video bna loo.. Mujhe english m starting m samjhne m problem hota h.. Aur tapori type lang chalega koi dikkat nhi h.. M bhi delhi se hu.. Yaha pr sab chalta h