These Data Engineering Projects Give You An Unfair Advantage
ฝัง
- เผยแพร่เมื่อ 4 พ.ย. 2023
- Join My Data Engineering Course Here: datavidhya.com/courses
Learn to build an amazing data engineering project for your resume and get a job, having a good project is key to getting interview calls for data engineering, in this video, I will give you a step-by-step guide on how to build an amazing data engineering project.
Join DataVidhya Community & Connect with Like-Minded People - courses.datavidhya.com/
🚀 Beginner Projects To Get Started 🚀
1. Building Data Model and Writing ETL Job - • Data Engineering Proje...
2. ETL Pipeline on AWS Cloud - • Data Engineering Proje...
3. TH-cam Data Analysis (End-To-End Data Engineering Project) - • TH-cam Data Analysis ...
4. Twitter Data Pipeline using Airflow - • Twitter Data Pipeline ...
5. Stock Market Real-Time Data Analysis using Kafka, AWS, and Python - • 📈 Stock Market Real-Ti...
6. Olympic Data Analytics | Azure End-To-End Data Engineering Project - • Olympic Data Analytics...
👦🏻 My Linkedin - / darshil-parmar
📷 Instagram - / datawithdarshil
🎯Twitter - / parmardarshil07
🌟 Please leave a LIKE ❤️ and SUBSCRIBE for more AMAZING content! 🌟
3 Books You Should Read
📈Principles: Life and Work: amzn.to/3HQJDyP
👀Deep Work: amzn.to/3IParkk
💼Rework: amzn.to/3HW981O
Tech I use every day
💻MacBook Pro M1: amzn.to/3CiFVwC
📺LG 22 Inch Monitor: amzn.to/3zk0Dts
🎥Sony ZV1: amzn.to/3hRpSMJ
🎙Maono AU-A04: amzn.to/3Bnu53n
⽴Tripod Stand: amzn.to/3tA7hu7
🔅Osaka Ring Light and Stand: amzn.to/3MtLAEG
🎧Sony WH-1000XM4 Headphone: amzn.to/3sM4sXS
🖱Zebronics Zeb-War Keyboard and Mouse: amzn.to/3zeF1yq
💺CELLBELL C104 Office Chair: amzn.to/3IRpiL2
👉Data Engineering Complete Roadmap: • Data Engineer Complete...
👉Data Engineering Project Series: • Data Engineering Proje...
👉Become Full-Time Freelancer: • Best Freelancer Series...
👉Data With Darshil Podcast: • Podcast Series - Data ...
✨ Tags ✨
✨ Hashtags ✨
#dataengineering #aws #project
Going To Upload End-To-End Project soon once I reach 100k📈 Don't forget to Hit that LIKE button and Subscribe if you are here!!!
Thanks for guiding us, with the simplest approach possible.... 🤩
101k subscriber, congrats, expecting a new project video
You are providing tremendous amount of knowledge, keep up the great work. May we all grow together!
Bought the combo of python and SQL for DE, excited to learn and implement the projects, pls bring one Google Cloud End to End Data Engineering project (ingestion, transformation, loading).
Thank you for the video. It was essential during these hard times in the tech industry. Have learnt Data Engineering/ETL & Analytics process from your Uber Data GCP video! Can’t thank you enough for making such awesome content for Data domain knowledge.
Glad you found my content helpful Prathamesh
Once again you're here with quality content, loved the way you structured the content this was helpful, waiting for more end to end projects!💫
Thank you Hritika, more to come!
Hi Darshil, amazing guidance, amazing work and amazing contribution to the society. Bless you. You come up as a person, who's like DK Goel or T S Grewal for accountancy students, whosoever starts his/her journey with accountancy, cannot simply go without these 2 authors (accountancy students will relate with me). Anyone stepping-in in DE domain, cannot simply go without doing your projects.
Please let me know, whatever projects we make, how can we show them to the recruiters during interview. Like, when I used to give interviews for Power BI role, I used to show them the dashboards, either published on my portfolio website or any other way. So what about DE work. Also, same question for any SQL or python/pandas project.
Thanks.
You never disappoint. Great work 👏
Really very good content.loved it.only knowledgeable talks no timepass at all in video thanks
Thanks for the amazing content!
U just set level high for content of data engineering field to others.
Very gud step step by guide to build projects. 👍👍👍
Glad you found my content helpful
One of the best video 💯❤️
this channel is a blessing to me. thanks you Darshil!
This 28 mins of video are worth it and helpful ❤🙌🏻🤝🏻
You rock, bro!!! 🔥👍🔥👍🔥👍🔥👍🔥 Please don't stop!!! 🙏🙏🙏 Thank you so much for your brilliant content!!! 🙏🙏👍💪🚀🌟
More to come!
Thanks for supporting the community. Keep up the good work.
Thank you too
Can you please also make a video on behaviour questions they ask in the interview?
Hi Darshil thank you for this quality content really appreciate your work
.... Can you please mention aws services required for data engineering??
You are insane mate , props to you
Thanks man! Appreciate it
Thank you Darshil bhai!
Thankyou so much. This video is just perfect for my situation. I am in my final year and applying to companies. Clearly there are more jobs for freshers for the data analysts and data scientists roles compared to data engineering. I really wish to get a data engineering role itself. Any advices? Btw your videos are really guiding me from long. Please keep going. Thankuu
Try to do cloud certifications and build projects, that's the best way!
I really appreciate the content in this video, especially as someone who's starting in data engineering.
Currently struggling for a job in DE field but such video motivates me alot to work on more n more project. Thanks for all such insightful contents
All the best
Hey Darshil, First of all fantastic video, So many of these projects use cloud tools, we can use that once but can not keep it active as it will cost money and we are students :) , so my question is how we should present this projects in our portfolio.
Put it on GitHub with script, architecture and other things that needed for project and add link in resume
Hey darshil , are questions of linked list , stack , queue , array and string along with some approaches like dynamic programming, greedy enough to clear coding round?
I have a video on this, please check here - th-cam.com/video/gAk9m_d27yk/w-d-xo.html
Hi Darshil, hope you are doing well.May I know, what skills are crucial for azure data engineer role and how long does it take to learn them, roadmap to follow? Another question, as a data engineer, do I need to learn data modelling, designing fact and dimension table,snowflake etc.
@DarshilParmar
Thank you for the video! Just want to have some advises from you. As I come from a computer engineering background, is it necessary to have a master degree to become a data engineer?
Hi darshil pls make a full series on online data base to data engineering project.
love you bro thanks a lot!!!
You're welcome!
thank you mr. Darshil for this amazing video! just one question though, in the last section which is building ETL project using AWS, what's the point of using Amazon S3 here? let's say we loaded the data already and is available on the RDS, can we just use that data as our source for Glue tasks without having to load them onto S3 first? thanks!
Yes you can as this is single source but in real world you’ll mostly have multiple sources so S3 can act as a centralised source (datalake)
@@DarshilParmarah I see that makes sense. thanks a lot! appreciate it
Hai Bro,
Please help me with the below requirement.
To read data from S3, perform transformations using the Medallion architecture, and load the transformed data into Amazon Redshift using dbt.
Thanks for this video .❤🤝💯
You are welcome
teaching is extremely Superb ... can u please share the Pdf or ppt for reference
waiting for more GCP and DBT end to end projects! 💫
Airflow is important ? can you explain more about it?
Thanks brother for this amazing video❤🎉
You are welcome
Please make a video on clearing the coding round,and how to prepair for that🙏
I have a video on this, please check here - th-cam.com/video/gAk9m_d27yk/w-d-xo.html
Bro make a video on how to set up Python for pyspark in Pycharm IDE on mac and windows.
Hi Darshil ,
I am working in different domain need to transit in data engineering but i don't have prior experience in data engineering currently working as consultant and have done my MCA from NIT raipur 2023 will i get interview call if i do some of the projects after doing your projects?
I mean will it be difficult or usually people get transit into data engineerin
In which course do you think this ? The sql or the python ?
Thankuuu ❤
Isn't dimension modeling about determining the fields which are to be part of the ETL/ELT pipeline? Do correct me if I am wrong.
Yes, it is, more of an iterative approach, it keeps changing but this is a portfolio project so might be one time thing here
@@DarshilParmar thanks
The projects that u mentioned are from free tier right or is it to be paid for the services while building following projects
It's free
Mere Pass 3 CSv file thi maine python ki help se mysql me ek database create kr diya.. kya ye data model process bss itni hi thi ??
Hiii...I am from a Nontech background and I want to become a data engineer, ik that for non tech ppl data analyst is the first step, there are so many resources for SQL, python n all...I am literally confused that where should I learn as I will always feel like whether I am in the right direction or no ..or whether I am referring good resources? These are the doubts that come to my mind, so can you please help Nontech ppl to switch in tech and which resources to refer
Hello Sir, Sir these Cloud Services requires credit card. I tried with paytm debit card but was not able to make it... is there any other alternatives for the cloud services??
You can use your local pc and install the same things there
Make video on data analytics project
Loved it ❤
Thank you
@@DarshilParmar Wanted to ask can we represent our experience in other domain as data engineering experience in resume while transitioning into data engineering?
Yes, you can!
@@DarshilParmar Thanks!
Please share Data Analytics Project for Data Analyst Job(( for Beginners) ( using SQL, Power BI, Excel)
Check the link in the description, you'll find many
Where are your courses you mentioned in the video?
Check description
Are you from gujarati Medium i m also from gujarati medium. How do you learn from efficiently. We are from same school
Hi Darshil, Can I tell this in my 4 years experience data engineer interview?
Yes
Bhaiya data engineering ka internship ka roadmap bnao taki internship le sake Or use agee Or sekh sake
i noticed that, you didnt design a data model on the Uber data anallytics end - to - end. you only designed a dimensional model.
Yes, I mentioned that in video also
Is there any College degree required to earn money from upwork and fiverr?
The title feels a little misleading since the video is technically about how "Data Engineering works in depth" vs "data engineering projects"
Regardless , its still a good video
These are conceptual projects. I don’t see how creating the most general ETL pipeline gives me “unfair advantage “ . These projects may help a fresher but not anyone who have had some experience in industry
Gcp?
Thanks you
You are welcome
❤
Best TH-cam channel to learn python for data engineering?
Check out my course, it’s one of the best designed for data engineering
I have paid 1299 for data engineer with python but you didn't give access to course
Hi,
Please email me at info@datawithdarshil.com
Hi Bhai maira naam bhi darshil hai
I have dropped email as well you didn't rply
Gave you reply, please check
I actually thought you were gonna create a project and explain it through a practical example. Disappointed here
Check description and you’ll find 8 of them
Ungrateful fck.
Bhai tujhe hindi m bolne m koi prblm h ..
nahi par mera audiance 60% international hai toh english me bolta hu aur mera hindi Mumbai wala tapori jaisa hai
Aur data engineering me ho toh English aana important hai kyu ki sari cheeze english me he hai
@@DarshilParmar bhai ek humble request h.. Hindi m bhi video bna loo.. Mujhe english m starting m samjhne m problem hota h.. Aur tapori type lang chalega koi dikkat nhi h.. M bhi delhi se hu.. Yaha pr sab chalta h