วีดีโอ

I saw the failed message again, but then I checked and the database had been restored. Thanks!

The scheduler does not appear to be running. Last heartbeat was received 32 minutes ago. The DAGs list may not update, and new tasks will not be scheduled.I have followed all commands you mentioned but i was getting like this in my airflow user interface and the command prompt which i connected to ec2 was running airflow standalone where to run new commands so that i can run airflow scheduler ? pls reply

I´m getting this error when execute airflow standalone ModuleNotFoundError: No module named 'tenacity.asyncio'

amazing bro thanhs

After 7 hours trying to connect my instance, you really help me!

which app did you use to create the data pipeline visualization?

i'm still a bit confused, so is the AWS can be used freely, sir?🙏

Really helpful video!

Explanatory!

Very detailed!

Really helpful video!

Really helpful video!

Was a really helpful Bootcamp! 👏💯

Really helpful video!

Really helpful information!

Hi, Thanks for the video. It definitely solved my confusion points but still I have one doubt. Why airflow ? I mean we could've used the lambda for that work too right?

Excellent Tutorial

Thank you very much for making the concepts so easy to understand👌

I am getting following error while creating a virtual environment. E: Unable to locate package python3.11.9-venv E: Couldn't find any package by glob 'python3.11.9-venv' If anyone can help then it would be great!!

You are superb brother..

Please make a video on self Join

Thank u sooo much. It helped

Really great content! I just have one question, at 26:40, the part where you checked the Inbound Rules of VPC Security Group for the Redshift Cluster, is it standard practice to allow all inbound traffic and all IPv4 (Type = All traffic, Source=0.0.0.0/0)? AWS kept showing the warning to limit inbound traffic to only known IP, so I tried to set Inbound Rules to MyIP or the Public IP address of the EC2 instance I'm using to run Airflow, but for some reason step 4 failed to work when I do so (it worked fine if I follow the setting in your video for the inbound rule). Hope to hear your thoughts on this

The best ETL video I have ever come across. Thank you sir ❤‍🔥❤‍🔥❤‍🔥💯💯

Absolutely wonderful tutorial, thank you for the great content man! I learned a ton from your videos and now subscribed from your channel

i get my load_data task failed i configured everything right but still get failed for the last task i couldnt figure it out anyone with the same scenario got any soln?

This is just what I have been searching for, thank you good sir, please kindly post more videos, you are awesome

te quiero mucho :D estos videos siempre son la respuesta

Solution to ODBC Error: Go to the security group of the Redshift cluster, click the box for the security group and edit inbound rules, Port range => 5439, source => Ipv4 Everywhere, save

Thanks alot for this video, I learnt alot from it

Amazing content!! My friend 🙌🙌

Excellent information, thank you so much for posting this video here

If you have problems with installing dependencies it is because instead of sudo apt install3.10-venv, replate it to sudo apt install3-venv to get the latest version. Currently, it's at 3.12

While setting up the crawlers you said we will set up the frequency in airflow but in airflow we are not doing anything related to Glue crawler. Can you please suggest how to automate the glue crawlers ? Also When we are creating crawler and fetching data in Athena it is not showing the data correctly. You can check the timeline 1:01:07. Wrong values are populated in longitude, Gender etc. Can you please have a look ?

Thank you very much for creating this project. I followed all 3 videos from this series and learnt a lot. Thank you!

What can you do when it say failed instead of completed?

Since I’m a mech engineer coding is almost like mandarin to me but u sir the Great explanation 🙏🏻🔥🫡🫡 really loved it n totally understood ❤❤

I got the solution for 1:05:00 , In the code Just use aws_default connection, our EC2 already has Role access to our s3 buckets. aws_conn_id='aws_default' This worked perfectly

Great sessions!

nice demo man

Hi are you working with browse job in Bangalore. The guy who is teaching here , told you will be joining their team to teach us, is this true?

yay, i managed to finish it! and i have the csv file in s3. thx, u deserve the like lol.

1:38:20 - i dont get why do i need aws configure INSIDE my ec2? why do i need access key when i m already inside my ec2?

Please stop saying OK.

Awesome Tutorial. Helped me a lot. Thank you..!!

Hello, you are the best Data Engineering Instructor here on TH-cam. I want to continue learning on your end to end project unfortunately I am having a problemin in initiating airflow. scheduler | [2024-05-05 04:41:04 +0000] [3014] [INFO] Booting worker with pid: 3014 scheduler | [2024-05-05T04:41:04.168+0000] {settings.py:60} INFO - Configured default timezone UTC scheduler | [2024-05-05 04:41:04 +0000] [3016] [INFO] Booting worker with pid: 3016 scheduler | [2024-05-05T04:41:04.405+0000] {manager.py:393} WARNING - Because we cannot use more than 1 thread (parsing_processes = 2) when using sqlite. So we set parallelism to 1. this is the error came from my terminal. Hope you can assist me sir. Thank you and more power

dont ask for likes, i will only like if i can finish and add this to my resume

Thanks man!

Thanks for everything 💖 i have question if i add some data into csv they will automatically updated in power bi ?