Check out my new Udemy complete MLOps Course with 10+ end to end ML Projects: www.udemy.com/course/complete-mlops-bootcamp-with-10-end-to-end-ml-projects/?couponCode=SHARING
what I would have preferred to see is how you configured it to work with local files rather than calling an external api. since I posted this comment, I have now solved the problem myself. the short of it is to use astro's docker-compose.overrride.yml file to mount your local drives so it can communicate with the local directories
Krish Sir you really bring very good course, please include kubernetes. Also which tablet and software you use to write and explain sir. Love the way you teach. Kindly answer🙏
Thank you for such a nice video. It was really informative. I want to understand from the multiple pods which are coming up, if I want to run the worker node in AKS then what all chants are required and the process ?
I got the point it's base one but I have some senerios to thinnk about -> What is Retry mechanism if any of the step fails -> If we have a senerio where a large data should be loaded then from one DB to another then how to resume from a point we left of, for example there are 50k records to be loaded from one loc to another then and process broke at 25k then it should resume when next time it runs instead of running 50k from point 0
Your Voice Was Breaking in the Video due to a Connectivity issue in your end...Does this happen in any-part of your Udemy Video's too...Planning to Buy the Data Science Course on Udemy
hey krish please add production level project in your paid course (399) ... how we are suppose to know working process at industry lvl ... just 1 project please
Env file ".env" found. Loading... [+] Running 3/4 - Container 20241028-etl-weather_43a1dc-postgres-1 Starting 1.2s - Container 20241028-etl-weather_43a1dc-triggerer-1 Recreated 0.4s - Container 20241028-etl-weather_43a1dc-scheduler-1 Recreated 0.5s - Container 20241028-etl-weather_43a1dc-webserver-1 Recreated 0.4s Error: error building, (re)creating or starting project containers: Error response from daemon: Ports are not available: exposing port TCP 127.0.0.1:5432 -> 0.0.0.0:0: listen tcp 127.0.0.1:5432: bind: An attempt was made to access a socket in a way forbidden by its access permissions. i am getting this error when running astro dev start
Hello sir , Actually i want to buy your Udemy course of DATA ANALYST , But the price is currently high , so can you please provide me a Udemy coupon for this course then it will be really helpful sir 🥺🥺
Check out my new Udemy complete MLOps Course with 10+ end to end ML Projects:
www.udemy.com/course/complete-mlops-bootcamp-with-10-end-to-end-ml-projects/?couponCode=SHARING
sir, we need new udemy coupon for ' DSA bootcamp + Leetcode Exercise ' . please sir ! do it quickly.🙏
Realizing the Power of Airflow 😎 this video help me have high level understanding of what i was doing from last 3 years
It's very straightforward and helpful! Thank you!
when will be big data engineer cource we can expect krish sir
It's Etl , etl can be done though power query and load it to postgre sql .
It's Etl , etl can be done though power query and load it to postgre sql .
Awesome. How is airflow different in comparison to Microsoft fabric
very insightful !! thanks for the effort !
what I would have preferred to see is how you configured it to work with local files rather than calling an external api.
since I posted this comment, I have now solved the problem myself.
the short of it is to use astro's docker-compose.overrride.yml file to mount your local drives so it can communicate with the local directories
Hi krish,
How many videos you will upload on this series ?
Sir talk about Kubernetes please
Krish Sir you really bring very good course, please include kubernetes. Also which tablet and software you use to write and explain sir. Love the way you teach. Kindly answer🙏
What tools are you using for the video?
Krish! This is amazing!!! Please is there any way Apache Airflow can be connected with k8
hey krish! thank you so much for this helping video. Can we use this build this using aws free tier account?
Top content, Classic!
Sir for your mlops course do we also need to have aws subscription to do project work or is it not needed we can do something in free tiwr
U can do in aws free tier
@@krishnaik06sir the AWS Environment set-up is giving some errors, i have tried various fixes
@@harshsinha12 i have taken of my friend
Running Dockers and airflow in local windows? It needs Linux environment right?
Need more etl tools using project
Hi Sir, can you please add projects on Market mix modelling?
Please add more Videos on Data Engineering
Amazing sir 👏👏
Can the pipeline still run when i turn off my laptop ?
hey Krish please add production-level project in your paid course (399) ... there were only basic project
Thank you for such a nice video. It was really informative. I want to understand from the multiple pods which are coming up, if I want to run the worker node in AKS then what all chants are required and the process ?
I got the point it's base one but I have some senerios to thinnk about
-> What is Retry mechanism if any of the step fails
-> If we have a senerio where a large data should be loaded then from one DB to another then how to resume from a point we left of, for example there are 50k records to be loaded from one loc to another then and process broke at 25k then it should resume when next time it runs instead of running 50k from point 0
Thanks for this course! Can you create a Jarvis using Python+AI?
Thanks bhai you listen to me
Great work..
hey krish please add production level project in your paid course (399) ...
Hello Krish,
create a end to end data science project which should involve ETL steps as well with airflow and also deployment
Sir machin learning ka paid cours kaise join kare kaise sir please guide me
Your Voice Was Breaking in the Video due to a Connectivity issue in your end...Does this happen in any-part of your Udemy Video's too...Planning to Buy the Data Science Course on Udemy
U can get it all the videos are recorded properly
@@krishnaik06 Thanks a Lot Krish Sir
Great ContentSir,will it be the part of data engineering course,and when is it available?
yes a;ready started big data engineering course recording
@@krishnaik06sir when it will launch?
Sir pls provide full DATA science course from beginner to advance level on udemy sir
hey krish please add production level project in your paid course (399) ... how we are suppose to know working process at industry lvl ... just 1 project please
Hindi video sir airflow 🙏🙏🙏
📌ONE VIDEO ON KAFKA ALSOOOOO
S missing in using word
sir please upload some more tools in udemy course
yes brother kubernetes will also get added
@@krishnaik06 sir i want to learn feature store also from you . please sir
Krish sir, is this available on MLOps course ??
yes many projects have been uploaded there :)
sir hindi video please
Env file ".env" found. Loading...
[+] Running 3/4
- Container 20241028-etl-weather_43a1dc-postgres-1 Starting 1.2s
- Container 20241028-etl-weather_43a1dc-triggerer-1 Recreated 0.4s
- Container 20241028-etl-weather_43a1dc-scheduler-1 Recreated 0.5s
- Container 20241028-etl-weather_43a1dc-webserver-1 Recreated 0.4s
Error: error building, (re)creating or starting project containers: Error response from daemon: Ports are not available: exposing port TCP 127.0.0.1:5432 -> 0.0.0.0:0: listen tcp 127.0.0.1:5432: bind: An attempt was made to access a socket in a way forbidden by its access permissions.
i am getting this error when running astro dev start
go to services and turn off you postgress service. or see if any other image is using that port
Hello sir , Actually i want to buy your Udemy course of DATA ANALYST , But the price is currently high , so can you please provide me a Udemy coupon for this course then it will be really helpful sir 🥺🥺
First comment