if your're stucked in docker-compose up airflow-init mysql-not-healthy. try changing the healthcheck script of mysql service as described here github.com/maxcotec/Apache-Airflow/issues/2#issuecomment-1321010233
Can you help me to know how to install a Python package into the docker on Windows? I am working with dags on airflow and I need to use the pymongo library.
You can create another Dockerfile that inherits from base airflow image, and add additional py packages, and use this custom image. Part of this will be covered in next video, where I'll show how you easily deploy, manage and version control dags in production environment.
@@maxcoteclearning Thank you so much. Looking foward to your next videos. I am having a problem with the adding additonal py packages. I have just worked with Py and Docker for few days.😅
after installing, it should run on command prompt by just typing `docker`. If not, please follow some good related guide on internet. e.g. this; www.simplilearn.com/tutorials/docker-tutorial/install-docker-on-windows
Could you explain more on this error plz ? Could be docker memory problem. Before running docker-compose, make sure you have enough memory allocated to Docker Host machine. read more about this at maxcotec.com/blog/apache-airflow-2-docker-beginners-guide/
PS C:\Users\verma\airflow> docker compose up airflow-init error during connect: this error may indicate that the docker daemon is not running: Get "%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/containers/json?all=1&filters=%7B%22label%22%3A%7B%22com.docker.compose.project%3Dairflow%22%3Atrue%7D%7D": open //./pipe/docker_engine: The system cannot find the file specified. Any thoughts?
if your're stucked in docker-compose up airflow-init mysql-not-healthy. try changing the healthcheck script of mysql service as described here github.com/maxcotec/Apache-Airflow/issues/2#issuecomment-1321010233
The Visual Studio cursor animations when you indent and remove code are awesome lol never seen that before
Love this bro keep it up
Great video ! Keep it up ! :)
Thankyou @Thomasz
gracias!
Airflow is overwhelming. Thanks for the tutorial though.
Glad you like it :). Thanks for your support.
Thank you!!! Can i create a alert to tell when a specific DAG is paused?
I don't believe there is any callback for this in airflow. check here
airflow.apache.org/docs/apache-airflow/2.2.1/logging-monitoring/callbacks.html
Can you please tell how to setup this with celery executer ... And how to run that
Sir, do we have to install Airflow first before installing Docker? I'm currently using windows 10
Install Docker first. then run given docker-compose which spins up airflow scheduler and webserver.
@@maxcoteclearning So after I install docker, I don't need to install airflow?
@@MooJin You don't need any installation for airflow. docker-compose.yaml runs airflow. Please follow this video on how to :).
@@maxcoteclearning Thank you sir!
After installing Docker on windows machine, what tool I need to open to run the commands? Command prompt, putty or PowerShell?
You can use simple windows command prompt.
Can you help me to know how to install a Python package into the docker on Windows? I am working with dags on airflow and I need to use the pymongo library.
You can create another Dockerfile that inherits from base airflow image, and add additional py packages, and use this custom image. Part of this will be covered in next video, where I'll show how you easily deploy, manage and version control dags in production environment.
@@maxcoteclearning Thank you so much. Looking foward to your next videos. I am having a problem with the adding additonal py packages. I have just worked with Py and Docker for few days.😅
I have installed the docker now how to run on comand propmt not able to understand , I am on windows software
after installing, it should run on command prompt by just typing `docker`. If not, please follow some good related guide on internet. e.g. this;
www.simplilearn.com/tutorials/docker-tutorial/install-docker-on-windows
my task are getting failed in airflow UI can u tell why it is happening, so I copied all your code properly
Hi Riya, could you explain more about the failure? Any logs?
This a good video however i would not suggest that it is for beginners.
unhealthy container problems
Could you explain more on this error plz ?
Could be docker memory problem. Before running docker-compose, make sure you have enough memory allocated to Docker Host machine. read more about this at maxcotec.com/blog/apache-airflow-2-docker-beginners-guide/
Someone raised a related issue, plz check my suggested solution here github.com/maxcotec/Apache-Airflow/issues/2#issuecomment-1321010233
Video Quality is not good record it again
@@pankajsuryavanshi8332 its recorded in 4k resolution. Plz switch the video resolution from settings>Quality
PS C:\Users\verma\airflow> docker compose up airflow-init
error during connect: this error may indicate that the docker daemon is not running: Get "%2F%2F.%2Fpipe%2Fdocker_engine/v1.24/containers/json?all=1&filters=%7B%22label%22%3A%7B%22com.docker.compose.project%3Dairflow%22%3Atrue%7D%7D": open //./pipe/docker_engine: The system cannot find the file specified.
Any thoughts?