Airflow Helm Chart : Quick Start For Beginners in 10mins
ฝัง
- เผยแพร่เมื่อ 20 ต.ค. 2024
- Airflow Helm Chart : Quick Start For Beginners in 10mins
👍 Smash the like button to become an Airflow Super Hero!
❤️ Subscribe to my channel to become a master of Airflow
🏆 BECOME A PRO: www.udemy.com/...
🚨 My Patreon: / marclamberti
The Official Airflow Helm Chart is out!
Why is it important for you?
Now you only have one chart to look for and to stay up to date with. With the official Airflow helm chart you can quickly set up and run Airflow on your Kubernetes cluster. In this quick video, you are going to learn:
How to set up your own Kubernetes cluster locally
How to deploy Airflow with the Celery Executor using the Helm chart
How to configure the Airflow helm chart and so, your Airflow instance
At the end of the video, you will have a fully functional Kubernetes cluster with Airflow deployed using the Celery Executor!
Enjoy!
Materials: www.notion.so/...
![CAMPปลิ้น | EP.83[1/2] เปิดแคมป์หลอนต้อนรับ 2 ตัวพ่อแห่งวงการผี!](http://i.ytimg.com/vi/2uPuHYHgwiI/mqdefault.jpg)
You saved my day.
🫶
Can you make a video on deploying it in some private gke or eks cluster?
Very nice. In my case im using EKS. So i just need to skip Kind cluster part and proceed to rest of steps? Thanks!
Top-notch as always Marc!
how to load our own dags with helm , if you have any link available please share it.
LOL! I love the energy !!!!! :)
Great video! One question, how would I use load balancer instead of port forwarding for AKS deployment? Thank you!
How to add dags created by me into airflow? How do I load my dags folder?
you found out how to do it
Init:CrashLoopBackOff when i using git-sync ?
Thanks Marc!
You are mind blowing.
thank you so much :)
Great video. How can I add my own dag?
awesome!!
Teach us autoscaling with Keda. Thanks Marc!
Hi What is the image for flower, and what is pod_template ? ( I am new to k8s and airflow)
How do you make this thing work with rancher?
how to set the base_url as a configmap and enable it on the value.yaml file.
How you suggest to add spark binaries to this Helm Chart?
Great video! Btw, when using helm chart to deploy airflow on k8s, how do I install python package such as boto3? Is there configuration for this?
Unfortunately, this did not work. I use microk8s under PopOS 20.04. I created the default cluster on the local dev environment using the commands provided by both you and the apache airflow helm page. Error: INSTALLATION FAILED: failed post-install: timed out waiting for the condition
same here
thanks for the video! Where can I find the minimum specs for the nodes? Thanks
Great!
Great works! One question: what if i want to install extra python packages using requirements.txt? Which part should I change?
The docker image of Airflow :)
Hi Marc, I'm hitting that error when trying to upgrade helm airflow. Hope you can help. Thank you!
PS C:\Projects\kind-airflow> helm upgrade --install airflow apache-airflow/airflow -n airflow -f values.yaml
Error: UPGRADE FAILED: execution error at (airflow/charts/postgresql/templates/secrets.yaml:20:15):
PASSWORDS ERROR: The secret "airflow-postgresql" does not contain the key "password"
Did anybody tried with reverse proxy like exposing airflow ui thorugh nginx server?
Dummy operator is not working
Is anybody know what has to do
Hi there, I have an error on this command "helm install airflow apache-airflow/airflow --namespace airflow --debug". Has anybody had any issues with that?
Hi,
Please place --timeout 15m at the end of command.
helm upgrade --install airflow apache-airflow/airflow -n airflow -f values.yaml --debug --timeout 15m
Use this command it will help you to create
@@jaganmohan4388 Thank you Jagan! I'll try and get back to you with my outcome later.
🚀🚀🔥
Thanks Marc!!!