Scaling Out Airflow

[@christianfernandez5717]

Great video. Would also be interested in a webinar regarding scaling the Airflow database since I'm having some difficulties of my own with that.

[@Astronomer]

Noted, thanks for the suggestion! If it's helpful, you can check out our guide on the metadata db docs.astronomer.io/learn/airflow-database. Using a managed service like Astro is also one way many companies avoid scaling issues with Airflow.

[@risebyliftingothers]

Awesome 👍

[@Astronomer]

Thanks!

[@felipegermany]

What's the name of the logging system shown in the video @32:14 ?

[@risebyliftingothers]

Elastic search with kibana

[@Astronomer]

Thanks!

[@pedroandrade9736]

Is not recommended to use **worker_autoscale** ??

[@Astronomer]

Nope, definitely use worker_autoscale!

[@mohitkeshwani456]

Please make a airflow tutorial... 😐

[@Astronomer]

Hey - you can find many tutorials and guides on our website www.astronomer.io/guides/