A deep dive into Airflow configuration options for scalability
Presented by Ephraim Anierobi at Airflow Summit 2024.
Apache Airflow has a lot of configuration options. A change in some of these options can affect the performance of Airflow.
If you are wondering why your Airflow instance is not running the number of tasks you expected it to run, after this talk, you will have a better understanding of the configuration options available for improving the number of tasks your Airflow instance can run.
We will talk about the DAG parsing configuration options, options for scheduler scalability, etc., and the pros and cons of these options.
![[FREE] Lossa x Jungeli Afro Type Beat “Chaud” | Prod @Tr3vinho](https://images.mixrolikus.cc/video/7emxHeBKAe4)
