Production Docker image for Apache Airflow

Подписаться 12 тыс.

Просмотров 16 тыс.

50% 1

Presented by Jarek Potiuk at Airflow Summit 2020. This talk guides you trough internals of the official Production Docker Image of Airflow. It shows foreseen use cases for it and how to use it in conjunction with the Official Helm Chart to make your own deployments.
0:40 - Intro
5:00 - Context (Container, Images, Why?)
15:10 - History and status of containes in Airflow
21:00 - Internals (Dockerhub, Building, Testing)
35:54 - Usage (Extending Image, Custom a.k.a build from source)
43:40 - Future state
45:24 - Q&A

Опубликовано:

30 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 9

@PhilipShon 4 года назад

Found this incredibly helpful, went ahead and created some timecodes b/c I can see myself referencing this video 0:40 - Intro 5:00 - Context (Container, Images, Why?) 15:10 - Status (History, Current Status) 21:00 - Internals (Dockerhub, Building, Testing) 35:54 - Usage (Extending Image, Custom a.k.a build from source) 43:40 - Future State 45:24 - Q&A

@user-xb1yp7hq9f 3 года назад

Thanks for the timeline hint! It's really helpful :)

@luisantoniochavezolaya96 4 года назад

tremendous presentation, I am starting with airflow in containers and in fact in the organization we seek to make it more productive, this helps me to have another perspective, TYVM!

@edduardoo 3 года назад

Great content, thank you!

@digitallworld 7 месяцев назад

very helpful . thanks.

@andrewm4894 2 года назад

Really interesting

@SocialAwareness-007 3 года назад

whats the difference between AirFlow and DolphinScheduler.. Does Airflow have a visual designer for DAG's ? That's a great value

@brendoaraujo9110 2 года назад

Hello, I have an airflow running on my machine with Postgresql on the scheduler's backend and LocalExecutor, but when I put my dags to run it consumes a lot of server CPU, how could I solve this high consumption problem?