Orchestration of ML workloads via Airflow and GKE Batch

Опубликовано: 28 Октябрь 2024
на канале: Apache Airflow
52
0

Presented by Piotr Lesniak at Airflow Summit 2024.

During this talk we give an overview of different orchestration approaches (Kubeflow, Ray, Airflow, etc.) when running ML workloads on Kubernetes and specifically we will focus on how to use Kubernetes Batch API and Kubernetes Operators to run complex ML workloads.