Airflow at Faire: Democratizing ML feature store framework at scale

Опубликовано: 13 Октябрь 2023
на канале: Apache Airflow
198
1

Presented by Rafay Aleem & Victoria Varney at Airflow Summit 2023.

Data science and machine learning are at the heart of Faire’s industry-celebrated marketplace (a16z top-ranked marketplace) and drive powerful search, navigation, and risk functions which are powered by ML models that are trained on 3000+ features defined by our data scientists. Previously, defining, backfilling and maintaining feature lifecycle was error-prone. Having a framework built on top of Airflow has empowered them to maintain and deploy their changes independently. We will explore: