Presto On Spark: A Unified SQL Experience - Databricks Data+AI Summit 2022
Presto On Spark: A Unified SQL Experience
Databricks Data + AI Summit 2022
Shradha Ambekar
Staff Software Engineer
Intuit
Presto on Spark is an integration between Presto and Spark that leverages Presto's compiler/evaluation as a library and Spark's large scale processing capabilities. It enables a unified SQL experience between interactive and batch use cases. A unified option for batch data processing and ad hoc is very important for creating the experience of queries that scale instead of fail without requiring rewrites between different SQL dialects.
In this session, we'll talk about Presto On Spark motivation, architecture, why it matters and its implementation/usage at Intuit.
#AI #Data #Databricks #DeltaLake #Lakehouse #MLOps
