Optimizing Latency Sensitive Queries for Presto
Speakers:
Rohit Jain, Software engineer at Facebook
Bin Fan, Founding engineer and VP of Open Source at Alluxio
For many latency-sensitive SQL workloads, Presto is often bound by retrieving distant data. In this talk, Rohit Jain from Facebook and Bin Fan from Alluxio will introduce their teams’ collaboration on adding a local on-SSD Alluxio cache inside Presto workers to improve unsatisfied Presto latency.
This talk will focus on:
Insights of the Presto workloads at Facebook w.r.t. cache effectiveness
API and internals of the Alluxio local cache, from design trade-offs (e.g. caching granularity, concurrency level and etc) to performance optimizations.
Initial performance analysis and timeline to deliver this feature for general Presto users.
