What if Apache Pig had a SQL front-end and query optimizer? What if Apache Calcite was able to use Pig and MapReduce to run queries? In this project, we aimed to answer both questions by adding a Pig adapter for Calcite. In this talk, we describe Calcite's adapter framework, how we used it to write a Pig adapter, and how you can use this SQL interface to Pig for interactive and long-running queries.
Julian Hyde is an expert in query optimization, in-memory analytics, and streaming. He was the initial developer of Apache Calcite and is a PMC member of Drill, Kylin and Eagle. He is an architect at Hortonworks.