Optimizing Apache Pinot's Query Performance

00:00:00 Welcome 00:01:17 Subbu Intro 00:03:21 Optimizing Pinot Realtime Performance by Subbu Subramaniam, Sr. Staff Engineer, Linkedin 00:38:50 Q&A 00:44:08 Jackie Intro 00:46:32 Optimize Query Performance in Apache Pinot by Jackie Jiang, Founding Engineer at StarTree, Apache Pinot PPMC and Committer 01:19:47 Q&A ---------------------------------------- TALK 1: Optimizing Pinot Realtime performance ---------------------------------------- Pinot supports ingestion of rows in realtime from data streams, making them available for queries instantly. In this talk we will present some techniques to optimize Pinot's performance and resource utilization depending on the offered load Links from slides: Tuning Realtime performance : https://docs.pinot.apache.org/operato... Config recommendation engine : https://docs.pinot.apache.org/operato... Auto-tuning Pinot realtime consumption (blog) :   / auto-tuning-pinot   Table configuration reference : https://docs.pinot.apache.org/configu... Presented by: Subbu Subramaniam Sr. Staff Engineer, Linkedin Subbu has been working on Pinot for the past 5 years, and has designed and implemented much of the Realtime infrastructure in Pinot. Prior to joining Pinot team, Subbu worked on a variety of technologies including Key-Value stores (espresso at Linkedin, PNUTS at Yahoo), change capture technology (Databus at Linkedin). Subbu has experience working on Embedded systems as well, building redundance and fault tolerance in network switches. ---------------------------------------- TALK 2: Optimize query performance: which index to use? & TALK 3: Filter optimizing and segment pruning ---------------------------------------- Both Presented by: Jackie Jiang Founding Engineer at StarTree, Apache Pinot PPMC and Committer Jackie is a Founding Engineer at StarTree. Before that, he worked at LinkedIn Pinot Team for 4 and half years and became the PMC and one of the top committers for Apache Pinot. Jackie's goal is to make Apache Pinot the fastest online analytics platform on the market. ---------------------------------------- Resources ---------------------------------------- StarTree: https://www.startree.ai/ Pinot Meetup https://www.meetup.com/apache-pinot/ Pinot website http://pinot.apache.org/ Pinot docs https://docs.pinot.apache.org/ Pinot Slack https://communityinviter.com/apps/apa... Pinot Github https://github.com/apache/incubator-p... Pinot twitter:   / apachepinot