Lifecycle of a Sample in the Prometheus TSDB - Ganesh Vernekar

Prometheus is the leading open-source metrics monitoring solution. Prometheus 2.x contains a highly optimised Time Series Database (TSDB). It has ACID compliance and works efficiently with 100s of millions of time series on a single node. On top of its code base, Cortex, Thanos, and Mimir have implemented distributed TSDBs. The Prometheus TSDB has many components that make this all possible - an in-memory database, a Write-Ahead Log (WAL) for durability, memory-mapping of data from disk, persistent immutable data blocks with highly optimised inverted indices, and various techniques of maintaining this data in the background. This talk will take you through the entire lifecycle of a time series sample `(timestamp int64, value float64)` starting from the point it enters the Prometheus TSDB’s in-memory database until it gets deleted from the persistent blocks according to the retention policies. Ganesh Vernekar Senior Software Engineer, Grafana Labs Ganesh has been contributing to Prometheus for over 5 years and is a Prometheus team member and maintainer of its Time Series Database (TSDB). Most recently, he worked on the new native histograms in Prometheus. He has also contributed to Cortex, Grafana Mimir, and Grafana.