Maintaining Iceberg at Scale: Lessons from Slack
Apache Iceberg is a powerful and broadly applicable table format. But while Iceberg is generally applicable, maintaining Iceberg tables isn't. At Slack, our Iceberg adoption grew from a small number of curated datasets to tens of thousands of tables across many teams and workloads. We quickly found that maintenance-not table creation or query performance-was the real scaling challenge. Compaction, snapshot expiration, and metadata growth vary widely based on data volume, ingestion patterns, and business importance, making one-size-fits-all approaches ineffective. Just as importantly, the challenge was organizational. Expecting every data owner to understand Iceberg internals and reliably maintain their own tables didn't scale. This talk covers how we addressed both problems by treating Iceberg maintenance as a centralized, automated platform capability. I'll share how we classify datasets, apply tailored maintenance strategies, and operate Iceberg safely at scale-along with the lessons we learned along the way. Speakers: Lweikum (Speaker) - [email protected] --- Recorded at Iceberg Summit 2026. Learn more: https://www.icebergsummit2026.com/ #ApacheIceberg #IcebergSummit #DataLakehouse

The Easy Button for Apache Iceberg: Migrate Less, Manage Better, Build Agentic Analytics

Correctness Techniques for Apache Iceberg™ Compaction

Semantic Models and Direct Lake Mode in Microsoft Fabric

How to Tune Indexes Fast

From Batch to Streaming and AI, Iceberg for Everyone by Everyone

Lessons from npm's Dark Side: These Are Not the Packages You're Looking For

Implementing Intelligent Snapshot Management

Snowflake’s Embrace of Open Source Software

Learn Practical Techniques for Applying Data Quality in the Lakehouse with Databricks

The French Do Not Care About Work

🚗 BYD : The biggest SCAM of the car industry ?

Stop Rambling: The 3-2-1 Speaking Trick That Makes You Sound Like A CEO

Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan

This Simple Table Exposes Weak Normal Forms Knowledge

Richard Feynman Explains What Everyone Gets Wrong About GRAVITY

Advancing Query Performance with Iceberg Secondary Indexes

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker

Ex-Google Recruiter Explains Why "Lying" Gets You Hired

Something is jamming GPS over Europe. Here's what we found

