The 1000x faster financial database | Joran Dirk Greef, creator of TigerBeetle

In July of 2020, Joran Dirk Greef stumbled into a fundamental limitation in the general-purpose database design for transaction processing. This sent him on a path that ended with ‪@tigerbeetledb‬, a redesigned distributed database for financial transactions that yielded three orders of magnitude faster OLTP performance over the usual (general-purpose) suspects. On this episode, Joran joins Jerod to explain how TigerBeetle got so fast, to defend its resilience and durability claims as a new market entrant, and to stake his claim at the intersection of open source and business. Oh, plus the age old question: Why Zig? SUBSCRIBE: RSS: https://changelog.fm/rss Apple: https://changelog.fm/apple Spotify: https://changelog.fm/spotify Android: https://changelog.fm/android Overcast: https://changelog.fm/overcast Email: https://changelog.fm/email X: https://x.com/changelog Bluesky: https://bsky.app/profile/changelog.com Mastodon: https://changelog.social/@changelog SPONSORS: Augment Code - Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates. https://www.augmentcode.com Depot - *Build faster. Waste less time.* Accelerate Docker image builds, and GitHub Actions workflows. Easily integrate with your existing CI provider and dev workflows to save hours of build time. https://depot.dev Notion - Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It’s a workspace designed not just for making progress, but getting inspired. Notion is for everyone — whether you’re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. http://notion.com/changelog LINKS: https://tigerbeetle.com/ https://sim.tigerbeetle.com/ https://github.com/tigerbeetle/tigerb... https://github.com/tigerbeetle/tigerb... https://ziglang.org/ CHAPTERS: 00:00 Start the show! 00:35 Stumbling into it 03:44 Maybe I did it wrong 04:58 It's the row locks 06:50 Pareto meets the Mag 7 08:57 Financial, not SQL, transactions 10:08 A specialized database 13:18 Why build yet another database? 18:05 Where do you start? 20:35 Who is 'we'? 21:58 10_000x faster?! 23:33 New world, new constraints 25:03 Row, column, mulit-major 28:57 Multi-row major implications 34:34 Embarrassingly simple 37:25 On durability 47:54 "Centuries" of testing 50:06 What about real-world use tho 55:27 Worst-case scenario logic 56:35 TigerBeetle Simulator 1:05:10 The open source story 1:15:28 Jerod reacts 1:15:50 What about AWS re-hosting 1:20:29 Written in Zig 1:26:00 Redis open source again? 1:27:00 Wrapping up