Observability in an Asynchronous World • James Eastham • GOTO 2024
This presentation was recorded at GOTO EDA Day Warsaw 2024. #GOTOcon #GOTOeda https://gotopia.tech James Eastham - Serverless Developer Advocate at Datadog @serverlessjames RESOURCES / plantpowerjames / james-eastham https://github.com/jeastham1993 https://jameseastham.co.uk ABSTRACT Observability is one of the most essential parts of modern software development! I want you to imagine a scenario. You've designed and built an event-driven system. It's working brilliantly—until one day, at 3 a.m., your pager goes off. Something is broken. You're not sure what it is, and you don't have the tools to quickly diagnose the issue. Messages are flying around between multiple distributed systems, and you have no way to understand who is talking to who or what is causing the outage. This lack of observability is causing downtime and frustration for your users. Now what? How do you get to a place where you can confidently respond to that page? When you can confidently get your users back online and understand what your system is doing at any moment? And that's what you're going to learn about in this talk. You're going to sit in the shoes of an engineer and go on a journey into the world of observability in event-driven systems. From understanding cause and effect in your architecture to practical implementation details and, most importantly, how to let the needs of your users drive your observability strategy. [...] TIMECODES 00:00 Intro 05:52 What's an event? 06:50 What does it mean to be "event-drive"? 07:49 Events or messages 08:46 Types of events 11:31 Observability 13:48 Challenges with observability in EDA 17:16 Evolvability 21:09 Now what? 26:23 Documenting 31:07 Tracing 37:46 Metrics 40:27 Success 40:55 Observability in action 43:26 Takeaways 46:02 Outro Read the full abstract here: https://gotopia.eu/eda-day-warsaw-202... RECOMMENDED BOOKS Adam Bellemare • Building Event-Driven Microservices • https://amzn.to/3WfNKfM Peter Sbarski • Serverless Architectures on AWS • https://amzn.to/3hJzEUM Michael Stack • Event-Driven Architecture in Golang • https://amzn.to/3G5e8ST Ford, Richards, Sadalage & Dehghani • Software Architecture: The Hard Parts • https://amzn.to/3v4pKQS Gerardus Blokdyk • Event-Driven Architecture EDA • https://amzn.to/3FOfUHE James Urquhart • Flow Architectures • https://amzn.to/3Tyz8cY / gotocon / goto- / goto_con / gotoconferences #Observability #Evolvability #Serverless #Events #DistributedSystems #EventDrivenArchitecture #SoftwareArchitecture #AWS #PlatformEngineering #EventLoop #LambdaFunctions #JamesEastham CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: / @goto- Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConf...

Event-Driven Architectures Done Right, Apache Kafka • Tim Berglund • Devoxx Poland 2021

Software Architecture: The Hard Parts - Neal Ford

Patterns for Building Event-driven Web & Mobile App Backends • Josh Kahn • GOTO 2024

Datadog vs Grafana Cloud 2026: Which Wins for the Mid-Market Platform Team?

Build Abstractions Not Illusions • Gregor Hohpe • YOW! 2023

Blue Ridge Ruby 2026 - InstiLLMent of Successful Practices in an Agentic World by Kevin Murphy

So You Want to Build An Event Driven System? - James Eastham - NDC London 2024

Complexity is the Gotcha of Event-driven Architecture • David Boyne • GOTO 2024

Design more decoupled services with one weird trick - Udi Dahan - NDC Oslo 2024

Minimum Viable Architecture • Randy Shoup • YOW! 2022

Message Queues in System Design Interviews w/ Meta Staff Engineer

AWS re:Invent 2022 - Observability best practices at Amazon (COP343)

So You Want to Build An Event Driven System? - James Eastham - NDC Oslo 2024

Modern Trade-off Analysis for Software Architecture - Neal Ford - DDD Europe

Shifting Gears: From Events to Event-Driven • Ryan Cormack • GOTO 2024

Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan

Conan O’Brien Delivers the Commencement Address | Harvard Commencement 2026

Observability vs. APM vs. Monitoring

Empowering Architectural Evolution: Governing Event-Driven Solutions • Sam Dengler • GOTO 2023

