The Art of Load Balancing: Cutting Tail Latency at Scale - AWS Community Day Turkiye 2025

In this session, we'll dive deep into load balancing, a cornerstone of scalable and reliable architectures. We'll discuss: 1.Load Balancing Across Layers: Explore Hardware, L4 (Network) vs. L7 (Application) load balancing, their use cases, and trade-offs. 2.Load Balancing Methods: Compare algorithms like round robin, least connections, and weighted routing. 3.Tail Latency: Understand what causes tail latency in distributed systems, why it matters, and how to mitigate it. Bio: Yigit Varli is a computer engineering graduate from Middle East Technical University (METU) and works as a Software Engineer on the AWS L7 Load Balancing team. He contributes to the core logic of the Load Balancer platform used by all AWS and Amazon services, ensuring reliability and scalability across platforms like CloudWatch, Kinesis, Prime Video, and Amazon.com. Before joining AWS, Yigit worked as a software engineer at Edge Delta and contributed to research in software engineering at ETH Zurich. His expertise lies in networking infrastructures and distributed systems, with a focus on building scalable and efficient solutions. Outside of working, Yigit has been playing volleyball professionally in the Ireland Premier League. His team won the Shield Cup last year! Organized by Cloud Turkiye X https://x.com/CloudTurkiye Kommunity https://kommunity.com/cloud-turkiye LinkedIn   / cloud-turkiye   Medium   / cloud