Apache Pulsar: The Next Gen Messaging & Queuing System • Karthik Ramasamy • YOW! 2020

This presentation was recorded at YOW! 2020. #GOTOcon #YOW https://yowcon.com Karthik Ramasamy - Senior Director of Engineering at Splunk RESOURCES   / karthikz     / kramasamy   ABSTRACT #ApachePulsar is the next generation messaging and #QueuingSystem with unique design trade-offs driven by the need for scalability and durability. Its two layered architecture of separating message storage from serving led to an implementation that unifies the flexibility and the high-level constructs of messaging, queuing and light weight computing with the scalable properties of log storage systems. This allows Apache #Pulsar to be dynamically scaled up or down without any downtime. Using #ApacheBookKeeper as the underlying data storage, Pulsar guarantees data consistency and durability while maintaining strict SLAs for throughput and latency. Furthermore, Apache Pulsar integrates Pulsar Functions, a #Lambda style framework to write #Serverless functions to natively process data immediately upon arrival. This serverless stream processing approach is ideal for lightweight processing tasks like filtering, data routing and transformations. In this talk, we will give an overview about Apache Pulsar and delve into its unique architecture on messaging, storage and serverless data processing. We will also describe how Apache Pulsar is deployed in use case scenarios and explain how end-to-end streaming applications are written using Pulsar. [...] RECOMMENDED BOOKS David Kjerrumgaard • Apache Pulsar in Action • https://amzn.to/3Q2V9gv Jowanza Joseph • Mastering Apache Pulsar • https://amzn.to/3Ma25Hz Viktor Gamov, Dylan Scott & Dave Klein • Kafka in Action • https://amzn.to/3CrB8KU Shapira, Palino, Sivaram & Petty • Kafka: The Definitive Guide • https://amzn.to/3RPtdLP Bill Bejeck • Kafka Streams in Action • https://amzn.to/3CGJiiM   / gotocon     / goto-     / gotoconferences   #CloudNative #EventStreaming #EventSourcing #Programming #SoftwareEngineering #EventDriven #EventDrivenArchitecture #MessageDriven #MessageDrivenMessaging #KarthikRamasamy #ApacheZookeeper #ApacheKafka #SLA #YOWcon Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConf...