SEMplicity: Scaling Large Elastic Cloud Enterprise Deployments - Apr 17, 2020 Elastic Meetup

From the trenches: what does it really take to scale up a large Elastic security log deployment? Elasticsearch for enterprise security log storage & management is a hot topic today. Specular gains in performance, functionality and cost are ready for harvest. But what exactly does it take to create a large Elastic log storage infrastructure? This talk will present war stories related to at 150,000 events per second Elastic log storage implementation with 2 month retention built at a large commercial client. We'll take the audience through sizing, design. staffing & cost; discuss architecture, storage density & ingestion: and share our gotchas & lessons learned. We will also talk a bit about evidentiary-quality log storage for compliance. If you are curious about what it would take for Elastic to hold your security logs, this talk will show you what to expect. Special thanks to George Boitano for presenting! George is a developer, inventor and entrepreneur with over 25 years of experience in data security for large enterprises. As a founder of Security Integration in 1990, he served as technical officer and authored U.S. patent[masked]: Apparatus and Method for Computer System Integrated Security. As President, he created OEM channel partnerships with Netegrity, Inc. and other vendors, and managed the acquisition of the company by Rocket Software in 2004. George then consulted at LogLogic, Aveksa, Verisign, Secureworks and Dell Services, where he developed an interest in SIEM technology and acquired familiarity with the Managed Security Services business model. George holds a bachelor’s degree in physics from Harvard University. Be sure to join the United States and Canada Elastic Virtual User Group to stay up-to-date on upcoming meetups: https://community.elastic.co/united-s... Questions? Check out https://discuss.elastic.co/ Connect with the Elastic community through Slack: https://ela.st/slack