LabStore - Part 2 - Building an Object Store in Go: Authentication with SigV4

Let's learn all about the inner workings of AWS Signature Version 4 (SigV4), used in Amazon Simple Storage Service (AWS S3), or any S3-compatible object store, to authenticate requests. We'll learn all about signature verification for standard single chunk requests, as well as for streaming multiple chunk requests. Embark in this series with IllumiKnow Labs, and let's see where this journey takes us. Hopefully you'll learn a lot along the way, and don't forget to comment below, if you have requests, suggestions, or feedback! 📺 Watch the full LabStore series here ►    • LabStore   ► In part 1, we present LabStore's backend as a Go project, and the S3 requests we prioritize. ► In part 2, we delve into SigV4, the authorization signature algorithm used by S3 to authenticate requests and individual chunks. ► In part 3, we test alternative open source solutions and setup a benchmark for these solutions, comparing them with LabStore. ► In part 4, we cover the implementation and integration of IAM (Identity and Access Management). ► In part 5, we delve into designing a command line interface to manage LabStore. ► In part 6, we explore TUI development in Go, building an S3 client and file explorer for the CLI. "Go Gopher" by Renée French is licensed under CC BY 4.0 🔗 Resources: 💻 GitHub repo: https://github.com/IllumiKnowLabs/lab... 📝 Blog post: https://datalabtechtv.com/posts/labst... 🐹 Go: https://go.dev/ 📚 AWS SigV4 (Standard, Single Chunk): https://docs.aws.amazon.com/AmazonS3/... 📚 AWS SigV4 (Streaming, Multiple Chunks): https://docs.aws.amazon.com/AmazonS3/... 🔔 Subscribe for more deep dives data science, data engineering, and all things data! ☁️ Follow the channel on Bluesky: https://bsky.app/profile/datalabtecht... 🎧 Join our community's Discord:   / discord   👽 Join our subreddit:   / datalabtechtv   💻 Check out the channel's GitHub: https://github.com/DataLabTechTV 🌐 Visit our website for blog posts: https://datalabtechtv.com #softwareengineering #s3 #sigv4 #authentication #objectstorage #objectstore #aws #golang #go 00:00:00 Intro 00:00:43 Understanding SigV4 00:03:51 The Spec 00:05:09 The Spec: Single Chunk 00:13:35 The Spec: Multiple Chunks 00:16:57 LabStore Implementation 00:18:27 LabStore Impl: Single Chunk 00:20:22 LabStore Impl: Multiple Chunks 00:21:58 LabStore Impl: Sequence 00:23:56 LabStore Code Architecture 00:24:33 LabStore: Router 00:24:48 LabStore: AuthMiddleware 00:27:10 LabStore: auth/auth.go 00:27:57 LabStore: auth/signature.go 00:32:19 LabStore: auth/streaming.go 00:36:43 LabStore SigV4 Log Tracing 00:41:23 Introducing a Bug Into SigV4 00:42:28 Outro