Fluentd on Kubernetes: Log collection explained

Follow DevOps Roadmap šŸ‘‰šŸ½ Ā Ā /Ā marceldempersĀ Ā  My DevOps Course šŸ‘‰šŸ½ https://marceldempers.dev Patreon šŸ‘‰šŸ½Ā Ā /Ā marceldempersĀ Ā  In this video we take a look at log collection on a kubernetes cluster. We take a look at the fluentd dockerfile, how to run it on each kubernetes node using a daemonset. More importantly is the configuration required to tell fluentd how to collect logs. We also look into where logs are stored on each kubernetes node. Finally we see how to ship the collected logs out of the cluster. Checkout my Introduction to Logging video:    • UnderstandingĀ Logging:Ā ContainersĀ &Ā Micros...Ā Ā  Checkout my Introduction to Fluentd video:    • IntroductionĀ toĀ Fluentd:Ā CollectĀ logsĀ andĀ ...Ā Ā  Checkout the source code below šŸ‘‡šŸ½ and follow along šŸ¤“ Also if you want to support the channel further, become a member šŸ˜Ž https://marceldempers.dev/join Checkout "That DevOps Community" too https://marceldempers.dev/community Source Code 🧐 -------------------------------------------------------------- https://github.com/marcel-dempers/doc... If you are new to Kubernetes, check out my getting started playlist on Kubernetes below :) Kubernetes Guide for Beginners: ---------------------------------------------------    • KubernetesĀ developmentĀ guideĀ forĀ beginnersĀ Ā  Kubernetes Monitoring Guide: -----------------------------------------------    • KubernetesĀ MonitoringĀ guideĀ forĀ beginnersĀ Ā  Kubernetes Secret Management Guide: --------------------------------------------------------------    • KubernetesĀ SecretĀ ManagementĀ guideĀ beginne...Ā Ā  Like and Subscribe for more :) Follow me on socials! https://marceldempers.dev Twitter | Ā Ā /Ā marceldempersĀ Ā  GitHub | https://github.com/marcel-dempers Facebook | http://fb.me/thatdevopsguy LinkedIn | Ā Ā /Ā marceldempersĀ Ā  Instagram | Ā Ā /Ā marceldempersĀ Ā  Music: Track: Amine Maxwell - Amine Maxwell & MICHAL - Chill Night | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā amine-maxwell-michal-chill-nightĀ Ā  Track: POLAROID PAPI - audi | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā audiĀ Ā  Track: Amine Maxwell - Amine Maxwell & Soyb - You & I | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā amine-maxwell-soyb-you-iĀ Ā  Track: Amine Maxwell - Night And The City | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā night-and-the-cityĀ Ā  Track: LiQWYD - Bridges (Free download) | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā bridges-free-downloadĀ Ā  Track: Soyb - Soyb & Amine Maxwell - California | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā soyb-amine-maxwell-californiaĀ Ā  Track: souKo - souKo - Parallel | is licensed under a Creative Commons Attribution licence (https://creativecommons.org/licenses/...) Listen: Ā Ā /Ā parallelĀ Ā 

Understanding StatefulSets in Kubernetes
ā–¶ļøŽ

Understanding StatefulSets in Kubernetes

Kubernetes and retiring at the top with Kelsey Hightower
ā–¶ļøŽ

Kubernetes and retiring at the top with Kelsey Hightower

Kubernetes Tutorial for Beginners [FULL COURSE in 4 Hours]
ā–¶ļøŽ

Kubernetes Tutorial for Beginners [FULL COURSE in 4 Hours]

Simplify Kubernetes YAML with Kustomize
ā–¶ļøŽ

Simplify Kubernetes YAML with Kustomize

Logging Operator: Multi-Tenant Kubernetes Logging
ā–¶ļøŽ

Logging Operator: Multi-Tenant Kubernetes Logging

Docker Logging - "docker logs" Command | Log Drivers | Logging Strategies
ā–¶ļøŽ

Docker Logging - "docker logs" Command | Log Drivers | Logging Strategies

Understanding Kubernetes RBAC | Access control basics explained
ā–¶ļøŽ

Understanding Kubernetes RBAC | Access control basics explained

Understanding CPU & Memory with the Kubernetes Vertical Pod Autoscaler
ā–¶ļøŽ

Understanding CPU & Memory with the Kubernetes Vertical Pod Autoscaler

Kubernetes Ingress Tutorial for Beginners | simply explained  | Kubernetes Tutorial 22
ā–¶ļøŽ

Kubernetes Ingress Tutorial for Beginners | simply explained | Kubernetes Tutorial 22

AWS ECS Full Tutorial | Learn EC2, EKS, Fargate, Load Balancers and Docker Deployment with Demo
ā–¶ļøŽ

AWS ECS Full Tutorial | Learn EC2, EKS, Fargate, Load Balancers and Docker Deployment with Demo

Kubernetes Zero to Hero: The Complete Beginner’s Guide (2025 Edition)
ā–¶ļøŽ

Kubernetes Zero to Hero: The Complete Beginner’s Guide (2025 Edition)

Kubernetes Crash Course for Absolute Beginners [NEW]
ā–¶ļøŽ

Kubernetes Crash Course for Absolute Beginners [NEW]

Istio Service mesh explained
ā–¶ļøŽ

Istio Service mesh explained

Webinar: Cluster API (CAPI) -  A Kubernetes subproject to simplify cluster lifecycle management
ā–¶ļøŽ

Webinar: Cluster API (CAPI) - A Kubernetes subproject to simplify cluster lifecycle management

How to Monitor a Kubernetes Cluster in 2022 with Prometheus & Grafana
ā–¶ļøŽ

How to Monitor a Kubernetes Cluster in 2022 with Prometheus & Grafana

Kubernetes StatefulSet simply explained | Deployment vs StatefulSet
ā–¶ļøŽ

Kubernetes StatefulSet simply explained | Deployment vs StatefulSet

Setup Prometheus On Kubernetes Using Helm | Kubernetes Monitoring With Prometheus
ā–¶ļøŽ

Setup Prometheus On Kubernetes Using Helm | Kubernetes Monitoring With Prometheus

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker
ā–¶ļøŽ

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker

Kubernetes Services explained | ClusterIP vs NodePort vs LoadBalancer vs Headless Service
ā–¶ļøŽ

Kubernetes Services explained | ClusterIP vs NodePort vs LoadBalancer vs Headless Service

Mastering Grafana Loki: Kubernetes Log Collection & Integration | Part 2
ā–¶ļøŽ

Mastering Grafana Loki: Kubernetes Log Collection & Integration | Part 2