I Built a Distributed VM System on AWS

In this step-by-step DevOps tutorial, learn how to architect and deploy a distributed virtual machine (VM) system using AWS and Terraform. We break down Infrastructure as Code (IaC) to separate a Node.js API worker from a Python machine learning inference worker over a private subnet using RPC. blog link:- https://paramcodes.notion.site/Built-... github repo link:- https://github.com/paramcodes/devops-... Timestamps:- 00:00:00 - Introduction & Project Overview 00:01:19 - Why Build a Distributed System? (Tradeoffs & Scalability) 00:03:46 - Comparing Node.js & Python Processes 00:04:33 - Security, Authentication, and Bill Management 00:05:53 - How Virtual Machines Communicate (RPC & Subnets) 00:07:22 - Deep Dive: Caller Worker vs. Inference Worker 00:10:12 - Architectural Walkthrough 00:11:32 - Process Basics & Ports Explained 00:13:08 - What are Engine Workers? 00:13:43 - Infrastructure as Code (IaC) & Terraform Benefits 00:15:14 - Setting up AWS Credentials 00:17:15 - End-to-End Execution Flow (WebSockets vs. HTTP) 00:19:15 - AWS Core Jargon: VPCs, Subnets, and Gateways 00:22:34 - Route Tables & Network Routing 00:24:08 - Security Groups & Firewall Rules (Bastion Jumps) 00:26:47 - Process Persistence: systemd & tmux 00:29:43 - Terraform Configuration & Deployment Sequence 00:32:02 - Linux Deployment Commands & Repo Setup 00:33:35 - Testing the API Endpoint & Model Responses 00:34:31 - Engineering Challenges: Route Table & Storage Issues 00:35:58 - Handling Memory Constraints with Swap Files 00:38:00 - Debugging API Routing & WebSocket URLs 00:38:46 - AWS Console Walkthrough (EC2, VPC, Subnets) 00:41:21 - Production Scaling & 100x Growth Strategies