How to Deploy ML model to AWS Sagemaker with mlflow and Docker - Step by step

This video tutorial demonstrates how to deploy your Machine Learning (ML) model to AWS Sagemaker with mlflow and with Docker Desktop application. With this course I tried to explain everything in detail without any video cuts or interrupting, including even the smallest steps which you must do to finish this tutorial successfully. To finish this tutorial you will need: mlflow (recommended version 1.18.0). You can install it by typing command in your terminal: pip install mlflow==1.18.0 Docker Desktop application. You can download it from the official website: https://www.docker.com/products/docke... Anaconda software, to create a conda environment with Python 3.6 kernel. You can download it from official website: https://www.anaconda.com/products/ind... In this tutorial we will use: MLflow: it is an open source platform to manage the ML lifecycle, including experimentation, reproducibility, deployment, and a central model registry. Check official website here: https://www.mlflow.org AWS Elastic Container Registry (AWS ECR): is a fully managed container registry that makes it easy to store, manage, share, and deploy your container images and artifacts anywhere (https://aws.amazon.com/ecr/). AWS SageMaker: this service helps data scientists and developers to prepare, build, train, and deploy high-quality machine learning models quickly by bringing together a broad set of capabilities purpose-built for machine learning. AWS IAM (Identity and Management): it enables you to manage access to AWS services and resources securely (https://aws.amazon.com/iam). AWS CLI (Command Line Interface): is a unified tool to manage your AWS services (https://aws.amazon.com/cli). The main idea of this stream is to make your ML model readable for MLflow User Interface (MLflow UI), then you will be able to track model performance across experiments. By using MLflow functionality, you will create two Docker images: the first one will be placed locally, and another one on AWS ECR, where a special repository will be created for our image containing all information about our ML model. Then we use this image on AWS ECR to deploy our ML model to the AWS SageMaker. Remember to add required IAM roles and permissions to SageMaker and S3 where all model artifacts will be saved. Finally, we will be able to use the model and make new predictions with new data ingested to the model from anywhere using Python scripts. The content of the tutorial: 0:00 - Intro 0:43 - P1. Prepare you Python virtual environment 2:26 - P2. Install dependencies on your virtual environment 5:47 - P3. Setup AWS IAM user and AWS CLI configuration 12:29 - P4. Test if mlflow is working good 14:09 - P5. Adapt your ML training code for mlflow 25:24 - P6. Build a Docker Image and push it to AWS ECR 33:50 - P7. Deploy Image from AWS ECR to AWS SageMaker 49:18 - P8. Use the deployed model with the new data and make predictions 52:46 - Bonus: Github repo of this tutorial and Thank you! At the end of this lesson, you will be able to make predictions on your ML model from anywhere using boto3 using model inference and endpoints you have built on AWS Sagemaker. The full explained steps are clearly written with screenshots in this repo: https://github.com/vb100/deploy-ml-ml... If you need any clarifications and add more details on any step, let me know. #mlflow #sagemaker #docker

AWS IAM: Users, Groups, Roles, and Policies
▶︎

AWS IAM: Users, Groups, Roles, and Policies

AWS re:Invent 2020: Building end-to-end ML workflows with Kubeflow Pipelines
▶︎

AWS re:Invent 2020: Building end-to-end ML workflows with Kubeflow Pipelines

AI Engineering with AWS SageMaker: Crash Course for Beginners!
▶︎

AI Engineering with AWS SageMaker: Crash Course for Beginners!

Deploy RAG to Production Faster Than You Think
▶︎

Deploy RAG to Production Faster Than You Think

Building an ML Platform from Scratch: Live Coding Session // Alon Gubkin // MLOps Meetup #67
▶︎

Building an ML Platform from Scratch: Live Coding Session // Alon Gubkin // MLOps Meetup #67

MLOps Explained - What It Is, Why You Need It and How It Works
▶︎

MLOps Explained - What It Is, Why You Need It and How It Works

AWS Summit DC 2022 - Amazon SageMaker Inference explained: Which style is right for you?
▶︎

AWS Summit DC 2022 - Amazon SageMaker Inference explained: Which style is right for you?

AWS Summit ANZ 2022 - End-to-end MLOps for architects (ARCH3)
▶︎

AWS Summit ANZ 2022 - End-to-end MLOps for architects (ARCH3)

How to Deploy ML Solutions with FastAPI, Docker, & AWS
▶︎

How to Deploy ML Solutions with FastAPI, Docker, & AWS

YOUR CODE! AT SCALE! Amazon SageMaker Script Mode
▶︎

YOUR CODE! AT SCALE! Amazon SageMaker Script Mode

Zig 2026: No-AI Policy, $670K Foundation, Left GitHub & Why Zig Isn’t 1.0 - Andrew Kelley Explains
▶︎

Zig 2026: No-AI Policy, $670K Foundation, Left GitHub & Why Zig Isn’t 1.0 - Andrew Kelley Explains

The Easiest Way to Build Machine Learning Models (AWS Sagemaker) MLOps
▶︎

The Easiest Way to Build Machine Learning Models (AWS Sagemaker) MLOps

Stanford CS153 Frontier Systems | Scale, AGI, and the Future of Everything
▶︎

Stanford CS153 Frontier Systems | Scale, AGI, and the Future of Everything

Introduction to Amazon SageMaker Serverless Inference | Concepts & Code examples
▶︎

Introduction to Amazon SageMaker Serverless Inference | Concepts & Code examples

Deliver high-performance ML models faster with MLOps tools
▶︎

Deliver high-performance ML models faster with MLOps tools

#3-Deployment Of Huggingface OpenSource LLM Models In AWS Sagemakers With Endpoints
▶︎

#3-Deployment Of Huggingface OpenSource LLM Models In AWS Sagemakers With Endpoints

Train Machine Learning Model with SparkML (...and Python) | Hands-on tutorial
▶︎

Train Machine Learning Model with SparkML (...and Python) | Hands-on tutorial

Building, training and deploying machine learning models with Amazon SageMaker (July 2020)
▶︎

Building, training and deploying machine learning models with Amazon SageMaker (July 2020)

How To: Use AWS SageMaker for End-to-End ML — Setup, Training, Deployment, and Bias Detection
▶︎

How To: Use AWS SageMaker for End-to-End ML — Setup, Training, Deployment, and Bias Detection

SageMaker Friday episode 1 - How to build, train and deploy and a machine learning model easily
▶︎

SageMaker Friday episode 1 - How to build, train and deploy and a machine learning model easily