Machine Learning Pipeline using Luigi and Scikit Learn - PyConSG 2016
Speaker: Atreya Biswas Description Using Luigi and Scikit-Learn to create a Machine Learning Pipeline which trains a model and predict through a Rest API Abstract A Machine Learning Pipeline can be broadly thought of as many tasks which includes - Data Ingestion - Data Cleaning - Feature Extraction - Training Models - Hyper Parameter Optimization - Model Evaluation - Model Deployment. Luigi is Spotify's open sourced Python framework for batch data processing including dependency resolution, workflow resolution, visualisation, handling failures and monitoring. Scikit-Learn is the most popular and widely used Machine Learning Library in Python. We will demonstrate how Luigi and Scikit-Learn can be used to orchestrate the Machine Learning Tasks, hence creating a cohesive Machine Learning Pipeline. Event Page: https://pycon.sg Produced by Engineers.SG Help us caption & translate this video! http://amara.org/v/P6Rz/

Python in the MicroServices world - PyConSG 2016

Niels Zeilemaker | Deploying Python models to production

Data Pipelines - Comparing Airflow and Luigi - Orr Shilon & Alex Levin - PyCon Israel 2019

Jake VanderPlas: Machine Learning with Scikit Learn

Machine Learning with Text in scikit-learn (PyCon 2016)

22 Machine Learning Projects That Will Make You A God At Data Science

Peter Owlett - Lessons from 6 months of using Luigi in production

Thomas Reineking - Plumbing in Python: Pipelines for Data Science Applications

Billionaire's WARNING: I'm SELLING. The Crash Is Already Here!

Tom Augspurger | Mind the Gap! Bridging the pandas – scikit learn dtype divide

What Nobody Tells You About Being a Quant

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker

Learn Apache Airflow in 10 Minutes | High-Paying Skills for Data Engineers

How To Think SO CLEARLY People Assume You're A Genius

System Design Explained: APIs, Databases, Caching, CDNs, Load Balancing & Production Infra

Laura Lorenz | How I learned to time travel, or, data pipelining and scheduling with Airflow

Data Science Workflows using Docker Containers

Deep Learning With Python & Tensorflow - PyConSG 2016

Julie Michelman - Pandas, Pipelines, and Custom Transformers

