Working with Large Datasets as a Data Scientist (with Python)

Learn how to deal with larger-than-memory datasets and also how to format python code using git hooks ABOUT THIS EVENT Dealing with large datasets can be a challenge when your computer does not have enough memory. As a data scientist, you might want to use python instead of moving your dataset to a SQL table. In this event, learn how you can optimize a dataframe's memory usage and work with larger-than-memory datasets in python. We will cover pandas memory optimization and tools such as dask, SQL, and the Cloud. Bonus content—Learn how to automatically format your Python notebooks to adhere to PEP8 standards using git hooks. Having a coding style is important when working in a team and making it work automatically is key to adoption. This is an intermediate-level webinar perfect for anyone with basic familiarity with pandas and/or git. BIO Rishi Goutam is a recent graduate of the NYC Data Science Academy's Jan 2022 cohort. He was previously a software engineer at Microsoft and Amazon and has also worked as a technology strategy consultant. About NYC Data Science Academy NYC Data Science Academy provides data science training programs and courses that prepare people for employment opportunities for data science professionals across all industries. NYCDSA teaches data science, trains companies and their employees to better profit from data, excels at big data project consulting, and connects trained Data Scientists to our industry. We have graduated over 5000 students at this point! Join our Interactive Distance / In-Person Learning Bootcamp, and get ready for the next step in your data science career! (https://nycdatascience.edu/data-scien...)