Future of DataFrames and Data Systems with Wes McKinney (creator of pandas and Apache Arrow)

Wes McKinney, the creator of pandas, Apache Arrow, and Ibis, will discuss the future of dataframes and composable data systems. I (‪@ChipHuyen‬) am really excited about this talk, as Wes is both a really thoughtful person and a great engineer! 00:00 Intro 02:13 Presentation on composable data systems 26:05 Out of all the work you've done, what are you most proud of? 27:57 Why pandas became popular 31:43 How to decide which dataframe library to use 34:30 How close are we to a truly unified dataframe API? 36:53 How GPUs will change data engineering interface 40:45 Why CPU performance will hit a wall for data workloads 44:25 Will everything be able to run on a single node? 49:30 Biggest challenges for data engineering 53:50 What skills should data engineers and data scientists learn Please post your questions on Discord:   / discord   RSVP: https://lu.ma/vkd8h5nu For more events hosted by Chip in the future: https://lu.ma/chiphuyen