GPU Programming in Pure Python - Bryce Adelstein Lelbach

GPU programming can be scary but doesn’t need to be. With the CUDA Core Libraries and CUDA Python object model, you have a friendly interface to get you started with GPU acceleration. In this example-driven talk, we'll begin with a general discussion of the CUDA model and how to manage accelerator devices in Python with cuda.core. Next, we'll teach you how to launch work and manage memory. Then, you'll learn how to use parallel algorithms with cuda.parallel, write your own kernels that leverage cooperative algorithms with cuda.cooperative, and integrate seamlessly with accelerated libraries such as cuDNN and cuBLAS. We'll look at a variety of parallel examples, from counting words, to implementing softmax, to a full blown machine learning demo. By the time the talk is over, you'll be ready to start accelerating your Python code with GPUs!