Building on AlphaZero with Julia | Jonathan Laurent | JuliaCon 2021

This talk was presented as part of JuliaCon 2021 Abstract: In this talk, we give an introduction to the AlphaZero algorithm and discuss some research challenges of using it beyond board games. In an effort to make this algorithm widely accessible to students and researchers, we introduce AlphaZero.jl. We show how this package leverages Julia's strengths to provide an implementation that is simple and flexible, while being up to two orders of magnitude faster than comparable Python implementations. You can find the repo for this talk here: https://github.com/jonathan-laurent/A... For more info on the Julia Programming Language, follow us on Twitter:   / julialanguage   and consider sponsoring us on GitHub: https://github.com/sponsors/JuliaLang Contents 00:00 Welcome 00:10 Introduction 00:43 DeepMind short history moments 02:15 Outline 03:00 An Introduction to AlphaZero 04:55 Monte-Carlo Tree Search 06:11 MCTS in Action 07:46 UCT Formula 10:18 After 600 simulations 11:00 MCTS as a policy improvement operator 11:50 How to apply MCTS? 12:56 AlphaZero beyond board games 13:40 AlphaZero for automated theorem proving 17:56 AlphaZero.jl and execution speed 19:27 AlphaZero.jl parallelism 20:48 Composable parallelism 21:34 There is room for performance improvement 22:59 AlphaZero.jl online documentation 23:42 Conclusion S/O to https://github.com/filchristou for the video timestamps! Want to help add timestamps to our YouTube videos to help with discoverability? Find out more here: https://github.com/JuliaCommunity/You... Interested in improving the auto generated captions? Get involved here: https://github.com/JuliaCommunity/You...