BlueHat 2024: S24: Automate AI Red Teaming in your existing tool chain with PyRIT

BlueHat 2024: Session 24: Automate AI Red Teaming in your existing tool chain with PyRIT Presented by Joris de Gruyter and Shiven Chawla from Microsoft Abstract: Microsoft's open-source tool PyRIT provides a set of extensible APIs and scripts that can be used for red teaming AI applications that use LLMs. The strength of the tool lies in the continuous addition of new techniques to red team LLMs as research is published. To overcome the challenge of learning a new tool set or potentially a new language (Python), we present PyRITShip - a layer on top of PyRIT to enable easy integration into existing tools, which can be run locally in Python directly, or using a container. In this session we will discuss the basic uses and features of PyRIT. We then move onto a live demo of our BURP Suite Extension to enable LLM red teaming using BURP's repeater module with PyRIT as the driver. Finally, we will outline some future ideas for extensibility in other tool sets, and a call to action on making PyRIT work for you and how you can contribute.