James Gealy On AI Safety Standards For Frontier Models

In this episode, hosts Michael Mainelli and Adam Leon Smith welcome James Gealy, Standardization Lead at Safer AI, a French NGO focused on AI risk modelling. With a background in spacecraft testing and operations at Northrop Grumman and Airbus, James brings hard-earned lessons from high-stakes risk and quality management, inspired by the Challenger disaster, into the world of AI standards. James discusses Safer AI’s pioneering risk modelling work on how frontier models like Claude’s Mythos could amplify cyber threats, benchmark saturation, and real-world harms. He also shares insights on his key standards roles, including editing ISO/IEC 42119 Part 8 on LLM benchmarking and red teaming, co-editing the European AI Risk Management Standard, and leading a new Preliminary Work Item on the safety of AI models, systems, and applications. The conversation explores balancing innovation with safety, standards’ role in the EU AI Act, international collaboration, and the challenges of addressing frontier risks. A timely, pragmatic discussion on turning real-world risk insights into actionable global standards.