56. AI for UX Analysis: How Accurate Is It? (feat. Christian Holst & Jamie Holst, Baymard Institute)

As AI-powered tools flood the market promising quick evaluations and audits, this episode dives into a critical issue: the reliability of these tools. Host Therese Fessenden and NN/G VP Kate Moran sit down with Jamie Holst and Christian Holst, co-founders of ‪@baymard‬, to examine the growing role of AI in UX analysis. They discuss the risks of over‑relying on AI, especially for junior practitioners, and what professionalism really means in an AI‑driven UX landscape. 👥 Speakers Christian Holst, Co‑founder & Research Director, Baymard Institute baymard.com/about/team/christian-holst Jamie Holst, Co‑founder & CTO, Baymard Institute baymard.com/about/team/jamie-holst Kate Moran, VP, Nielsen Norman Group www.nngroup.com/people/kate-moran 🔗 Links Referenced in the Episode Try UX‑Ray for free baymard.com/product/ux-ray Baymard article on AI accuracy and heuristic evaluations baymard.com/blog/ai-heuristic-evaluations 🎓 Related NN/g Courses Accelerating Research with AI www.nngroup.com/courses/research-with-ai/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 AI for Design Workflows www.nngroup.com/courses/ai-for-design/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 Designing AI Experiences www.nngroup.com/courses/designing-ai-experiences/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 AI Product Strategy www.nngroup.com/courses/ai-product-strategy/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 Explore all NN/g courses nngroup.com/learning 📝 Related NN/g Articles AI Hallucinations: What Designers Need to Know www.nngroup.com/articles/ai-hallucinations/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 AI‑Powered Tools for UX Research: Issues and Limitations www.nngroup.com/articles/ai-powered-tools-limitations/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 AI as a UX Assistant www.nngroup.com/articles/ai-roles-ux/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 AI Chatbots Discourage Error Checking www.nngroup.com/articles/ai-chatbots-discourage-error-checking/?utm_source=podcast&utm_medium=social&utm_campaign=ep56 TYXU5WMUAXAS8GTC

36. AI & UX: Innovations, Challenges, and Impact (ft. Henry Modisett)
▶︎

36. AI & UX: Innovations, Challenges, and Impact (ft. Henry Modisett)

The Next Decade of UX: Why Psychology Matters More Than Ever (Feat. Thomas Watkins) | EP 57
▶︎

The Next Decade of UX: Why Psychology Matters More Than Ever (Feat. Thomas Watkins) | EP 57

Conan O’Brien Delivers the Commencement Address | Harvard Commencement 2026
▶︎

Conan O’Brien Delivers the Commencement Address | Harvard Commencement 2026

Using AI as a UX Research Partner w/ Maria Rosala
▶︎

Using AI as a UX Research Partner w/ Maria Rosala

The UX of AI: Research-Backed Best Practices for Designing AI Interfaces
▶︎

The UX of AI: Research-Backed Best Practices for Designing AI Interfaces

45. Choosing Better User Impact Metrics (feat. Connor Joyce, Author & Behavioral Scientist)
▶︎

45. Choosing Better User Impact Metrics (feat. Connor Joyce, Author & Behavioral Scientist)

The future of intelligence | Demis Hassabis (Co-founder and CEO of DeepMind)
▶︎

The future of intelligence | Demis Hassabis (Co-founder and CEO of DeepMind)

State-Of-The-Art Prompting For AI Agents
▶︎

State-Of-The-Art Prompting For AI Agents

This is not the AI we were promised | The Royal Society
▶︎

This is not the AI we were promised | The Royal Society

52. Rethinking Users as Ecosystems (feat. authors Mike Youngblood and Ben Chesluk)
▶︎

52. Rethinking Users as Ecosystems (feat. authors Mike Youngblood and Ben Chesluk)

How to Build a Remarkable Brand in the Age of AI | Seth Godin
▶︎

How to Build a Remarkable Brand in the Age of AI | Seth Godin

Bonus Episode: Design’s Role as AI Expands (Feat. Don Norman and Sarah Gibbons, VP at NN/g)
▶︎

Bonus Episode: Design’s Role as AI Expands (Feat. Don Norman and Sarah Gibbons, VP at NN/g)

The most rational take on AI you’ll hear this year
▶︎

The most rational take on AI you’ll hear this year

10 Years of UX Research Experience in 4.5 hours - Ultimate Crash Course
▶︎

10 Years of UX Research Experience in 4.5 hours - Ultimate Crash Course

The Truth About Lean & Agile (Feat. Principal Experience Specialist, Laura Klein) | EP 58
▶︎

The Truth About Lean & Agile (Feat. Principal Experience Specialist, Laura Klein) | EP 58

Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan
▶︎

Andrej Karpathy: From Vibe Coding to Agentic Engineering w/ Stephanie Zhan

Bonus: Journey-Centric Design: The Evolution of UX Design Operations (feat. Kim Flaherty, NN/g)
▶︎

Bonus: Journey-Centric Design: The Evolution of UX Design Operations (feat. Kim Flaherty, NN/g)

FULL DISCUSSION: Google's Demis Hassabis, Anthropic's Dario Amodei Debate the World After AGI | AI1G
▶︎

FULL DISCUSSION: Google's Demis Hassabis, Anthropic's Dario Amodei Debate the World After AGI | AI1G

Jenny Wen: The design process is dead. Why Designers can no longer trust it.
▶︎

Jenny Wen: The design process is dead. Why Designers can no longer trust it.

The Immutable Rules of UX (Jakob Nielsen Keynote)
▶︎

The Immutable Rules of UX (Jakob Nielsen Keynote)