The AI-Enabled Power BI Developer - Part 1 - Testing Fabric Data Agents with Promptfoo

In this video, I show how Microsoft's support for service principal connections with Fabric Data Agents enables you to use Promptfoo to automate testing. This approach reduces manual UI testing and helps you move to a more scalable, automated workflow. I demonstrate how to: • Set up the template to support testing • Run multiple prompts against the agent with a single command • Review and interpret test results Promptfoo allows you to continuously test your AI solutions, making it easier to validate changes to Data Agents and catch regressions early so your solutions remain reliable. 🔗 Template Repo https://github.com/clientfirsttech/fa... 🔗Microsoft Announcement https://community.fabric.microsoft.co... ⏱️ Chapters 00:00 Intro 01:30 Walkthrough of Fabric Data Agents in the UI 03:52 Setting up Promptfoo with service principals 05:30 Importing the template and configuring the environment for automated testing 08:59 Updating the Promptfoo configuration to connect to your agent and define prompts 12:48 Running tests against the agent 14:24 Reviewing test results 15:29 Recap