Apache Flink + MCP Demo - Real-time data processing using Gemini AI Agent

In this episode Bhargav Kosaraju, Practice Director Data & Streaming at Synapsewerx, shares his recent demonstration from the Melbourne Kafka meet-up. In this demo, Bhargav walks us through a use case and the detailed solution architecture before he shows us the code he's developed to interact with 3 separate MCP Servers, all of which he'll demo live! Bhargav uses an advanced rules-based prompting technique to provide structure and deep context to a Gemini model which is invoked within a Flink Broadcast State Pattern. In this CRM based use case, the LLM uses a business logic to generate an MCP prompt on the fly and in real time. In this demo, the MCP server has multiple action types available to it before updating the event stream. During the demo, business and technical context is provided via discussion with Malcolm Ingram, CEO Synapsewerx and Carlos Rodriguez Iturria, CTO and Chief Architect at Synapsewerx. 00:00:00 - Start 00:00:13 - Welcome & Introduction 00:02:53 - What is an MCP Server 00:07:10 - Demo: Flink MCP Kafka GenAI LLM 00:07:41 - Solution Architecture 00:16:38 - MCP & LLM clarification 00:18:56 - Business benefit of MCP 00:20:07 - MCP Scalability 00:20:33 - Demo: Business Context & Use Case 00:23:57 - The wonder of in-stream inference 00:25:12 - Demo: Solution design 00:31:42 - Rules based LLM constraints 00:33:06 - Demo: Payloads 00:35:54 - Prompts are the new JSON 00:39:42 - Demo continued code walkthrough 00:40:50 - Invest in Kafka schemas! 00:41:44 - Demo continued walkthrough 00:43:24 - Demo execution 00:49:23 - The vendor rush to MCP! 00:51:13 - Demo & Code walkthrough 00:58:04 - Breadcrumbs 00:58:46 - Handling hallucinations 01:01:16 - Designing for failure 01:05:44 - Pay attention: Integration Engineers 01:08:13 - FLINK: Broadcast state pattern 01:12:58 - Confluent Cloud Free Credits 01:13:41 - Closing Comments 01:17:03 - Outro Follow Bhargav Kosaraju   / bhargavkosaraju   Follow Carlos Rodriguez Iturria   / citurria   Follow Malcolm Ingram   / malcolmingram   SWX Social Website: https://synapsewerx.ai LinkedIn:   / synapsewerx   Confluent Social Website: https://www.confluent.io/ LinkedIn:   / confluent   This video was not paid for by sponsors. #MCP #Flink #Kafka #Confluent #RealTimeAI #ContextAware #IntelligentTransformation #TheFutureOfIntegration #ThoughtLeadership #AIAgents #AgenticAI