From Voice to Action: Real-Time AI in MR with Daniel Oquelis

In this talk, I’ll show how to turn voice into real-time interaction in XR using Unity and Meta Quest. Instead of traditional speech-to-text pipelines, we’ll use a speech-to-speech setup to enable fast, natural conversations. Beyond voice, the system can trigger actions directly inside the scene, responding to what you say in real time. Through live demos and a reusable Unity setup, you’ll see how to integrate real-time voice interaction into XR apps and build more responsive experiences.