LiteRT.js + Gemma 4: Building an AI Adaptive Eye-Tracking Game for Pediatric Therapy

在本影片中，我們將為大家展示 Eye Aim Arena — 一款完全在客戶端瀏覽器運行的網頁式視線追蹤遊戲，並由 Google 全新的 LiteRT.js 與 Gemma 2 驅動！這款遊戲專為輔助科技與兒童運動康復而設計，讓使用者單純透過眼神注視和眨眼即可進行完整互動。 影片核心內容： 100% 本地隱私保護： 利用 LiteRT.js（前身為 TensorFlow Lite），視線追蹤與大型語言模型（LLM）推理完全在本地瀏覽器運行，絕不上傳任何隱私數據至伺服器。 Gemma 2 瀏覽器端 AI： 看看內置的 Gemma 4 模型如何化身為「AI 自適應治療師」，實時分析遊戲表現，並提供溫暖且具備情境感知的語音鼓勵。 專為康復訓練定制： 支持自定義射擊目標、視覺主題和背景音樂，為腦性麻痺或有運動障礙的兒童提供更有趣味性的眼肌與專注力訓練。 數據分析工具： 展示內建的熱圖（Heatmap）生成功能，記錄視線停留時間與精準度，方便導師或治療師進行評估。 如果您對 Web AI、無障礙輔助科技或本地端 LLM 應用感興趣，請點讚、訂閱並關注我們的開源項目！ In this video, we dive into Eye Aim Arena, a fully client-side, web-based eye-tracking game powered by Google's new LiteRT.js and Gemma 2! Designed with accessibility and pediatric motor rehabilitation in mind, this game allows users to interact completely through eye gaze and blinks. Key Features Explored: 100% Local Privacy: Both eye-tracking and LLM inference run entirely in your browser using LiteRT.js (formerly TensorFlow Lite) — no server-side data collection required! Gemma 4 On-Device AI: Watch how the integrated Gemma 2 model acts as an "AI Adaptive Therapist," analyzing real-time game performance and providing encouraging, context-aware voice prompts. Customization for Therapy: Learn how to customize targets, themes, and background music to make training engaging for children with physical or motor impairments (such as Cerebral Palsy or Spasticity). Analytical Tools: See the built-in heatmap generator that tracks precision and gaze dwell time, helping therapists review sessions. If you are interested in Web AI, accessibility technology, or on-device LLMs, don't forget to like, subscribe, and check out the open-source code! GitHub Repo: https://github.com/wongcyrus/Eye-Aim-... #EyeAimArena #LiteRT #Gemma4 #WebAI #EyeTracking #AssistiveTech #OnDeviceAI #WebDevelopment #Accessibility #AIHealthcare #OpenSource #GoogleAI