In a recent development, today, we are introducing on-device Automatic Speech Recognition (ASR) and Text-to-Speech (TTS) capabilities in Google AI Edge Gallery. Voice is often the most natural way to interact with AI on phones and wearables. Recent advances in compact speech architectures now make it possible to run accurate, multilingual ASR and expressive TTS models entirely on device, all within a small memory footprint, with low latency, and completely offline. By pairing these lightweight speech models with on-device small language models (SLMs) like Gemini Nano and Gemma 4, developers can build apps that stream live transcriptions as the user speaks and synthesize natural spoken replies locally.

This release brings together major advancements across both Google’s system speech models and the open-weight ecosystem:.

Below, we’ll explore how this local voice pipeline powers the newly introduced XR (Extended Reality) Language Teacher showcase, upgrades AI Chat in Google AI Edge Gallery, and how you can build with these APIs and models today.

It has been revealed that learning a language while traveling happens in the real world, often in underground stations, busy markets, or abroad where Wi-Fi and roaming data may not be available. To show how vision, language, and speech models can work together 100% locally on your phone with no network connection needed, we built the XR Language Teacher showcase in Google AI Edge Gallery. Simply point your camera at an unfamiliar object or menu, ask "What is that, and how do I ask for one?", and immediately hear an explanation in your language alongside authentic pronunciation in the local language.

→ Read original article