Audio → VAD (voice activity detection) → Whisper (speech recognition) → local translation → WebSocket → OBS overlay.
On a modern NVIDIA GPU we see roughly 0.3–0.7 s per phrase, including translation. On CPU it still works, just slower (1–2 s and more depending on the model). For live captions, predictable latency matters more than "maximum accuracy": medium on a GPU is the sweet spot for most streams.
Industry observers note that NLLB is a great model, but its license (CC BY-NC 4.0) forbids commercial use. Shipping it inside a paid product is not an option, so in Stream Subs 1.8 we removed NLLB and kept:.
For a streamer doing 10+ hours a month, a cloud subscription usually costs more in the first year than a one-time license — and the audio never leaves their PC.
Stream Subs 1.8 adds a CPU build for machines without a discrete GPU, session statistics (lines, translations, average latency), presets for stream/webinar/recording scenarios, and a choice of translation engine. It is open source (MIT): github.com/TenLux-dev.
Product page: tenlux.tech/stream-subs.
If you are building something similar, or you stream and want to try it, feedback is welcome — we are a small studio, and real use cases shape the roadmap more than feature lists.
