// Software stack
Local voice assistant
Speech recognition, a local LLM and speech synthesis all running on your machine, without cloud APIs.
4 pieces4 setup stepsscenario: Run models on your own machine
What goes in it
- 1 ★ 26k
faster-whisper Speech recognition & synthesis Open source
Speech to text
Faster Whisper transcription with CTranslate2
- 2 ★ 184k
Ollama Local inference & serving Open source
Local LLM
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
- 3 ★ 24k
CosyVoice Speech recognition & synthesis Open source
Text to speech, strong in Chinese
Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
- 4 ★ 5.6k
Kokoro-FastAPI optional Speech recognition & synthesis Open source
Lightweight TTS server
Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI
How to set it up
- 01Speech-to-text with faster-whisper (officially up to 4× faster than openai/whisper at the same accuracy)
- 02Run a local model with Ollama in the middle
- 03Use CosyVoice for Chinese speech and Kokoro for lightweight English speech
- 04Measure end-to-end latency before choosing model sizes
✓ Good fit
- Offline use, no voice uploads
✗ Look elsewhere if
- Lowest latency and most natural voice: cloud voice services are more mature