// Software stack
Local private LLM
Keep data on-device while running chat, APIs and simple agents.
4 pieces4 setup stepsscenario: Run models on your own machine
💡 Beginners: LM Studio or Ollama + Open WebUI (see “Run LLMs on your computer”). The chat UI and memory parts here are trending GitHub projects, better for experimenting.
What goes in it
- 1
LM Studio Local inference & serving Closed / commercial
Inference runtime
Desktop app to download and run local LLMs with an OpenAI-compatible server.
- 2 ★ 38k
llmfit Local inference & serving Open source
Hardware fit check
One command to find which models and providers fit your hardware.
- 3 ★ 14k
Open-LLM-VTuber AI apps & chat clients Open source
Chat UI
Talk to any LLM with hands-free voice and Live2D.
Or: airi · private-gpt
- 4 ★ 60k
mempalace Memory & context Open source
Memory
Open-source AI memory system with strong public benchmarks.
Or: supermemory · engram
How to set it up
- 01Use llmfit / whichllm to see what your machine can run
- 02Install LM Studio or osaurus and download a model
- 03Turn on the OpenAI-compatible API
- 04Connect a memory layer and your usual clients
Similar stacks: what’s different
- Run LLMs on your own computerThat one is the mainstream, stable starter set