Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// Inference & local runtime

google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Official · Google AI EdgeApache-2.0Active

GitHub ↗Website ↗

01Overview

google-ai-edge/LiteRT-LM is an official Google AI Edge repository in our “Inference & local runtime” category, written mainly in C++ and licensed under Apache-2.0. As of 2026-10-23 it has 6,715 stars and 765 forks, ranking #39 of 62 tracked Inference & local runtime repos and #720 of all 1046 repos we track. It was created on 2025-04-14 (about 1.5 years ago); the latest commit is from 2026-10-22, so it is actively updated. The latest release is v0.18.1 (2026-10-21), with 2 releases in the last 30 days.

GitHub topics:edge-aion-device-aion-device-llm

02Recent releases

03Related repos (shared GitHub topics)

  • cactus-compute/cactus ★ 6,149 · edge-ai, on-device-aiQuantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

04More from Google AI Edge

Vendor page →

05Same category

All repos →
ggml-org/llama.cpp LLM inference in C/C++ Inference & local runtime · official★ 132k vllm-project/vllm A high-throughput and memory-efficient inference and serving engine for LLMs Inference & local runtime · official★ 95.2k mudler/LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. Inference & local runtime★ 49.9k exo-explore/exo Run frontier AI locally. Inference & local runtime★ 48.0k ray-project/ray Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. Inference & local runtime★ 44.1k

FAQ

What licence does LiteRT-LM use?

Apache-2.0, as shown on GitHub. Check the LICENSE file in google-ai-edge/LiteRT-LM before commercial use.

Is LiteRT-LM still maintained?

The last commit was on 2026-10-22 (1 days before 2026-10-23) and the latest release is v0.18.1 from 2026-10-21.

How popular is LiteRT-LM among Inference & local runtime projects?

#39 of 62 by stars (6,715). The most-starred in this category is ggml-org/llama.cpp (132k).

Data updated: GitHub OSS radar(UTC+8)