// AI news · 2026-11-13 · AWS Machine Learning Blog
Building LLM Gateway with Amazon Bedrock and LiteLLM
A self-service LLM gateway is built using Amazon Bedrock Application Inference Profiles and LiteLLM on AWS Fargate, exposing foundation models via an OpenAI-compatible API.
Published 2026-11-13 02:41 (Beijing time)Source AWS Machine Learning BlogAuto-summarised, fact-checked against source
01Summary
Developers access models through a single key with no direct Amazon Bedrock interaction. Platform teams gain per-user cost control, quota isolation, and observability. The solution includes RDS for state tracking, ElastiCache for caching, and Langfuse for prompt-level telemetry. Enterprise version of LiteLLM is required for self-service key issuance.
Summarised from the original article by an open-source model, then checked automatically: every number and English name must appear in the source. The original article is authoritative.
02Key points
- Exposes Bedrock models via OpenAI-compatible API.
- Provides per-user cost control and quota isolation.
- Uses RDS and ElastiCache for state and caching.
- Requires LiteLLM Enterprise for self-service key issuance.
03Source
Building a self-service LLM gateway with Amazon Bedrock and LiteLLM
AWS Machine Learning Blog · published 2026-11-13 02:41 Beijing time
05Related news
- Same source · Fine-grained access control for Bedrock KB tools2026-11-12 · AWS Machine Learning Blog
- Same source · Natera builds lab ops AI on Amazon Bedrock AgentCore2026-11-13 · AWS Machine Learning Blog
- Same topic · How Enterprises Deploy OpenAI Codix on AWS Bedrock2026-11-12 · AWS Machine Learning Blog
- Same topic · OpenAI and Databricks Enable Enterprise AI on Governed Data2026-11-13 · Databricks Blog
- Same day · IBM Releases LLMON Markup for Granite 4.1 Models2026-11-13 · Hugging Face Blog
From AIMap AI news: collected from 1,100+ official and media sources. Summaries only restate the original article; follow the link for the full story. All stories of 2026-11-13 · Archive by date · All AI news · Today