ActiveLitellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Quick Answer
- 1. Litellm gives AI agents ai & ml capabilities with 54,085 GitHub stars and a quality score of 99/99.
- 2. Install: Run
pip install litellmor add the config to your MCP client. - 3. Runtime: python — no authentication required.
- 4. Health: Actively maintained — last checked 7/29/2026.
Overview
Category: AI & ML
Runtime: python
Install: pip install litellm
Auth: No auth required
Source: community
Stars: 54,085
Setup time: ~30 sec
What You Can Build
With the Litellm MCP server, your AI assistant can:
- Access ai & ml functionality through natural language
- Use the server immediately with no API key setup
- Combine with other MCP servers for cross-tool automation workflows
- Run with python for reliable, consistent deployments
Health Status
ActiveLast commit: 7/20/2026
Checked: 7/29/2026
Page updated: June 13, 2026
One-Click Install
Copy the snippet for your MCP client and paste it in.
Claude Desktop
Add to claude_desktop_config.json
{
"mcpServers": {
"litellm": {
"command": "pip",
"args": [
"install",
"litellm"
],
"env": {}
}
}
}Cursor
Settings → MCP Servers → Add
{
"mcpServers": {
"litellm": {
"command": "pip install litellm"
}
}
}Saves as .cursor/mcp.json in the download. Move it to your project root.
VS Code
Use with MCP extension
{
"mcpServers": {
"litellm": {
"command": "pip install litellm"
}
}
}SDK & Code Integration Examples
Connect to Litellm programmatically using TypeScript or Python MCP SDKs.
import { Client } from "@modelcontextprotocol/sdk/client/index.js";
import { StdioClientTransport } from "@modelcontextprotocol/sdk/client/stdio.js";
// Initialize Litellm MCP client transport
const transport = new StdioClientTransport({
command: "pip",
args: ["install","litellm"],
});
const client = new Client(
{ name: "mcp-app-client", version: "1.0.0" },
{ capabilities: { tools: {} } }
);
async function connectAndRun() {
await client.connect(transport);
const tools = await client.listTools();
console.log("Connected to Litellm. Available tools:", tools);
}
connectAndRun().catch(console.error);MCP Server Configuration
Add this to your claude_desktop_config.json
{
"mcpServers": {
"litellm": {
"command": "pip",
"args": ["install","litellm"],
"env": {}
}
}
}Topics
Error Resolution & Troubleshooting Matrix
Common JSON-RPC protocol error codes and environment troubleshooting for Litellm.
-32600 (Invalid Request)Cause: Malformed JSON-RPC payload sent to server
Resolution: Verify MCP client payload adheres to JSON-RPC 2.0 specs.
-32601 (Method Not Found)Cause: Requested tool or resource method does not exist
Resolution: Call list_tools() to inspect supported tool names.
-32602 (Invalid Params)Cause: Missing or invalid tool arguments
Resolution: Check argument schema types against tool definition.
-32603 (Internal Error)Cause: Unhandled execution exception inside server process
Resolution: Inspect process stderr logs or check API key credentials.
AUTH_KEY_MISSINGCause: Required environment variable not set in MCP config
Resolution: Define required API key under 'env' object in claude_desktop_config.json.
STDIO_PIPE_CLOSEDCause: Server process crashed on startup
Resolution: Run install command manually in terminal to inspect error output.
Quality Score
Automated quality ranking of maintaining source repository.
Own this server?
Claim your listing to update description, links, and category — and get a verified badge.
Claim this listing →Similar MCP Servers
Other servers in the AI & ML category.
Awesome DeepSeek Integration MCP Server
Model Context Protocol (MCP) server integration for DeepSeek V3 and DeepSeek R1 models. Connect DeepSeek AI reasoning, chat completion, function calling, and code generation to Claude Desktop, Cursor, and AI agents.
DeepSeek MCP Server
MCP server for DeepSeek V3 and R1 models — chat, reasoning mode, code completion, and cost tracking for AI client tools.
Brave Search MCP
MCP server for Brave Search API — web and local search results through AI agents.
OpenAI MCP Server
MCP server for OpenAI — access GPT models, embeddings, and assistants through standard MCP interface.