smg-project / smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

活跃维护 Apache 2.0 Rust Notable
679 200 3 分钟前
CI
anthropic claude gemini inference-gateway llm openai routing sglang vllm tensorrtllm anthropic-api chat mcp responses-api trtllm lightseek tokenspeed
GitHub 项目主页 对比

星标趋势

数据积累中，暂无足够数据生成趋势图

AI 分析

项目摘要

smg-project/smg: Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

为什么值得关注

active contributor community (161 contributors), frequent releases.

优势

  • Continuous integration configured
  • Open source (Apache-2.0)
  • Regular release cadence

局限性

  • No visible test suite
  • Limited documentation
分析模型：fallback | 分析时间：刚刚