flashinfer-ai / flashinfer

FlashInfer: Kernel Library for LLM Serving

活跃维护 Apache 2.0 Python Notable
6.3k 1.4k 1 小时前
CIPyPI
gpu large-large-models cuda pytorch llm-inference jit attention nvidia distributed-inference moe

星标趋势

数据积累中,暂无足够数据生成趋势图

AI 分析

项目摘要

flashinfer-ai/flashinfer: FlashInfer: Kernel Library for LLM Serving

为什么值得关注

Growing community with 6,286 stars, active contributor community (338 contributors), frequent releases.

优势

  • Large and active community
  • Continuous integration configured
  • Test suite present

局限性

  • Limited documentation
分析模型:fallback | 分析时间:刚刚