flashinfer-ai / flashinfer
FlashInfer: Kernel Library for LLM Serving
活跃维护 Apache 2.0 Cuda Tracked
6.8k 1.7k 21 分钟前
CIPyPI
gpu large-large-models cuda pytorch llm-inference jit attention nvidia distributed-inference moe
星标趋势
数据积累中,暂无足够数据生成趋势图
AI 分析
项目摘要
flashinfer-ai/flashinfer: FlashInfer: Kernel Library for LLM Serving
为什么值得关注
Growing community with 6,338 stars, active contributor community (338 contributors), frequent releases.
优势
- Large and active community
- Continuous integration configured
- Test suite present
局限性
- Limited documentation
分析模型:fallback | 分析时间:1 个月前