kvcache-ai / ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

活跃维护 Apache 2.0 Python Tracked
19.6k 1.6k 6 天前
CIPyPI
GitHub 项目主页 对比

星标趋势

数据积累中，暂无足够数据生成趋势图

AI 分析

项目摘要

kvcache-ai/ktransformers: A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

为什么值得关注

High popularity with 19,458 stars, active contributor community (124 contributors), frequent releases.

优势

  • Large and active community
  • Continuous integration configured
  • Open source (Apache-2.0)

局限性

  • No visible test suite
  • Limited documentation
分析模型：fallback | 分析时间：1 个月前