jundot / omlx
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
正常维护 Apache 2.0 Python Notable
21.0k 1.8k 11 小时前
CIPyPI
apple-silicon inference-server llm macos mlx openai-api
星标趋势
数据积累中，暂无足够数据生成趋势图
AI 分析
项目摘要
jundot/omlx: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
为什么值得关注
High popularity with 20,971 stars, active contributor community (222 contributors), frequent releases.
优势
- Large and active community
- Continuous integration configured
- Test suite present
局限性
- Limited documentation
分析模型：fallback | 分析时间：刚刚