LLM Frameworks

A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

Self-evolving Context Database for AI Agents. Unify Agent Memory, Knowledge RAG and Skills.

⌥ Coding agent with the IDE wired in

Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

Open source observability platform for logs, metrics, traces, frontend monitoring, pipelines and LLM observability. A sophisticated, simple and highly performant alternative to Datadog, Splunk, and Elasticsearch with 140x lower storage costs and single binary deployment.

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

The programming language for agents

AirLLM 70B inference with single 4GB GPU

Turn any technical book PDF into a Claude Code skill — ready to study, reference, and use while you work.

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Prompt as Code | GPT-Image2 工业级提示词引擎与模板库，530+ 个案例逆向工程，20+ 套工业级模板，并提炼出Skills，持续更新中

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

Hundreds of models & providers. One command to find what runs on your hardware.

RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs

利用 AI 大模型和自动化工作流，根据主题或关键词一键生成高清短视频。Generate HD short videos from a topic or keyword with an automated AI workflow.

Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / WeChat(企业微信, 企微智能机器人, 公众号) / 飞书 / 钉钉 / QQ / Matrix e.g. Integrated with ChatGPT(GPT), DeepSeek, Dify, n8n, Langflow, Coze, Claude, Gemini, GLM, Ollama, SiliconFlow, Moonshot, openclaw / hermes agent, deerflow

Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.

[EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation

Agent skill that removes signs of AI-generated writing from text

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

GitNexus: The Zero-Server Code Intelligence Engine - GitNexus is a client-side knowledge graph creator that runs entirely in your browser. Drop in a git repository (Github, Gitlab, Azure, Local) or ZIP file, and get an interactive knowledge graph with a built in Graph RAG Agent. Perfect for code exploration

🪢 Open source AI engineering platform: LLM evals, observability, metrics, prompt management, playground, datasets. Integrates with OpenTelemetry, LangChain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

⚙️🦀 Build modular and scalable LLM Applications in Rust

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Find secrets with Gitleaks 🔑

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

14MB foundation model for tiny devices; phones, wearables, smart home, and robots.

Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

Python scraper based on AI

TSP自托管、零运维的 A 股「选股 + 监控 + 回测」量化工作台 | 基于 TickFlow 数据源 | LLM能力驱使策略定制+个股分析+复盘 | 自由接入第三方数据源与个性化扩展数据 | 个人开源 ,非第三方官方项目

GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questions into trusted dashboards, charts, and SQL across 20+ data sources, such as BigQuery, Snowflake, PostgreSQL, ClickHouse, Amazon Redshift, Databricks and more.

ConardLi's open-source Skills collection, featuring web design, knowledge retrieval, image generation, and more.

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

Incremental engine for long horizon agents 🌟 Star if you like it!

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience

A modular graph-based Retrieval-Augmented Generation (RAG) system

How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.

Skill that audits and rewrites content to remove AI writing patterns. Use it with your favorite agents including Claude Code, OpenClaw, Codex, and Hermes.

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

🚀 The fast, Pythonic way to build MCP servers and clients.

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

The ultimate RAG for your monorepo. Query, understand, and edit multi-language codebases with the power of AI and knowledge graphs

Fully automatic censorship removal for language models

Open-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

The batteries-included agent harness.

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

PipesHub is an open-source fully extensible AI context layer that unifies your business data for explainable enterprise search and agentic workflow automation.

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

LLM 驱动的多市场股票智能分析系统：多源行情、实时新闻、决策看板与自动推送，支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications, and cost-free scheduled runs.

The context API to search, scrape, and interact with the web at scale. 🔥

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

🚀 Efficient implementations for emerging model architectures

Open-source inference server and production cluster for all the models your agent needs.

Appwrite® - complete cloud infrastructure for your web, mobile and AI apps. Including Auth, Databases, Storage, Functions, Messaging, Hosting, Realtime and more

Structured Outputs

Browser Harness | Self-healing harness that enables LLMs to complete any task.

Extracted system prompts from Anthropic - Claude Fable 5, Opus 5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-5.6-Sol, Codex. Google - Gemini 3.5 Flash, 3.1 Pro, Antigravity. xAI - Grok, Cursor, Copilot, VS Code, Perplexity, and more. Updated regularly.

AI Client for chat, RAG, plans, MCP tools, and agents. Support multiple LLMs (Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM, Gemini, OpenRouter)

📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG

本地私有、开源的自进化跨平台 AI 内容发现 Agent：先理解你，再主动从 B站、小红书、抖音、YouTube、X、知乎、Reddit、微博等平台与开放 Web 寻找内容。（支持 deepseek harness 插件） | Local-first open-source cross-platform AI content discovery agent: understands you, then proactively finds content across Bilibili, Xiaohongshu, Douyin, YouTube, X, Zhihu, Reddit, Weibo and the open web.（support deepseek harness plugin）

✨多agent实现全自动AI小说生成

开箱即用的AI标书编写工具，标书AI生成工具，投标工具箱、知识库、标书查重、废标项检查，完全开源免费，欢迎使用

Practical patterns, starters & CLI tools for loop engineering with AI coding agents. Design systems that prompt and orchestrate agents (inspired by Addy Osmani and Boris Cherny). Includes loop-audit, loop-init, loop-cost.

OpenKB: Open LLM Knowledge Base

Run LLMs on AMD Ryzen™ AI NPUs in minutes; purpose-built and deeply optimized for the AMD NPUs.

🪨 why use many token when few token do trick — Claude Code skill that cuts 65% of tokens by talking like caveman

The classic Sillytavern, now has been rewritten in Tauri/Rust.

An ops AI Agent that understands your infrastructure, finds the root cause, and fixes it — right from Slack, Telegram, Lark or DingTalk.

100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.

🏖️ A serverless, open-source file hosting solution built on Cloudflare. Supports image hosting, secure file storage, and personal cloud drive capabilities.

Python tool for converting files and office documents to Markdown.

Modular logistics and supply chain operating system (LSOS)

QuantMind is an agent-native knowledge extraction and retrieval framework for quantitative finance.

Simple, unified interface to multiple Generative AI providers

ADHD — a skill for coding agents. Tree-of-thought with pruning, built on the Claude & Codex Agent SDK. Fans out parallel divergent thoughts under different cognitive frames, scores, prunes traps, deepens the survivors. The no-brainer skill for creative and interdisciplinary work.

程序员鱼皮的 AI 资源大全 + Vibe Coding 零基础教程，分享 OpenClaw 保姆级教程、大模型玩法（DeepSeek / GPT / Gemini / Claude / GLM）、最新 AI 资讯、Prompt 提示词大全、AI 知识百科（Agent Skills / RAG / MCP / A2A）、AI 编程教程（Harness Engineering）、AI 工具用法（Cursor / Claude Code / TRAE / Codex / Copilot）、AI 开发框架教程（Spring AI / LangChain）、AI 产品变现指南，帮你快速掌握 AI 技术，走在时代前沿。本项目为开源文档 aiguide，已升级为鱼皮 AI 导航网站

Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D taking face running locally across platforms

🦋 An Infographic Generation and Rendering Framework, bring words to life with AI!

List of Permanent Free LLM API (API Keys)

OBLITERATE THE CHAINS THAT BIND YOU

Build AI Agents, Visually