callstack / agent-device

项目摘要

agent-device is a device automation CLI that enables AI agents to control and inspect real apps across iOS, Android, TV, web, and desktop platforms. It provides token-efficient accessibility snapshots, semantic element references, and rich evidence capture (screenshots, videos, logs, traces) to ground AI agent workflows in actual device behavior rather than code reasoning alone.

为什么值得关注

It bridges the gap between AI agents and physical device interaction, offering a purpose-built tool for agent-driven mobile testing with thoughtful design around token efficiency, structured accessibility data, and MCP integration. With 3,400+ stars and 100 releases in 6 months, it's rapidly becoming a key infrastructure piece for AI-agent-based app verification.

优势

• Cross-platform support spanning iOS, Android, TV, web, and desktop with native, Expo, Flutter, and React Native compatibility
• Token-efficient design optimized for AI agent consumption with semantic refs and structured accessibility snapshots
• Comprehensive evidence capture including screenshots, videos, network traces, performance samples, and crash context
• Strong engineering practices with CI, tests, 35 contributors, and active release cadence
• MCP server support for seamless integration with AI agent ecosystems

局限性

• Relatively new project (created January 2026) with a rapid release cycle that may indicate API instability
• Web platform support is minimal compared to mobile, delegating to agent-browser for browser sessions
• Requires physical devices, simulators, or emulators, adding infrastructure complexity for CI pipelines

使用场景

• AI agent-driven end-to-end mobile app testing and verification on real devices
• Automated debugging workflows where agents inspect UI state and capture diagnostic evidence
• Cross-platform app verification with repeatable .ad script replay for CI pipelines
• QA harness integration for autonomous mobile app quality assurance