agent-desktop Released: A Cross-Platform Desktop Accessibility Tree Control CLI for AI Agents
Vercel: Computer use CLI for AI agents
agent-desktop has been released as a CLI and C library tool that enables AI agents to inspect desktop application UIs via accessibility trees and return structured JSON. The tool includes no built-in models; instead, it assigns refs to actionable elements, allowing external scripts to close the "observe-act-verify" loop. It focuses solely on native desktop apps without relying on raw pixel matching. With cross-platform support for macOS, Windows, and Linux, it provides a unified set of 60 basic action commands.
Relying on OS accessibility trees rather than pure visual pixel matching, it offers developers a lightweight interface solution for building cross-platform desktop automation agents.
Source:Hacker News · AI · agent-browser.dev