Poinky Launches: Open-Source macOS Desktop Assistant with Voice Interaction and Screen Awareness
Show HN: Poinky – Claude Code you talk to, that sees your screen
Developers have open-sourced Poinky, a macOS desktop assistant powered by Claude Code and the Anthropic API that delivers visual screen perception, voice Q&A, and on-screen annotation guides. Users can hold a hotkey to ask voice questions about on-screen content, while the assistant speaks and simultaneously draws step-by-step guides, circles click targets, or helps type text. By default, the project runs the Kokoro voice model locally and provides a one-line script for local build, installation, and permissions setup.
By transforming Claude Code and screen understanding into a voice assistant housed in the macOS notch, the project showcases a viable implementation of multimodal, companion-style desktop interaction.
Source:Hacker News · AI · github.com