Hacker News · AI· usetrim·· 7 hours agoSelectedAI score66
Trim open-sources local proxy tool to compress prompts before sending them to LLMs
Trim - local proxy that compresses coding prompts before they reach your LLM
AI guide
Trim has introduced a local proxy for AI coding tools that cuts context size by compressing prompts before requests reach upstream large language models. Featuring a unified, OpenAI-compatible local interface, it integrates directly with tools such as Cursor, Continue, VS Code Chat, and Claude Code, and supports both a fast AST-based compression mode and a deep mode running LLMLingua entirely locally.
Why it matters
By executing heuristic and model-based compression at the local proxy layer, the project provides a drop-in solution to reduce context token overhead for AI coding assistants.
Source:Hacker News · AI · github.com