https://andreasnissen.dev/tags/tool-design/Recent content in Tool Design on Andreas NissenHugoen-us© Andreas NissenSat, 29 Aug 2026 00:00:00 +0000https://andreasnissen.dev/writing/from-screenshots-to-governed-tools/Sat, 29 Aug 2026 00:00:00 +0000https://andreasnissen.dev/writing/from-screenshots-to-governed-tools/<p>An agent can use a website by looking at pixels, clicking controls, and reading the result. That is powerful because it works without changing the application.</p> <p>It is also the least explicit way to automate a consequential interface.</p> <p>The agent has to infer what a chart means, which control maps to which action, whether the page changed, and whether an approval actually exists. The human sees a visual interface. The agent reconstructs a hidden API from appearance and behavior.</p>