little browser agent hack: stop sending screenshots to find buttons. ask Chrome for the accessibili...
Browser Use(@browser_use) · 人工智能
little browser agent hack: stop sending screenshots to find buttons. ask Chrome for the accessibility tree: cdp("Accessibility.getFullAXTree") > every element with role, name and node id > filter to links, buttons, inputs > DOM.getBoxModel -> click the center on Hacker News: 1,764 nodes -> 227 clickable, zero vision tokens Browser Harness agents work this way: github.com/browser-use/br… 💬 3 🔄 2 ❤️ 27 👀 1487 📊 9 ⚡ Powered by xgo.ing