Glass is purpose-built for software development, and aims to enable headless, parallelized agent work while the user continues to use the machine unhindered[0]. It minimizes token usage, increases consistency, and just goes faster by preferring to interact with an app's accessibility tree, before taking the screenshot route (which glass also fully supports).
Glass is cross-platform and the code is Apache-2.0 licensed. We release builds for Linux, Windows, and macOS hosts. Glass supports development targeting the three above host platforms, Android (all hosts) and iOS[1] (macOS hosts). The internal API is backend-agnostic, and new platforms can be added in the future pretty easily.
Feedback is very welcome, either here or at github. If it breaks on your app, I am especially interested in knowing about that. I hope you build great things.
[0] Due to the license enforcement on Windows and macOS, isolated headless development targeting those platforms requires a VM. It will otherwise interact directly with the desktop. Android and iOS development on those platforms can still be done headlessly via the emulators.
[1] The iOS backend does not currently support multi-touch gestures.