typesafe-computer-use
Computer use on macOS, with one Jev decision per step.
**typesafe-computer-use** (jev for short) drives a Mac toward a goal you type in plain English, for about a fiftieth of a cent per step. It reads the screen deterministically, asks a small classifier which action comes next, and only calls a writing model when a text field genuinely needs free text or the classifier has stopped and the screen needs reading. One idea runs through it: the classifier picks, code decides facts, and the writer only writes free text. Anything a model would have to work out (a date, whether a field is focused, whether a URL is clean) is computed in code and handed over as state. [VISION.md](VISION.md) says what it is for in a dozen lines. ``` clicker "go to techcrunch and take me to the checkout page for the cheapest tickets to their next upcoming event" --act ``` > **Beta.** This is under heavy development. Expect rough edges, and expect settings and > behavior to change between 0.x [releases](https://github.com/awlevin/typesafe-computer-use/releases). > It drives your real mouse and keyboard, so start with a dry run. ## Why a classifier Frontier-model computer use is capable and expensive: every step ships a screenshot and waits several seconds for a plan. Most steps do not need a plan. They need one choice from a short list, made quickly and cheaply, with a confidence number you can gate on. [TypeSafe](https://docs.typesafe.ai) sells exactly that: a decision model that answers a `Choice` over up to 255 options with a full probability distribution and a calibrated confidence, in a few hundred milliseconds, with free output tokens. This project is a computer-use loop built around it. Measured on the same screenshot and goal, one decision each: | | typesafe (jev) | Claude Opus 5, bare screenshot | multiplier | |---|---|---|---| | input