TipTour

# TipTour

**This and That**

[](./LICENSE)
[](https://www.apple.com/macos)

</div>

A macOS menu bar companion with two modes, powered by your own API keys.

| Mode | Shortcut | What it does |
| --- | --- | --- |
| Gemini realtime | Ctrl+Option | Talk about your screen and ask for one desktop action per turn. Press again to stop. |
| JEV text | Ctrl+K | Type a click-based task. JEV chooses from locally detected controls, then TipTour executes and validates each action. |

**JEV is selected by default.** On first launch, choose JEV or Gemini, save that mode’s API key, then grant its permissions. JEV does not require microphone access. You can switch later in **Settings → Models**, which shows only the selected mode’s key field. Keys stay in macOS Keychain. There are no shared keys, hosted key proxies, or keys loaded from other projects.

Shortcuts activate only the selected mode. The primary menu-bar button and welcome hint follow your selection.

## Using TipTour

- Gemini supports clicking, typing, shortcuts, app/URL opening, scrolling, and highlighted text edits. It also supports creating an Apple Notes note from supplied content.
- JEV supports single, double, and right clicks. It reads screen labels and locations from local detection; it cannot see images or generate replacement text. Use Gemini for writing or keyboard actions.
- Press **Escape** in the text panel or click **Stop** to cancel JEV. JEV acts on its top-ranked target without a confidence cutoff. The loop stops when JEV chooses none or reports completion, on an execution pause/failure, or at its 12-action limit.
- Hold **Ctrl+Shift** and paint over an area to give Gemini focus context.
- Hold **Ctrl+Option+Command** for the Speak / Type / Highlight shortcut chooser.
- **Auto-click** lets TipTour act. **