TipTour lives in the Mac menu bar with two modes. In the Jev mode you press Ctrl and K, type a click-based task, and Jev chooses the right control from a list of on-screen elements that a small local model has already found and labelled.
The screen is never sent anywhere. A local model on the Mac's own machine-learning chip finds every button, on-device text reading adds the labels, and only that text plus your typed task and recent actions go to Jev. TipTour then does the click and checks that it worked.
The other mode uses Gemini's live voice so you can talk about your screen. You bring your own API keys for whichever mode you choose, and you can stop a Jev run at any time with Escape.
What you get
- Full Swift source code and Xcode project under the MIT license
- Notes on the source layout and how the local test harness works
- Isolated tests for Jev's decisions
Jev
Swift
macOS
CodeRabbit Top10
TypeScript
React
FastAPI
Next.js
Vercel
Python