shipwithjev

Catalog / Tools & apps

0033GitHub

pi-jev-skill-picker

Ranks the Pi agent’s skills for the task in front of it.

Safzan Pirani’s picker scores every installed skill with Jev and hands the agent the ones that fit, instead of loading them all.

safzanpirani/pi-jev-skill-pickerREADME ↗
# pi-jev-skill-picker

A Pi extension that keeps the Agent Skills catalog out of model requests and replaces it with one ranking tool backed by [TypeSafe's Jev](https://docs.typesafe.ai) System One model.

Skills stay loaded, so `/skill:name` keeps working. Before each agent turn the extension removes Pi's generated `<skills>` catalog from the effective system prompt and gives the model two tools to pull skills in on demand.

`skill_search` takes a plain-language description of the task, rates every enabled skill against it, and returns the complete `SKILL.md` instructions of the skills that apply.

## What it saves

On a 137-skill catalog the generated `<skills>` block runs about 19,000 tokens, which is 87% of Pi's system prompt. Pi resends it on every request.

Both rows below use the same captured prompt and one trivial turn:

| Model | Catalog present | Catalog stripped | Saving |
|---|---|---|---|
| `gpt-6-astra` | 21,074 tokens, $0.2107 | 2,541 tokens, $0.0254 | 87.9% |
| `deepseek-v4.1-flash` | 22,377 tokens, $0.0034 | 3,434 tokens, $0.0005 | 84.6% |

One `skill_search` call costs about 38,600 Jev input tokens, or $0.0016 at $42 per billion. Jev bills input only. Against `gpt-6-astra` that is under 1% of what a single un-stripped request wastes.

## How the ranking works

Each skill becomes its own Score question. The task goes in the shared `state`, and the skill's name and description go in that skill's own `instructions`. Jev judges each skill without seeing the others, so no keyword prefilter can drop one first.

Every skill is rated on the same three ordered levels:

| Level | Meaning |
|---|---|
| 0 | Unrelated. A different domain, tool or workflow. |
| 1 | Adjacent. Same general area, not the specific thing the task needs. |
| 2 | Directly applicable. Cove

Also filed under Tools & apps

  1. 0573

    Support chat: agent offered a human escalation path

    A frustrated customer hits a bot loop twice; the judge checks whether a human handoff was offered.

    everyai-com · Tools & apps

  2. 0572

    Subscription cancel: effective date is explicit

    An agent cancels a subscription; the judge checks the exact date the cancellation takes effect.

    everyai-com · Tools & apps

  3. 0571

    Sales quote: numbers match the official price list

    An agent quotes $29/seat against a price list; the judge checks the quote matches exactly.

    everyai-com · Tools & apps

  4. 0570

    Refund chat: agent stated the amount before issuing it

    A support agent issues a $42.50 refund; the judge checks the exact amount was stated before the refund was confirmed.

    everyai-com · Tools & apps