shipwithjev

Catalog / Tools & apps

0361GitHub

jev-scout

MCP server that scores an agent's every search query, result, and fetched page for relevance and credibility, with session budgets, SSRF-guarded fetching, and a live decision…

kierandotai/jev-scoutREADME ↗
# jev-scout

MCP stdio server exposing `guarded_search`, `guarded_fetch`, and
`research_report`, where every query, result, and fetched page is scored by
Jev (TypeSafe's System One decision model) with atomic, observable-signal
criteria — and every decision streams to a live local dashboard.

## What it is

Agents research the web through opaque built-in tools: nobody sees which
sources they trusted, what they skipped, or what junk steered them. Jev's
economics (per-decision cost around $0.0001, latency 70–500ms) make it viable
to judge *every* research step rather than sampling a few. jev-scout wraps a
pluggable search backend and a page fetcher with one Jev call per result
(relevance, credibility, worth-fetching) and one Jev call per fetched page
(answered, content class, steering risk), then writes every decision to a
JSONL ledger and streams it to a same-process dashboard over SSE.

jev-scout is built on [TypeSafe](https://typesafe.ai)'s Jev via the
`jev-client` sibling library (`../jev-client`), which isolates the
OpenRouter/TypeSafe provider wiring so jev-scout only talks to a small
`Judge` interface.

jev-scout is deliberately **not** a research agent. There is no multi-hop
planning, no synthesis, no answer-writing — it is a thin decision layer in
front of existing search that annotates (or, optionally, gates) what an
agent sees, and makes the whole process visible. The dashboard shows three
things while an agent works: a live decision feed grouped by search (with
confidence, and an explicit "unscored" badge instead of a misleading 0%
whenever Jev couldn't be reached), a running cost/call ticker, and a
per-domain credibility table.

**Measured, not vibes:** the judging rubrics are validated against a
hand-labeled golden set — relevance 88%, credibility 96% on the

Also filed under Tools & apps

  1. 0573

    Support chat: agent offered a human escalation path

    A frustrated customer hits a bot loop twice; the judge checks whether a human handoff was offered.

    everyai-com · Tools & apps

  2. 0572

    Subscription cancel: effective date is explicit

    An agent cancels a subscription; the judge checks the exact date the cancellation takes effect.

    everyai-com · Tools & apps

  3. 0571

    Sales quote: numbers match the official price list

    An agent quotes $29/seat against a price list; the judge checks the quote matches exactly.

    everyai-com · Tools & apps

  4. 0570

    Refund chat: agent stated the amount before issuing it

    A support agent issues a $42.50 refund; the judge checks the exact amount was stated before the refund was confirmed.

    everyai-com · Tools & apps