shipwithjev

Catalog / Tools & apps

0063GitHub

jev-crawlers

Bug-hunting crawlers built from five Unix-style primitives.

Recursive crawlers that look for bugs, built out of seed, expand, judge, verify and report. Every node in the crawl carries its own typed judgment from Jev.

russfranky/jev-crawlersREADME ↗
# jev-crawlers

Small unix tools for bug-discovery, powered by Jev. One tool, one job, JSON lines on stdin/stdout, composed with pipes.

AI writes code faster than humans can review it. Linters match patterns. One-shot AI reviewers read a diff once and stop. Few tools follow the lead: they never ask "who else calls this?", "what config changes it?", "where does this input become trusted?" These tools do, and keep going until the lead dries up.

The trick is cheap judgment. [Jev](https://vercel.com/docs/ai-gateway) (typesafe-ai/jev, via the Vercel AI Gateway) returns typed verdicts, choice, boolean, and score, for about $0.00006 per normal node in our calibration runs. When each judgment costs a fraction of a cent, you can judge every node instead of every scan.

## The tools

Each tool reads JSON lines on stdin and writes JSON lines on stdout. They compose with plain shell pipes:

```
jev-seed --repo X | jev-judge | jev-verify | jev-report
```

- **jev-seed**: emits starting leads, one per line. Sources: the current diff, TODO and FIXME comments, and risky patterns (auth, money movement, eval, shell). Human false-positive verdicts (`data/fp-verdicts.json`) suppress exact repeats; suppressions log to stderr.
- **jev-expand**: follows context cues from one lead. It finds symbol references (callers), files that change together in git history, and config files that name the symbol. Mechanical. No model calls.
- **jev-judge**: one Jev call per node. Typed answers: a `verdict` suggestion
  (expand, report, prune, escalate), a `bug_likely` ranking signal, a `risk`
  score from 0 to 3, and whether a falsifiable artifact is stated. Routing
  follows the risk bands; no route is gated on a raw boolean. Recent
  human false-positive verdicts ride along as negative examples.
- **jev

Also filed under Tools & apps

  1. 0573

    Support chat: agent offered a human escalation path

    A frustrated customer hits a bot loop twice; the judge checks whether a human handoff was offered.

    everyai-com · Tools & apps

  2. 0572

    Subscription cancel: effective date is explicit

    An agent cancels a subscription; the judge checks the exact date the cancellation takes effect.

    everyai-com · Tools & apps

  3. 0571

    Sales quote: numbers match the official price list

    An agent quotes $29/seat against a price list; the judge checks the quote matches exactly.

    everyai-com · Tools & apps

  4. 0570

    Refund chat: agent stated the amount before issuing it

    A support agent issues a $42.50 refund; the judge checks the exact amount was stated before the refund was confirmed.

    everyai-com · Tools & apps