shipwithjev

Catalog / Research & data

0003X posts

OpenRouter’s Ori Eval

Jev judged a 30-way labelling task faster than every model tested.

OpenRouter ran Jev against popular models on their platform at judging. They reported Jev more than five times faster than the next fastest, with its slowest requests still beating every other model’s median.

Open source ↗ x.comcost-time>5× the next fastest

Also filed under Research & data

  1. 0607

    Verify: new-hire onboarding completion

    An agent reports onboarding done; the judge verifies access and equipment claims.

    everyai-com · Research & data

  2. 0606

    Triage: vague meeting request gets a disposition

    A vendor asks for 30 minutes with no agenda; the judge picks the disposition.

    everyai-com · Research & data

  3. 0605

    Triage: data-loss bug gets a severity

    A note-taking app silently drops edits on flaky networks; the judge grades severity.

    everyai-com · Research & data

  4. 0604

    Triage: crash report routing + reproducibility

    A crash report with steps and logs; the judge routes it and checks reproducibility.

    everyai-com · Research & data