shipwithjev

Catalog / Tools & apps

0118GitHub

OpenJev (Verdict)

An open 151M decision model on ModernBERT, with a WebGPU playground.

Heman10x-NGU/Verdict-open-jevREADME ↗
# OpenJev (Verdict): Non-Autoregressive Decision Engine (151M)

[](https://huggingface.co/heman10x/rlcd-modernbert-151m)
[](https://github.com/Heman10x-NGU/Verdict-open-jev)
[](#running-the-in-browser-webgpu-playground)
[](#upstream-credits-and-licenses)
[](#reinforcement-learning-for-calibrated-decisions-rlcd)
[](LICENSE)

**OpenJev (Verdict)** is an open-source, post-trained foundational decision model designed for structured software workflows, inspired by **TypeSafe AI\'s Jev** and **Reinforcement Learning for Calibrated Decisions (RLCD)**. 

Instead of generating free-form conversational text that software must parse and validate, OpenJev accepts unstructured input context and evaluates multiple typed questions in a **single non-autoregressive forward pass**. It returns discrete choices, ordinal scores, and binary probabilities with mathematically calibrated confidence values in under 35 milliseconds.

---

## What changed in the inference engine

These are inference fixes, not a retrain. The weights are byte-identical to the published checkpoint. Measured on the 231 public JevBench tasks.

<p align="center">
  <img src="assets/v1.4/benchmark-leaderboard-chart.png" alt="JevBench Score Leaderboard: openJev Verdict v1.4" width="100%">
</p>

<p align="center">
  <img src="assets/v1.4/benchmark-leaderboard-table.png" alt="JevBench Detailed Evaluation Table: openJev Verdict v1.4" width="100%">
</p>

The update addresses three defects in the inference engine:

1. Calibrator auto-loading and removal of the 5-option scope restriction: The engine previously failed to load `calibrator.json` during standalone instantiation, running at uncalibrated temperature 1.0. A scope check also limited calibration exclusively to 5-candidate queries, leaving other cardinalities unscaled. 

Also filed under Tools & apps

  1. 0573

    Support chat: agent offered a human escalation path

    A frustrated customer hits a bot loop twice; the judge checks whether a human handoff was offered.

    everyai-com · Tools & apps

  2. 0572

    Subscription cancel: effective date is explicit

    An agent cancels a subscription; the judge checks the exact date the cancellation takes effect.

    everyai-com · Tools & apps

  3. 0571

    Sales quote: numbers match the official price list

    An agent quotes $29/seat against a price list; the judge checks the quote matches exactly.

    everyai-com · Tools & apps

  4. 0570

    Refund chat: agent stated the amount before issuing it

    A support agent issues a $42.50 refund; the judge checks the exact amount was stated before the refund was confirmed.

    everyai-com · Tools & apps