shipwithjev

Catalog / Tools & apps

0395GitHub

slop-grader

Rule-based text grader that uses Jev scores and line-by-line flags to audit documents against custom rulesets and guide an AI agent to auto-fix violations.

lukstei/slop-graderREADME ↗
# slop-grader


[](https://github.com/lukstei/slop-grader/actions/workflows/ci.yml)
[](https://opensource.org/licenses/MIT)
[](https://www.npmjs.com/package/@lukstei/slop-grader)


Rule-based slop grader for text files, powered by [Jev](https://typesafe.ai).

## How it works

`slop-grader` runs as a two-step loop: grade text with the CLI, then paste the output to your AI agent to plan the improvements.

### 1. Grade the document

Run `slop-grader` on a document like [`examples/slop.md`](examples/slop.md):

```sh
npx @lukstei/slop-grader@latest -r no-ai-slop examples/slop.md
```

<img src="assets/terminal.png" alt="Terminal output" width="550" />

### 2. Fix with an AI agent

Pass the output to your AI agent:

- The agent distinguishes real violations from false positives and generates concrete replacements ([Example with Gemini 3.8 Flash](examples/plan.md)):
  ```markdown
  ### Line 1 — `banned_word`
  - **Original:** `# 🚀 The Ultimate Paradigm Shift in Modern Data Architecture`
  - **Fix:** `# Modern Data Architecture`
  - **Reason:** Removes the banned phrase "paradigm shift" and decorative emoji.

  ### Line 7 — `binary_contrast` + `faux_insight` + `colon_reveal` + `fake_profound_kicker`
  - **Original:** `What most people get wrong about databases is simple: it's not about speed, it's about trust.`
  - **Fix:** `Database design balances speed and trust.`
  - **Reason:** Removes rhetorical framing and fake insight.
  ```
- After your review the plan is applied to produce an [improved document](examples/slop-improved.md).

## FAQ

<details>
<summary><strong>How does evaluation work?</strong></summary>

Evaluation separates line-level checks (spotting specific patterns or phrases) from document-level checks (evaluating tone or overall structure).

Documents have hundr

Also filed under Tools & apps

  1. 0573

    Support chat: agent offered a human escalation path

    A frustrated customer hits a bot loop twice; the judge checks whether a human handoff was offered.

    everyai-com · Tools & apps

  2. 0572

    Subscription cancel: effective date is explicit

    An agent cancels a subscription; the judge checks the exact date the cancellation takes effect.

    everyai-com · Tools & apps

  3. 0571

    Sales quote: numbers match the official price list

    An agent quotes $29/seat against a price list; the judge checks the quote matches exactly.

    everyai-com · Tools & apps

  4. 0570

    Refund chat: agent stated the amount before issuing it

    A support agent issues a $42.50 refund; the judge checks the exact amount was stated before the refund was confirmed.

    everyai-com · Tools & apps