shipwithjev

Catalog / Triage & routing

0320GitHub

jev-curate

Streaming filter and scorer for Parquet and JSONL datasets.

AkashPriyadarshii/jev-curateREADME ↗
# `jev-curate`

**Support:** fuel the next build — [](https://buymeacoffee.com/AkashPriyadarshi)

**High-Throughput Synthetic & Pretraining Dataset Sifter Powered by TypeSafe AI (Jev)**

> Beta: v0.2.0 is experimental. Expect rough edges. Please contribute by opening an issue or PR.

**Live:** [jev-curate.vercel.app](https://jev-curate.vercel.app)

Measured: **23.9 rows/sec** single-node local mock (`bash bench/run_mock.sh`, results in `bench/results/mock.json`). Not measured: **1,500+ rows/sec** is a horizontal-scaling target, not a benchmark result.

**Product Hunt:** [jev-curate Upcoming](https://www.producthunt.com/products/jev-curate?launch=jev-curate) (launches Oct 13, 12:01am PT)

<a href="https://www.producthunt.com/products/jev-curate?embed=true&utm_source=badge-featured&utm_medium=badge&utm_campaign=badge-jev-curate" target="_blank" rel="noopener noreferrer"><img alt="jev-curate - Sift 1B-row datasets 444x cheaper with Jev | Product Hunt" width="250" height="54" src="https://api.producthunt.com/widgets/embed-image/v1/featured.svg?post_id=1272040&theme=light&t=1791323078281"></a>

[](https://pypi.org/project/jev-curate/)
[](LICENSE)
[](https://typesafe.ai)

By **[Akash Priyadarshi](https://github.com/AkashPriyadarshii)**

[Why jev-curate](#why-jev-curate) &bull; [Quickstart](#quickstart) &bull; [CLI Reference](#cli-reference) &bull; [Python API](#python-api) &bull; [Architecture](#architecture) &bull; [Non-Goals](#non-goals) &bull; [Ecosystem](#ecosystem)

</div>

[](https://github.com/AkashPriyadarshii/jev-curate/stargazers) [](https://crates.io/crates/jev-curate) [](https://crates.io/crates/jev-curate) [](https://github.com/AkashPriyadarshii/jev-curate/releases)

---

## Why `jev-curate`?

Cleaning 10M to 1B rows of synthetic reasoning data, instruction tunin

Also filed under Triage & routing

  1. 0613

    momus: staged Rust code and security review

    A fast scanner that reviews code for correctness, security, reliability, compatibility and test gaps, with actionable feedback. Supports the Jev API and local models.

    Brian Luby · Triage & routing

  2. 0602

    Jevops: SRE log triage with Jev

    Jev triages streaming logs into page, digest or resolve, cutting alert noise and paging humans only for high-confidence incidents. About $1–3 for 1M events a month.

    Mu99Ti · Triage & routing · $1–3 per 1M events/month

  3. 0598

    jev-sec-audit: flag risky npm packages with Jev

    npm install is the scariest command in your terminal. One typo → lookalike package → malicious postinstall → secrets gone. jev-sec-audit flags it in milliseconds using Jev, a System 1 model built for fast decisions, not chat. One step in GitHub Actions. Open source.

    @Dhanush_Nehru · Triage & routing

  4. 0555

    Jev Codex Router: model and reasoning selection per call

    A local Codex router asks Jev to choose the next model and reasoning effort while forwarding the complete conversation to that model.

    0xNatoshi · Triage & routing