shipwithjev

Blog / Questions / FIG. 122

Can Jev Summarize Text? (No; Here's the Split)

Can Jev summarize? No: Jev does no text generation. The split that works: a chat model writes the summary, Jev makes the decisions around it.

No. Jev, TypeSafe AI's decision model, does not summarize, because summarizing is writing and Jev does no text generation of any kind. It answers closed questions (a label, a yes/no, a score, a pick from a list), and a summary is none of those.

This is the sibling of the can Jev write code question, and the answer has the same shape: not a replacement, a partner. The useful move is to split the job.

The split: chat model writes, Jev decides

A summarization feature is rarely just "write a summary". It's a pile of small decisions with one piece of writing in the middle. Pull them apart:

Before the summary (Jev): Does this document need summarizing at all? Which sections are relevant to the reader's question? Is it in scope, in the right language, readable enough to process? These are closed questions, and at builder-reported prices, asking them of everything is cheap.

The summary (a chat model): A frontier or small chat model composes the text. This is the generation step, and it belongs to a model built to write. The Jev vs GPT comparison maps which jobs belong to which side.

After the summary (Jev): Does the summary state anything the source doesn't support? Does it mention the refund amount? Does it drop the deadline? Faithfulness checks are judge questions, and a decision model is a natural judge for text it didn't write.

Route the uncertain cases to a person or a bigger model per the cascade pattern, and you have a summarization pipeline where the expensive model only does the part that needs it.

Often you didn't need a summary

Many "summarize this" requests are really "tell me what's in this", and a table of judgments answers that better than prose. One builder ran 3,282 X posts through eight questions each about topic, hook, tone, and whether the post teaches something, for $0.1282, as reported. The output wasn't a summary; it was a queryable dataset. A sales-call coach in the directory takes the same line, as reported: the call is turned into judgments rather than a summary, and the coach reports on those.

If what you want is to sort, count, filter, or compare, ask Jev the questions directly and skip the prose.

Frequently asked questions

Can Jev generate any text?

No. It returns structured answers from closed sets, with a probability per choice per ecosystem documentation; no summaries, rewrites, or replies.

What should I use to summarize text then?

A chat model for the summary itself, with Jev handling the decisions around it: what to summarize, and whether the result is faithful to the source.

Can Jev check whether a summary is accurate?

It can answer closed faithfulness questions about a summary and its source, such as whether a specific claim is supported. Keep a human or bigger model on low-confidence verdicts.

Is a table of verdicts ever better than a summary?

Often, when the goal is analysis rather than reading: judgments can be counted, filtered, and compared, and prose can't. The x-post-analysis build is the reported example.

Numbers throughout are as reported by the build authors, not verified by shipwithjev. Code-shaped examples are pseudocode; the official docs live at docs.typesafe.ai.