Open · Last updated

Jev for data teams

Data teams should treat Jev as an external labeling/feature function with a model id column, not as a source of numeric truth.

Unofficial data-team notes — not a warehouse product and not TypeSafe’s AutoResearch cookbook (that remains outbound). Confirm facts on docs.typesafe.ai. Open-cluster replicas are not Jev and not endorsed. We do not issue keys.

Warehouse hygiene

Store model, question git SHA, full probability maps, and the action taken. Mark tables as non-deterministic hops. Do not join as if Nouls were identities.

What not to ask Jev

Aggregates, unique counts, date diffs, and “expected revenue from a Score.” Those are SQL.

Feature store pattern

Write Jev outputs as a narrow table: entity_id, as_of, model, question_sha, noul_or_choice, probabilities (JSON), action. Downstream models can consume them (AutoResearch-shaped). Do not overwrite source-of-truth facts with a Noul.

Calibration is your job. TypeSafe trains for calibrated decisions — that is a vendor claim. Plot reliability on your labels before you use a Noul as P(churn).

Columns the narrow table still needs

Make that feature-store row append-only and add the fields audits actually ask for:

Column Notes
entity_id The thing you judged
as_of When the hop ran
door First-party vs gateway
model response.model, not the alias you intended
question_sha Git of instructions/criteria/floors
primitive Choice / Score / Noul
noul_or_choice The typed answer
probabilities JSON, full map
action Policy enum, including timeout
input_tokens From usage

Churn flags, revenue, unique counts, and date diffs stay in SQL. Jaggedness: jev-1.13 is the wrong engine for math and date order. Joins that treat Nouls as identities will invent cohorts. Pin jev-1.13.0 if any consumer treats a number as a floor; jev-latest can move under you.

Calibration is yours

TypeSafe trains for calibrated decisions — label that a vendor claim. Plot reliability on your labels before you use a Noul as P(churn). Methodology: evaluation guide and offline evaluation. Official: questions are independent; do not average Nouls across ids into one “model quality” feature.

Noul 0.5 = yes/no equally likely. If a feature store publishes that as “50% churn,” product will believe it. Pair with a human sample. Deterministic pipelines still own exact compute — vs deterministic pipelines.

Operate failure modes

When not to use this page’s advice

Do not ask Jev to compute aggregates “as a feature.” Do not treat this table as ECE numbers we invented. Do not skip humans on high-stakes labels. Schema-safe answers are still not factual correctness.

What this page does not claim

FAQ

Can Jev replace our labeling vendor? Only for snap judgments you can define. Still sample humans.

Streaming features? Call from workers with RPM caps. See vs streaming.

May I upsert the Noul onto the entity fact table? No. Append a hop table. Facts stay facts.

Is AutoResearch required? No. It is an official cookbook shape. Your classical model is still yours.

Disclaimer

This is an independent unofficial site and is not affiliated with TypeSafe AI; official documentation is available at https://docs.typesafe.ai. Never treat jev.pro as TypeSafe official documentation. We do not sell, issue, or proxy API keys.

Open-cluster pages are independent field-guide notes. Replicas and third-party interfaces mentioned anywhere on jev.pro are not Jev and not endorsed. Hub: Open. Siblings: evaluation guide, offline evaluation, vs deterministic pipelines. Canonical: https://docs.typesafe.ai.

Sources