Top Repos· Jev-Based· Eval· Last updated 2026-09-21

anisselbd / jev-phishing-bench

“Jev (TypeSafe) vs Claude Haiku 4.5 on 2 000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark.”

Jev-Based rank #152In Eval #30

• 2Stars
• —Stars Δ / 1d
• —Stars Δ / 7d
• —Stars Δ / 30d
• 0Forks
• 0Watchers

GitHub ↗Official docs ↗Back to ranking

TL;DR

anisselbd/jev-phishing-bench showed up as Jev / System One related work: Open replica or independent decision engine — not Jev, not endorsed.

The author describes it as: “Jev (TypeSafe) vs Claude Haiku 4.5 on 2 000 phishing emails: accuracy, calibration, latency, cost. Reproducible benchmark.” That is their claim, not a bench this site ran.

Who it’s for

• Agent / harness authors who need a typed gate, route, or prune step
• Inbox triage owners who want Choice / Noul over a mail brief
• Anyone who needs the unofficial line: jev.pro does not issue keys and is not TypeSafe

What’s inside

Top-level entries on GitHub at generation time: .env.example, .gitignore, CLAUDE.md, README.md, analyze.py, bench, charts.py, charts_simple.py, net_floor.py, prepare_data.py, pyproject.toml, results, run_jev.py, run_llm.py. Read those before you trust a one-line install.

How to use

1. Clone and follow the author’s Python toolchain. Do not invent a package name.

git clone https://github.com/anisselbd/jev-phishing-bench.git
cd jev-phishing-bench

2. If the project calls hosted Jev, you still need a TypeSafe console key or a documented gateway.
3. Send a complete state and typed questions. Code owns control flow after the probabilities.

Hosted Jev still looks like a function call — wrapper or not:

{
  model: "jev-1.13.0",
  state: { source: "anisselbd/jev-phishing-bench", brief: "..." },
  questions: {
    gate: { type: "noul", instructions: "Should we act on this state?" },
    route: { type: "choice", instructions: "Pick one next system.", criteria: ["code", "review", "human"] },
  },
}

Try this

Put Jev on one real brief

Wire anisselbd/jev-phishing-bench so one real state (ticket, diff, or utterance) becomes a Choice plus a Noul. Do not ask Jev to write the user-facing reply.

Schema-safe ≠ correct

On a case anisselbd/jev-phishing-bench gets wrong, write down the schema-legal answer it returned and the human label. Do not “fix” it by asking Jev to generate an explanation.

FAQ

Does this replace the TypeSafe SDK?

Only if the author implemented a full client. Most harnesses still call the vendor SDK or raw HTTP.

Are the star chips live?

Star, fork, and watcher chips refresh from the public GitHub API via a scheduled job. The prose on this page is editorial.