Jev rate limits
Rate limits are the token-per-second and request-per-minute caps TypeSafe publishes for Jev. Exceeding either returns 429 Too Many Requests. 529 Overloaded means their side is temporarily overloaded.
This page is for builders who already heard of Jev / System One and need to get a credential, stay inside published limits, or onboard a team. jev.pro is an independent unofficial field guide — not affiliated with TypeSafe AI. We do not sell, issue, or proxy API keys. Confirm current numbers on docs.typesafe.ai.
Published defaults (vendor claims)
The models page publishes:
- 250,000 tokens per second
- 1,200 requests per minute
TypeSafe is explicit that limits are adjusting dynamically under demand and “can change without notice.” Higher limits: custom and enterprise, [email protected]. We do not publish unofficial “hidden” limits.
Steps
- Treat 429/529 as backoff events, not as “try a different model id.”
- Official Python and JavaScript SDKs retry with backoff and honor
retry-afterwhen present. - If you call HTTP yourself, implement exponential backoff. Do not tight-loop 429s.
- Batch questions in one
POST /v1/systemoneso you do not spend the 1,200 RPM budget on one-question calls. See speculative fan-out. - Watch
usage.input_tokens— token/second is the other axis.
Pitfalls
- Fan-out of HTTP calls (one question each) is how you hit 1,200 RPM without meaning to.
- A gateway or marketplace may impose its caps on top of TypeSafe’s. Read that invoice.
- Do not invent a
/v1/rate-limitprobe.GET /v1/modelslists aliases; it is not a quota API.
See also
FAQ
Are these numbers SLAs from jev.pro?
No. They are vendor-published and can change. Confirm on the models page before you bid a contract.
Does 429 mean my question was wrong?
No. Slow down. 422 is the validation failure.
Can jev.pro raise my limit?
No. We do not issue keys or quotas.
Disclaimer
This is an independent unofficial site and is not affiliated with TypeSafe AI; official documentation is available at https://docs.typesafe.ai. Never treat jev.pro as TypeSafe official documentation. We do not sell, issue, or proxy API keys.