Launch log

Release

v4.0

Karman 4.0: rollouts that test themselves

Max-Q shadow testing now runs on every deploy, comparing latency, cost and output quality before any user sees a change.

Every deploy now passes through Max-Q, an automatic shadow test. Karman replays a slice of your live traffic against the new version and compares it with the current one, side by side.

If latency, cost or output quality drifts beyond the limits you set, the rollout stops before a single user is affected.

What gets measured

Max-Q compares p50 and p99 latency, cost per request, error rate and — for language models — semantic drift between the two versions’ answers. Results appear in Mission Control next to each release.

Create a free website with Framer, the website builder loved by startups, designers and agencies.