Canary / A-B Model Routing — traffic splits with winner detection
2026-03-23
What We Built
Canary/A-B routing for model comparison. Configure traffic splits between model variants, track quality/latency/cost per variant, auto-detect winner by quality/cost ratio.
Deterministic assignment: same API key always routes to same variant (FNV-1a hash).
Lockstep Checklist
- [x] API: 4 endpoints at
/v1/routing/canary - [x] SDK-TS:
Canaryresource - [x] SDK-PY:
Canary+AsyncCanary - [x] Tests: 14 tests for config, selection, hash, results
- [x] Docs: Ship log