Canary / A-B Model Routing — traffic splits with winner detection

2026-03-23

router

What We Built

Canary/A-B routing for model comparison. Configure traffic splits between model variants, track quality/latency/cost per variant, auto-detect winner by quality/cost ratio.

Deterministic assignment: same API key always routes to same variant (FNV-1a hash).

Lockstep Checklist

  • [x] API: 4 endpoints at /v1/routing/canary
  • [x] SDK-TS: Canary resource
  • [x] SDK-PY: Canary + AsyncCanary
  • [x] Tests: 14 tests for config, selection, hash, results
  • [x] Docs: Ship log