port(omniroute): add provider and routing evaluation runs #1130

Outcome

DurinDoor has tests and model probes, but no persisted evaluation runner and suites UI. Add repeatable operator-triggered comparisons with bounded cost.

Evidence and source state

DurinDoor baseline: 93f6de64c69b17d52f790d6f14d09a74cffc7fa5.

• src/app/api/models/test/route.js
  OmniRoute source snapshot: 61e07fb7e0d4e1e76111495d3718c9e4d06d2a62 on release/v3.8.52.
• src/lib/evals
• omniroute #42: feat: v0.5.0 - Dashboard refinements, evals framework, and combo strategies | MERGED | merge 95916591c9bb9104e231966f60784cebe1f0bfc7

Implementation subtasks and acceptance criteria

• Use deterministic suite versions and explicit model/account selection.
• Record quality, latency, tokens, price source and failure separately.
• Require opt-in live runs with budgets and cancellation; keep offline mode credential-free.

Dependencies

No hard predecessor. Complete source review and reproduction/discovery before implementation.

Parent epic: #1063. Roadmap: #1056. Priority P2. Stage 3.

Delivery contract

Planning ticket only. No implementation, runtime test, live-provider call, deployment or stored-data mutation was performed in this audit. Before a port, confirm a merged final upstream diff or a reachable source commit, compare local equivalents/tests, and preserve local auth/routing/quota/database contracts. Open upstream work remains a review candidate. Use port(omniroute): title and target a focused PR at bloodf/durindoor:main. Behavior changes require a focused test plus docs. Run npm run lint and cd tests && npm run test:ci; never add baseline failures. Pure docs/CI edits may skip runtime tests. Regenerate registry/agent indexes with their scripts. Preserve stored credentials and unrelated work.