Repository navigation

feat(agent-arena): add the continuous online evaluation loop - #94

Merged

sishuo-yang merged 30 commits into

build-workshop-v1from

feat/agent-arena-online-evaluation

Aug 9, 2026

Merged

feat(agent-arena): add the continuous online evaluation loop#94
sishuo-yang merged 30 commits into
build-workshop-v1from
feat/agent-arena-online-evaluation

Commits on Aug 8, 2026
- feat(agent-arena): add versioned business policies
  sishuo-yang
  committed
  a8ed792
- fix(agent-arena): validate policy document shape
  sishuo-yang
  committed
  e24b12a
- feat(agent-arena): trace versioned policy context
  sishuo-yang
  committed
  90335a2
- test(agent-arena): cover policy run orchestration
  sishuo-yang
  committed
  13f9f80
- feat(agent-arena): capture reliable user thumbs
  sishuo-yang
  committed
  1809d67
- fix(agent-arena): announce feedback status
  sishuo-yang
  committed
  f00f5b0
- feat(agent-arena): retain production dataset provenance
  sishuo-yang
  committed
  70411c3
- fix(agent-arena): validate promotion provenance before query
  sishuo-yang
  committed
  6bfbe6c
- feat(agent-arena): verify the seeded online incident
  sishuo-yang
  committed
  1f6541d
- fix(agent-arena): harden seeded incident preflight
  sishuo-yang
  committed
  2cefe0b
- fix(agent-arena): reject ambiguous preflight SQL
  sishuo-yang
  committed
  8e9e3b9
- fix(agent-arena): reject nested preflight queries
  sishuo-yang
  committed
  8713e19
- feat(agent-arena): score live SQL execution
  sishuo-yang
  committed
  44299bd
- fix(agent-arena): harden evaluator provisioning
  sishuo-yang
  committed
  4ddf4d4
- feat(agent-arena): evaluate governed metrics online
  sishuo-yang
  committed
  3f5fecb
- fix(agent-arena): verify experiment score provenance
  sishuo-yang
  committed
  cbfaae5
- fix(agent-arena): preserve terminal score pages
  sishuo-yang
  committed
  b9dd572
- fix(agent-arena): retry empty model responses
  sishuo-yang
  committed
  54bc5fb
- fix(agent-arena): bound reasoning tokens
  sishuo-yang
  committed
  9c551e4
- fix(agent-arena): validate reasoning modes
  sishuo-yang
  committed
  9be3ee2
- docs(agent-arena): teach the online improvement loop
  sishuo-yang
  committed
  fb3a2cb
- docs(agent-arena): bound conversion verification retry
  sishuo-yang
  committed
  069b53c
- fix(agent-arena): harden online evaluation runtime
  sishuo-yang
  committed
  733a5bd
- docs(agent-arena): update Langfuse adapter pin
  sishuo-yang
  committed
  971e772
- docs(agent-arena): clarify promotion provenance
  sishuo-yang
  committed
  4e34bec
Commits on Aug 9, 2026

Navigation Menu

Repository navigation

feat(agent-arena): add the continuous online evaluation loop - #94

feat(agent-arena): add the continuous online evaluation loop#94
sishuo-yang merged 30 commits into
build-workshop-v1from
feat/agent-arena-online-evaluation

Commits on Aug 8, 2026

feat(agent-arena): add versioned business policies

fix(agent-arena): validate policy document shape

feat(agent-arena): trace versioned policy context

test(agent-arena): cover policy run orchestration

feat(agent-arena): capture reliable user thumbs

fix(agent-arena): announce feedback status

feat(agent-arena): retain production dataset provenance

fix(agent-arena): validate promotion provenance before query

feat(agent-arena): verify the seeded online incident

fix(agent-arena): harden seeded incident preflight

fix(agent-arena): reject ambiguous preflight SQL

fix(agent-arena): reject nested preflight queries

feat(agent-arena): score live SQL execution

fix(agent-arena): harden evaluator provisioning

feat(agent-arena): evaluate governed metrics online

fix(agent-arena): verify experiment score provenance

fix(agent-arena): preserve terminal score pages

fix(agent-arena): retry empty model responses

fix(agent-arena): bound reasoning tokens

fix(agent-arena): validate reasoning modes

docs(agent-arena): teach the online improvement loop

docs(agent-arena): bound conversion verification retry

fix(agent-arena): harden online evaluation runtime

docs(agent-arena): update Langfuse adapter pin

docs(agent-arena): clarify promotion provenance

Commits on Aug 9, 2026

fix(agent-arena): retry unknown seeded classification once

fix(agent-arena): honor per-question numeric precision

Merge remote-tracking branch 'origin/build-workshop-v1' into feat/agent-arena-online-evaluation

fix(agent-arena): preserve golden precision on provisioning

fix(agent-arena): harden online evaluation gates