Context
tests/quality/README.md ("What it does NOT measure") notes that the deterministic quality benchmark intentionally excludes LLM-based scoring (src/scoring.js) because it is non-deterministic and adds API cost/latency, and that "a separate live-mode benchmark would be its own follow-up". This was the only follow-up note in the repo without a tracking issue — filing it so it doesn't get lost.
Scope
Non-goals
- No CI gate: live results are diagnostics, consistent with the existing live-quality stance.
Source: tests/quality/README.md follow-up note, surfaced during the 2026-06-11 remaining-work audit.
Context
tests/quality/README.md("What it does NOT measure") notes that the deterministic quality benchmark intentionally excludes LLM-based scoring (src/scoring.js) because it is non-deterministic and adds API cost/latency, and that "a separate live-mode benchmark would be its own follow-up". This was the only follow-up note in the repo without a tracking issue — filing it so it doesn't get lost.Scope
src/scoring.jsend-to-end against the suspect-zones / rebaseline corpora and reports score distributions per pattern pack.tests/quality/; same opt-in posture astests/quality/live-quality.mjs.Non-goals
Source: tests/quality/README.md follow-up note, surfaced during the 2026-06-11 remaining-work audit.