Skip to content

fix(compat): report changes and reject duplicate snapshots - #106

Merged
simonvanlierde merged 2 commits into
mainfrom
fix/compat-snapshot-reporting
Nov 1, 2026
Merged

simonvanlierde merged 2 commits into
mainfrom
fix/compat-snapshot-reporting

Conversation

@simonvanlierde

Copy link
Copy Markdown
Owner

Compatibility reports now distinguish new failures, continuing failures and recoveries, with links to both workflow runs.

  • Compare snapshots by column, Python version and operating system.
  • Keep skipped, cancelled, absent and unevaluated jobs separate from failures.
  • Reject duplicate jobs and malformed consumed metadata so invalid snapshots cannot replace the saved baseline. Empty job lists, null conclusions and future conclusion strings remain supported.

Tests: 278 passed, one optional bw2io skip; 30 scoped tests pass on Python 3.15. Duplicate failure/success entries reproduced a hidden failure before the fix. The isolated steward integration test now preserves the baseline, and the deployed helper accepts the current published snapshot.

@simonvanlierde
simonvanlierde merged commit 672d15a into main Nov 1, 2026
9 checks passed
@simonvanlierde
simonvanlierde deleted the fix/compat-snapshot-reporting branch November 1, 2026 06:42
simonvanlierde added a commit that referenced this pull request Nov 1, 2026
* origin/main:
  fix(synth): preserve default benchmark histories (#107)
  fix(compat): report changes and reject duplicate snapshots (#106)
  fix: make benchmark probes reliable (#105)

Signed-off-by: Simon van Lierde <simonvanlierde@gmail.com>

# Conflicts:
#	CHANGELOG.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant