Skip to content

[codex] add complex replay feasibility probe#31

Merged
InfoSecHack merged 1 commit into
mainfrom
codex/complex-replay-feasibility-probe
Jun 3, 2026
Merged

[codex] add complex replay feasibility probe#31
InfoSecHack merged 1 commit into
mainfrom
codex/complex-replay-feasibility-probe

Conversation

@InfoSecHack

Copy link
Copy Markdown
Owner

Summary

  • Add a local-only complex benchmark replay feasibility probe.
  • Report replay-equivalence as not_proven with input-contract gaps for the current frozen synthetic oracle fixture.
  • Add focused tests covering output refusal, manifest/summary boundaries, pattern feasibility rows, static-only/unsupported rows, no AWS credential requirement, and no committed generated outputs.

Boundaries

  • No fixture semantic changes, reasoner changes, benchmark semantic changes, live AWS, Terraform, AWS CLI, STS, Lambda API, or iam:PassRole calls.
  • No replay-equivalence claim, live evidence claim, composite benchmark score, or pass/fail benchmark label.

Validation

  • python -m pytest -q tests/test_complex_benchmark_replay_feasibility_probe.py
  • python scripts/probe_complex_benchmark_replay_feasibility.py --out /tmp/iamscope-complex-replay-feasibility
  • cat /tmp/iamscope-complex-replay-feasibility/replay-feasibility-summary.md
  • jq . /tmp/iamscope-complex-replay-feasibility/replay-feasibility-manifest.json
  • grep account/ARN hygiene scans
  • find generated live/Terraform artifacts scan
  • ./scripts/check.sh
  • ./scripts/test_fast.sh
  • git diff --check

@InfoSecHack InfoSecHack marked this pull request as ready for review June 3, 2026 23:37
@InfoSecHack InfoSecHack merged commit bd9a15e into main Jun 3, 2026
6 checks passed
@InfoSecHack InfoSecHack deleted the codex/complex-replay-feasibility-probe branch June 3, 2026 23:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant