Skip to content

[codex] wire replay subset into public demo review#33

Merged
InfoSecHack merged 1 commit into
mainfrom
codex/public-demo-review-replay-subset
Jun 4, 2026
Merged

[codex] wire replay subset into public demo review#33
InfoSecHack merged 1 commit into
mainfrom
codex/public-demo-review-replay-subset

Conversation

@InfoSecHack

Copy link
Copy Markdown
Owner

Summary

  • Wire the narrow PassRole-to-Lambda replay subset probe into the one-command public demo review runner.
  • Add a separate summary and manifest layer for passrole_lambda_replay_subset with matched/missing/extra/static-only counts.
  • Update the public demo review runbook and focused runner tests.

Result

  • replay_subset_status: replayed_selected_passrole_lambda_subset
  • input_contract_status: replay_ready
  • safe_replay_attempted: true
  • reasoners_attempted: passrole_lambda
  • matched_rows: 1
  • missing_rows: 0
  • extra_rows: 0
  • static_only_rows: 1

Boundaries

  • Local-only runner integration; no live AWS, Terraform, AWS CLI, STS, Lambda API, or iam:PassRole calls.
  • No full complex benchmark replay-equivalence claim.
  • No composite benchmark score or pass/fail benchmark label.

Validation

  • python -m pytest -q tests/test_public_demo_review_runner.py tests/test_complex_passrole_lambda_replay_subset.py
  • python scripts/run_public_demo_review.py --out /tmp/iamscope-public-demo-review
  • cat /tmp/iamscope-public-demo-review/summary.md
  • jq .passrole_lambda_replay_subset /tmp/iamscope-public-demo-review/manifest.json
  • summary grep for replay subset boundaries and non-score language
  • account/ARN hygiene scans
  • generated live/Terraform artifact scan
  • ./scripts/check.sh
  • ./scripts/test_fast.sh
  • git diff --check

@InfoSecHack
InfoSecHack marked this pull request as ready for review June 4, 2026 00:26
@InfoSecHack
InfoSecHack merged commit 67b995d into main Jun 4, 2026
6 checks passed
@InfoSecHack
InfoSecHack deleted the codex/public-demo-review-replay-subset branch June 4, 2026 00:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant