Skip to content

[codex] add prod-like oracle fixture files#36

Merged
InfoSecHack merged 1 commit into
mainfrom
codex/prod-like-oracle-fixture-files
Jun 4, 2026
Merged

[codex] add prod-like oracle fixture files#36
InfoSecHack merged 1 commit into
mainfrom
codex/prod-like-oracle-fixture-files

Conversation

@InfoSecHack

Copy link
Copy Markdown
Owner

Summary

  • Add the Phase 2 local prod-like AWS accuracy oracle fixture files.
  • Freeze exactly 24 oracle rows with the designed 6/5/4/5/4 category breakdown.
  • Add focused tests pinning fixture structure, metadata, unsupported/static-only handling, and hygiene boundaries.

Boundaries

  • Local fixture/test only.
  • No runner integration, code/reasoner changes, Terraform, live AWS, AWS CLI, STS/Lambda/API calls, iam:PassRole calls, benchmark semantic changes, release/version change, or new evidence claims.
  • Unsupported rows stay static-only and are not counted as false positives, false negatives, extra findings, or missing findings.
  • No composite benchmark score or pass/fail benchmark label.

Validation

  • python -m pytest -q tests/test_prod_like_aws_accuracy_oracle_fixture.py
  • account/ARN hygiene scans
  • generated live/Terraform artifact scan
  • ./scripts/check.sh
  • ./scripts/test_fast.sh
  • git diff --check

@InfoSecHack InfoSecHack marked this pull request as ready for review June 4, 2026 01:24
@InfoSecHack InfoSecHack merged commit a866f35 into main Jun 4, 2026
6 checks passed
@InfoSecHack InfoSecHack deleted the codex/prod-like-oracle-fixture-files branch June 4, 2026 01:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant