Repository navigation
Bridge actual numeric evaluations into naming fixture proposals - #327
Merged
Merged
Conversation
Exohayvan
force-pushed
the
codex/numeric-naming-evidence-bridge
branch
from
October 12, 2026 04:11
b9a76ad to
331cbaf
Compare
Exohayvan
marked this pull request as ready for review
October 12, 2026 04:15
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Connect the existing numeric prototype's actual evaluator outputs to the naming fixture without training a new model. Keep
synthetic-quadratic-expertas the identity;Numericis only an internal fixture alias, not Ash/Ember or an assigned production family. This example stays outside SDK runtime orchestration.Run the trusted existing worker's evaluation operation exactly three times on documented fixed coefficients: baseline, fitted polynomial and regression control. Independently recompute every rational prediction, verify exact task/output shape and source/context bindings, then derive fixture reports and pins. The fitted artifact measures held-out SSE 250 → 0 with zero regressions and yields an eligible fixture proposal. The regression control measures SSE 4 with one regressed case and yields an experimental proposal without a name/version increment. No trainer/solver or learning-journal operation is invoked by the bridge.
Commit exact baseline/candidate artifacts, held-out/regression suite, schema, metric semantics and worker/demo/bridge source revisions. Reject altered task/prediction/artifact/context evidence and source drift before/after execution; reject non-integral SSE instead of rounding it. Retain original outputs, translated reports, policy and pins for inspection. Existing helper pipe/deadline/CPU/cancellation bounds apply. No downloaded code, credentials, network service, model loading or user configuration is involved.
Local arithmetic verification is real; evaluator identity/independence and publication authority are not established. Embedded fixture decisions stay explicitly simulated, with no committed promotion/name reservation/live capability proof. Outer output explicitly denies training, authenticated evidence, independent operators, production family assignment and production promotion. The suite remains tiny, fixed, public and synthetic; zero arithmetic uncertainty is not a generalization claim.
Five focused tests (10 subtests) exercise actual helper outputs, evaluation-only calls, accepted/rejected proposals, bindings/tampering/source drift/cancellation and non-lossy metric conversion. Python 3.11 focused tests pass with ResourceWarning as error; bridge-focused required coverage reaches 100%. The new installed acceptance executes the bridge against the built SDK with Python -I outside the checkout. Existing repository regression tests retain their original tiny synthetic training checks; the bridge does not call those training paths. Native fast gate passed: 1,362 tests / 2,654 subtests, required coverage, lint/format, strict typing and repository policy checks. Wheel/sdist build and installed acceptance passed, including the new evaluation-only bridge. No new E-level complexity. All 24 fresh hosted checks passed on the reconciled exact head, including build/install, coverage, security and repeatability. Mutation not run. Independent review cleared the original head; a normal guarded merge is authorized after fresh checks pass.
Review head:
331cbaf7b0fe7b509242d7822db1f25615820ede; treedcac70777b09b3d454262135aa668bbccd6f2984. Base: merged PR3257c8e5324bd7d9b64d7fb183ede4b8c06a7208277.Reconciliation proof: original reviewed head
b9a76ad342392bc822c0311afa192d9d5e041a5cand rebased head have the identical full treedcac70777b09b3d454262135aa668bbccd6f2984. The five-file feature patch is byte-identical. Fresh native fast gate passed again (1,362 tests / 2,654 subtests).