Repository navigation
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
auto, cheap/fast, coding, long-horizon, reasoning, security)route/autotraffic; deterministic task/difficulty signals take precedenceInitial policy
Model/provider mappings live in gateway configuration so they can change without application releases.
Tests
Added regression tests first for:
route/autowhen Bifrost is availableVerification status
CI triggered, but the Lint/Test/Build jobs all terminated before executing any steps (
runner_id=0). This is an Actions admission/infrastructure failure, not a compiler or test result. The PR remains draft until a real CI run validates compilation/tests and the sample Bifrost config is exercised against a real gateway.Known blocker: cost authority
Dev Plane's run budget currently accumulates
CallResult.Cost. With dynamic Bifrost routing, the resolved model may not exist in Dev Plane's static price table, producing a zero local estimate. Bifrost computes authoritative request cost internally but does not currently return it on the normal inference response.Do not fix this by copying volatile provider prices back into Dev Plane. Before merge, choose one of these boundaries:
Until that boundary is resolved, cost-capped production traffic should not use the dynamic routes in this PR.
Follow-up
The next routing iteration should add task-level routing decision/outcome telemetry. Do not train from the current
model_usage.successfield: it represents successful provider calls, not successful software tasks. The adaptive selector should learn from verifier/build/test/security outcomes and optimize cost per successful task.