Skip to content

LCORE-4697: Extended inference providers configuration options #2909

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tisnik merged 1 commit into from
Oct 15, 2026
Merged

LCORE-4697: Extended inference providers configuration options #2909

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
975 changes: 890 additions & 85 deletions docs/devel_doc/openapi.json
View file
Open in desktop

Large diffs are not rendered by default.

6 changes: 3 additions & 3 deletions docs/models/successful_responses.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1953,7 +1953,7 @@
"providers": {
"description": "Unified-mode synthesis input (Decision S5): a high-level, backend-agnostic list of inference providers the synthesizer expands into OGX provider entries. Lives at the configuration root so it survives a future backend change. A non-empty list signals unified mode. Empty (the default) leaves legacy/remote modes unaffected. The sibling default_model / default_provider keep their query-time routing meaning and are independent of this list.",
"items": {
"$ref": "`#/components/schemas/`UnifiedInferenceProvider"
"$ref": "`#/components/schemas/`UnifiedInferenceProviderEntry"
},
"title": "High-level inference providers",
"type": "array"
Expand Down Expand Up @@ -6748,7 +6748,7 @@
"title": "TrustedProxyServiceAccount",
"type": "object"
},
"UnifiedInferenceProvider": {
"UnifiedInferenceProviderEntry": {
"additionalProperties": false,
"description": "A high-level inference provider entry for unified-mode synthesis.\n\nOperators describe inference providers at this high level (backend-agnostic\nvocabulary) instead of authoring raw OGX provider blocks. The\nsynthesizer (`apply_high_level_inference`) expands each entry into an OGX\n`providers.inference` entry, mapping `type` to a `provider_type` and\nemitting `${env.<VAR>}` references for secrets (never literal values).\n\nAttributes:\n type: Canonical provider identifier. Vendor-neutral so it survives a\n future backend change; each backend-specific synthesizer maps it to\n its own provider vocabulary.\n id: Optional identifier emitted as the OGX provider_id. When\n omitted, synthesized as type with underscores hyphenated. If set,\n must be non-empty after stripping whitespace and may contain only\n lowercase letters, digits, underscores, and hyphens.\n api_key_env: Name of the environment variable holding the provider API\n key. Emitted verbatim as `${env.<name>}` so the secret never lands\n on disk resolved.\n allowed_models: Optional allow-list of model identifiers passed through\n to the synthesized provider config.\n extra: Additional provider-config keys merged verbatim into the\n synthesized provider's `config` block \u2014 an escape hatch for\n provider-specific knobs not modeled here.",
"properties": {
Expand Down Expand Up @@ -6799,7 +6799,7 @@
"required": [
"type"
],
"title": "UnifiedInferenceProvider",
"title": "UnifiedInferenceProviderEntry",
"type": "object"
},
"UnifiedOgxConfig": {
Expand Down
2 changes: 1 addition & 1 deletion docs/models/successful_responses.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2904,7 +2904,7 @@ A Kubernetes ServiceAccount identity for trusted-proxy allowlist.
| name | string | Name of the Kubernetes ServiceAccount. |


## UnifiedInferenceProvider
## UnifiedInferenceProviderEntry


A high-level inference provider entry for unified-mode synthesis.
Expand Down
6 changes: 3 additions & 3 deletions docs/user_doc/config.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1025,7 +1025,7 @@
"providers": {
"description": "Unified-mode synthesis input (Decision S5): a high-level, backend-agnostic list of inference providers the synthesizer expands into OGX provider entries. Lives at the configuration root so it survives a future backend change. A non-empty list signals unified mode. Empty (the default) leaves legacy/remote modes unaffected. The sibling default_model / default_provider keep their query-time routing meaning and are independent of this list.",
"items": {
"$ref": "`#/components/schemas/`UnifiedInferenceProvider"
"$ref": "`#/components/schemas/`UnifiedInferenceProviderEntry"
},
"title": "High-level inference providers",
"type": "array"
Expand Down Expand Up @@ -2391,7 +2391,7 @@
"title": "TrustedProxyServiceAccount",
"type": "object"
},
"UnifiedInferenceProvider": {
"UnifiedInferenceProviderEntry": {
Comment thread
asimurka marked this conversation as resolved.
"additionalProperties": false,
"description": "A high-level inference provider entry for unified-mode synthesis.\n\nOperators describe inference providers at this high level (backend-agnostic\nvocabulary) instead of authoring raw OGX provider blocks. The\nsynthesizer (`apply_high_level_inference`) expands each entry into an OGX\n`providers.inference` entry, mapping `type` to a `provider_type` and\nemitting `${env.<VAR>}` references for secrets (never literal values).\n\nAttributes:\n type: Canonical provider identifier. Vendor-neutral so it survives a\n future backend change; each backend-specific synthesizer maps it to\n its own provider vocabulary.\n id: Optional identifier emitted as the OGX provider_id. When\n omitted, synthesized as type with underscores hyphenated. If set,\n must be non-empty after stripping whitespace and may contain only\n lowercase letters, digits, underscores, and hyphens.\n api_key_env: Name of the environment variable holding the provider API\n key. Emitted verbatim as `${env.<name>}` so the secret never lands\n on disk resolved.\n allowed_models: Optional allow-list of model identifiers passed through\n to the synthesized provider config.\n extra: Additional provider-config keys merged verbatim into the\n synthesized provider's `config` block — an escape hatch for\n provider-specific knobs not modeled here.",
"properties": {
Expand Down Expand Up @@ -2442,7 +2442,7 @@
"required": [
"type"
],
"title": "UnifiedInferenceProvider",
"title": "UnifiedInferenceProviderEntry",
"type": "object"
},
"UnifiedOgxConfig": {
Expand Down
2 changes: 1 addition & 1 deletion docs/user_doc/config.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1134,7 +1134,7 @@ A Kubernetes ServiceAccount identity for trusted-proxy allowlist.
| name | string | Name of the Kubernetes ServiceAccount. |


## UnifiedInferenceProvider
## UnifiedInferenceProviderEntry


A high-level inference provider entry for unified-mode synthesis.
Expand Down
Loading
Loading