Skip to content

Commit e1a5f3d

Browse files
author
Radovan Fuchs
committed
update used models in provider tests
1 parent ba75700 commit e1a5f3d

12 files changed

Lines changed: 35 additions & 31 deletions

‎.github/workflows/e2e_tests_providers.yaml‎

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -24,21 +24,21 @@ jobs:
2424
# | environment | model_id | provider_id |
2525
# |-------------|--------------------------------------------| --------------|
2626
# | azure | gpt-5.6-luna | azure |
27-
# | vertexai | publishers/google/models/gemini-2.5-flash | google-vertex |
28-
# | watsonx | meta-llama/llama-3-3-70b-instruct | watsonx |
29-
# | bedrock | deepseek.v3-v1:0 | aws-bedrock |
27+
# | vertexai | publishers/google/models/gemini-3.5-flash-lite | google-vertex |
28+
# | watsonx | openai/gpt-oss-120b | watsonx |
29+
# | bedrock | google.gemma-4-31b | aws-bedrock |
3030
include:
3131
- environment: azure
3232
e2e_default_model: gpt-5.6-luna
3333
e2e_default_provider: azure
3434
- environment: vertexai
35-
e2e_default_model: publishers/google/models/gemini-2.5-flash
35+
e2e_default_model: publishers/google/models/gemini-3.5-flash-lite
3636
e2e_default_provider: google-vertex
3737
- environment: watsonx
38-
e2e_default_model: meta-llama/llama-3-3-70b-instruct
38+
e2e_default_model: openai/gpt-oss-120b
3939
e2e_default_provider: watsonx
4040
- environment: bedrock
41-
e2e_default_model: deepseek.v3-v1:0
41+
e2e_default_model: google.gemma-4-31b
4242
e2e_default_provider: aws-bedrock
4343

4444
name: "E2E: ${{ matrix.mode }} mode / ${{ matrix.environment }}"

‎README.md‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -249,9 +249,9 @@ __Note__: Support for individual models is dependent on the specific inference p
249249
| RHEL AI (RHAIIS/vLLM) | meta-llama/Llama-3.1-8B-Instruct | Yes | remote::vllm | [1](tests/e2e/configs/run-rhelai.yaml) [2](tests/e2e/configs/run-rhaiis.yaml) |
250250
| Azure | gpt-5, gpt-5-mini, gpt-5-nano, gpt-5.6-luna, o3-mini, o4-mini, o1 | Yes | remote::azure | [1](examples/azure-run.yaml) |
251251
| Azure | gpt-5-chat, gpt-4.1, gpt-4.1-mini, gpt-4.1-nano, o1-mini | No or limited | remote::azure | |
252-
| VertexAI | google/gemini-2.0-flash, google/gemini-2.5-flash, google/gemini-2.5-pro [^1] | Yes | remote::vertexai | [1](examples/vertexai-run.yaml) |
253-
| WatsonX | meta-llama/llama-3-3-70b-instruct | Yes | remote::watsonx | [1](examples/watsonx-run.yaml) |
254-
| AWS Bedrock | deepseek.v3-v1 | Yes | remote::bedrock | [1](examples/bedrock-run.yaml) |
252+
| VertexAI | google/gemini-3.5-flash-lite [^1] | Yes | remote::vertexai | [1](examples/vertexai-run.yaml) |
253+
| WatsonX | openai/gpt-oss-120b | Yes | remote::watsonx | [1](examples/watsonx-run.yaml) |
254+
| AWS Bedrock | google.gemma-4-31b | Yes | remote::bedrock | [1](examples/bedrock-run.yaml) |
255255
256256
[^1]: List of models is limited by design in OGX, future versions will probably allow to use more models (see [here](https://github.com/ogx-ai/ogx/blob/main/ogx/providers/remote/inference/vertexai/vertexai.py#L54))
257257

‎examples/bedrock-run.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ registered_resources:
9696
- model_id: custom-bedrock-model
9797
model_type: llm
9898
provider_id: aws-bedrock
99-
provider_model_id: deepseek.v3-v1:0
99+
provider_model_id: google.gemma-4-31b
100100
- model_id: all-mpnet-base-v2
101101
model_type: embedding
102102
provider_id: sentence-transformers

‎examples/vertexai-run.yaml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ providers:
1919
config:
2020
project: ${env.VERTEX_AI_PROJECT}
2121
location: ${env.VERTEX_AI_LOCATION}
22-
allowed_models: ["publishers/google/models/gemini-2.5-flash"]
22+
allowed_models: ["publishers/google/models/gemini-3.5-flash-lite"]
2323
- provider_id: openai
2424
provider_type: remote::openai
2525
config:
@@ -97,10 +97,10 @@ storage:
9797
backend: sql_default
9898
registered_resources:
9999
models:
100-
- model_id: publishers/google/models/gemini-2.5-flash
100+
- model_id: publishers/google/models/gemini-3.5-flash-lite
101101
provider_id: google-vertex
102102
model_type: llm
103-
provider_model_id: publishers/google/models/gemini-2.5-flash
103+
provider_model_id: publishers/google/models/gemini-3.5-flash-lite
104104
- model_id: all-mpnet-base-v2
105105
model_type: embedding
106106
provider_id: sentence-transformers

‎examples/watsonx-run.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -101,7 +101,7 @@ registered_resources:
101101
- model_id: custom-watsonx-model
102102
provider_id: watsonx
103103
model_type: llm
104-
provider_model_id: watsonx/meta-llama/llama-3-3-70b-instruct
104+
provider_model_id: openai/gpt-oss-120b
105105
- model_id: all-mpnet-base-v2
106106
model_type: embedding
107107
provider_id: sentence-transformers

‎tests/e2e/configs/run-bedrock.yaml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -97,10 +97,10 @@ storage:
9797
backend: sql_default
9898
registered_resources:
9999
models:
100-
- model_id: deepseek.v3-v1:0
100+
- model_id: google.gemma-4-31b
101101
model_type: llm
102102
provider_id: aws-bedrock
103-
provider_model_id: deepseek.v3-v1:0
103+
provider_model_id: google.gemma-4-31b
104104
- model_id: all-mpnet-base-v2
105105
model_type: embedding
106106
provider_id: sentence-transformers

‎tests/e2e/configs/run-vertexai.yaml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ providers:
1919
config:
2020
project: ${env.VERTEX_AI_PROJECT}
2121
location: ${env.VERTEX_AI_LOCATION}
22-
allowed_models: ["publishers/google/models/gemini-2.5-flash"]
22+
allowed_models: ["publishers/google/models/gemini-3.5-flash-lite"]
2323
- provider_id: openai
2424
provider_type: remote::openai
2525
config:
@@ -98,10 +98,10 @@ storage:
9898
backend: sql_default
9999
registered_resources:
100100
models:
101-
- model_id: publishers/google/models/gemini-2.5-flash
101+
- model_id: publishers/google/models/gemini-3.5-flash-lite
102102
provider_id: google-vertex
103103
model_type: llm
104-
provider_model_id: publishers/google/models/gemini-2.5-flash
104+
provider_model_id: publishers/google/models/gemini-3.5-flash-lite
105105
- model_id: all-mpnet-base-v2
106106
model_type: embedding
107107
provider_id: sentence-transformers

‎tests/e2e/configs/run-watsonx.yaml‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -99,6 +99,10 @@ storage:
9999
backend: sql_default
100100
registered_resources:
101101
models:
102+
- model_id: openai/gpt-oss-120b
103+
provider_id: watsonx
104+
model_type: llm
105+
provider_model_id: openai/gpt-oss-120b
102106
- model_id: all-mpnet-base-v2
103107
model_type: embedding
104108
provider_id: sentence-transformers

‎tests/e2e/configuration/library-mode/lightspeed-stack-compaction-disabled.yaml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -33,9 +33,9 @@ inference:
3333
context_windows:
3434
openai/gpt-5.6-luna: 2000
3535
azure/gpt-5.6-luna: 2000
36-
google-vertex/publishers/google/models/gemini-2.5-flash: 2000
37-
watsonx/meta-llama/llama-3-3-70b-instruct: 2000
38-
aws-bedrock/deepseek.v3-v1:0: 2000
36+
google-vertex/publishers/google/models/gemini-3.5-flash-lite: 2000
37+
watsonx/openai/gpt-oss-120b: 2000
38+
aws-bedrock/google.gemma-4-31b: 2000
3939
rag:
4040
byok:
4141
stores:

‎tests/e2e/configuration/library-mode/lightspeed-stack-compaction.yaml‎

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -33,9 +33,9 @@ inference:
3333
context_windows:
3434
openai/gpt-5.6-luna: 2000
3535
azure/gpt-5.6-luna: 2000
36-
google-vertex/publishers/google/models/gemini-2.5-flash: 2000
37-
watsonx/meta-llama/llama-3-3-70b-instruct: 2000
38-
aws-bedrock/deepseek.v3-v1:0: 2000
36+
google-vertex/publishers/google/models/gemini-3.5-flash-lite: 2000
37+
watsonx/openai/gpt-oss-120b: 2000
38+
aws-bedrock/google.gemma-4-31b: 2000
3939
rag:
4040
byok:
4141
stores:

0 commit comments

Comments
 (0)