Add a failover LLM in case the primary one becomes unavailable#2332

Open

chrislatimer wants to merge 10 commits into

mainfrom

feat/llm-failover-provider

Commits on Jun 19, 2026

Commits on Jun 20, 2026

test(conftest): pre-import torch.overrides + transformers to fix xdist shard-2 race
chrislatimer
committed
test(conftest): drop transformers eager-import; keep only torch.overrides
chrislatimer
committed
test(conftest): eager-import sentence_transformers to prime full worker chain
chrislatimer
committed