[labv2-bot]

Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package	Update	Change
ghcr.io/berriai/litellm (source)	minor	v1.108.3 → v1.109.1

---

Release Notes

BerriAI/litellm (ghcr.io/berriai/litellm)

v1.109.1

Compare Source

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. This release is signed with the key introduced in commit e82a3c6.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the published signing key:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/e82a3c646908ba0a6ee0beddc4310d7a6cac4065/cosign.pub \
  ghcr.io/berriai/litellm:v1.109.1

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/v1.109.1/cosign.pub \
  ghcr.io/berriai/litellm:v1.109.1

Expected output:

The following checks were performed on each of these signatures:
  - The cosign claims were validated
  - The signatures were verified against the specified public key

---

What's Changed

• security(proxy): backport #​51254 to stable/1.109.x by @​shrey-berri in #​51264
• chore: bump litellm 1.109.0 -> 1.109.1 by @​yuneng-berri in #​51298

Full Changelog: BerriAI/litellm@v1.109.0...v1.109.1

v1.109.0

Compare Source

Verify this release

cosign verify \
  --key https://raw.githubusercontent.com/BerriAI/litellm/e82a3c646908ba0a6ee0beddc4310d7a6cac4065/cosign.pub \
  ghcr.io/berriai/litellm:v1.109.0

Same command for litellm-database, litellm-non_root and the docker.io/litellm/* images

What's new in 1.109.0

982 PRs. 144 added, 424 fixed, 60 changed, 17 improved, 9 removed. 5 need action

Action required

• Routing and fallbacks: Change string fallback targets to lists of model names (#​48943)
• Caching: Switch cache_params.type from disk to local or redis, since the disk cache backend (diskcache) has been removed (#​48114)
• Routing and fallbacks: Add optional_pre_call_checks: ["enforce_model_rate_limits"] to keep a hard rpm cap on deployments (#​48873)
• Vertex AI and Gemini: Set drop_params: true or stop sending temperature, top_p and top_k to Gemini 3.6 Flash, 3.5 Flash-Lite and newer (#​47645)
• Deployment: Deploy Lens from its own chart and set lens.* in your values (#​49169)

Highlights

• Admin UI: Added a Chat UI with a model hub, image generation and usage metrics (#​48108)
• Routing and fallbacks: Added mid-stream fallback continuation so a streaming chat cut off mid-answer continues on the configured fallback (#​41127)
• Deployment: Added LITELLM_OFFLINE_MODE to turn off every fetch LiteLLM makes on its own with one switch (#​48096)
• Cost tracking and pricing: Added model_info.pricing_provider to price a deployment from another provider's catalog rates instead of $0 (#​47620)
• Vertex AI and Gemini: Added Gemini 3.1 Flash TTS support, including multi-speaker voices and mp3, opus, alaw and mulaw output (#​31915)
• SDK: Fixed tool calls on completion() and responses() failing with No module named 'mcp' on base SDK installs (#​45961) ^{Also in 1.108.4}

All changes

OpenAI (19)

• Added per-deployment workload identity on non-chat routes, realtime and the moderation guardrail (#​39966)
• Added the 12-hour cache write rate for gpt-5.6-cyber (#​48246)
• Added OpenAI gpt-6.1-terra with pricing (#​48429)
• Added Batch and Ultrafast 12-hour cache write rates for OpenAI models (#​48433)
• Added gpt-6-rosalind to the model cost map with its published prices (#​49268)
• Added gpt-6-astra-law with pricing from the OpenAI pricing page (#​49444)
• Fixed 400 errors and $0 spend logs on gpt-transcribe calls without response_format (#​44021)
• Fixed nonstreaming aiohttp_openai responses dropping service_tier (#​47263)
• Fixed prompt_cache_retention such as 24h being silently dropped instead of sent upstream (#​47480)
• Fixed /health marking OpenAI and Azure audio chat models unhealthy (#​47730)
• Fixed OpenAI context_length_exceeded errors raising BadRequestError instead of ContextWindowExceededError (#​47954)
• Fixed 12-hour prompt cache writes on openai/gpt-5.6 and newer billing at the 30-minute rate (#​48088)
• Fixed uncatalogued ChatGPT models hitting an unsupported Chat Completions endpoint (#​48244)
• Fixed the whole reasoning_effort dict not being sent when chat is bridged to Responses (#​48807)
• Fixed 400 invalid_beta on Agents API calls through the OpenAI passthrough (#​49009)
• Fixed empty e.response.text on OpenAI and Azure errors so the upstream error body is readable (#​49079)
• Changed OpenAI 401 and 404 invalid_request_error to raise matching exceptions, not BadRequestError (#​32537)
• Changed the ChatGPT session id to derive from prompt_cache_key for stable cache affinity (#​42014)
• Changed gpt-6-luna Decisions cache rates to the standard cached and write rates (#​48066)

Azure (18)

• Added Entra ID auth, including keyless auth, for Azure Decisions on /v1/decisions and /v1/systemone (#​46539, #​48529)
• Added access to Foundry agents through the project Responses API for azure_ai/agents/<name> (#​47717)
• Added azure_ai/MAI-Code-1.1-Flash (#​47779)
• Added max_input_tokens of 32768 for azure_ai/Microsoft-Decision-1 (#​48434)
• Added outputContentFormat=markdown support on /ocr for Azure Document Intelligence (#​48926)
• Fixed Foundry chat requests losing OpenAI prompt cache breakpoints (#​45299)
• Fixed /v1/responses 404 on dated api_version deployments and azure_ai Grok reasoning token billing (#​46377)
• Fixed under-billed Grok reasoning tokens on azure_ai when the deployment name lacks "grok" (#​46969)
• Fixed Azure realtime over WebRTC failing with a 404 on client_secrets and an invalid token on the SDP exchange (#​47316)
• Fixed 400 from Foundry when tool results contain tool_reference parts on chat (#​48032)
• Fixed 400 on azure_ai/claude-* when using thinking.block_binding (#​48033)
• Fixed Responses API calls that use an explicit v1 Azure base URL (#​48118)
• Fixed 404 on Azure vector store retrieve, update and delete (#​48224)
• Fixed null audio capability metadata on two Azure audio snapshot models (#​48475)
• Fixed Azure context_length_exceeded raising BadRequestError so context_window_fallbacks never ran (#​48616)
• Fixed batch calls on unversioned azure/ o3, o4-mini, o3-mini, gpt-4o and gpt-4o-mini billing at the standard rate (#​49182)
• Changed max_input_tokens to 128000 for gpt-chat-latest on Azure (#​48252)
• Improved Entra auth by reusing credentials and tokens across requests and refreshing them off the event loop (#​46421, #​47348, #​48769)

Anthropic (16)

• Fixed a fake [System: ...] message being added to tool-call-only assistant turns sent to Anthropic (#​34822)
• Fixed PDFs sent as chat image_url being rejected with 400 by sending them as document blocks (#​46984)
• Fixed Claude json_schema answers losing keys listed only in required and escaping non-ASCII characters (#​47478)
• Fixed replayed redacted_thinking blocks being dropped, and Bedrock Converse 400s when sent twice (#​47489)
• Fixed clear_tool_uses input_tokens trigger ignoring the system prompt, which delayed clearing (#​47857)
• Fixed native Anthropic responses omitting a null stop_sequence (#​47987)
• Fixed streamed responses leaving native web search fees out of the reconstructed usage cost (#​48528)
• Fixed drop_params not dropping speed on claude-opus-4-7, which Anthropic rejects with 400 (#​48764)
• Fixed 400 from beta-gated body fields when drop_params: true, including Claude Code and Codex traffic (#​48793)
• Fixed model_context_window_exceeded being reported as stop instead of length (#​48874)
• Fixed 400 on /v1/messages with many strict tools under drop_params by retrying without strict (#​49102)
• Fixed Claude pause_turn reported as finished and refusal explanations dropped on chat and Responses (#​49192)
• Fixed 500 on a non-string role or tool call id, now a 400 that names the field (#​49237)
• Fixed metadata.user_id being dropped on Anthropic /v1/messages pass-through routes (#​49333)
• Changed the default max_tokens for unmapped Anthropic models from 4096 to 128000 (#​48502)
• Changed the opening prompt usage estimate in the Chat Completions adapter to be off by default (#​48633)

AWS Bedrock (28)

• Added context and output token limits for the Nova Sonic models (#​48247)
• Added pricing for native guardrailConfig trace usage to spend and x-litellm-response-cost (#​48278)
• Added global.openai.gpt-6.1-terra and us.openai.gpt-6.1-terra Bedrock models with pricing (#​48441)
• Added token counting for three Mantle-native Bedrock Claude models (#​48682)
• Added published Priority, Batch and Flex prices to 46 Bedrock regional rows (#​49113)
• Fixed Bedrock Voxtral transcription returning 400, logging $0 spend and ignoring language (#​41565)
• Fixed Unknown provider=None 404 for Bedrock models missing from the cost map (#​43290)
• Fixed 400 errors on Bedrock Kimi K3 Converse calls with max_tokens below 16 (#​43875)
• Fixed 400 invalid beta flag on Claude Code auto mode requests that carry no safeguards (#​44471)
• Fixed a malformed Bedrock batch JSONL line failing the upload with a 500 instead of a 400 (#​45992)
• Fixed post_call guardrails not scanning Claude output on invoke-with-response-stream passthrough (#​46524)
• Fixed Claude json_schema streams dropping reasoning and thinking blocks and ending on tool_calls with no tool calls (#​46863)
• Fixed JSON schema requests failing on Fable 5 and Sonnet 4.6 and losing adaptive thinking on Haiku 5.5 (#​46870)
• Fixed bedrock_request_metadata_fields being ignored on the /bedrock pass-through routes (#​47040)
• Fixed Bedrock Opus 4.8 and Sonnet 5 dropping reasoning on json_schema requests by trying native output first (#​47100)
• Fixed Bedrock batch jobs ignoring a configured control-plane endpoint (#​47260)
• Fixed AWS region lookups through Vault blocking the event loop and stalling other requests on the worker (#​47331)
• Fixed $0 spend and ModelNotMappedError for bedrock/claude_platform/<id> calls (#​48150)
• Fixed max_input_tokens to 922000 on Bedrock GPT models and added Mantle token counting for claude-opus-5-5 (#​48479)
• Fixed Bedrock rejecting strict tool schemas by retrying without strict under drop_params (#​48733)
• Fixed 400 on Bedrock when Codex repeats its tool list across turns (#​49006)
• Fixed region-prefixed Bedrock embedding models not routing to their region or billing its price (#​49072)
• Fixed bedrock_mantle/openai.gpt-5.6-cyber token limits and endpoints to match its model card (#​49350)
• Fixed max_output_tokens for Bedrock GovCloud West Llama 3 models, now 8192 (#​49543)
• Changed converse-stream pass-through to stream frames through post_call guardrails instead of buffering the reply (#​46307)
• Changed /bedrock pass-through routes to apply a model's guardrailConfig, returning 400 if Bedrock cannot use it (#​47429)
• Changed Bedrock pass-through to use request metadata as the session id, fixing 400s with missing_session_id: reject (#​49193)
• Changed Bedrock Invoke and Mantle Claude to use the model's own default max_tokens (#​49724)

Vertex AI and Gemini (34)

• Added Gemini 3.1 Flash TTS support, including multi-speaker voices and mp3, opus, alaw and mulaw output (#​31915)
• Added a setting to drop chosen anthropic-beta values on the Vertex AI pass-through routes (#​47185)
• Added LITELLM_GEMINI_DEFAULT_MAX_OUTPUT_TOKENS to set the output limit for requests that set none (#​47542)
• Added thought_signature_in_tool_call_id to keep Gemini tool call ids short for clients that cap them (#​47692)
• Added a 2026-06-30 deprecation date to vertex_ai/veo-2.0-generate-001 (#​47847)
• Added Batch rates for two Llama 4 MaaS models so Vertex batch jobs no longer bill at on-demand rates (#​48085)
• Added Vertex batch prices above 200k tokens and image output prices for Gemini models (#​48945)
• Fixed the Gemini 3 sampling deprecation warning logging on every request, now once per model per worker (#​40868)
• Fixed vertex_ai/* keys not listing partner, Veo and embedding models and dropping publisher prefixes (#​41959)
• Fixed Gemini TTS /v1/audio/speech calling Google twice and logging 0 tokens in spend (#​44551)
• Fixed 400 from compaction, thinking display and tool change betas on Claude via Vertex AI and Azure AI (#​44747)
• Fixed context caching on Vertex AI failing when a custom api_base is set (#​44783)
• Fixed streamed Vertex AI pass-through calls missing the regional 10% uplift and custom deployment prices (#​44795)
• Fixed Gemini not receiving integer enum values in tool parameters (#​44908)
• Fixed Vertex Claude batches returning 404 at create (#​45715)
• Fixed cache-marked requests listing all cachedContents on every call and creating duplicate caches (#​46857)
• Fixed Vertex AI rate limit errors returned as 403 when the error text contains 403 (#​47134)
• Fixed Gemini audio input and cached audio billed at the Standard rate on flex, priority and batch tiers (#​48086)
• Fixed gemini-2.5-flash-native-audio video input billed at the text rate instead of the audio/video rate (#​48248)
• Fixed Gemini 2.5 rejecting tool results with images and the history replay that follows (#​48428)
• Fixed Vertex AI shared credential cache growing without bound across credential and project pairs (#​48442)
• Fixed Vertex AI image sizes outside the old lookup table silently producing square output (#​48463)
• Fixed slow Google credential requests blocking the proxy worker on Claude /v1/messages (#​48523)
• Fixed explicit Gemini and Vertex embedding timeouts silently becoming 300 seconds (#​48690)
• Fixed Gemini grounding keeping only the first web source for a passage (#​48745)
• Fixed labels on vertex_ai/claude-* returning 400 by sending them as X-Vertex-AI-Labels (#​48753)
• Fixed 400 on countTokens and generateContent when repeated fields are a single object or null (#​48771)
• Fixed Vertex Claude /v1/messages returning 400 when the SDK sends anthropic-version as a header (#​48814)
• Fixed Claude web search billing per request on Vertex AI deployments priced in model_info (#​49160)
• Fixed batch image output billed at the Standard rate on gemini-nano-banana-2.1 and gemini-3.1-flash-lite-image (#​49317, #​49358)
• Changed Gemini 3.6 Flash, 3.5 Flash-Lite and newer to refuse temperature, top_p and top_k without drop_params (#​47645)
• Improved rerank latency by reusing cached Google credentials on every request (#​48430)
• Improved failure logs for Gemini and Vertex pass-through calls by adding the URL model and declared provider (#​49075)
• Removed the floor deprecation_date from gemini-3.1-flash-lite-image (#​48587)

Other providers (3)

• Added 11 new providers: ai&, BigModel, CLF AI Gateway, Hostinger Router, Kyma API, Nace, OpenCode Go, OpenInfer, Refuseless, StreamLake and ZeroGPU (#​38958, #​39324, #​41006, #​41034, #​43874, #​44863, #​46523, #​48140, #​48497, #​48563, #​48756)
• Added models, endpoints and options for smaller providers (31 PRs) (#​41021, #​41522, #​46156, #​46875, #​47401, #​47473, #​47610, #​47690, #​47785, #​47812, #​48158, #​48251, #​48335, #​48448, #​48450, #​48453, #​48498, #​48621, #​48651, #​48676, #​48677, #​48735, #​48871, #​48998, #​49252, #​49280, #​49281, #​49282, #​49287, #​49297, #​49542)
• Fixed issues and updated behavior on smaller providers (41 PRs) (#​38736, #​40152, #​43390, #​44723, #​45092, #​45567, #​46091, #​46861, #​46945, #​46959, #​47091, #​47423, #​47424, #​47432, #​47495, #​47784, #​47794, #​48121, #​48254, #​48265, #​48268, #​48270, #​48455, #​48522, #​48527, #​48668, #​48684, #​48706, #​48707, #​48778, #​48820, #​48837, #​49068, #​49158, #​49278, #​49344, #​49458, #​49462, #​49498, #​49502, #​49616)

Chat completions (17)

• Fixed streams with logprobs ending in a 500 error frame before the finish chunk (#​33549)
• Fixed 500 errors when a prompt template omits initial_prompt_value or final_prompt_value (#​39762)
• Fixed rebuilt streamed text completions returning null finish_reason and zero prompt_tokens (#​44349)
• Fixed Foundry deployments and Claude fallbacks getting the wrong cache options, which caused 400s (#​45295)
• Fixed non-streaming chat dropping upstream response headers on bedrock_mantle/ and other OpenAI-like providers (#​46928)
• Fixed chat streams failing with a proxy error when progress chunks have no choice index (#​46947)
• Fixed the overhead header under-reporting on chat requests when guardrails add litellm_metadata (#​47790)
• Fixed streamed chunks containing [DONE] being read as end of stream and dropped (#​47832)
• Fixed completions streams including usage when it was not requested (#​48052)
• Fixed an upstream abort on streamed chat completions returning a clean HTTP 200 instead of a server error (#​48328)
• Fixed unbalanced think tags in merged streams and SSE lines splitting on characters other than CR/LF (#​48755)
• Fixed 400 on system-first models like Qwen3.5 when a later developer message appears (#​48897)
• Fixed streamed chat completions with n>1 rebuilding each choice (#​49002)
• Fixed streaming clients missing tool execution when OpenAI-compatible providers end tool calls with stop (#​49388)
• Changed the include_usage stream chunk to send an empty choices array like OpenAI (#​47109)
• Changed stalled stream reads to raise a 408 litellm.Timeout on chat, messages and responses (#​47198)
• Changed streams that end without a finish reason to fail as errors instead of reporting a normal completion (#​47665)

Responses API (34)

• Added max_agentic_loops support to raise the streamed MCP auto-execute round cap above 5 (#​47688)
• Added resuming background response streams with stream and starting_after on retrieve (#​48819)
• Added Codex client tool_search support on Anthropic and other bridged providers, cutting input tokens (#​48972)
• Fixed Responses API logging tasks being dropped by garbage collection and cut off at shutdown (#​31074)
• Fixed non-stream MCP auto-execute on /v1/responses logging and billing only one of its two model calls (#​43667)
• Fixed 400 from malformed prompt_cache_breakpoint on /v1/responses with drop_params: true (#​45330)
• Fixed later turns on an open Responses WebSocket skipping deployment checks and not counting toward budgets (#​45727)
• Fixed streamed /v1/responses events showing the backend deployment name in nested response.model (#​46662)
• Fixed /v1/responses on Claude dropping returned and replayed compaction items (#​46754)
• Fixed Responses WebSocket running pre_call guardrails on turn one only and rebilling that cost every turn (#​47013)
• Fixed OpenAI pass-through GET /responses/{id} being billed again on every call (#​47171)
• Fixed background spend not counting toward the key's project or per-model budgets (#​47504)
• Fixed the billed cost of background responses not reaching key and team loggers (#​47506)
• Fixed failed Responses streams billing 0 tokens and bridged /v1/messages stream failures not being reported (#​47537)
• Fixed clear_tool_uses_20250919 being silently dropped for openai/ models on the Responses API (#​47861)
• Fixed per-call input_cost_per_token and output_cost_per_token being ignored by responses() (#​48119)
• Fixed 500 when replaying web_search_call input items that have no action (#​48417)
• Fixed audio, PDF and image tool results and history media being dropped in Responses and Gemini conversions (#​48484)
• Fixed retries from previous_response_id returning 400 on Bedrock after a failed turn (#​48647)
• Fixed Responses params the chat bridge cannot translate causing 400s like max_tool_calls on Bedrock Claude (#​48655)
• Fixed typed streaming text access breaking on /v1/responses when logprobs is omitted (#​48686)
• Fixed moderation on /v1/responses being dropped before the OpenAI call (#​48708)
• Fixed later citation batches and pending citations being dropped when streaming Responses (#​48747)
• Fixed replayed Responses output items being rejected by OpenAI because of a null created_by (#​48783)
• Fixed an empty function_call_output reaching models as serialized JSON instead of an empty tool result (#​48845)
• Fixed Responses compaction by dropping params it rejects and sending Azure compaction to the v1 route (#​48876)
• Fixed Responses item order, phase and boundaries not being replayed on the next chat turn (#​48912)
• Fixed bridged Responses requests losing the requested text verbosity when sent to chat completions (#​49049)
• Fixed deployment itpm and otpm limits not being checked or counted on later Responses WebSocket turns (#​49069)
• Fixed litellm.responses() through litellm_proxy/ leaving e.body, e.code and e.type empty on errors (#​49073)
• Fixed dict reasoning_effort losing mode and context on Azure, ChatGPT, Perplexity, xAI, Fireworks and Copilot (#​49082)
• Fixed repeated Codex tools being merged for all callers, now only merged when drop_params is on (#​49112)
• Fixed native /v1/responses WebSocket turns not counting toward key and tag tpm_limit (#​49257)
• Changed a lone Responses built-in tool on Claude to return 400 before token counting (#​48798)

Messages API (14)

• Fixed web-search-only requests coming back without native search blocks on streamed replies (#​40967)
• Fixed retried /v1/messages attempts mixing up usage and spend logs, and exhausted retries billing only the last (#​45194)
• Fixed safeguard_results and stop_details missing from streamed /v1/messages message_delta events (#​46096)
• Fixed the clear_tool_uses polyfill ignoring clear_at_least, exclude_tools and clear_tool_inputs (#​47123)
• Fixed /v1/messages PDF documents being sent to Azure OpenAI models as images instead of file parts (#​47166)
• Fixed 500 on /v1/messages and count_tokens for null or numeric tool_result text, now a 400 (#​47347)
• Fixed 400 Tool reference not found for tool names over 64 chars when a guardrail rewrites /v1/messages (#​47434)
• Fixed canceled /v1/messages streams not closing the upstream request (#​48220)
• Fixed stop_sequences being ignored for OpenAI models on /v1/messages (#​48534)
• Fixed the client's anthropic-beta replacing the deployment's on /v1/messages (#​48594)
• Fixed /v1/messages streams reporting zero input_tokens in message_start when bridged to Chat Completions (#​48618)
• Fixed Anthropic-format tool_choice crashing input token counting and causing false budget refusals (#​48624)
• Fixed 400 on /v1/messages caused by a non-spec custom object in tool definitions (#​48893)
• Fixed Mistral thinking text being lost on streaming /v1/messages (#​49059)

Realtime (4)

• Added Soniox realtime speech-to-text on /v1/realtime with stt-rt-v5 (#​44822)
• Fixed Gemini Live ignoring session.update instructions and tools, and answering text clients with audio (#​39864)
• Fixed /health reporting OpenAI realtime deployments with a missing or invalid key as healthy (#​41233)
• Fixed sessions going silent when a transcript guardrail sent turn_detection with no type to OpenAI (#​44939)

Embeddings, images and audio (8)

• Added a per-request input batch limit on /v1/embeddings to cap how many inputs one call can send (#​44574)
• Fixed video status and content polling failing with per-model keys by keeping model_id in video ids (#​44614)
• Fixed aws_polly/standard, long-form and generative being sent with the neural engine (#​47963)
• Fixed image generation ignoring max_retries and Router retries multiplying upstream attempts (#​48705)
• Fixed async image edits with no image returning HTTP 500 instead of 400 (#​48872)
• Fixed key and team router_settings being ignored on /v1/images/generations (#​49286)
• Changed unsupported transcription providers to return 400 naming the provider and model instead of 500 (#​47971)
• Removed dall-e-2 and dall-e-3 support, and image generation without a model now returns 400 (#​48703)

Batches and files (8)

• Added routing of POST /v1/batches to batch deployments and supported_endpoints on /model_group/info (#​47376)
• Fixed 400 on GET /files/{id}/content with raw gs:// file ids from the unmanaged Vertex batch flow (#​40621)
• Fixed fine-tuning jobs failing with 400 for files uploaded with target_model_names (#​46552)
• Fixed completed batches skipping success callbacks and losing usage under redaction (#​47192)
• Fixed file lists showing every file on the shared key and ignoring limit and after with require_managed_files (#​47682)
• Fixed batch retrieve showing zero prompt and completion tokens (#​47740)
• Fixed unbillable batches blocking file deletes and new-batch polling (#​48752)
• Fixed unmanaged gs:// Vertex batches being costed through the wrong deployment and reading zero spend (#​49301)

Vector stores (5)

• Added OpenSearch k-NN search as a vector store provider (#​47759)
• Fixed /rag/ingest and /rag/query ignoring team provider credentials and denying viewers and team JWTs (#​45497)
• Fixed team key vector store search failing when the team's first model is from a different provider (#​46894)
• Fixed team and key Allowed Vector Stores being ignored on /v1/responses file_search without a registry (#​48915)
• Improved Vertex AI Search vector store searches by reusing HTTP/2 connections and OAuth tokens (#​40631)

Token counting (10)

• Added one log line per token count call with its id, model and count (#​47657)
• Fixed /v1/messages/count_tokens and /utils/token_counter failing on histories with a compaction block (#​44784)
• Fixed DeepSeek V4 token counts missing Azure's billed tokens by using DeepSeek's own tokenizer (#​47173, #​47353)
• Fixed count_tokens overcounting PDFs about 12x for OpenAI and Azure models (#​47554)
• Fixed token counts retrying a failed HuggingFace tokenizer download and adding about 23s per request (#​47586)
• Fixed HTTP 500 when counting tokens for Anthropic search results and unsupported blocks (#​48699)
• Fixed token counts for OpenAI models newer than the tiktoken table by using o200k_base (#​48728)
• Fixed a loaded Hugging Face tokenizer being hidden when a later download fails ([#​48916](https

[!IMPORTANT]
✂ PR body was truncated to here.

---

Configuration

📅 Schedule: (in timezone Europe/Amsterdam)

• Branch creation
  • Between 01:00 AM and 01:59 AM, only on Monday and Thursday (* 1 * * 1,4)
• Automerge
  • At any time (no schedule defined)

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

---

• If you want to rebase/retry this PR, check this box

---

This PR has been generated by Mend Renovate CLI.

[github-actions]

Rendered Kubernetes changes

Base: 328c560740caa0b950c70a69bd9a40679972d7f3

Head: 7c7a9661dc6a21c1bdd5cd22dc3f676cb48cfecc

Rendering evidence unavailable. Rendering failed, timed out, was skipped, or did not match this revision. No change categories can be verified. Renderer diagnostics are withheld to protect secrets.

[github-actions]

✅ Automated recommendation: APPROVE

Analysis engine: qwen3.5-9b-fallback (openai)

Approve this minor version bump of ghcr.io/berriai/litellm from v1.108.3 to v1.109.1. This is a security patch release (backport of PR 51254) with proper digest pinning. Breaking changes from v1.109.0 are already addressed in the manifests (cache_params.type: redis, drop_params: true). No configuration changes required.