Skip to content

Count the requests the fleet gateway has open to each model - #548

Merged
dennis-upbound merged 2 commits into
modelplaneai:mainfrom
dennis-upbound:dennis/frontend-requests-active
Oct 21, 2026
Merged

Count the requests the fleet gateway has open to each model#548
dennis-upbound merged 2 commits into
modelplaneai:mainfrom
dennis-upbound:dennis/frontend-requests-active

Keep other Envoys' requests in flight out of the gateway's count

4643d3c
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 21, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO