feat(scheduler): land GPU arbiter on one VRAM authority + eviction/heartbeat fixes (#894/#185, continues #1718)#1859

Merged

jaylfc merged 19 commits into

devfrom

feat/gpu-arbiter-takeover

Jul 16, 2026

Commits on Jul 7, 2026

feat(scheduler): GPU arbiter — VRAM-accounted admission + queue + eviction
hognek
committed
fix(scheduler): preempt running GPU work on eviction, not just cancel futures
hognek
committed
fix(scheduler): clear lease-release ownership in eviction vs. completion
hognek
committed
fix(tests): remove test_gpu_arbiter.py — uses #1689-style API incompatible with stack
hognek
committed
fix(scheduler): close TOCTOU race in GPU admission with in-flight VRAM reservation
hognek
committed
fix(scheduler): move lease claim inside try/finally + subtract reserved VRAM in cluster path
hognek
committed
fix(scheduler): non-blocking drain + eviction-to-make-room in GPU arbiter
hognek
committed
fix(scheduler): use _reserve_and_check in post-eviction re-admit path
hognek
committed
fix(scheduler): add _running_lock coverage to eviction paths in GpuArbiter
hognek
committed
fix(scheduler): wire GpuArbiter with real VRAM probe in app.py
hognek
committed
fix(scheduler): add _running_lock coverage to eviction paths
hognek
committed
feat(cluster): worker auto-update with graceful drain, pause, install, restart
hognek
committed
fix(cluster): use exact worker-name compare in lease drain matching
hognek
committed
feat(scheduler): pause/resume GPU queue + hardware-aware LLM admission
hognek
committed
fix(tests): add missing await to _evict_task calls in test_gpu_arbiter_894
hognek
committed
fix(cluster): make drain_worker/cancel_drain async, hold _lease_lock on force-release, wire arbiter task cancellation
hognek
committed
fix(cluster): move worker.status='offline' inside _lease_lock; return (cancelled, already_completed) from cancel_running_for_leases
hognek
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat(scheduler): land GPU arbiter on one VRAM authority + eviction/heartbeat fixes (#894/#185, continues #1718)#1859

feat(scheduler): land GPU arbiter on one VRAM authority + eviction/heartbeat fixes (#894/#185, continues #1718)#1859
jaylfc merged 19 commits into
devfrom
feat/gpu-arbiter-takeover

Commits on Jul 7, 2026

feat(scheduler): GPU arbiter — VRAM-accounted admission + queue + eviction

fix(scheduler): preempt running GPU work on eviction, not just cancel futures

fix(scheduler): clear lease-release ownership in eviction vs. completion

fix(tests): remove test_gpu_arbiter.py — uses #1689-style API incompatible with stack

fix(scheduler): close TOCTOU race in GPU admission with in-flight VRAM reservation

fix(scheduler): move lease claim inside try/finally + subtract reserved VRAM in cluster path

fix(scheduler): non-blocking drain + eviction-to-make-room in GPU arbiter

fix(scheduler): use _reserve_and_check in post-eviction re-admit path

fix(scheduler): add _running_lock coverage to eviction paths in GpuArbiter

fix(scheduler): wire GpuArbiter with real VRAM probe in app.py

fix(scheduler): add _running_lock coverage to eviction paths

feat(cluster): worker auto-update with graceful drain, pause, install, restart

fix(cluster): use exact worker-name compare in lease drain matching

feat(scheduler): pause/resume GPU queue + hardware-aware LLM admission

fix(tests): add missing await to _evict_task calls in test_gpu_arbiter_894

fix(cluster): make drain_worker/cancel_drain async, hold _lease_lock on force-release, wire arbiter task cancellation

fix(cluster): move worker.status='offline' inside _lease_lock; return (cancelled, already_completed) from cancel_running_for_leases

Commits on Jul 16, 2026

merge dev + reconcile GPU arbiter onto one VRAM authority (#894/#185)

fix(scheduler): exact GPU-arch + resource-on-worker match (kilo review)