Skip to content

Harden cold archive consistency - #8

Merged
GatewayJ merged 5 commits into
Demoio:mainfrom
GatewayJ:feat/vtl-archive-pipeline
Jul 5, 2026
Merged

Harden cold archive consistency#8
GatewayJ merged 5 commits into
Demoio:mainfrom
GatewayJ:feat/vtl-archive-pipeline

Conversation

@GatewayJ

@GatewayJ GatewayJ commented Jul 5, 2026

Copy link
Copy Markdown
Member

Summary

  • make persistent single-node metadata Raft the default path and add an atomic CompleteArchiveObject CAS-style metadata update
  • harden cache capacity handling so staging pressure is rejected explicitly and restored eviction cannot mask staging budget exhaustion
  • expand gateway/scheduler protocol behavior for S3 errors, restore/list semantics, archive validation, and concurrent task boundaries
  • refresh architecture/module documentation to match the current implementation

Validation

  • pre-commit hook passed:
    • cargo fmt --all -- --check
    • cargo clippy --workspace --all-targets -- -D warnings
    • cargo check --workspace
    • cargo test --workspace --no-fail-fast

GatewayJ added 3 commits May 31, 2026 17:42
Add a coldstore-vtl crate with an in-memory VTL simulator and safe command-spec/discovery helpers for mhVTL preparation.\n\nBridge the simulator into the tape service behind a TapeBackend abstraction, then wire scheduler archive batching through CacheArchiveClient and TapeArchiveClient adapters. The archive path is covered by in-process metadata/cache/tape gRPC tests and remains free of live mhVTL or host /dev access.\n\nUpdate safe verification targets and docs to describe the current Phase-1 archive pipeline.
@GatewayJ GatewayJ changed the title [codex] wire single-node archive pipeline runtime Harden cold archive consistency Jul 5, 2026
GatewayJ added 2 commits July 5, 2026 20:04
…line

# Conflicts:
#	Cargo.toml
#	Makefile
#	crates/scheduler/src/service.rs
#	crates/tape/src/service.rs
@GatewayJ
GatewayJ marked this pull request as ready for review July 5, 2026 12:52
@GatewayJ
GatewayJ merged commit c205a5b into Demoio:main Jul 5, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant