You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
After #172, the adjacency zarrs contain everything needed for routing (topology + flowpath attributes). These files are small enough (<50 MB each) to live in the repository, eliminating the need for any manual data preparation before running DDR.
Current sizes (topology only):
hydrofabric_v2.2_conus_adjacency.zarr — 5.8 MB
merit_conus_adjacency.zarr — 2.3 MB
With baked-in flowpath attributes, these will grow modestly (5 float arrays × ~300-800k segments × 4 bytes ≈ 6-16 MB additional).
Commit them to data/ (or examples/data/) in the repository
Update example configs to point to the in-repo zarrs with relative paths
Add to .gitattributes if needed for LFS (likely unnecessary at <50 MB)
Per-gage adjacency zarrs
The *_gages_conus_adjacency.zarr files are ~300 MB each — too large for the repo. These are only needed for gage-based training/testing, not for routing. They should remain a separate download (future ddr fetch or manual).
Context
After #172, the adjacency zarrs contain everything needed for routing (topology + flowpath attributes). These files are small enough (<50 MB each) to live in the repository, eliminating the need for any manual data preparation before running DDR.
Current sizes (topology only):
hydrofabric_v2.2_conus_adjacency.zarr— 5.8 MBmerit_conus_adjacency.zarr— 2.3 MBWith baked-in flowpath attributes, these will grow modestly (5 float arrays × ~300-800k segments × 4 bytes ≈ 6-16 MB additional).
Proposal
data/(orexamples/data/) in the repository.gitattributesif needed for LFS (likely unnecessary at <50 MB)Per-gage adjacency zarrs
The
*_gages_conus_adjacency.zarrfiles are ~300 MB each — too large for the repo. These are only needed for gage-based training/testing, not for routing. They should remain a separate download (futureddr fetchor manual).Files to modify
data/orexamples/data/— add zarr storesexamples/merit/example_config.yaml— update pathsexamples/lynker_hydrofabric/example_config.yaml— update pathsconfig/templates/*.yaml— update default pathsAcceptance criteria
ddr route --config-name exampleresolves the adjacency zarr without any downloads.gitignoreupdated if needed to not exclude these specific zarrsDepends on