Skip to content

Add 6 oracle-verified reader test cases from delta-semantics-tester#1

Open
murali-db wants to merge 1 commit into
mainfrom
semantics-tester-golden-tables
Open

Add 6 oracle-verified reader test cases from delta-semantics-tester#1
murali-db wants to merge 1 commit into
mainfrom
semantics-tester-golden-tables

Conversation

@murali-db
Copy link
Copy Markdown
Owner

Summary

Adds 6 new @reference_table test cases generated by the delta-semantics-tester project.

New test cases

Name What it tests
semantics_append_read Basic append/read agreement across engines
semantics_multi_append Multiple sequential appends, all data visible
semantics_partition_filter Partitioned table with predicate filter
semantics_delete_read Delete rows, verify they're gone
semantics_optimize_invariance OPTIMIZE preserves logical results (metamorphic)
semantics_time_travel Time travel to prior version after delete

How they were generated

Each table was:

  1. Written via deltalake (delta-rs Python bindings)
  2. Read through multiple independent engines (delta-rs + DuckDB)
  3. Verified against an independent reference oracle (Python-based Delta log replay)
  4. Validated against the kernel-rs DAT runner (25/25 pass including these 6 new cases)

Validation

These @reference_table functions follow the existing pattern in generated_tables.py. They require PySpark + Delta to generate the output tables via make write-generated-tables.

New test cases:
- semantics_append_read: basic append/read agreement
- semantics_multi_append: multiple sequential appends
- semantics_partition_filter: partitioned table with predicate
- semantics_delete_read: append then delete
- semantics_optimize_invariance: OPTIMIZE metamorphic check
- semantics_time_travel: time travel across versions after delete

These tables were generated by a hybrid oracle that independently
reconstructs table state from the Delta log, verified against delta-rs
and DuckDB, and validated against the kernel-rs DAT runner (25/25 pass).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant