omnigraph/crates/omnigraph
Ragnor Comerford cdfbccbfdc
MR-794 step 2: scaffold MutationStaging accumulator + scan_with_pending
Add the scaffolding for the in-memory staged-write rewire — no behavior
change yet:

* New crates/omnigraph/src/exec/staging.rs with MutationStaging,
  PendingTable, PendingMode, StagedTablePath, plus the end-of-query
  finalize() that issues one stage_* + commit_staged per pending
  table (Merge mode dedupes by id, last-write-wins).
* TableStore::scan_with_pending and count_rows_with_pending helpers —
  Lance scan committed + DataFusion MemTable scan pending, concat.
  Sidesteps the Scanner::with_fragments filter-pushdown limitation
  documented on scan_with_staged.
* Add datafusion = "52" to workspace + omnigraph-engine deps for
  MemTable (transitively pulled by Lance already).

Engine code still uses the legacy MutationStaging shape; the rewire
lands in subsequent commits.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 10:42:21 +02:00
..
examples Clean up bench_expand example 2026-04-25 00:59:21 +03:00
src MR-794 step 2: scaffold MutationStaging accumulator + scan_with_pending 2026-05-01 10:42:21 +02:00
tests MR-794 step 1: fix u32 cast + pin scan_with_staged filter limitation 2026-05-01 01:03:27 +02:00
Cargo.toml MR-794 step 2: scaffold MutationStaging accumulator + scan_with_pending 2026-05-01 10:42:21 +02:00