Port HelixDB fork changes to SlateDB v0.15 by matthewsanetra · Pull Request #8 · HelixDB/slatedb

matthewsanetra · 2026-08-07T15:41:42Z

Note

Validated against HelixDB/helix-db@bb5a1a02967109f20dd462972d562c5523748eee with only its SlateDB dependency redirected to this local v0.15 port. The db crate check, full test suite, requested bitmap concurrency/race cases, and strict library Clippy check passed.

Summary

Port the HelixDB fork changes onto the SlateDB v0.15.0 codebase while preserving v0.15 reader modes, manifest polling, WAL behavior, and cache policy support.
Reconcile reader snapshots with ManagedCheckpoint, Checkpoint, and FollowLatest modes, including protected generations and mode-specific behavior.
Restore multi-get across databases, readers, snapshots, transactions, and shared read operations.
Add the fork's Rust-only conflict-compatible transaction merge API, preserving SSI read conflicts while allowing commutative writers to the same key to commit concurrently.
Integrate query-scoped storage metrics, synchronous cache usage snapshots, the typed DatabaseMissing error, binding expectations, and the macOS cross-test matrix.
Preserve HelixDB's cache_puts configuration and legacy optional-checkpoint reader opening while routing both through v0.15-native cache policies and DbReaderMode.

Validation

Each-feature workspace check: 30/30 configurations passed with warnings denied.
Workspace/all-feature nextest: 2,235 passed, 1 skipped by profile.
Documentation tests: 63 passed, 7 ignored.
DST profile: 4 passed, 25 skipped by profile.
Binding suites: Node 49/49, Python 47/47, Go passed, Java passed with Java 22, and generated binding directories remained unchanged.
Reader scaling and reader memory-scaling benchmarks compile with warnings denied.
HelixDB db validation at bb5a1a02967109f20dd462972d562c5523748eee: cargo check -p db, full cargo test -p db, requested bitmap concurrency/race tests, and cargo clippy -p db --lib -- -D warnings passed.
HelixDB's all-target strict Clippy additionally reports one pre-existing manual_range_patterns lint in unchanged test code (production_contracts.rs).

slatedb#1882)

…latedb#1885)

Blog post on segment-oriented compaction from rfc 24.

)

…y logic (slatedb#1916)

…slatedb#1899)

… that share inner (slatedb#1886)

…latedb#1928)

…cted` tick and increase worker default heartbeat_interval (slatedb#1931)

…DME (slatedb#1942)

)

…latedb#1930)

…disabled) (slatedb#1939)

…db#1961)

…atedb#1978)

- Introduced `multi_get` and `multi_get_with_options` methods in `Db`, `DbReader`, `DbSnapshot`, and `DbTransaction` to retrieve multiple values efficiently. - Implemented a new `WriteBatchLookup` enum to facilitate lookup operations in `WriteBatch`. - Enhanced the `lookup_latest_for_key` method to support the new multi-get functionality. - Added tests to ensure correctness of multi-get operations, preserving input order and handling duplicates. This update improves the performance and usability of batch retrieval operations in the database.

Keep the fork-facing object-store cache switch while routing it through v0.15's split flush and compaction admission policy. Accept the legacy optional checkpoint argument at DbReader::open through DbReaderMode conversion without weakening the v0.15 builder API.

All origin/main changes through dfe4b4d were reapplied as v0.15-compatible commits on top of v0.15.0. Record origin/main as integrated without reintroducing pre-v0.15 implementations.

## What changed - update the Helix SlateDB fork revision from dfe4b4dc to merge commit 30d9f28c - consume SlateDB v0.15.0 from the merged HelixDB/slatedb#8 port - refresh the workspace, migration-parity, and checked-in fuzz lockfiles - use a portable /tmp fallback for production-coverage scripts on Ubuntu runners ## Revision provenance SlateDB commit 30d9f28cfeb93cf95652aac2b7724811c5c49630 is the merge commit for HelixDB/slatedb#8. Its second parent is a60a1234f8b6a184381b0b0b2dc88c1cabd010f7, the former codex/port-v0.15 branch tip. Pinning the merge commit validates the merged main-branch state while retaining the exact PR revision in its ancestry. ## Why The SlateDB v0.15 fork port is now merged. Helix should validate the immutable merged revision rather than the former draft branch tip. ## Impact No Helix source compatibility changes were required beyond the existing SlateDB v0.15 migration-parity adjustments. The production-coverage script change only replaces the macOS-specific /private/tmp fallback with portable /tmp. ## Validation - cargo fmt --all -- --check - cargo clippy --workspace -- -D warnings - cargo metadata --locked resolves SlateDB v0.15.0 at 30d9f28c - all four checked-in lockfiles resolve SlateDB packages at 30d9f28c - shell syntax and unset-TMPDIR fallback checks pass

rodesai and others added 30 commits July 8, 2026 18:43

[k/N] wal refactor: reorganize wal buffer so its owned by batch writer (

076834d

slatedb#1882)

[k/n] wal refactor: only update last seen wal id with flushed wals (s…

5cdc57d

…latedb#1885)

Blog post on segmentation (slatedb#1912)

8729820

Blog post on segment-oriented compaction from rfc 24.

[1908] Wire RetryingObjectStore into Admin and Clone paths (slatedb#1909

016b676

)

1707 RFC-0029 GC Safe SST Ulid Allocator (slatedb#1822)

0789090

Did small refactoring for db_state.rs triple-duplicates first/last ke…

323ed1b

…y logic (slatedb#1916)

Optimize DST binary (slatedb#1918)

c676f11

RFC 0027 impl (4/N) - wiring object store cache for compaction and gc (…

9937c2d

…slatedb#1899)

extract gc deletion into maybe_delete methods (slatedb#1919)

d304e71

Add a DST for DB rescaling (slatedb#1920)

62047c3

Allow users to disable boundary files in GC (slatedb#1917)

44295b0

adds schema evolution docs wrt PrefixExtractor (slatedb#1921)

6b4857b

Regenerate Go bindings (slatedb#1922)

593c62e

Add DbReaderMode and latest manifest polling (slatedb#1915)

4ff907a

Clarify impact of disabled boundary files (slatedb#1925)

8f4eada

[k/N] wal refactor: reorganize WalBufferManager into separate handles…

e7d6b4f

… that share inner (slatedb#1886)

fix accounting for max_concurrent_compactions (slatedb#1926)

cc69461

k/N wal refactor: drop last seq tracking from the wal (slatedb#1927)

844f724

switch fence fault injection over to fail channel from fail-parallel (s…

7e5108d

…latedb#1928)

[1923] Add configurable object-store retry bound (slatedb#1924)

6a28896

Eliminate unnecessary object store requests made on each `CommitCompa…

c8e62bc

…cted` tick and increase worker default heartbeat_interval (slatedb#1931)

[1941] Fix stale nightly benchmark description in slatedb-bencher REA…

5ddac5b

…DME (slatedb#1942)

[1923] Expose object_store_max_retries on UniFFI (slatedb#1933)

3f8e301

Fix flaky local filesystem boundary test (slatedb#1940)

5f7ac90

remove fsync from cached object store (slatedb#1945)

5beefe1

[1932] Expose manifest structural counts as DbStats gauges (slatedb#1934

4df9dcf

)

wal refactor k/N: simplify backpressure to use flushed events only (s…

5604c9b

…latedb#1930)

Fix stale external SSTs after manifest merge (slatedb#1936)

5ea9afb

[1938] Count active memtable in total_mem_size_bytes (fix 0 with WAL …

57c0965

…disabled) (slatedb#1939)

rename wait_until_wal_released->wait_until_wal_flushed (slatedb#1946)

0f39324

rodesai and others added 24 commits July 28, 2026 02:26

[rfc-30 1/N]: refactor writer WAL write path to use new traits (slate…

40ef029

…db#1961)

Fix panic when probing a zero-bit prefix Bloom filter (slatedb#1969)

779c905

fix flaky test_size_based_flush_triggering (slatedb#1979)

54b2f33

[1977] Fix flaky test_backpressure_waiter_exits_when_db_is_fenced (sl…

71a4963

…atedb#1978)

Fix test_compactor_applies_output_cache_policy (slatedb#1981)

42a9f15

convert block prefetch panic to error (slatedb#1983)

402a3cf

Add simple trivial moves to compactor scheduler (slatedb#1982)

69892b3

Add DbIterator.next_batch to the UniFFI binding (slatedb#1986)

4a9a2e4

Probe latest sequenced objects before listing (slatedb#1968)

81acc3c

Bump version to 0.15.0

7db4911

Add request-scoped query storage metrics

8742c84

Add snapshot isolation to DbReader

7869213

Harden reader snapshot WAL replay test

b313ac2

ci: drop Windows test runner

4e3c5df

Add SlateDB cache usage snapshots

d439a32

Update SlateDB dependency lockfile

ec429d7

Keep unbounded cache accounting synchronous

2b99b7b

Add typed database-missing reader error

eaff69b

Update missing database binding tests

567d683

Finish v0.15 reader API adaptation

ce9c7d2

Add conflict-compatible transaction merges

24d7cdd

Merge updated origin/main after v0.15 port

a60a123

All origin/main changes through dfe4b4d were reapplied as v0.15-compatible commits on top of v0.15.0. Record origin/main as integrated without reintroducing pre-v0.15 implementations.

matthewsanetra force-pushed the codex/port-v0.15 branch from 25101ca to a60a123 Compare August 14, 2026 15:12

matthewsanetra mentioned this pull request Aug 17, 2026

Update SlateDB fork to v0.15 HelixDB/helix-db#996

Merged

matthewsanetra marked this pull request as ready for review August 18, 2026 10:17

matthewsanetra merged commit 30d9f28 into main Aug 18, 2026
17 checks passed

xav-db deleted the codex/port-v0.15 branch August 25, 2026 18:26

Navigation Menu

Repository navigation

Port HelixDB fork changes to SlateDB v0.15 - #8

Port HelixDB fork changes to SlateDB v0.15#8
matthewsanetra merged 66 commits into
mainfrom
codex/port-v0.15

matthewsanetra commented Aug 7, 2026 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants

Conversation

matthewsanetra commented Aug 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Validation

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants

matthewsanetra commented Aug 7, 2026 •

edited

Loading