Skip to content

Segmented bundle format for incremental persistence (post-mortem F8) — v0.3 design #21

Description

Builder post-mortem F8 (second half): every save is a full rewrite of all artifacts — O(corpus) per flush — so append-forever workloads must batch flushes (brief-03's memory app). The 0.2.0 hardening wave ships the safety half (non-clobber write modes, documented full-rewrite cost).

This issue: the real fix is a segmented format (segments/NNNNNN.ovrq + per-segment sign/ids sidecars, flush_delta/compact), which is a cross-repo format/schema change: ordvec-manifest's schema assumes a single primary artifact, and RankQuant is a single contiguous file. Needs its own design doc; do not attempt as a patch.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions