Skip to content

fix(baseline): preserve exact findings and protect baseline output - #657

Open
chrisknvidia wants to merge 4 commits into
NVIDIA:mainfrom
chrisknvidia:feat/christopherk/fix-baseline-finding-coverage
Open

chrisknvidia wants to merge 4 commits into
NVIDIA:mainfrom
chrisknvidia:feat/christopherk/fix-baseline-finding-coverage

Conversation

@chrisknvidia

@chrisknvidia chrisknvidia commented Sep 28, 2026 •

Copy link
Copy Markdown
Collaborator

Baseline generation fingerprinted compacted report representatives, leaving repeated findings and identical matches in other files active on an unchanged rescan. Generate exact fingerprints from sanitized original findings before report compaction, preserving each occurrence's evidence and strict source/version matching.

Reject failed scans before generating acceptance; warn when accepting observed findings from a successful partial scan. Validate the complete baseline before atomic replacement, preserve existing output on failures, and round-trip Unicode reasons correctly. POSIX output is owner-only, with inherited macOS ACLs removed before writing; symlink and special-file destinations are rejected.

Add a dedicated credential-free CI job for real baseline CLI and MCP transport regressions. Isolate the FIFO operation watchdog from cold-import latency and check dense-directory timing against the documented stage deadlines.

Closes #656.

Validation: 620 focused tests, 14 CLI/MCP integration tests, 29 installed-wheel cases and an actual installed-command scan → baseline → rescan (18 findings → 18 suppressed, zero active). Native macOS ACL checks and real provider-failure output preservation also passed. Live semantic evidence can vary between runs; exact matching remains intentionally strict, with the static-only workflow documented.

Signed-off-by: Christopher Kevin <christopherk@nvidia.com>
Signed-off-by: Christopher Kevin <christopherk@nvidia.com>
@chrisknvidia
chrisknvidia marked this pull request as ready for review September 28, 2026 20:36
Signed-off-by: Christopher Kevin <christopherk@nvidia.com>
Signed-off-by: Christopher Kevin <christopherk@nvidia.com>
@chrisknvidia chrisknvidia changed the title fix(baseline): preserve repeated and cross-file findings fix(baseline): preserve exact findings and protect baseline output Sep 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Baseline generation silently drops findings: dedupe key is coarser than match scope

1 participant