Skip to content

Commit 97ede6c

Browse files
committed
docs(fidelity): record that the v2.336.0 replay gate is currently red
The section claims all 24 scenarios pass, dated 2026-07-28. CI's `server-light` job reports `conformance failed for 6 scenario(s)`. Verified pre-existing rather than a regression from this branch: `main` at `c9a6d89e` fails the same job with the same count as this branch at `110266ec`. This is the hedge I left unresolved in the #212 review — it is now checked rather than assumed. The failing scenario names appear only in preserved artifacts inside the ephemeral runner VM, which is torn down before the job reports, so a conformance failure cannot currently be diagnosed from the log alone.
1 parent da6e5eb commit 97ede6c

1 file changed

Lines changed: 10 additions & 0 deletions

File tree

‎docs/fidelity-gap.md‎

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -292,6 +292,16 @@ The conformance gate checks:
292292

293293
Body-value diffs (different URLs, IDs, tokens) are expected and not gated.
294294

295+
> **Stale as of 2026-09-02.** CI's `server-light` job reports
296+
> `conformance failed for 6 scenario(s)` on this replay. Verified as
297+
> pre-existing rather than a regression: `main` at `c9a6d89e` and
298+
> `Bnjoroge/step-manifest` at `110266ec` fail the same job with the same
299+
> count. The failing scenario names are only in the run's preserved
300+
> artifacts, which live in the ephemeral runner VM and are gone by the time
301+
> the job reports, so they are not yet identified here — that artifact
302+
> retention is itself worth fixing, since a conformance failure currently
303+
> cannot be diagnosed after the fact from the log alone.
304+
295305
### 1a.2 Scenario coverage
296306

297307

0 commit comments

Comments
 (0)