Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
127 commits
Select commit Hold shift + click to select a range
ff123b9
Succinct game monitor (#141)
piersy May 18, 2026
56c428c
Jovian -> Succinct v2.1.0 Upgrade (#135)
Mc01 May 26, 2026
699a36d
Merge pull request #142 from celo-org/seolaoh/cost-estimator-and-mult…
seolaoh Jun 1, 2026
a4392a0
Game monitor reliability (#143)
piersy Jun 2, 2026
17b196e
Fix proposer canonical head stalling on catch-up chains (#144)
seolaoh Jun 9, 2026
79613cf
docs: add contained game monitor design spec
piersy Jun 10, 2026
f4b43ab
docs: add contained game monitor implementation plan
piersy Jun 10, 2026
25853ce
feat(estimator): scaffold op-succinct-estimator crate
piersy Jun 10, 2026
48ce3d1
feat(estimator): EstimatorError with transient/fatal classification
piersy Jun 10, 2026
05440ca
feat(estimator): lift aggregate_execution_stats (no CSV round-trip)
piersy Jun 10, 2026
aa95f34
feat(estimator): WitnessCache keys with DA discriminator + absolute base
piersy Jun 10, 2026
d884c52
feat(estimator): cache SP1Stdin blobs with atomic publish
piersy Jun 10, 2026
9b79298
feat(estimator): cache WitnessData blobs via rkyv + drop_witness
piersy Jun 10, 2026
965d873
feat(estimator): stdin prune + age helpers (separate-clock pruning)
piersy Jun 10, 2026
4d41919
feat(host): split_range_based_on_safe_heads_with_fetcher (reuse share…
piersy Jun 10, 2026
c8b6044
feat(estimator): lift network_call_with_timeout helper
piersy Jun 10, 2026
1ee8951
fix(host): convert OnlineBlobStore KZG/mutex panics to retryable errors
piersy Jun 10, 2026
9e1dc3f
feat(host): RetryBackoffLayer on L1/L2 providers + RPC timeout (FIXME…
piersy Jun 10, 2026
a6bb33b
feat(estimator): build_range_witness (cache WitnessData + SP1Stdin, d…
piersy Jun 10, 2026
5b63d73
feat(estimator): execute_range (load stdin, spawn_blocking SP1 execut…
piersy Jun 10, 2026
10e8f73
fix(estimator): classify SP1 TooMuchMemory as Oom (never retried)
piersy Jun 10, 2026
b33f5ec
feat(estimator): cgroup v1/v2 memory budget + usage parsing
piersy Jun 10, 2026
c8a55f5
feat(estimator): RSS admission gate + peak-RSS projection history
piersy Jun 10, 2026
1de6414
fix(estimator): RssHistory Default honors max_len>=1 invariant
piersy Jun 10, 2026
f082ad5
feat(estimator): PROPOSAL_INTERVAL window prediction with lead cap
piersy Jun 11, 2026
aebca86
feat(monitor): contained daemon scaffold + JSON tracing + CLI args
piersy Jun 11, 2026
5910ca2
feat(monitor): lift game discovery + fetch_game_data (type-42, finali…
piersy Jun 11, 2026
38303f4
feat(monitor): two-tier retry policy + progress resume (pure, tested)
piersy Jun 11, 2026
f388cfe
feat(monitor): predictive witness pipeline (finalization-gated build)
piersy Jun 11, 2026
ea3bf06
fix(estimator): unique cache tmp paths so concurrent same-range write…
piersy Jun 11, 2026
395d832
feat(monitor): wire run loop — executor + pipeline + RSS admission
piersy Jun 11, 2026
ba3aa86
fix(monitor): harden safe-head splitter panic + restore L2-behind cle…
piersy Jun 11, 2026
d8d2bc7
test(monitor): integration — parity, prebuild-skip, recovery, prune
piersy Jun 11, 2026
fddc60c
feat(monitor): prune stdin blobs after game success + grace
piersy Jun 11, 2026
96f7763
feat(monitor): warn+freeze-admission overrun guard (no in-process kill)
piersy Jun 11, 2026
038b58f
fix(monitor): seed pipeline frontier at proposal boundary so prebuilt…
piersy Jun 11, 2026
859af0a
feat(monitor): wire adaptive RSS admission (memory.rs) + L1-head pers…
piersy Jun 11, 2026
4ecd4cb
fix(monitor): raw-RPC retry (§8), per-sub-range overrun gating, wire …
piersy Jun 11, 2026
232027f
chore: remove unused deps (cargo machete) from estimator + scripts
piersy Jun 11, 2026
b9c0c9f
feat(monitor): concurrent games + ranges, registry-backed overrun wat…
piersy Jun 11, 2026
036644b
refactor(monitor): drop freeze-based overrun guard; admission is pure…
piersy Jun 11, 2026
7c774a5
feat(monitor): incremental within-window witness pipeline (build per …
piersy Jun 16, 2026
23f097a
refactor(monitor): replace WindowPredictor with a WitnessSource that …
piersy Jun 16, 2026
408017a
refactor(monitor): rename WitnessSource to ReadyRangeProvider
piersy Jun 17, 2026
cb72665
Re-word comment for clarity
piersy Jun 17, 2026
e1569c8
Cargo fmt
piersy Jun 17, 2026
819ddf0
feat(monitor): sampler-based memory admission with unified concurrenc…
piersy Jun 17, 2026
557ed9d
style(monitor): fix clippy warnings
piersy Jun 17, 2026
9982ad7
refactor(monitor): Rename function
piersy Jun 17, 2026
6074854
refactor(monitor): simplify contained module and add module overview
piersy Jun 29, 2026
6f0ec5f
refactor(monitor): rename contained module to game-monitor-embedded
piersy Jun 29, 2026
a10bb94
ci(monitor): build and push game-monitor-embedded dev image
piersy Jun 29, 2026
053d94b
fix(monitor): create parent dir when persisting memory model
piersy Jun 29, 2026
240836a
fix(monitor): guard startup pipeline seed against zero games
piersy Jun 29, 2026
58564bd
feat(monitor): add per-game/range/attempt tracing spans (spec 4.6)
piersy Jun 29, 2026
d34eb5b
feat(monitor): log permanent abandonment of aged-out background retries
piersy Jun 30, 2026
5d8edb7
feat(monitor): log memory admission prediction per unit
piersy Jun 30, 2026
20d9242
fix(monitor): return retryable error on missing L2 block
piersy Jun 30, 2026
1e03045
perf(monitor): thread block data into execute_range
piersy Jun 30, 2026
60707fb
docs(monitor): refresh outstanding-work status
piersy Jun 30, 2026
7702f04
feat(monitor): drop SafeDB dependency, split with split_range_basic
piersy Jun 30, 2026
6863f30
fix(monitor): liveness floor so a poisoned model can't wedge admission
piersy Jun 30, 2026
fe884e6
docs(monitor): record SafeDB-removal and admission liveness-floor fixes
piersy Jun 30, 2026
09d4de7
fix(monitor): attribute SP1 executor logs to the execute span
piersy Jul 1, 2026
cec85b1
feat(monitor): per-kind admission cost model + readable projection logs
piersy Jul 1, 2026
31210c1
docs(monitor): fix item #6 commit hash after amend
piersy Jul 1, 2026
9e9a946
fix(monitor): readable admission logs — 1-decimal GiB and text log fo…
piersy Jul 1, 2026
bc66b1b
feat(monitor): periodic in-flight build/execute status heartbeat
piersy Jul 1, 2026
049ba81
fix(monitor): reuse shared log suppression filter in embedded daemon
piersy Jul 2, 2026
9915e40
feat(monitor): orchestrator status snapshot each poll
piersy Jul 2, 2026
167977a
feat(monitor): bound witness cache with --max-cache-size backstop GC
piersy Jul 6, 2026
105ae26
perf(monitor): use jemalloc to keep RSS tracking live usage
piersy Jul 7, 2026
c3c4060
fix(monitor): EWMA of per-episode peaks for admission cost, not runni…
piersy Jul 7, 2026
2c57517
chore: point celo-kona deps at piersy/game-monitor-improvements
piersy Jul 7, 2026
feee9a1
chore(logger): suppress per-build SP1/canoe/eigenda host noise
piersy Jul 8, 2026
3e4fd21
feat(monitor): concurrent prebuild pipeline gated by memory admission
piersy Jul 8, 2026
8829f07
chore(admission): temp raw RSS-vs-in-flight-gas sampling logs
piersy Jul 8, 2026
3c93307
chore(monitor): clearer monitor-status field names
piersy Jul 8, 2026
f1a6ba8
refactor(monitor): shared L2+L1 readiness gate for build and execute
piersy Jul 8, 2026
d034b63
feat(monitor): rename --delay to --retry-backoff-delay (duration string)
piersy Jul 8, 2026
b082aca
docs(monitor): mark item #5 (concurrent prebuild pipeline) done
piersy Jul 9, 2026
77066d2
docs(monitor): track game-task panic slot-leak (#23) as outstanding work
piersy Jul 9, 2026
6075653
chore(deps): bump celo-kona pin for beacon blob-provider backoff
piersy Jul 9, 2026
763a641
fix(monitor): catch game-task panics and requeue as Transient (item #23)
piersy Jul 9, 2026
4293734
docs(monitor): mark item #23 (game-task panic recovery) done
piersy Jul 9, 2026
e7f9914
docs(monitor): promote speculative execute + canoe memoization to tod…
piersy Jul 9, 2026
dc929b7
chore(monitor): apply cargo fmt to admission.rs and readiness.rs
piersy Jul 9, 2026
cd80337
docs(monitor): add cache-fronted scheduling design (#26) to todos
piersy Jul 10, 2026
027400c
docs(monitor): add persist above-watermark completions (#27) to todos
piersy Jul 10, 2026
ae93cf2
docs(monitor): add learned baseline_bytes calibration (#28) to todos
piersy Jul 13, 2026
c1baa13
feat(monitor): per-kind admission count cap so builds don't starve ex…
piersy Jul 13, 2026
e6b0688
docs(monitor): kind-aware admission gate plan (#29); first step landed
piersy Jul 13, 2026
7e6b910
docs(monitor): #29 — separate per-kind caps; count cap stays primary,…
piersy Jul 13, 2026
1fca908
docs(monitor): refresh outstanding-work refs against current code
piersy Jul 13, 2026
927da49
docs(monitor): correct the readiness-gate rationale
piersy Jul 13, 2026
7cd3a58
refactor: extract the calculate_safe_l1_head +20 into a shared L1_HEA…
piersy Jul 13, 2026
d28c38f
refactor(monitor): drop the L1_HEAD_FINALITY_BUFFER alias
piersy Jul 14, 2026
43084e7
refactor(monitor): rename Oom -> TooMuchMemory; retry MissingTrieNode
piersy Jul 15, 2026
c19d7a2
refactor(monitor): classify SP1 execute errors by ExecutionError variant
piersy Jul 15, 2026
b28799a
refactor(monitor): fold SP1 execute errors into a single non-transien…
piersy Jul 15, 2026
0c9170f
fix(monitor): prune stdin on fatal game failure (#9)
piersy Jul 15, 2026
2c7b212
refactor(monitor): prune stdin immediately, drop the grace period
piersy Jul 15, 2026
d18f55f
feat(monitor): persist above-watermark completions so restarts don't …
piersy Jul 15, 2026
2fa136c
fix(monitor): retain fatal-game stdin instead of pruning it
piersy Jul 15, 2026
6089620
docs(monitor): refresh notes for stdin-lifecycle + completion-persist…
piersy Jul 15, 2026
b42e21e
docs(monitor): mark #10 fixed (shared L1_HEAD_BUFFER, no duplication)
piersy Jul 15, 2026
24a28b4
fix(monitor): make post-stdin drop_witness best-effort (#12)
piersy Jul 15, 2026
6193213
feat(monitor): learn the admission idle baseline instead of a startup…
piersy Jul 15, 2026
78e8749
refactor(monitor): drop the redundant Defer +poll; fix stale --delay …
piersy Jul 16, 2026
798fa2f
fix(monitor): recover the admission cost mutex on poison instead of u…
piersy Jul 16, 2026
ef8a77d
docs(monitor): mark #14 and #18 won't-do (out of scope)
piersy Jul 16, 2026
f8849b7
test(monitor): prove the build fast-path skips host.run by fault inje…
piersy Jul 16, 2026
db766fe
test(monitor): parity-check execute_game against a serial reference (…
piersy Jul 16, 2026
5859a51
test(monitor): run env-gated integration tests on a multi-thread runtime
piersy Jul 16, 2026
cb4929e
fix(host): enable the experimental witness endpoint
piersy Jul 17, 2026
b846f1d
fix(deps): bump celo-kona for the debug_executePayload attrs fix
piersy Jul 17, 2026
561ec76
docs(monitor): #31 — prefer the upstream kona fix, deferred pending t…
piersy Jul 27, 2026
a995312
feat(monitor): cache-fronted scheduling with speculative execute (#26…
piersy Jul 27, 2026
cb1c0f7
chore(monitor): demote the RSS sample instrumentation to trace
piersy Jul 28, 2026
71a45c5
docs(monitor): correct the --batch-size flag doc
piersy Jul 29, 2026
c38ba82
chore(monitor): rename status fields queued_builds/queued_executes ->…
piersy Jul 29, 2026
9db5d22
docs(monitor): drop outstanding-work references from comments for com…
piersy Jul 29, 2026
7fd784f
docs(monitor): replace metaphors in comments with plain language
piersy Jul 29, 2026
3198955
refactor(monitor): rename build/execute to witness/prove
piersy Jul 29, 2026
0f408ba
chore(monitor): raise --max-concurrent-games default to 20 and clarif…
piersy Jul 30, 2026
04d65cf
docs(monitor): remove stale design spec and implementation plan
piersy Jul 30, 2026
52d2618
feat(monitor): document RSS admission flags, group related CLI flags
piersy Jul 30, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .github/workflows/push-container-dev-non-essentials.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,12 +10,12 @@ on:
workflow_dispatch:

jobs:
push_container_parallel-cost-estimator_dev:
name: Build and push parallel-cost-estimator development image
push_container_cost-estimator-and-multi-and-agg_dev:
name: Build and push cost-estimator-and-multi-and-agg development image
uses: ./.github/workflows/push-container.yaml
with:
file: scripts/utils/Dockerfile.parallel-cost-estimator
artifact-registry: us-west1-docker.pkg.dev/devopsre/dev-images/${{ github.event.repository.name }}-parallel-cost-estimator
file: scripts/utils/Dockerfile.cost-estimator-and-multi-and-agg
artifact-registry: us-west1-docker.pkg.dev/devopsre/dev-images/${{ github.event.repository.name }}-cost-estimator-and-multi-and-agg
service-account: op-succinct-gh-dev@devopsre.iam.gserviceaccount.com
workload-id-provider: projects/1094498259535/locations/global/workloadIdentityPools/gh-op-succinct-dev/providers/github-by-repos
concurrency-group: ${{ github.workflow }}-${{ github.head_ref || github.ref }}-parallel-cost-estimator-dev
concurrency-group: ${{ github.workflow }}-${{ github.head_ref || github.ref }}-cost-estimator-and-multi-and-agg-dev
9 changes: 9 additions & 0 deletions .github/workflows/push-container-dev.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -37,3 +37,12 @@ jobs:
service-account: op-succinct-gh-dev@devopsre.iam.gserviceaccount.com
workload-id-provider: projects/1094498259535/locations/global/workloadIdentityPools/gh-op-succinct-dev/providers/github-by-repos
concurrency-group: ${{ github.workflow }}-${{ github.head_ref || github.ref }}-game-monitor-dev
push_container_game_monitor_embedded_dev:
name: Build and push game-monitor-embedded development image
uses: ./.github/workflows/push-container.yaml
with:
file: scripts/utils/Dockerfile.game-monitor-embedded
artifact-registry: us-west1-docker.pkg.dev/devopsre/dev-images/${{ github.event.repository.name }}-game-monitor-embedded
service-account: op-succinct-gh-dev@devopsre.iam.gserviceaccount.com
workload-id-provider: projects/1094498259535/locations/global/workloadIdentityPools/gh-op-succinct-dev/providers/github-by-repos
concurrency-group: ${{ github.workflow }}-${{ github.head_ref || github.ref }}-game-monitor-embedded-dev
Loading
Loading