Skip to content

test(spec): re-measure the two declared test budgets over 11 executed hourly runs #23937

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
objectstack-fleet merged 2 commits into from
Oct 16, 2026
Merged

test(spec): re-measure the two declared test budgets over 11 executed hourly runs #23937

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
1c32e6b
test(spec): re-measure the two declared test budgets over 11 executed…
claude Oct 16, 2026
314de56
Merge branch 'main' into claude/issue-23180-declared-budgets-remeasure
objectstack-fleet[bot] Oct 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion packages/spec/scripts/build-schemas-check-mode.test.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
// Copyright (c) 2026 ObjectStack. Licensed under the Apache-2.0 license.
// test-budget: 940 — spawns the real producer once per single-cause fixture: every case runs the real schema generator (build-schemas.ts --check) in its own sandbox git tree, one fixture per cause; slowest CI reading 749.9 s (hourly run 38657693085) x 1.25, rounded up
// test-budget: 1230 — spawns the real producer once per single-cause fixture: every case runs the real schema generator (build-schemas.ts --check) in its own sandbox git tree, one fixture per cause; re-measured 2026-10-16 over the 11 hourly runs that executed it (38731551915 to 38891051243): slowest CI reading 983.3 s (run 38798542648) x 1.25, rounded up; rose from 940, which rested on 3 executed runs, with the file unchanged: its wall tracks the run's load (spec package 969.8 to 1560.2 s in the same runs)
//
// Pins that `build-schemas.ts --check` — the script behind
// `check:authorable-surface`, one of the eight generated-artifact gates
Expand Down
2 changes: 1 addition & 1 deletion packages/spec/scripts/liveness/check-liveness.test.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
// Copyright (c) 2026 ObjectStack. Licensed under the Apache-2.0 license.
// test-budget: 410 — spawns the real producer once per single-cause fixture: each case spawns the real liveness gate (check-liveness.mts) on a ledger copy with exactly one cause for its verdict; slowest CI reading 320.4 s (hourly run 38657693085) x 1.25, rounded up
// test-budget: 540 — spawns the real producer once per single-cause fixture: each case spawns the real liveness gate (check-liveness.mts) on a ledger copy with exactly one cause for its verdict; re-measured 2026-10-16 over the 11 hourly runs that executed it (38731551915 to 38891051243): slowest CI reading 425.6 s (run 38798542648) x 1.25, rounded up; rose from 410, which rested on 3 executed runs, with the file unchanged before that reading: its wall tracks the run's load (spec package 969.8 to 1560.2 s in the same runs)
//
// Self-test for the liveness gate's EVIDENCE guard (#5623).
//
Expand Down
Loading