Repository navigation
chore(ci): refresh the Test Core shard-timings dataset - #25960
Closed
github-actions[bot] wants to merge 2 commits into
Closed
github-actions[bot] wants to merge 2 commits into
github-actions[bot] wants to merge 2 commits into
Conversation
Regenerated by .github/workflows/shard-timings-refresh.yml from the test-core-run-summary artifacts of 14 accumulated run(s) (40272142430 40266979145 40262173089 40257470166 40242835329 40238189261 40233481335 40228747755 40223991179 40219252911 40214410982 40209651657 40204927516 40200279306), newest 40272142430 at 2a728ba. Generated, never hand-edited.
Contributor
|
Superseded by #25968, which carries this PR's commit This PR could not land on its own. On the refreshed weights the partitioner's pin 3c refuses Generated by Claude Code |
This was referenced Oct 26, 2026
Merged
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Refreshes
scripts/test-shard-timings.json, the balancing input for the Test Coreshard split. Opened automatically by
.github/workflows/shard-timings-refresh.yml.Every byte came out of
scripts/measure-test-shard-timings.mjs; nothing here washand-edited, and no bound, timeout or matrix entry was touched.
Regression readings: rises, density, files over budget
Regression detection lives here since #22949 ruling E: the suite-duration ceilings only report, and each refresh diffs its window against the previous dataset instead. Nothing in this section fails a build -- a finding is a card (see the next section).
Density per run (packages executed, cache replays excluded), newest first:
4027214243020 ·4026697914559 ·4026217308958 ·4025747016658 ·4024283532932 ·4023818926133 ·4023348133529 ·4022874775520 ·4022399117920 ·4021925291120 ·4021441098240 ·4020965165740 ·4020492751675 ·4020027930673 -- this window's mean is 41.2 over 14 run(s).Previous window: mean 63.4 over 8 run(s) -- NOT comparable (1.54×; "comparable" is within 1.25× of each other).
This diff is a BASELINE, not a judgement: the two windows are not of comparable density -- 41.2 executed packages per run against 63.4 (1.54x, over the 1.25x that "comparable" allows) -- so this window becomes the baseline instead. The rises below are readings -- none is a finding and none is filed. The next refresh whose window density is comparable with this one judges against it.
Packages up by 25 % or more: 4 (findings: 0)
@objectstack/verifysrc/dashboard-window.test.ts73.29 s (run40200279306)@objectstack/plugin-pinyin-searchsrc/boot-reconcile.integration.test.ts17.47 s (run40200279306)@objectstack/organizationssrc/object-extension-managed-target.wall.test.ts7.08 s (run40200279306)@objectstack/service-cachesrc/memory-cache-adapter.test.ts0.11 s (run40214410982)Verdicts: finding = up 1.25× or more AND its share up 1.25× or more (a card); density only = its share moved less than 1.25×, so the run slowed around it (not a card); provisional = one of the two weights rests on fewer than 3 executed runs (not a baseline); no prior share = the previous window replayed it, so the guard has nothing to read; baseline = see above.
Down: 62 package(s) lighter, 47 by the same factor or more (at most 80 % of the previous weight) --
@objectstack/example-embed-objectql28.22 → 7.86 s,@objectstack/example-showcase130.48 → 48.49 s,@objectstack/downstream-contract16.85 → 6.80 s,@objectstack/service-sms22.13 → 8.95 s,@objectstack/cloud-connection268.04 → 115.93 s,@objectstack/service-i18n17.69 → 7.81 s,@objectstack/service-job31.65 → 14.25 s,@objectstack/objectql970.12 → 450.03 s,@objectstack/example-todo58.58 → 27.48 s,@objectstack/vitest-filter-preflight28.34 → 13.41 s, +37 more. Not compared: 0 carried (a cache HIT re-confirmed the previous weight; no run of this window executed them), 0 new, 0 gone.Test files over budget in this window (10 s of wall, unless the file declares a measured budget with its class): 146 in 11 package(s)
src/commands/migrate/data-commands.absent-database.integration.test.ts(integration)@objectstack/cli40200279306test/stack-conversion-record-door.test.ts(integration)@objectstack/cli40204927516test/package-install-local-uninstall-cleanups.integration.test.ts(integration)@objectstack/cli40200279306test/serve-config-boot-residual.integration.test.ts(integration)@objectstack/cli40200279306test/artifact-flag-precedence.integration.test.ts(integration)@objectstack/cli40200279306scripts/build-schemas-check-mode.retired-keys.test.ts(repo)@objectstack/spec40204927516scripts/build-schemas-check-mode.manifest.test.ts(repo)@objectstack/spec40204927516test/stack-provenance-door.test.ts(integration)@objectstack/cli40204927516src/commands/migrate/object-scope.integration.test.ts(integration)@objectstack/cli40204927516test/package-install-local-jobs.integration.test.ts(integration)@objectstack/cli40204927516test/generate-stack-reach.test.ts(integration)@objectstack/cli40200279306test/picklist-reference-doors.test.ts(integration)@objectstack/cli40200279306scripts/build-schemas-check-mode.anchor.test.ts(repo)@objectstack/spec40204927516test/package-install-local-hooks.integration.test.ts(integration)@objectstack/cli40204927516test/build-callable-names.test.ts(integration)@objectstack/cli40200279306test/lint-per-package-authoring-parity.test.ts(integration)@objectstack/cli40200279306src/commands/migrate/plan.boot-parity.integration.test.ts(integration)@objectstack/cli40204927516src/commands/migrate/plan.telemetry-sibling.integration.test.ts(integration)@objectstack/cli40200279306test/package-install-local-jobs-shared-name.integration.test.ts(integration)@objectstack/cli40200279306test/package-install-local-jobs-pull.integration.test.ts(integration)@objectstack/cli40200279306test/i18n-extract-check-json.test.ts(integration)@objectstack/cli40204927516test/package-install-local-handlers.integration.test.ts(integration)@objectstack/cli40204927516src/commands/migrate/unmapped-columns.integration.test.ts(integration)@objectstack/cli40204927516src/commands/migrate/plan.declared-default-datasource.integration.test.ts(integration)@objectstack/cli40204927516test/validate-per-package-authoring-parity.test.ts(integration)@objectstack/cli40204927516test/generate-refuses-unimportable-alias.test.ts(integration)@objectstack/cli40204927516test/build-runtime-bundle-bodyless.test.ts(integration)@objectstack/cli40200279306test/i18n-extract-check-dry-run.test.ts(integration)@objectstack/cli40200279306test/package-union-readers.test.ts(integration)@objectstack/cli40200279306test/package-install-local-boot-steps.integration.test.ts(integration)@objectstack/cli40200279306test/build-strict-body-count.test.ts(integration)@objectstack/cli40204927516test/serve-package-declared-capabilities.test.ts(integration)@objectstack/cli40204927516test/lint-eval-generator-refusal-separator.test.ts(integration)@objectstack/cli40204927516test/verify-author-time-stage.test.ts(integration)@objectstack/cli40204927516test/info-detail-package-fold.test.ts(integration)@objectstack/cli40200279306test/union-fold-command-parity.test.ts(integration)@objectstack/cli40204927516src/dashboard-window.test.ts@objectstack/verify40200279306test/generate-refuses-namespace-prefix.test.ts(integration)@objectstack/cli40204927516test/build-view-container-name.test.ts(integration)@objectstack/cli40204927516test/generate-refuses-unparseable-name.test.ts(integration)@objectstack/cli40200279306src/parent-write-reach.test.ts@objectstack/verify40200279306test/dev-boot-output-order.integration.test.ts(integration)@objectstack/cli40204927516src/commands/migrate/plan.nullable-tenant-columns.integration.test.ts(integration)@objectstack/cli40204927516src/unique-scope.test.ts@objectstack/verify40200279306test/verify-parent-write-reach.test.ts(integration)@objectstack/cli40204927516test/verify-delete-behaviors.test.ts(integration)@objectstack/cli40204927516test/verify-dashboard-windows.test.ts(integration)@objectstack/cli40200279306test/migrate-meta-default-range.test.ts(integration)@objectstack/cli40200279306test/verify-unique-scopes.test.ts(integration)@objectstack/cli40204927516test/i18n-extract-companion-orphan.test.ts(integration)@objectstack/cli40200279306test/generate-refuses-name-outside-charset.test.ts(integration)@objectstack/cli40204927516test/verify-reference-shapes.test.ts(integration)@objectstack/cli40200279306test/validate-view-container-name.test.ts(integration)@objectstack/cli40204927516test/generate-refuses-retired-generator.test.ts(integration)@objectstack/cli40204927516test/package-owned-command-readers.test.ts(integration)@objectstack/cli40204927516test/serve-config-boot-flat-docs.integration.test.ts(integration)@objectstack/cli40204927516test/serve-view-container-read.integration.test.ts(integration)@objectstack/cli40204927516src/commands/migrate/resume.recorded-by.integration.test.ts(integration)@objectstack/cli40200279306test/serve-no-auth-secret-refusal.integration.test.ts(integration)@objectstack/cli40200279306test/create-objectstack-stack-reach.test.ts(integration)@objectstack/cli40204927516src/eager-entry-import.test.ts(local)@objectstack/spec40266979145test/build-text-face-advisory-count.test.ts(integration)@objectstack/cli40200279306test/validate-lint-mapping-connector-source.test.ts(integration)@objectstack/cli40200279306test/dev-no-watch.pin.test.ts(integration)@objectstack/cli40204927516test/package-restart-acceptance.integration.test.ts(integration)@objectstack/cli40200279306test/verify-json-stdout.test.ts(integration)@objectstack/cli40200279306src/parent-record-read-leaf.integration.test.ts@objectstack/plugin-audit40204927516test/qa-names-and-tags-run.test.ts(integration)@objectstack/cli40204927516test/serve-host-config-metadata-door.integration.test.ts(integration)@objectstack/cli40200279306test/metadata-type-schema-gate.test.ts(integration)@objectstack/cli40204927516test/scaffold-emission-typechecks.test.ts(unit)@objectstack/cli40242835329src/commands/migrate/apply.remote-posture.test.ts(unit)@objectstack/cli40200279306test/serve-migrate-exit-schema-parity.integration.test.ts(integration)@objectstack/cli40204927516src/held-session-vendor-admin-doors.pin.test.ts@objectstack/verify40200279306scripts/upgrade-guide-docs.test.ts(local)@objectstack/spec40214410982test/dev-standalone-self-heal.integration.test.ts(integration)@objectstack/cli40204927516test/retry-policy-key-validate-door.test.ts(integration)@objectstack/cli40204927516src/comment-parent-pair.integration.test.ts@objectstack/plugin-audit40204927516test/stack-datasource-default-validate-door.test.ts(integration)@objectstack/cli40204927516test/validate-field-predicate-traversal.test.ts(integration)@objectstack/cli40200279306test/qa-requires-skip-run.test.ts(integration)@objectstack/cli40204927516test/authoring-rule-command-parity.test.ts(integration)@objectstack/cli40204927516test/emit-json-pipe.test.ts(integration)@objectstack/cli40204927516src/serializers/typescript-serializer-annotation.test.ts@objectstack/metadata40204927516src/harness.key-custody.test.ts@objectstack/verify40200279306src/utils/schema-migrate.one-shot-family.integration.test.ts(integration)@objectstack/cli40242835329test/serve-runtime-state-project-key.test.ts(integration)@objectstack/cli40204927516src/harness.app-default-profile.test.ts@objectstack/verify40200279306src/commands/migrate/plan.deferred-reads.integration.test.ts(integration)@objectstack/cli40200279306src/harness.one-composition.test.ts@objectstack/verify40200279306test/verify-host-root.test.ts(integration)@objectstack/cli40204927516src/boot-reconcile.integration.test.ts@objectstack/plugin-pinyin-search40200279306src/handle.test.ts@objectstack/verify40200279306test/published-entry-node-env-source-reroute.test.ts(integration)@objectstack/cli40204927516src/harness.org-context.test.ts@objectstack/verify40200279306test/format-zod-union.test.ts(integration)@objectstack/cli40200279306src/held-session-impersonation-target.pin.test.ts@objectstack/verify40200279306src/utils/schema-migration-plugins.test.ts(unit)@objectstack/cli40242835329test/migrate-meta-strict-factories.test.ts(unit)@objectstack/cli40200279306src/stored-metadata-reader-contexts.pin.test.ts(local)@objectstack/runtime40200279306…and 46 more file(s) over budget, in full in this run's job log.
Held to the budget it declares (ruling record 6181973363), in place of the 10 s line:
scripts/build-schemas-check-mode.git-topology.test.ts(@objectstack/spec) 469.74 s of its 580 s, spawns the real producer once per single-cause fixture;scripts/build-schemas-check-mode.deleted-baseline.test.ts(@objectstack/spec) 413.94 s of its 530 s, spawns the real producer once per single-cause fixture;scripts/build-schemas-check-mode.deletion-proofs.test.ts(@objectstack/spec) 366.03 s of its 490 s, spawns the real producer once per single-cause fixture;scripts/liveness/check-liveness.test.ts(@objectstack/spec) 341.59 s of its 540 s, spawns the real producer once per single-cause fixture;scripts/build-schemas-check-mode.retired-keys.test.ts(@objectstack/spec) 241.05 s of its 190 s, spawns the real producer once per single-cause fixture;scripts/build-schemas-check-mode.manifest.test.ts(@objectstack/spec) 226.64 s of its 180 s, spawns the real producer once per single-cause fixture;scripts/build-schemas-check-mode.anchor.test.ts(@objectstack/spec) 144.97 s of its 140 s, spawns the real producer once per single-cause fixture;src/commands/migrate/plan.declared-default-datasource.integration.test.ts(@objectstack/cli) 95.65 s of its 80 s, spawns the real producer once per single-cause fixture;src/commands/migrate/audit-mail-bodies.archive.integration.test.ts(@objectstack/cli) 60.92 s of its 90 s, spawns the real producer once per single-cause fixture;src/shared/alias-integrity.test.ts(@objectstack/spec) 43.31 s of its 50 s, whole-package import;src/eager-entry-import.test.ts(@objectstack/spec) 41.61 s of its 30 s, whole-package import;scripts/upgrade-guide-docs.test.ts(@objectstack/spec) 30.07 s of its 30 s, spawns the real producer once per single-cause fixture;src/commands/serve-kernel-only-lifetime.integration.test.ts(@objectstack/cli) 25.75 s of its 40 s, spawns the real producer once per single-cause fixture;test/serve-no-storage-boot-guard.integration.test.ts(@objectstack/cli) 24.41 s of its 40 s, spawns the real producer once per single-cause fixture;src/commands/serve-no-server-banner.integration.test.ts(@objectstack/cli) 23.63 s of its 30 s, spawns the real producer once per single-cause fixture;test/start-stdio-stdout-purity.integration.test.ts(@objectstack/cli) 19.55 s of its 20 s, spawns the real producer once per single-cause fixture;scripts/dist-freshness-adoption.test.ts(@objectstack/spec) 19.15 s of its 90 s, spawns the real producer once per single-cause fixture;test/start-mcp-stdio-early-initialize.integration.test.ts(@objectstack/cli) 18.76 s of its 20 s, spawns the real producer once per single-cause fixture;scripts/projection-cli.test.ts(@objectstack/spec) 18.27 s of its 20 s, spawns the real producer once per single-cause fixture;src/commands/serve-no-transport-announcements.integration.test.ts(@objectstack/cli) 17.25 s of its 30 s, spawns the real producer once per single-cause fixture;test/serve-plugin-auth-load-failure-refusal.integration.test.ts(@objectstack/cli) 16.58 s of its 20 s, spawns the real producer once per single-cause fixture;test/serve-mcp-stdio-early-initialize.integration.test.ts(@objectstack/cli) 15.92 s of its 20 s, spawns the real producer once per single-cause fixture;scripts/def-key-collisions.test.ts(@objectstack/spec) 13.38 s of its 70 s, spawns the real producer once per single-cause fixture;scripts/dist-freshness.test.ts(@objectstack/spec) 12.40 s of its 40 s, spawns the real producer once per single-cause fixture;test/serve-datasource-mapping-before-sync.integration.test.ts(@objectstack/cli) 11.83 s of its 30 s, spawns the real producer once per single-cause fixture;src/integration/connector-author-shape.test.ts(@objectstack/spec) 11.76 s of its 30 s, compiles the package type graph once;src/contracts/scoped-context.test.ts(@objectstack/spec) 10.57 s of its 30 s, compiles the package type graph once.Per-file reading: the window's per-shard captures (
test-core-timings-N-of-M, written byreport-test-timings.mjs --capture), read for 14 of 14 run(s): 30506 file line(s) measured here; 48894 replayed line(s) left out, because a cache HIT replays a duration measured outside this window.Every package has a per-file reading in this window.
What the seat landing this PR does
The refresh lane's seat, after this PR lands (#22949 ruling E; the workflow's header carries the same duty). The bot files nothing.
Source
Measured across 14 accumulated run(s) of the HOURLY
schedulerun of CI onmain— the full-battery run (#16467). Apushrun onmainis affected-only andis not a measurement of the workspace, so no push run feeds this file.
No single green run measures the whole workspace either — turbo's cache is namespaced
per shard and only main pushes write it, so a
package whose inputs have not changed is a HIT and the generator refuses hits rather
than recording a replay as a duration. Runs are therefore accumulated, each fenced by
its own
--rungroup, until every package has been EXECUTED by at least thegenerator's minimum number of them, and each weight is the median of those executions.
https://github.com/objectstack-ai/objectstack/actions/runs/40272142430
https://github.com/objectstack-ai/objectstack/actions/runs/40266979145
https://github.com/objectstack-ai/objectstack/actions/runs/40262173089
https://github.com/objectstack-ai/objectstack/actions/runs/40257470166
https://github.com/objectstack-ai/objectstack/actions/runs/40242835329
https://github.com/objectstack-ai/objectstack/actions/runs/40238189261
https://github.com/objectstack-ai/objectstack/actions/runs/40233481335
https://github.com/objectstack-ai/objectstack/actions/runs/40228747755
https://github.com/objectstack-ai/objectstack/actions/runs/40223991179
https://github.com/objectstack-ai/objectstack/actions/runs/40219252911
https://github.com/objectstack-ai/objectstack/actions/runs/40214410982
https://github.com/objectstack-ai/objectstack/actions/runs/40209651657
https://github.com/objectstack-ai/objectstack/actions/runs/40204927516
https://github.com/objectstack-ai/objectstack/actions/runs/40200279306
Newest run in the set:
40272142430, commit2a728ba2acf52c13d1918c2afca7b79bf391e1f5— the date this refresh carries.Every run above had every
Test Core (N/M)shard job concludesuccesswith itsrun-summary artifact still retained; runs that were cancelled, failed or had lost
their artifacts were rejected by name in the log before any of these were used.
All 75 package weights were measured in these runs; nothing was carried.
because a weekly lane cannot know which cards a given run ought to retire. If this is
the first refresh to land, retire those two by hand as part of merging it.
Sample depth, run-to-run spread and suite-duration ceilings
provisionallist and are fit to balance on, NOT to set a per-package ceiling from: @objectstack/metadata-protocol, @objectstack/plugin-audit, @objectstack/plugin-sharing, @objectstack/rest, @objectstack/runtime, @objectstack/service-analytics, @objectstack/service-automation, @objectstack/verify.Suite-duration ceilings: 75 held unchanged (a refresh never moves one; a raise is a ruling), 0 new, each new one its slowest executed run in this window x 1.25.
Every package carries a ceiling.
Each package's executed runs in this refresh (minimum 3), the spread of its readings in seconds, and the suite-duration ceiling
Test Coregrades it against: its slowest executed run x 1.25 when first set, then held by every refresh -- a ceiling is raised only by a ruling.@objectstack/client@objectstack/example-embed-objectql@objectstack/service-cluster-redis@objectstack/service-sms@objectstack/example-showcase@objectstack/service-cluster@objectstack/trigger-api@objectstack/metadata-core@objectstack/downstream-contract@objectstack/service-i18n@objectstack/vitest-filter-preflight@objectstack/knowledge-memory@objectstack/driver-turso@objectstack/plugin-auth@objectstack/cloud-connectioncreate-objectstack@objectstack/knowledge-ragflow@objectstack/service-job@objectstack/service-messaging@objectstack/driver-sqlite-wasm@objectstack/hono@objectstack/service-datasource@objectstack/organizations@objectstack/plugin-webhooks@objectstack/service-realtime@objectstack/objectql@objectstack/example-crm@objectstack/connector-mcp@objectstack/mcp@objectstack/connector-rest@objectstack/core@objectstack/service-storage@objectstack/types@objectstack/client-react@objectstack/connector-slack@objectstack/sdui-parser@objectstack/plugin-email@objectstack/service-queue@objectstack/service-package@objectstack/platform-objects@objectstack/embedder-openai@objectstack/trigger-record-change@objectstack/observability@objectstack/metadata-fs@objectstack/service-cache@objectstack/driver-mongodb@objectstack/driver-memory@objectstack/driver-sql@objectstack/formula@objectstack/trigger-schedule@objectstack/plugin-pinyin-search@objectstack/service-analytics@objectstack/connector-openapi@objectstack/service-settings@objectstack/runtime@objectstack/example-todo@objectstack/plugin-security@objectstack/verify@objectstack/lint@objectstack/plugin-hono-server@objectstack/service-mailbox@objectstack/spec@objectstack/service-knowledge@objectstack/connector-imap@objectstack/metadata@objectstack/plugin-dev@objectstack/service-print@objectstack/rest@objectstack/plugin-approvals@objectstack/plugin-sharing@objectstack/http-conformance@objectstack/cli@objectstack/service-automation@objectstack/plugin-audit@objectstack/metadata-protocolMeasured per-shard suite time on the newest run in the set
Predicted bins, before and after
The partitioner's own pins RED on this refresh — read this before merging
This is the designed behaviour, not a defect in the refresh: the acceptance bound is
a ratio, and a package that has grown past what the Test Core split can bin makes the
pins fail with the arithmetic in the message. The remedy the partitioner names is to
raise the file-level slice count for that package — ⛔ never to raise the bound, and
⛔ never to hand-edit this dataset. This workflow deliberately does neither: it
reports and stops, because both are decisions.
No checks will start on this PR by themselves
It was opened with the Actions
GITHUB_TOKEN, and GitHub's recursion guard means aPR opened that way triggers no workflow runs. Push any commit to the branch, or close
and reopen the PR, to start CI.
Refs #16464, #16173, #16222.