Skip to content

ci: add pull request benchmark reports - #293

Draft
BridgeAR wants to merge 2 commits into
mainfrom
BridgeAR/2026-09-09-pr-benchmarks
Draft

BridgeAR wants to merge 2 commits into
mainfrom
BridgeAR/2026-09-09-pr-benchmarks

Conversation

@BridgeAR

@BridgeAR BridgeAR commented Sep 9, 2026

Copy link
Copy Markdown
Member

Adds startup benchmarks for inactive and active loader paths. The PR workflow compares the head with its base, and a separate artifact-only workflow updates one bot comment after validating its source SHA.

Pull request code runs without write permission. The artifact report runs after completion so only validated data reaches a bot comment.
Separate base and head runs can attribute scheduling drift to code changes.
Paired observations retain the evidence needed to assess measurement noise.

An older PR branch can lack the benchmark harness, and the PR payload can
retain an outdated base SHA. Measuring the test merge against its first
parent uses the landed harness and the target revision actually merged.

Concurrent report jobs can both find no existing bot comment and create
duplicates. Serial publication preserves one report comment for each PR.
@BridgeAR
BridgeAR force-pushed the BridgeAR/2026-09-09-pr-benchmarks branch from 71064bc to bb0740a Compare October 5, 2026 11:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant