Skip to content

bench: measure PHP source mutations - #4

Merged
PHPCraftdream merged 3 commits into
mainfrom
perf-source-mutate09
Oct 27, 2026
Merged

PHPCraftdream merged 3 commits into
mainfrom
perf-source-mutate09

Conversation

@PHPCraftdream

@PHPCraftdream PHPCraftdream commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Add native/pure mutation benchmarks and a same-runner, alternating base/candidate pure comparison. Both use exact-source and independent semantic assertions; no wall-clock threshold is enforced.
  • Avoid one duplicate trimBounds computation in pure inline insertion, retaining output reparse and intended-tree verification. Add exact/semantic compatibility cases.
  • Correct the benchmark's +01 oracle to the specified String value, retaining strict type-sensitive comparisons.

Validation and interpretation

Exact head: 52dd602dd166b3607a1c8a29e5c76fa5af48955d. The host-language CI and benchmark completed successfully: host run 40533942436, paired benchmark 40533942865, 25/25 checks.

On this runner, median pure insert fixture 0 changed from 615,122 to 605,817 ns/op (1.5% lower), while unchanged control cases changed by approximately 0.5–1.2%. Individual samples varied substantially. A meaningful speedup is not established. The end-to-end benchmark does not isolate the cost of trimBounds; a deeper CI profile is needed before choosing a more substantial optimization. This is an attempted micro-optimization, not a performance guarantee.

The parent did not run product builds, tests, PHP runtime, or benchmarks locally. A delegated worker ran Python commands to read files; these were not product execution or performance evidence. No dependencies or versions changed; the pre-existing local spec checkout change is excluded. This PR remains draft; no merge or release is requested.

🤖 Generated with Claude Code

PHPCraftdream and others added 3 commits October 27, 2026 16:09
Compare native and pure mutations in GitHub CI with exact-source and independent semantic oracles.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Keep strict independent semantic assertions and report actual values on mismatches.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Avoid duplicate boundary scanning during insertion and compare base and candidate on the same CI runner with exact and semantic oracles.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@PHPCraftdream
PHPCraftdream marked this pull request as ready for review October 27, 2026 16:35
@PHPCraftdream
PHPCraftdream merged commit 582cd00 into main Oct 27, 2026
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant