bench(jit): measure mixed gpui-shell workload - #17
Conversation
x86_64 Linux gpui-shell performance evidenceMeasured from clean commits Sampling: 5 discarded warmup processes, 30 interleaved paired fresh processes, 200 observations per process, and 10,000 paired bootstrap resamples. Every process was pinned to CPU 0.
Lifecycle speed CIs: first window 0.99x..1.00x; hot reload 0.99x..1.00x. Interpreter and automatic mode produced identical checksums, snapshot SHA-256 values, and script-render counts in all 30 pairs. The overall acceptance report passed. The mixed workload computes 96 quote scores, aggregates and sorts them, then builds a 12-row visible list through the real GPUI builder API. This demonstrates a stable product-shaped gain above 2x while retaining the host-heavy panel regression guard. Known follow-up: mixed automatic samples produced 120 optimizing-tier invalid-artifact compilation failures (four per process). They did not affect semantics or the installed native path, but tracing and eliminating or correctly classifying them is the next optimization target. Verification:
Tracked evidence: |
Issue # (if available)
Follow-up to longbridge/gpui-kit#2903.
Description of changes
x86_64 Linux gpui-shell performance evidence
Measured from clean commits
034c9f04f80ef0464ee2589dbb202608ac090e4d(quickjs-jit) andc0b989691707d5c18d973cf9cf805bbcadde37b5(gpui-kit).Sampling: 5 discarded warmup processes, 30 interleaved paired fresh processes, 200 observations per process, and 10,000 paired bootstrap resamples. Every process was pinned to CPU 0.
Lifecycle speed CIs: first window 0.99x..1.00x; hot reload 0.99x..1.00x. Interpreter and automatic mode produced identical checksums, snapshot SHA-256 values, and script-render counts in all 30 pairs. The overall acceptance report passed.
The mixed workload computes 96 quote scores, aggregates and sorts them, then builds a 12-row visible list through the real GPUI builder API. This demonstrates a stable product-shaped gain above 2x while retaining the host-heavy panel regression guard.
Known follow-up: mixed automatic samples produced 120 optimizing-tier invalid-artifact compilation failures (four per process). They did not affect semantics or the installed native path, but tracing and eliminating or correctly classifying them is the next optimization target.
Verification:
cargo test --workspacepassed.Tracked evidence:
benchmarks/results/gpui-shell-mixed-v1.jsonand.md.Verification
cargo test --workspacescripts/bench-gpui-shell.sh /home/jason/work/gpui-kit /tmp/gpui-shell-mixed-clean.jsonChecklist
性能进展