Skip to content

update benchmark #5

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
qieguo2016 merged 1 commit into from
Mar 24, 2026
Merged

update benchmark #5

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 12 additions & 8 deletions CLAUDE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,16 +69,20 @@ The main runtime flow is:

## Benchmark progress

1. `make build` — sync top-level `exprtk.hpp` from `src/` when headers changed.
2. `make benchmark` — produce `./bin/exprtk_benchmark` (uses repo-root include path).
3. Append several timed runs to one log (example: 5 rounds, 1000 iterations each, feature is arena_allocator):
1. Before optimizations: `make build && make -B benchmark && mv ./bin/exprtk_benchmark ./bin/exprtk_benchmark_base` (uses the `benchmark` Makefile target, `-I.` and root `exprtk.hpp`; not the same as `make exprtk_benchmark`, which uses `-Isrc` and modular headers).
2. After optimizations (modified files of `src`): `make build && make -B benchmark`.
3. Append several timed runs to one log (example: 5 rounds, 1000 iterations each for arena_allocator optimization):

```bash
doc='docs/benchmark_arena_allocator.md'
for i in $(seq 1 5); do
echo "## Base $i" >> benchmark_arena_allocator.md
./bin/exprtk_benchmark 1000 >> benchmark_arena_allocator.md 2>&1
echo >> benchmark_arena_allocator.md
echo "### Base $i" >> ${doc}
./bin/exprtk_benchmark_base 1000 >> ${doc} 2>&1
echo >> ${doc}

echo "### Optimized $i" >> ${doc}
./bin/exprtk_benchmark 1000 >> ${doc} 2>&1
echo >> ${doc}
done
```

4. After optimizations, repeat steps 1–2 and run the same loop with a new heading prefix (e.g. `## Optimized $i`) so before/after blocks stay in one file.
4. Use `scripts/benchmark_stats.py` to analyze the difference and have LLM to make a summary.
2 changes: 1 addition & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,4 +5,4 @@ A C++ Mathematical Expression Toolkit Library based on https://github.com/ArashP
## Major Changes

1. Split the original single header into modular files for easier iteration, with a merge script to generate a single hpp output
2. Added AST node arena allocator to improve memory efficiency
2. Added AST node arena allocator to improve memory efficiency, **median +3.3% parse throughput improvement**, see [benchmark_result](docs/benchmark_arena_allocator.md)
Loading