Goal
Refresh the benchmark suite after the CLI structural integration (issue #42, merged) and the Tagma hardware fixtures (issue #47, merged). Add a benchmark for the actual CLI verify path (evaluate_structural, which the CLI now runs by default) and for the new Tagma decoder fixture, then re-measure on merged main and update the documented numbers.
Scope
- Add
evaluate_structural/cva6_full_33M to benches/bench.rs: this is the pipeline ev verify runs today (raw total + StructuralEnum + evaluate_all on the valid subset), currently cited in the README as ~0.2 s but not benched directly.
- Add Tagma fixture benches:
evaluate/tagma_decoder_64K (naive, 65,536 raw) and struct_enum/tagma_decoder_64K (11,172 valid, 17% density).
- Re-run
cargo bench on merged main and update the fixture reference table and per-function comments in benches/bench.rs, plus the README validation table, with the fresh measurements.
- Fix the stale
docs/cva6.qmd reference in the bench header (the Quarto docs were removed).
Acceptance criteria
cargo bench compiles and runs on merged main.
- The bench header table and README cite measurements taken after the merges.
- The new
evaluate_structural bench reflects the CLI verify path, so the README's ~0.2 s claim is reproducible as a benchmark.
References
Goal
Refresh the benchmark suite after the CLI structural integration (issue #42, merged) and the Tagma hardware fixtures (issue #47, merged). Add a benchmark for the actual CLI verify path (
evaluate_structural, which the CLI now runs by default) and for the new Tagma decoder fixture, then re-measure on merged main and update the documented numbers.Scope
evaluate_structural/cva6_full_33Mtobenches/bench.rs: this is the pipelineev verifyruns today (raw total + StructuralEnum + evaluate_all on the valid subset), currently cited in the README as ~0.2 s but not benched directly.evaluate/tagma_decoder_64K(naive, 65,536 raw) andstruct_enum/tagma_decoder_64K(11,172 valid, 17% density).cargo benchon merged main and update the fixture reference table and per-function comments inbenches/bench.rs, plus the README validation table, with the fresh measurements.docs/cva6.qmdreference in the bench header (the Quarto docs were removed).Acceptance criteria
cargo benchcompiles and runs on merged main.evaluate_structuralbench reflects the CLI verify path, so the README's ~0.2 s claim is reproducible as a benchmark.References
benches/bench.rsfixture reference table