Skip to content

Benchmark refresh: structural CLI path and tagma fixture numbers #50

Description

@metasmile

Goal

Refresh the benchmark suite after the CLI structural integration (issue #42, merged) and the Tagma hardware fixtures (issue #47, merged). Add a benchmark for the actual CLI verify path (evaluate_structural, which the CLI now runs by default) and for the new Tagma decoder fixture, then re-measure on merged main and update the documented numbers.

Scope

  1. Add evaluate_structural/cva6_full_33M to benches/bench.rs: this is the pipeline ev verify runs today (raw total + StructuralEnum + evaluate_all on the valid subset), currently cited in the README as ~0.2 s but not benched directly.
  2. Add Tagma fixture benches: evaluate/tagma_decoder_64K (naive, 65,536 raw) and struct_enum/tagma_decoder_64K (11,172 valid, 17% density).
  3. Re-run cargo bench on merged main and update the fixture reference table and per-function comments in benches/bench.rs, plus the README validation table, with the fresh measurements.
  4. Fix the stale docs/cva6.qmd reference in the bench header (the Quarto docs were removed).

Acceptance criteria

  • cargo bench compiles and runs on merged main.
  • The bench header table and README cite measurements taken after the merges.
  • The new evaluate_structural bench reflects the CLI verify path, so the README's ~0.2 s claim is reproducible as a benchmark.

References

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions