Skip to content

Add repeatable local audio performance baseline - #23

Merged
FANNG1 merged 3 commits into
mainfrom
benchmark-local-baseline
Jul 22, 2026
Merged

FANNG1 merged 3 commits into
mainfrom
benchmark-local-baseline

Conversation

@FANNG1

@FANNG1 FANNG1 commented Jul 16, 2026

Copy link
Copy Markdown
Owner

Summary

  • add local-baseline for 40–60 fixed 60-second audio files (default 50)
  • warm up Ray/model/cache outside measured repeats and reuse one manifest across two isolated Lance outputs
  • generate JSON/Markdown comparisons with throughput mean, delta, CV, memory summaries, and repeatability SLO
  • preserve a baseline summary when a measured repeat fails or times out
  • document standard versus small diagnostic runs

Validation

  • uv run pytest (117 passed, 1 deselected)
  • independent agent review completed; failure-summary findings addressed

Follow-up to #22.

@FANNG1
FANNG1 force-pushed the benchmark-local-baseline branch from 32b6fa1 to fbc9f2b Compare July 21, 2026 07:00
@FANNG1
FANNG1 merged commit b6ba659 into main Jul 22, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant