Skip to content

fix(engine-vector): re-pin the TinyLlama anchor to vitni-regime-2 - #2

Merged
logickeau merged 1 commit into
mainfrom
fix/engine-vector-regime2
Oct 16, 2026
Merged

logickeau merged 1 commit into
mainfrom
fix/engine-vector-regime2

Conversation

@logickeau

Copy link
Copy Markdown
Contributor

The engine moved from `vitni-regime-1` to `vitni-regime-2` — this run's v2 `model_digest` went `ffebe862…` → `7a2e28c9…` — without the conformance vector following.

Why this matters: the engine reproducer (`engine.py`) requires the engine's reported `regime` to equal the vector's. So against the current `vitni-receipt` binary the regime-1 vector was rejected and silently reported SKIPPED — the engine tier had no passing vector at all, while the README/CHANGELOG still claimed "1 reproduced".

Change

  • `vectors/engine.json`: regime `vitni-regime-1` → `vitni-regime-2`, `model_digest` → `7a2e28c9…`. The frozen tier-1 v1 digest `9c0754…` is unchanged across the regime move (kept on the vector). The earlier regime-1 value is recorded in `notes` for history.
  • `README.md`: seed-vector anchor updated to the regime-2 value (regime-1 value kept as history).
  • `CHANGELOG.md`: 0.3.1 entry.

Verification — re-run end-to-end against the `vitni-receipt` binary (TinyLlama-1.1B-Chat Q4_K_M, "Once upon a time,", n=20): the vector reproduces bit-for-bit — 1 reproduced, 0 skipped; receipt tier still 16/16. The regime-2 digest was also reproduced byte-identically on arm64 and x86_64.

Follow-up (separate): the drift happened because no check ties the committed anchors to what the engine currently emits — worth an opt-in CI guard.

The engine moved from vitni-regime-1 to vitni-regime-2 (this run's v2 model_digest
went ffebe862... -> 7a2e28c9...) without the conformance vector following. The
reproducer requires the engine's reported regime to match the vector (engine.py),
so against the current vitni-receipt binary the vector was rejected and silently
reported SKIPPED rather than reproduced -- the engine tier had no passing vector.

Re-pin vectors/engine.json to vitni-regime-2 / 7a2e28c9...; the frozen tier-1 v1
digest 9c0754... is unchanged across the regime move. Update the README anchor and
add CHANGELOG 0.3.1. Re-verified end-to-end against the vitni-receipt binary: the
TinyLlama vector reproduces bit-for-bit (1 reproduced); receipt tier still 16/16.
@logickeau
logickeau merged commit 7389e5a into main Oct 16, 2026
5 checks passed
@logickeau
logickeau deleted the fix/engine-vector-regime2 branch October 16, 2026 23:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant