Skip to content

Add published Jev Typed accuracy - #20

Merged
weitianxin merged 4 commits into
mainfrom
docs/typed-jev-accuracy
Oct 1, 2026
Merged

weitianxin merged 4 commits into
mainfrom
docs/typed-jev-accuracy

Conversation

@weitianxin

Copy link
Copy Markdown
Collaborator

Summary

  • add the published TypeSafe Jev 1.13.0 Typed Decisions result to the main accuracy figure
  • show 72.70% with a dedicated published-only hatch and legend, next to JevAny Qwen3.8-27B at 72.80%
  • keep JevJudge full and text-only as explicit dashes because no matching result exists
  • synchronize README EN/ZH, provenance JSON, detailed docs, technical report PDF, and generated site

Provenance

  • source: pinned LocalLLaMA/typed-decisions dataset card
  • metric: 72.70% teacher-label agreement over 2,000 decisions
  • status: published only; not locally rerun

Verification

  • 44 focused tests passed
  • site check passed: 27 pages, 1,095 links, 239 assets
  • chart and 21-page PDF rebuild byte-identically
  • three independent provenance/code/visual reviews: PASS

@weitianxin
weitianxin merged commit 1577327 into main Oct 1, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant