Update CrossRouter Submission - #163
Conversation
|
/evaluate |
Router Evaluation ResultsRouter: RouterArena Metrics
Optimality Metrics
Evaluation completed by RouterArena automated workflow |
|
@yl231 Please update our results(CrossRouter) to leaderboard. Thanks! |
|
@yl231 Please update our latest results(CrossRouter) to leaderboard. Thanks! |
yl231
left a comment
There was a problem hiding this comment.
Maintainer review — approving. Genuine improvement over the merged Cross-Router (routing pool expanded 3→7 models). Faithfulness verified: sub_10 gap is normal (+5.5%, below the trusted-router average) and Opt.Sel is low (0.18) — i.e. not oracle/label-fit. Official /evaluate: Accuracy 78.14% · Arena 0.7612 · $0.3044 per 1K · Robustness 0.6714. All checks green. Thanks @JiaHg — merging; this supersedes the current Cross-Router leaderboard row.
…er (#159); Cross-Router update to #1 (#163) (#165) Adds three newly-merged router submissions and refreshes the Cross-Router row from its updated submission. Official /evaluate metrics: - Cross-Router (#163): Arena 76.12 · Acc 78.14% · $0.30/1K · Robust 67.14 -> now #1 - Nadir-Tumbler (#159): Arena 75.17 · Acc 75.34% · $0.08/1K · Robust 66.43 -> #4 - chuzom-solo-v32 (#161): Arena 70.61 · Acc 70.59% · $0.10/1K · Robust 100.00 -> #12 - BARouter (#157): Arena 67.09 · Acc 68.80% · $0.63/1K · Robust 52.38 -> #15 Manifest entries added for the three new routers so the website sync regenerates their derived data. Co-authored-by: yl231 <jamesbond19925@gmail.com> Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
Heads-up on a leaderboard correction affecting Cross-Router (#172, closes #166) — flagging transparently. xAI retired the Impact: Arena 76.12 → 75.75, cost $0.30 → $0.40/1K — you remain #1. No action needed on your end. Thanks for the submission! |
Update CrossRouter Submission