Skip to content

Sync leaderboard data from RouterArena - #45

Merged
yl231 merged 1 commit into
mainfrom
routerarena-sync
Jun 1, 2026
Merged

Sync leaderboard data from RouterArena#45
yl231 merged 1 commit into
mainfrom
routerarena-sync

Conversation

@yl231

@yl231 yl231 commented May 31, 2026

Copy link
Copy Markdown
Contributor

Automated update of src/data from RouterArena
(commit 78fb83a966fd99da589812e4efb2f3ab0b8971dd).

  • routerMetrics/leaderboard.json — headline metrics (sourced from README)
  • routerMetrics/category_scores.json — per-difficulty breakdown
  • flip_labels/* — per-query robustness flips

Generated by scripts/website/build_site_data.py.

@yl231
yl231 force-pushed the routerarena-sync branch from e84af79 to e77a2b9 Compare May 31, 2026 21:42
@YangY-Z

YangY-Z commented Jun 1, 2026

Copy link
Copy Markdown

Hi @yl231, I noticed PR #45 is currently blocked only by the pre-commit check.

I reproduced the failure locally and it looks like end-of-file-fixer only needs to add trailing newlines to the updated JSON files, including:

  • src/data/routerMetrics/leaderboard.json
  • src/data/routerMetrics/category_scores.json
  • src/data/flip_labels/flip_labels_agentforge.json
  • other updated flip_labels_*.json files

The fix may be just:

pre-commit run --all-files
git add src/data
git commit -m "Fix pre-commit formatting"
git push

Since this PR has maintainer_can_modify: false, could the PR author push this formatting fix?

@yl231
yl231 force-pushed the routerarena-sync branch from e77a2b9 to 84234cb Compare June 1, 2026 04:39
@yl231
yl231 force-pushed the routerarena-sync branch from 84234cb to 09724ec Compare June 1, 2026 05:15
@yl231
yl231 merged commit 1499147 into main Jun 1, 2026
2 checks passed
@yl231
yl231 deleted the routerarena-sync branch June 1, 2026 05:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants