Skip to content

Pull requests: google-ai-edge/eval

New pull request New
11 Open 23 Closed
11 Open 23 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add examples for custom catalogs and task groups.
#34 opened Jul 15, 2026 by copybara-service Bot Loading…
Implement declarative YAML catalogs for custom evaluation.
#33 opened Jul 15, 2026 by copybara-service Bot Loading…
Implement task groups for custom evaluation.
#32 opened Jul 15, 2026 by copybara-service Bot Loading…
Implement dataset loader registry for custom evaluation.
#31 opened Jul 14, 2026 by copybara-service Bot Loading…
Add MMMU-Pro multimodal task and improve JSON serialization.
#27 opened Jul 6, 2026 by copybara-service Bot Loading…
Add multimodal support to Lighteval framework.
#26 opened Jul 6, 2026 by copybara-service Bot Loading…
Make Python API's default sampler param match the engine's default value
#24 opened Jun 26, 2026 by copybara-service Bot Loading…
Implement metric and normalizer registries for custom evaluation.
#22 opened Jun 25, 2026 by copybara-service Bot Loading…
Internal code change.
#7 opened May 28, 2026 by copybara-service Bot Loading…
Internal change
#2 opened May 27, 2026 by copybara-service Bot Loading…
Prevent prompt duplication and content drops in chat score rendering.
#1 opened May 27, 2026 by copybara-service Bot Loading…
1
ProTip! Exclude everything labeled bug with -label:bug.