Issues

• [HF-14][P1 Release] End-to-end Hub publication QA, security/privacy sign-off, crosslinks and rollout/rollback checklist

  MSKazemi/aobench#110 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-13][P3] Evaluate native Hugging Face Benchmark registration and model .eval_results interoperability

  MSKazemi/aobench#109 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-12][P2] Research protocol: disjoint HPC permission training data, SFT/GRPO experiments and anti-contamination evaluation

  MSKazemi/aobench#108 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-11][P2] Prototype AOBench as a policy-aware OpenEnv/TRL interactive environment

  MSKazemi/aobench#107 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-10][P1] Integrate Hugging Face docs, discoverability, CI validation and opt-in release automation

  MSKazemi/aobench#106 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-09][P1] Document and test Hugging Face model evaluation path using existing AOBench adapters

  MSKazemi/aobench#105 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-08][P1] Convert reviewed AOBench traces to Hub Session Traces Format (STS) with redaction

  MSKazemi/aobench#104 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-07][P1] Build interactive HPC Safety Arena with role-aware RBAC demonstration

  MSKazemi/aobench#103 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-06][P1] Build responsive static Hugging Face AOBench Leaderboard Space

  MSKazemi/aobench#102 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-05][P0] Build evidence-verified, version-pinned leaderboard snapshot feed

  MSKazemi/aobench#101 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-04][P0] Publish a versioned AOBench Dataset Card and safe opt-in Hugging Face upload workflow

  MSKazemi/aobench#100 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-03][P0] Build deterministic development/lite dataset exporter with strict test-leakage and privacy guards

  MSKazemi/aobench#99 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-02][P0] Define canonical Hub artifact schemas, immutable fingerprints and comparability rules

  MSKazemi/aobench#98 · Filter by author MSKazemi opened on Oct 28, 2026

• [HF-01][P0] Audit release eligibility, locked split, corpus facts, licensing and score integrity

  MSKazemi/aobench#97 · Filter by author MSKazemi opened on Oct 28, 2026

• [EPIC][HF] Hugging Face Hub integration — dataset, verified leaderboard, safety arena, traces and OpenEnv

  MSKazemi/aobench#96 · Filter by author MSKazemi opened on Oct 28, 2026

• An unknown tool name is scored as an RBAC hard fail, and malformed tool arguments drop the task

  MSKazemi/aobench#91 · Filter by author MSKazemi opened on Oct 1, 2026

• [Result] qwen3.5:9b (Ollama, Q4_K_M, local M2 Pro): 0.561 over 3 runs

  MSKazemi/aobench#89 · Filter by author nikhil-kunapareddy opened on Sep 30, 2026
  2

• Generate and send a real RBAC-hard-fail fixture to the EvalPort spec (discussion #51)

  area: docs
  MSKazemi/aobench#85 · Filter by author MSKazemi opened on Sep 19, 2026

• Ten tasks grant tool families that do not exist — three dev tasks get zero tools, and validate passes

  area: benchmarkbugeffort: smallhelp wanted
  MSKazemi/aobench#74 · Filter by author MSKazemi opened on Sep 11, 2026
  6

• Flaky release gate: test_report_json_flag_emits_clean_json_on_stdout fails ~1 run in 8

  area: infrabugeffort: mediumhelp wanted
  MSKazemi/aobench#72 · Filter by author MSKazemi opened on Sep 11, 2026

• Two dev-split tasks are unpassable: my own job is owned by someone else, so a correct agent is RBAC hard-failed

  area: benchmarkbughelp wanted
  MSKazemi/aobench#63 · Filter by author MSKazemi opened on Sep 10, 2026

• Verify every command in the docs actually does what the page says — from a clean checkout

  area: docsdocumentationeffort: mediumgood first issuehelp wanted
  MSKazemi/aobench#62 · Filter by author MSKazemi opened on Sep 9, 2026
  2

• [Result] Claude Sonnet Benchmarking

  area: reporting
  MSKazemi/aobench#60 · Filter by author hari760 opened on Sep 2, 2026
  4

• AWS Bedrock adapter

  area: adapterseffort: mediumenhancementhelp wanted
  MSKazemi/aobench#35 · Filter by author MSKazemi opened on Aug 10, 2026 · v0.6 — Infrastructure

• Google Gemini adapter

  area: adapterseffort: mediumenhancementhelp wanted
  MSKazemi/aobench#34 · Filter by author MSKazemi opened on Aug 10, 2026 · v0.6 — Infrastructure