Issues

• manifests: 101 gated checkpoints whose terms the HF_TOKEN account has not accepted

  for:bellwether
  smg-project/bellwether#137 · Filter by author hello-alexmcc opened on Oct 13, 2026

• for:bellwether: the recordings Symphony needs for parity with smg's legacy parsers, and the rebase of #125 and #127

  for:bellwether
  smg-project/bellwether#131 · Filter by author slin1237 opened on Oct 13, 2026
  1

• needs:decision: templates that re-serialize a call's arguments (tojson with sorted keys and compact separators) spell them differently from the reference

  for:bellwetherneeds:decision
  smg-project/bellwether#110 · Filter by author slin1237 opened on Oct 11, 2026

• needs:decision: Mistral-7B-Instruct-v0.3: its template demands 9-character tool-call ids, and the oracle's unprimed decode drops the output's leading space

  needs:decision
  smg-project/bellwether#107 · Filter by author hello-alexmcc opened on Oct 11, 2026

• for:bellwether: the providers' verifier data: MiniMax's recorded runs and Kimi's prompt-token cases

  for:bellwether
  smg-project/bellwether#76 · Filter by author hello-alexmcc opened on Oct 7, 2026

• record: 8 groups' templates render no tool calls; for two of them vLLM ships its own tool template

  for:bellwetherneeds:decision
  smg-project/bellwether#59 · Filter by author hello-alexmcc opened on Oct 6, 2026
  1

• record: Mistral's template needs 9-character tool-call ids; the round trip gives none and the importers write call_<n>

  for:bellwether
  smg-project/bellwether#58 · Filter by author hello-alexmcc opened on Oct 6, 2026

• for:bellwether: BFCL through 89 models at once found four smg defects, three disagreements and two recorder gaps

  for:bellwether
  smg-project/bellwether#39 · Filter by author slin1237 opened on Oct 6, 2026
  1

• End of turn: the stop set from the generation config, and the template defects found

  for:bellwether
  smg-project/bellwether#38 · Filter by author hello-alexmcc opened on Oct 6, 2026

• needs:decision: one-off template failures are template defects; should the Hugging Face side mirror vLLM's request reshaping?

  needs:decision
  smg-project/bellwether#37 · Filter by author hello-alexmcc opened on Oct 6, 2026

• vendor-code models: the two sources share the encoder, and the vLLM step runs vendor code too

  smg-project/bellwether#36 · Filter by author hello-alexmcc opened on Oct 6, 2026
  1

• needs:decision: round trip: six templates whose turn without reasoning does not continue an open think block

  needs:decision
  smg-project/bellwether#32 · Filter by author hello-alexmcc opened on Oct 6, 2026
  1

• Finding: DeepSeek R1, V3 and V3.1 templates cannot take tool-call arguments as the object the engines pass

  smg-project/bellwether#27 · Filter by author hello-alexmcc opened on Oct 6, 2026

• Templates take tool-call arguments as an object or as a string; the round-trip reference says which

  for:symphony
  smg-project/bellwether#24 · Filter by author hello-alexmcc opened on Oct 6, 2026
  2

• for:bellwether: benchmark-scale fixture sets per model (BFCL, GSM8K, tau2 and the like), render and parse

  for:bellwether
  smg-project/bellwether#23 · Filter by author slin1237 opened on Oct 6, 2026
  17

• for:bellwether: adversarial parse cases with malformed tool-call arguments

  for:bellwether
  smg-project/bellwether#20 · Filter by author slin1237 opened on Oct 6, 2026

• for:bellwether: parse cases for outputs constrained by tool_choice (a forced function, and required)

  for:bellwether
  smg-project/bellwether#19 · Filter by author slin1237 opened on Oct 6, 2026
  1

• needs:decision: the template's separator bytes around reasoning and before tool calls: content, or formatting the parsers strip?

  needs:decision
  smg-project/bellwether#17 · Filter by author hello-alexmcc opened on Oct 5, 2026
  3

• needs:decision: marker strings inside content and reasoning: do parsers read them as markers (policy) or as text (reference)?

  needs:decision
  smg-project/bellwether#16 · Filter by author hello-alexmcc opened on Oct 5, 2026
  1

• needs:decision: DeepSeek-R1 parse reference: the round trip is lossy for every case; format definition or engines?

  needs:decision
  smg-project/bellwether#14 · Filter by author hello-alexmcc opened on Oct 5, 2026
  1

• needs:decision: empty message content: SMG rejects it with 400, the reference renders it

  needs:decision
  smg-project/bellwether#13 · Filter by author hello-alexmcc opened on Oct 5, 2026

• needs:decision: object-valued tool-call arguments in history: the Qwen3 template renders them, SMG and the engines reject them

  needs:decision
  smg-project/bellwether#12 · Filter by author hello-alexmcc opened on Oct 5, 2026

• Symphony PRs in smg need a code-owner approval; add hello-alexmcc to CODEOWNERS for crates/symphony?

  needs:decision
  smg-project/bellwether#6 · Filter by author slin1237 opened on Oct 5, 2026
  4

• needs:decision: are marker strings inside user text rendered as special tokens (hf-template) or as text (gateway policy)?

  needs:decision
  smg-project/bellwether#5 · Filter by author hello-alexmcc opened on Oct 5, 2026

• Decisions for the maintainer: section-12 recommendations and artifacts access for M1

  needs:decision
  smg-project/bellwether#2 · Filter by author hello-alexmcc opened on Oct 5, 2026
  1