Label issues and PRs

Workflow runs for Label issues and PRs

• fix(test): respect cuda device visibility in aime memory probe

  completed successfully:
  Label issues and PRs#556:Pull request#821editedbyjason-fxz
  Oct 24, 202610s
  More actions for workflow run 556

• Performance regression from v0.1.3 to v0.2.0 on RTX4060 8GB

  completed successfully:
  Label issues and PRs#555:Issue#822openedbymoro-hide
  Oct 24, 20267s
  More actions for workflow run 555

• feat(flint): add nvfp4 modelopt and gguf support

  completed successfully:
  Label issues and PRs#554:Pull request#797editedbyjesusjodar
  Oct 24, 20268s
  More actions for workflow run 554

• fix(test): respect cuda device visibility in aime memory probe

  completed successfully:
  Label issues and PRs#553:Pull request#821openedbyjesusjodar
  Oct 24, 20267s
  More actions for workflow run 553

• feat(models): add nvidia/Qwen3.8-Flash-Next-FP4-Local checkpoint support

  completed successfully:
  Label issues and PRs#552:Pull request#820openedbychrisqianz
  Oct 24, 20268s
  More actions for workflow run 552

• fix(models): find index-only checkpoints that keep shards in a subdirectory

  completed successfully:
  Label issues and PRs#551:Pull request#819openedbychrisqianz
  Oct 24, 20266s
  More actions for workflow run 551

• iter_weight_files silently loads 0 weights when the index points shards into a subdirectory

  completed successfully:
  Label issues and PRs#550:Issue#818openedbychrisqianz
  Oct 24, 20267s
  More actions for workflow run 550

• Support nvidia/Qwen3.8-Flash-Next-FP4-Local (Qwen4Exp, MIXED_PRECISION CSF NVFP4 + MXFP8 + FP4 PLE table)

  completed successfully:
  Label issues and PRs#549:Issue#817openedbychrisqianz
  Oct 24, 20267s
  More actions for workflow run 549

• feat(gguf): serve image input on deepseek4 ggufs from a deepseek4v mmproj

  completed successfully:
  Label issues and PRs#548:Pull request#816editedbyvoid-mckenzie
  Oct 23, 20267s
  More actions for workflow run 548

• feat(gguf): serve image input on deepseek4 ggufs from a deepseek4v mmproj

  completed successfully:
  Label issues and PRs#547:Pull request#816openedbyvoid-mckenzie
  Oct 23, 20268s
  More actions for workflow run 547

• GGUF vision towers (mmproj): survey and plan

  completed successfully:
  Label issues and PRs#546:Issue#794editedbyjason-fxz
  Oct 23, 20267s
  More actions for workflow run 546

• GGUF vision towers (mmproj): survey and plan

  completed successfully:
  Label issues and PRs#545:Issue#794editedbyjason-fxz
  Oct 23, 20269s
  More actions for workflow run 545

• feat: add --embed-weights host for a pinned host embedding table

  completed successfully:
  Label issues and PRs#544:Pull request#806editedbyjason-fxz
  Oct 23, 20268s
  More actions for workflow run 544

• fix(kernel): convert fp32 to e4m3 in one rounding on sm_89

  completed successfully:
  Label issues and PRs#543:Pull request#805editedbyischencheng
  Oct 23, 20267s
  More actions for workflow run 543

• [Desktop] weights failed to load: Qwen3.6-35B-A3B NVFP4

  completed successfully:
  Label issues and PRs#542:Issue#815openedbyblairg23
  Oct 23, 202610s
  More actions for workflow run 542

• feat(server): report per-request prefill and decode timings in api responses

  completed successfully:
  Label issues and PRs#541:Pull request#814openedbyvoid-mckenzie
  Oct 23, 202610s
  More actions for workflow run 541

• Report per-request prefill/decode timings in API responses (llama.cpp-style timings block)

  completed successfully:
  Label issues and PRs#540:Issue#813openedbyvoid-mckenzie
  Oct 23, 20269s
  More actions for workflow run 540

• fix(ple): add rocm disk wait-sync support

  completed successfully:
  Label issues and PRs#539:Pull request#776editedbyLZ-QWQ
  Oct 23, 20267s
  More actions for workflow run 539

• fix(ple): add rocm disk wait-sync support

  completed successfully:
  Label issues and PRs#538:Pull request#776editedbyLZ-QWQ
  Oct 23, 20268s
  More actions for workflow run 538

• feat(flint): add nvfp4 modelopt and gguf support

  completed successfully:
  Label issues and PRs#537:Pull request#797editedbyjesusjodar
  Oct 23, 20267s
  More actions for workflow run 537

• [Desktop] weights failed to load: Qwen3.6-35B-A3B NVFP4

  completed successfully:
  Label issues and PRs#536:Issue#812openedbywgbGit
  Oct 23, 202610s
  More actions for workflow run 536

• feat(engine): add --vram-reserve-mb to keep VRAM free at the largest prefill

  completed successfully:
  Label issues and PRs#535:Pull request#574editedbyYevheniiKotyrlo
  Oct 23, 20269s
  More actions for workflow run 535

• 🚧 [WIP] MoE cache, CPU experts and GGUF support

  completed successfully:
  Label issues and PRs#534:Issue#671editedbyjason-fxz
  Oct 23, 20266s
  More actions for workflow run 534

• 🚧 [WIP] MoE cache, CPU experts and GGUF support

  completed successfully:
  Label issues and PRs#533:Issue#671editedbyjason-fxz
  Oct 23, 20268s
  More actions for workflow run 533

• GGUF vision towers (mmproj): survey and plan

  completed successfully:
  Label issues and PRs#532:Issue#794editedbyjason-fxz
  Oct 23, 20266s
  More actions for workflow run 532