Issues

• [P0][GPU SAFETY] RTX 5080 CUDA/GSP loss during sustained NInfer Pi workloads (also with MTP OFF)

  toddballinger/ninfer-5080#86 · Filter by author toddballinger opened on Oct 23, 2026
  12

• [P0][SERVE] Fix C2/C3 admission starvation and >10-minute TTFT before OpenClaw rollout

  toddballinger/ninfer-5080#58 · Filter by author toddballinger opened on Oct 9, 2026
  85

• [Feature] kvmem support

  toddballinger/ninfer-5080#57 · Filter by author starskyzheng opened on Oct 6, 2026
  1

• [P1][SPEC] Evaluate probabilistic MTP drafting + rejection-sampling verification

  toddballinger/ninfer-5080#56 · Filter by author toddballinger opened on Oct 5, 2026
  3

• [FEATURE] Hybrid semantic execution planner: MTP + JEV + known-block mid-generation routing

  toddballinger/ninfer-5080#55 · Filter by author toddballinger opened on Oct 2, 2026
  13

• [P2][PERF] Measure Q3 SwiGLU T32 A16 fallback spill relevance before retuning

  toddballinger/ninfer-5080#49 · Filter by author toddballinger opened on Sep 28, 2026
  2

  

• [P1][PERF] Investigate Q4/U8 GQA prefill spill and dynamic-SMEM envelope on RTX 5080

  toddballinger/ninfer-5080#48 · Filter by author toddballinger opened on Sep 28, 2026
  

• [P1][PERF] Investigate Q4/U8 GQA decode q4_tiled spill-bearing schedules on RTX 5080

  toddballinger/ninfer-5080#47 · Filter by author toddballinger opened on Sep 28, 2026
  6

  

• [P2][CORRECTNESS] Audit sampling-chain semantics against an independent oracle

  toddballinger/ninfer-5080#45 · Filter by author toddballinger opened on Sep 28, 2026
  2

  

• [P2][PERF/MEM] Evaluate runtime auto-selection of qualified prefill chunks

  toddballinger/ninfer-5080#44 · Filter by author toddballinger opened on Sep 28, 2026
  1

  

• [P2][BUILD/MEM] Audit CUDA lazy module loading against the startup VRAM plan

  toddballinger/ninfer-5080#43 · Filter by author toddballinger opened on Sep 28, 2026
  

• [P2][MODEL/MEM] Evaluate Ternary Bonsai 2 27B on RTX 5080 16 GB

  toddballinger/ninfer-5080#42 · Filter by author toddballinger opened on Sep 28, 2026
  

• [P2][PERF] Profile MTP3 copy-engine and round-synchronization overhead

  toddballinger/ninfer-5080#41 · Filter by author toddballinger opened on Sep 28, 2026
  3

  

• [P2][SPEC] Evaluate shortlisted Q4 draft lm_head for MTP proposals

  toddballinger/ninfer-5080#40 · Filter by author toddballinger opened on Sep 28, 2026
  3

  

• [P1-B][MEM/PERF] Qualify current-Q4 C2/C4, then evaluate rk4v4-e8/rk2v4-e8 if memory-blocked

  toddballinger/ninfer-5080#32 · Filter by author toddballinger opened on Sep 26, 2026
  12

  

• [P1][PERF] Evaluate full-attention RMSNorm+RoPE fusion; track gate fusion as secondary

  toddballinger/ninfer-5080#31 · Filter by author toddballinger opened on Sep 26, 2026
  2

  

• [P1][PERF] Evaluate current upstream Q5 sliced-K MMA for MTP3 decode

  toddballinger/ninfer-5080#30 · Filter by author toddballinger opened on Sep 26, 2026
  5

  

• [P1][SPEC] Evaluate n-gram chain extension alongside production MTP3

  toddballinger/ninfer-5080#29 · Filter by author toddballinger opened on Sep 26, 2026
  3

  

• [P1][PERF] Evaluate short-suffix / long-prefix split-KV attention on 128K Q4 KV

  toddballinger/ninfer-5080#28 · Filter by author toddballinger opened on Sep 26, 2026
  

• [P1][CORRECTNESS] Harden tool-call and reasoning parsing for agent workloads

  toddballinger/ninfer-5080#27 · Filter by author toddballinger opened on Sep 26, 2026
  9

  

• [P1][AGENT] Benchmark and redesign prefix reuse for long OpenClaw workflows

  toddballinger/ninfer-5080#26 · Filter by author toddballinger opened on Sep 26, 2026
  5

  

• [P3][ARCH] Evaluate full NInfer v3 migration as a separate milestone

  toddballinger/ninfer-5080#23 · Filter by author toddballinger opened on Sep 26, 2026
  1

  

• [P3][OPS] Consider upstream configurable CUDA sync mode (bace20dc)

  toddballinger/ninfer-5080#22 · Filter by author toddballinger opened on Sep 26, 2026
  

• [P2][SPEC] Requalify DFlash2 K7 vs MTP3 on the winning 5080 artifact

  toddballinger/ninfer-5080#21 · Filter by author toddballinger opened on Sep 26, 2026
  5

  

• [P2][MEM/PERF] Prototype hybrid NVFP4 fused attention/GDN parents

  toddballinger/ninfer-5080#20 · Filter by author toddballinger opened on Sep 26, 2026
  1