Issues

• [Bug]: kv_cache_cpu patch reads retired DynamicCache attributes, AttributeError on current transformers

  microsoft/MInference#217 · Filter by author AmirF194 opened on Sep 23, 2026

• [Question]: How do you manage MInference's budget within SCBench?

  question
  microsoft/MInference#212 · Filter by author jjbong-1 opened on Jun 9, 2026

• Consider using pre-built Flash Attention kernels via kernels

  microsoft/MInference#211 · Filter by author sayakpaul opened on May 28, 2026

• Release Qwen2.5-3B and Llama-3.1-8B 512K context checkpoints on Hugging Face

  microsoft/MInference#210 · Filter by author NielsRogge opened on May 20, 2026

• [Bug]: AttributeError: 'DynamicCacheWithRepeat' object has no attribute 'key_cache'

  bug
  microsoft/MInference#207 · Filter by author mozhang-ah opened on Mar 11, 2026

• [Question]: Scbench, mulit turn, input=last turn true answers + now turn prompt, but cache is only the 1st turn prompt?????

  question
  microsoft/MInference#202 · Filter by author wagnzi opened on Jan 1, 2026

• [Question]: Feasibility of evaluating complex KV compression methods via single-turn or batch-input modes

  question
  microsoft/MInference#200 · Filter by author ponytaill opened on Dec 12, 2025

• [Question]: Out of memory for MInference in e2e benchmark test & NIAH with long context_window

  question
  microsoft/MInference#199 · Filter by author KevinWu2017 opened on Dec 2, 2025

• [Question]: Broken link in Leank: booksum.jsonl.zst dataset URL is inaccessible

  question
  microsoft/MInference#197 · Filter by author paitsai opened on Nov 25, 2025

• [Bug]: _triton_mixed_sparse_attention in pit_sparse_flash_attention_v2.py doesn't work with triton 3.2.0

  bug
  microsoft/MInference#196 · Filter by author zhengqigao opened on Nov 20, 2025
  1

• [Bug]: Can't run run_infinitebench.py

  bug
  microsoft/MInference#195 · Filter by author ruili-pml opened on Nov 3, 2025
  1

• [Question]: can TriMix be used in large models, such as deepseek, qwen3-235b?

  question
  microsoft/MInference#194 · Filter by author xwpaul3 opened on Oct 20, 2025
  3

• [Bug]: Unrecognized configuration class when running TriMix example code on Qwen-2.5-VL model

  bug
  microsoft/MInference#191 · Filter by author xwpaul3 opened on Oct 11, 2025

• [Question]: No speedup on multi-card with vllm

  question
  microsoft/MInference#188 · Filter by author Andy0422 opened on Sep 25, 2025

• [Feature Request]: Can MInference support chunked prefill?

  feature request
  microsoft/MInference#186 · Filter by author zongy17 opened on Sep 19, 2025
  5

  

• [Question]: Support for Qwen3 dense models

  question
  microsoft/MInference#184 · Filter by author ntudy opened on Sep 11, 2025

• [Bug]: Implement of TriangleMix

  bug
  microsoft/MInference#183 · Filter by author Espere-1119-Song opened on Sep 5, 2025
  2

• [Bug]: Unable to run streamingLLM properly on minference with the qwen3-0.6B model.

  bug
  microsoft/MInference#182 · Filter by author Enoch202 opened on Sep 1, 2025

• [Question]: How to use quantification and MInference together

  question
  microsoft/MInference#181 · Filter by author testpppppp opened on Aug 27, 2025

• [Question]: quick evaluation of kernel

  question
  microsoft/MInference#180 · Filter by author xwpaul3 opened on Aug 16, 2025

• [Bug]: Failed to launch vllm while import MInference

  bug
  microsoft/MInference#178 · Filter by author fluctlux opened on Aug 8, 2025
  3

  

• [Question]: Does Minference support Qwen3 model?

  question
  microsoft/MInference#177 · Filter by author Enoch202 opened on Aug 8, 2025
  2

  

• [Question]: Implement triangle attention in sglang?

  question
  microsoft/MInference#176 · Filter by author Ewan-Ding opened on Aug 7, 2025
  6

  

• [Question]: Is MMinference included?

  question
  microsoft/MInference#175 · Filter by author RUOJINHE opened on Aug 7, 2025
  4

  

• [Question]: Ruler test results abnormal

  question
  microsoft/MInference#170 · Filter by author Andy0422 opened on Jul 22, 2025
  2