Skip to content

CUDA: faster MoE prompt processing (compact MMQ tiling, device expert sort, GET_ROWS) - #264

Open
danielhanchen wants to merge 25 commits into
base/upstream-1ab23c33bfrom
cuda-moe-prompt-kernels
Open

danielhanchen wants to merge 25 commits into
base/upstream-1ab23c33bfrom
cuda-moe-prompt-kernels

Commits

  1. Commits on Oct 12, 2026

  2. Commits on Oct 13, 2026

  3. Commits on Oct 14, 2026

  4. Commits on Oct 16, 2026

  5. Commits on Oct 18, 2026

  6. Commits on Oct 25, 2026

  7. Commits on Oct 30, 2026