Skip to content

CUDA: faster MoE prompt processing (compact MMQ tiling, device expert sort, GET_ROWS) - #264

Open
danielhanchen wants to merge 25 commits into
base/upstream-1ab23c33bfrom
cuda-moe-prompt-kernels
Open

CUDA: faster MoE prompt processing (compact MMQ tiling, device expert sort, GET_ROWS)#264
danielhanchen wants to merge 25 commits into
base/upstream-1ab23c33bfrom
cuda-moe-prompt-kernels

Fix merge conflicts

ece7705
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs