Skip to content

qwen3_5 cuda: serve dense EXL3 checkpoints with DFlash2, tensor-core prompt tiles, and host-mapped embeddings - #1407

Closed
diwakergupta wants to merge 4 commits into
ashhart:mainfrom
diwakergupta:feat/beat-sglang-prod
Closed

qwen3_5 cuda: serve dense EXL3 checkpoints with DFlash2, tensor-core prompt tiles, and host-mapped embeddings#1407
diwakergupta wants to merge 4 commits into
ashhart:mainfrom
diwakergupta:feat/beat-sglang-prod

perf(qwen3_5): require long_match (20 tokens) for 27B root copies

00a81f0
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs