feat(moe): load a short prefill chunk's experts on demand through the slot cache by YevheniiKotyrlo · Pull Request #676 · FlashML-org/FreeToken

test(moe): a short prefill chunk loads its experts through the slot cache, bit-identical to the stream

YevheniiKotyrlo

committed

d313c0d

feat(moe): load a short prefill chunk's experts on demand through the slot cache

YevheniiKotyrlo

committed

dee1c00

test(moe): a dense model drops the demand-prefill threshold

YevheniiKotyrlo

committed

98379dc

test(moe): the demand-prefill threshold is refused off GPU decode

YevheniiKotyrlo

committed

2645b8c

fix(moe): admit a demand prefill chunk's distinct experts 128 at a time

YevheniiKotyrlo

and

gdevenyi

committed

84c2d04

fix(moe): align on triton past sgl_kernel's 1024-expert block

YevheniiKotyrlo

and

gdevenyi

committed

1998f4e

test(moe): a demand prefill chunk's nvfp4 gemms take their tiles and w4a4 scales from its layer

YevheniiKotyrlo

committed

430dd2a

fix(moe): size a demand prefill chunk's nvfp4 tiles and w4a4 scales by its layer's experts

YevheniiKotyrlo

committed

cf39859

test(moe): drop two demand-prefill tests the tests README no longer admits

YevheniiKotyrlo

committed

5b2f0a0

Navigation Menu

Repository navigation

feat(moe): load a short prefill chunk's experts on demand through the slot cache - #676

feat(moe): load a short prefill chunk's experts on demand through the slot cache#676
YevheniiKotyrlo wants to merge 9 commits into
FlashML-org:mainfrom
YevheniiKotyrlo:feat-moe-prefill-demand

Commits on Oct 23, 2026

test(moe): a short prefill chunk loads its experts through the slot cache, bit-identical to the stream

feat(moe): load a short prefill chunk's experts on demand through the slot cache

test(moe): a dense model drops the demand-prefill threshold

test(moe): the demand-prefill threshold is refused off GPU decode

fix(moe): admit a demand prefill chunk's distinct experts 128 at a time

fix(moe): align on triton past sgl_kernel's 1024-expert block

test(moe): a demand prefill chunk's nvfp4 gemms take their tiles and w4a4 scales from its layer

fix(moe): size a demand prefill chunk's nvfp4 tiles and w4a4 scales by its layer's experts

test(moe): drop two demand-prefill tests the tests README no longer admits