feat(core): core-side wiring for kimi-linear (k3) serving - #306

Merged

Andrewxu313 merged 19 commits into

mainfrom

tairanxu/k3-prefill-core

Aug 12, 2026

Commits on Aug 12, 2026

feat(core): core-side wiring for kimi-linear serving
TairanXU
committed
00198a3
fix(worker): M1 core-side fixes for kimi-linear (F5, decode heartbeat)
TairanXU
committed
a52e95c
fix(worker): stale completion metadata and slot reuse on decode drain
TairanXU
committed
f524e91
feat(kv_cache): manager-authoritative graph-ready KDA state pools
TairanXU
committed
72957f1
fix(worker): log the full sequence id in REPETITION warnings
TairanXU
committed
87aea66
fix(core): route kimi-k3 tokenizer; fail prompt construction loudly

SeedEverything328
authored and
TairanXU
committed
96436cb
fix(htod): throw on missing slot and size mismatch in the copy loop

SeedEverything328
authored and
TairanXU
committed
6e3cf46
fix: ckpt_converter refuses MXFP4 tensors in the INT4 marlin repack

SeedEverything328
authored and
TairanXU
committed
d6f42a9
feat(worker): carry K3 block residuals through the serving prefill loop
TairanXU
committed
cd8f1c4
fix(kv_cache): give kimi-k3 its own host-KV profile

SeedEverything328
authored and
TairanXU
committed
61e43dc
fix(worker): log the first token prefill actually sampled

SeedEverything328
authored and
TairanXU
committed
af34da9
perf(worker): seed preallocated block_residual; free inputs_embeds
TairanXU
committed
1842a65
feat(worker): return the prefill-sampled token for max_tokens=1 (C4)
TairanXU
committed
f2ee9be
perf(worker): share the input_ids pool per node and size it by need
TairanXU
committed
30a88e0
fix(worker): keep C4-completed seqs visible to legacy result gather
TairanXU
committed
211ae2a
feat(worker): emit a structured [METRICS] prefill record
TairanXU
committed
5f92b08
fix(worker): make the C4 result store survive a hot reload
TairanXU
committed
8fc02f2
feat(server): reject /v1/inference at the door instead of parking it
TairanXU
committed
7cf61f4
test(k3): exercise the buffer-pool grow rebind-with-live-sequences branch
TairanXU
committed
8d961b7

Navigation Menu

Uh oh!

feat(core): core-side wiring for kimi-linear (k3) serving - #306

feat(core): core-side wiring for kimi-linear (k3) serving#306
Andrewxu313 merged 19 commits into
mainfrom
tairanxu/k3-prefill-core

Commits on Aug 12, 2026

feat(core): core-side wiring for kimi-linear serving

fix(worker): M1 core-side fixes for kimi-linear (F5, decode heartbeat)

fix(worker): stale completion metadata and slot reuse on decode drain

feat(kv_cache): manager-authoritative graph-ready KDA state pools

fix(worker): log the full sequence id in REPETITION warnings

fix(core): route kimi-k3 tokenizer; fail prompt construction loudly

fix(htod): throw on missing slot and size mismatch in the copy loop

fix: ckpt_converter refuses MXFP4 tensors in the INT4 marlin repack

feat(worker): carry K3 block residuals through the serving prefill loop

fix(kv_cache): give kimi-k3 its own host-KV profile

fix(worker): log the first token prefill actually sampled

perf(worker): seed preallocated block_residual; free inputs_embeds

feat(worker): return the prefill-sampled token for max_tokens=1 (C4)

perf(worker): share the input_ids pool per node and size it by need

fix(worker): keep C4-completed seqs visible to legacy result gather

feat(worker): emit a structured [METRICS] prefill record

fix(worker): make the C4 result store survive a hot reload

feat(server): reject /v1/inference at the door instead of parking it

test(k3): exercise the buffer-pool grow rebind-with-live-sequences branch