Skip to content

fix(batch): deepseek-v4 serves concurrent requests (one-row prompt batches, CacheList promotion) - #38

Merged
asher merged 3 commits into
mainfrom
dsv4-batch-decode
Aug 10, 2026
Merged

fix(batch): deepseek-v4 serves concurrent requests (one-row prompt batches, CacheList promotion)#38
asher merged 3 commits into
mainfrom
dsv4-batch-decode

changelog: deepseek4 concurrent serving fix

7892c15
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
lint
succeeded Aug 10, 2026 in 7s