Skip to content

perf(pd): overlap the decode-side KV inject copies across device pairs - #66

Closed
Oseltamivir wants to merge 1 commit into
tile-ai:mainfrom
SemiAnalysisAI:perf/pd-parallel-inject
Closed

perf(pd): overlap the decode-side KV inject copies across device pairs#66
Oseltamivir wants to merge 1 commit into
tile-ai:mainfrom
SemiAnalysisAI:perf/pd-parallel-inject

perf(pd): overlap the decode-side KV inject copies across device pairs

40a14af
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs