Skip to content

fix: cap MAX_NUM_SEQS at 32 so vLLM starts on a 48 GB GPU - #4

Merged
kenlim-mops merged 1 commit into
mainfrom
fix/max-num-seqs
Oct 8, 2026
Merged

fix: cap MAX_NUM_SEQS at 32 so vLLM starts on a 48 GB GPU#4
kenlim-mops merged 1 commit into
mainfrom
fix/max-num-seqs

fix: cap MAX_NUM_SEQS at 32 so vLLM starts on a 48 GB GPU

47a8209
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar