Skip to content

fix: cap MAX_NUM_SEQS at 32 so vLLM starts on a 48 GB GPU - #4

Merged
kenlim-mops merged 1 commit into
mainfrom
fix/max-num-seqs
Oct 8, 2026
Merged

fix: cap MAX_NUM_SEQS at 32 so vLLM starts on a 48 GB GPU#4
kenlim-mops merged 1 commit into
mainfrom
fix/max-num-seqs

Commits

  1. Commits on Oct 8, 2026