Repository navigation

feat(server): add ft info and a pre-load memory preflight - #595

Open

KarrAcaRn wants to merge 8 commits into

FlashML-org:mainfrom

KarrAcaRn:feat/ft-info

Open

feat(server): add ft info and a pre-load memory preflight#595
KarrAcaRn wants to merge 8 commits into
FlashML-org:mainfrom
KarrAcaRn:feat/ft-info

Commits on Oct 3, 2026
- refactor(kvcache): split plan_num_pages out of solve_num_pages
  KarrAcaRn
  committed
  5d8ee35
- refactor(engine): share the moe-cache-auto plan and the expert slot size
  KarrAcaRn
  committed
  72310a6
- feat(server): add ft info, a pre-load GPU memory forecast with tips
  KarrAcaRn
  committed
  83a34b6
- feat(engine): refuse a configuration that cannot fit before loading its weights
  KarrAcaRn
  committed
  02d3767
- docs(cli): document ft info and --skip-preflight
  KarrAcaRn
  committed
  2deca49
- fix(info): read free gpu memory before the arch probe creates a cuda context
  KarrAcaRn
  committed
  e6d2a7d
- fix(info): forecast without the attention-workspace charge and the vram reserve
  KarrAcaRn
  committed
  2fc4897
Commits on Oct 5, 2026
- fix(info): price df11-compressed weights the meta build leaves empty
  KarrAcaRn
  committed
  50d8cd3