Skip to content

fix: vLLM 0.31 attention compatibility - #604

Closed
simone-chen wants to merge 1 commit into
mainfrom
simonec/vllm031-attention-compat
Closed

simone-chen wants to merge 1 commit into
mainfrom
simonec/vllm031-attention-compat

Conversation

@simone-chen

@simone-chen simone-chen commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Change

  • Consolidate fix: adapt vLLM attention metadata to removed CPU fields #569 and fix: qualify vLLM 0.31 B200 attention collectors #587 for Tianhao's collector review alongside his data update PR. Preserve the original branches and campaign source SHAs.
  • Adapt vLLM 0.31 attention metadata, pre/post MLA BMM, dense and encoder attention, MLA, DSA, and DSV4 to the pinned native serving APIs. Preserve older-version routes and explicit qualification gates.
  • Retain runtime pins, backend selection, cache layouts, tests, and collector documentation. Leave campaign filtering, CI change detection, recovery infrastructure, and measurement data outside this PR.

Review order

Validation

  • Focused attention, registry, provenance, and routing checks: 308 passed, 24 skipped in the local environment. Ruff and formatting checks pass.
  • The initial test run lacked the locally built native module; rerunning with the existing native build completed successfully.
  • This consolidation does not rerun GPU qualification. Collection remains stopped. Full CI will be requested for the exact signed head.

Signed-off-by: Simone Chen <simonec@nvidia.com>
@coderabbitai

coderabbitai Bot commented Oct 27, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

@simone-chen

Copy link
Copy Markdown
Contributor Author

/ok to test 2d0ed6c

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant