Repository navigation

[None][feat] Support layer and buffer reuse policies for attention and SSM - #21088

Merged

jiaganc merged 19 commits into

NVIDIA:mainfrom

jiaganc:codex/layer-reuse-policy

Oct 30, 2026

Merged

[None][feat] Support layer and buffer reuse policies for attention and SSM#21088
jiaganc merged 19 commits into
NVIDIA:mainfrom
jiaganc:codex/layer-reuse-policy

Commits on Oct 30, 2026
- [None][feat] BREAKING: Support layer-level reuse policies for attention and SSM
  jiaganc
  committed
  fb3ad4b
- [None][fix] Exclude unselected optional SSM groups from reuse statistics
  jiaganc
  committed
  e6a1dd7
- [None][doc] Explain SSM allocation branch ordering
  jiaganc
  committed
  46cd921
- [None][refactor] Simplify required SSM cache level assignment
  jiaganc
  committed
  ff87edc
- [None][feat] Support buffer-level reuse policy for SSM layers (By Agent)
  
  VALLIS-NERIA
  authored and
  jiaganc
  committed
  13a5c26
- [None][fix] Keep SSM reuse policies when dropping zero-size buffers (By Agent)
  
  VALLIS-NERIA
  authored and
  jiaganc
  committed
  54d010c
- Support per-buffer lifecycle queries and migrate cache storage metadata
  jiaganc
  committed
  dd58f34
- Cover split-buffer scratch allocation and transfer membership
  jiaganc
  committed
  892c6c8
- Reject ambiguous connector layer lookup and cover split transfer layout
  jiaganc
  committed
  7ef9931
- Preserve group membership order and pack unequal scratch shares safely
  jiaganc
  committed
  0e8a9cc
- Register lifecycles only for configured buffers
  jiaganc
  committed
  a4b257e
- Defer Python consumer adoption of per-buffer reuse policies
  jiaganc
  committed
  16773f0
- Remove deferred buffer adoption comments from Python consumers
  jiaganc
  committed
  3e3ce5d
- Remove V2 reuse policy section from V1 cache manager guide
  jiaganc
  committed
  74e17aa
- Wait for offload before overwriting recycled slots in tests
  jiaganc
  committed
  360a2f2
- Document attention and SSM buffer reuse policy overrides
  jiaganc
  committed
  4f26fed
- Clarify lifecycle policy helpers and cache group API contracts
  jiaganc
  committed
  13ff239
- Adapt buffer reuse policies to upstream sparse cache APIs
  jiaganc
  committed
  2295af0
- Validate suspended SSM working state with page holders
  jiaganc
  committed
  d0911a1

Commits

Commits on Oct 30, 2026