Repository navigation

[Serve] Expose multiplexed_model_ids on ReplicaDetails - #67276

Open

pardeep-singh wants to merge 5 commits into

ray-project:masterfrom

pardeep-singh:feat/serve-replica-multiplexed-model-ids

Open

[Serve] Expose multiplexed_model_ids on ReplicaDetails#67276
pardeep-singh wants to merge 5 commits into
ray-project:masterfrom
pardeep-singh:feat/serve-replica-multiplexed-model-ids

Commits on Oct 22, 2026
- [Serve] Expose multiplexed_model_ids on ReplicaDetails
  pardeep-singh
  committed
  f7870ee
Commits on Oct 25, 2026
- Drop failed and cancelled model loads from the reported IDs; use a tuple
  pardeep-singh
  committed
  f340d07
Commits on Oct 26, 2026
- Count in-flight loads per model ID so a cancelled waiter keeps it reported
  pardeep-singh
  committed
  9df5804
Commits on Oct 27, 2026
- Push after an eviction even if the unload fails, and pin the push flag in tests
  pardeep-singh
  committed
  b3e9698
Commits on Oct 28, 2026
- Stop pushing model IDs before unloading models on shutdown
  pardeep-singh
  committed
  308a983