Repository navigation
feat(global-router): preserve reserved GPU compute across workload redeploys - #17266
Closed
sachalmalick wants to merge 3 commits into
Closed
sachalmalick wants to merge 3 commits into
sachalmalick wants to merge 3 commits into
Conversation
Signed-off-by: Sachal Malick <s@chal.ai>
Signed-off-by: Anna Tchernych <atchernych@nvidia.com> Co-authored-by: Anna Tchernych <atchernych@nvidia.com> Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
…ers (#17271) Signed-off-by: Anna Tchernych <atchernych@nvidia.com> Signed-off-by: Sachal Malick <s@chal.ai> Co-authored-by: Anna Tchernych <atchernych@nvidia.com> Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add an independent CDK entry point for GPU node groups that target externally owned On-Demand Capacity Reservations. Separate regional VPC/EKS foundations from fixed-size compute and application deployments, retain compute dependencies, and use MINIMAL updates to avoid requiring surge capacity.
Use current operator credentials with an S3-only asset setup, pinned EKS NVIDIA releases and a pinned device plugin. Add read-only AWS preflight checks and an operator runbook; deployment identifiers remain in ignored local configuration.
Closes #17263.
Validation
No reservation was created, modified, extended or cancelled by this change. Actual model-serving performance is a separate validation step.
Superseded
Replaced by #17418, which combines this complete CDK stack into a single commit against the current
global-router-v2. The new PR includes the already merged #17270 and #17271 changes.