Repository navigation
feat(aws-containers): add Amazon ECS GPU sharing reference - #481
Open
matthewgoodman13 wants to merge 1 commit into
Open
matthewgoodman13 wants to merge 1 commit into
matthewgoodman13 wants to merge 1 commit into
Conversation
Add references/ecs-gpu-sharing.md and a routing line in references/ecs.md, in both the core-skills and aws-core plugin trees. The reference says what Amazon ECS GPU sharing with NVIDIA MPS does, when to use a whole GPU or a G6f fractional GPU instead, lists security considerations, and requires the agent to read the GPU sharing docs before advising.
matthewgoodman13
force-pushed
the
feat/aws-containers-ecs-gpu-sharing
branch
from
October 22, 2026 20:32
5a10d5a to
a06cab9
Compare
matthewgoodman13
enabled auto-merge
October 22, 2026 22:27
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Amazon ECS GPU sharing with NVIDIA Multi-Process Service (MPS) launches on 2026-10-22. Without guidance, an agent asked to pack small models onto fewer GPUs tells the user ECS can't share a GPU, recommends the older manual method (remove GPU resource requirements and make the NVIDIA runtime the default through instance user data), or suggests a multi-model inference server. This PR adds a short reference so the agent recommends managed GPU sharing when it fits and reads the official docs before advising.
Changes, applied identically to
skills/core-skills/aws-containersandplugins/aws-core/skills/aws-containers:references/ecs-gpu-sharing.md. It covers:sharingStrategywith annvidia_mpsobject in the container's GPU resource requirement, with a GPUmemorylimit in MiB and an optionalmaxcomputePercent. ECS places tasks by GPU memory only.memoryas a hard ceiling, and avoiding the manual method that lets every container on the instance use the GPUs.references/ecs.md: one routing line to the new reference.SKILL.mdfrontmatter is unchanged, so skill selection is unaffected. This PR touches the sameecs.mdrouting list as #476 (ECS Gateway); whichever merges second needs a one-line rebase.Validation (internal, pre-launch, docs not yet public):
aws-containersmisses beyond one unrelated GPT-5.4 miss that did not repeat.Type of Change
Checklist
python3 tools/validate.pyBy submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.