fix: use GRID v19 LTS for A10

[Ganeshkumar Ashokavardhanan (ganeshkumarashok)]

What this PR does / why we need it:

Consume the patched GRID v19.6 LTS image published after Azure/aks-gpu#196, retaining the R580 option for A10 instead of moving A10 applications to R595.

• Pin aks/aks-gpu-grid to 580.178.04-20261006181431.
• Keep NCv6 RTX PRO 6000 BSE on the existing aks-gpu-grid-v20 image, 595.91.07-20260917204440.
• Restrict Renovate to R580 for the A10 GRID image and R595 for GRID v20, so existing R595 tags in the standard GRID repository cannot undo the split.
• Preserve existing SKU routing, including the NCads_A10_v4 aliases, and all CUDA/CUDA-LTS image pins.
• Add exact configured-version assertions to the existing Ubuntu 22.04/24.04 A10 and Ubuntu 24.04 RTX GRID scenarios, checking every reported GPU rather than only the first GPU or a driver major.
• Add branch-load and 30-SKU selection tests, executable validator-script tests, and a targeted E2E-module unit-test step in GitHub CI.

Which issue(s) this PR fixes:

Related to Azure/aks-gpu#195 and the merged producer PR Azure/aks-gpu#196.

This is the R580/LTS alternative to the A10 R595 image pins proposed in #9672 and #9661. Their A10 image-version changes should not be combined with this pin.

Published artifact

The producer merge is 432207c529aebbd0604751f3fc7955cfbd9c8f03. Its publication run completed the GRID Build and Push job successfully.

The exact MCR manifest for 580.178.04-20261006181431 returns HTTP 200:

sha256:0aa1ec2015e78f1063432b929aa1c78a20d8aee9f37cf1226ea68bda0b642ae0

No placeholder or inferred timestamp is used.

Compatibility and scope

Azure's Linux GRID support matrix lists v19.6 and v20.2 for NVadsA10_v5, and only v20.2 for NCv6 and NCasT4_v3.

An available GRID option does not require switching a CUDA compute SKU to GRID. CUDA selection is unchanged. Azure Linux/ACL sysext installation paths are also unchanged by this Ubuntu image pin.

Isaac Sim 5.1's source pins Kit SDK 107.3.3; upstream explains that this version does not support 59x drivers. This PR retains a supported R580 option, but does not claim an exact Azure A10 Isaac Sim renderer run. The separate NCv6 MIG identifier issue still requires newer Kit.

Validation

• Full datamodel unit package passes, including R580/R595 branch assertions.
• Thirty SKU cases with casing variants pass for driver type, version, and image suffix; existing Ginkgo GPU-selection tests also pass.
• The exact-version script tests pass for both branches, stale/wrong versions, matching/mismatched multiple GPUs, empty output, failed nvidia-smi, and invalid expected versions. Tests execute the generated executable script with stub binaries; they do not access a real GPU.
• Existing GPU-managed-component version-consistency test passes.
• Renovate branch-policy truth tables, Go formatting, and git diff --check pass.
• The same new E2E-module script-test selector is wired into GitHub CI.
• Linux VHD gate 184427510 succeeded: all 12 image-build jobs passed, followed by downstream E2E with 118 passed, 0 flaky, 76 skipped, 0 failed.
• Windows VHD gate 184427618 succeeded: all three image builds, cache-validation and Packer-cleanup tasks passed. Its three E2E runs selected 1, 5, and 7 scenarios respectively, each with 0 flaky and 0 failed; their skipped counts were 193, 189, and 187.

Hardware GPU verification

GPU E2E build 184427740 succeeded on PR merge commit 1aa7e22b6c40ec89526ae458ed86041646d99edc, whose second parent is this PR's ba8e715eb63f679c8aa3042fd1108f0bcecba914.

Final results: 16 passed, 1 flaky (passed on retry), 177 skipped, 0 failed.

Scenario	Observed SMI driver / GRID installer	Outcome
Ubuntu2204_GPUA10	580.178.04	Passed on first attempt
Ubuntu2404_GPUA10	580.178.04	Passed on first attempt
Ubuntu2404_GPU_RTXPro6000_GridV20	595.91.07	Passed on first attempt

The versions above are observed in the scenario cluster-provision.log artifacts, not inferred from the image tag. The exact-version validators also passed.

The only flaky scenario was the unchanged T4 CUDA path, Ubuntu2204_GPUNC: the first attempt recorded a WALinuxAgent goal-state/Wireserver HTTP timeout; attempt 2 passed. The A10 and RTX GRID scenarios did not need a retry.

Read-only Azure verification found all 19 explicitly logged E2E VMSS targets absent after the run. No resources were manually deleted.

This proves the tested GPU bootstrap/runtime checks, not Isaac Sim renderer compatibility. Final GitHub rollup: 52 checks passed, 1 intentionally skipped, 0 failed, 0 pending. Both Linux and Windows VHD gates passed. The PR remains open and awaits review.

[github-actions]

Windows Unit Test Results

  3 files   18 suites   1m 10s ⏱️
551 tests 551 ✅ 0 💤 0 ❌
554 runs  554 ✅ 0 💤 0 ❌

Results for commit ba8e715.

[github-actions]

Package	Line Rate	Health
test	0%	❌
windows	27%	❌
staging_cse_windows Package 1	65%	➖
debug	0%	❌
provisioningscripts	2%	❌
parts_windows Package 1	76%	➖
Summary	39% (1663 / 6838)	❌

[github-actions]

Package	Line Rate	Health
github.com/Azure/agentbaker/aks-node-controller	71%	➖
github.com/Azure/agentbaker/aks-node-controller/common	100%	✔
github.com/Azure/agentbaker/aks-node-controller/helpers	68%	➖
github.com/Azure/agentbaker/aks-node-controller/parser	87%	✔
github.com/Azure/agentbaker/aks-node-controller/pkg/gpu	100%	✔
github.com/Azure/agentbaker/aks-node-controller/pkg/nodeconfigutils	70%	➖
github.com/Azure/agentbaker/aks-node-controller/utils	0%	❌
github.com/Azure/agentbaker/apiserver	24%	❌
github.com/Azure/agentbaker/cmd	0%	❌
github.com/Azure/agentbaker/cmd/starter	0%	❌
github.com/Azure/agentbaker/fuzz/api	0%	❌
github.com/Azure/agentbaker/hotfix/render-nodecustomdata	0%	❌
github.com/Azure/agentbaker/pkg/agent	76%	➖
github.com/Azure/agentbaker/pkg/agent/datamodel	76%	➖
github.com/Azure/agentbaker/pkg/agent/toggles	0%	❌
github.com/Azure/agentbaker/pkg/vhdbuilder/datamodel	87%	✔
Summary	73% (5337 / 7327)	➖

[github-actions]

Package	Line Rate	Health
shellspec spec	22%	❌
Summary	22% (3164 / 14345)	❌

[Copilot]

Copilot review overview

🔵 Needs a closer look

The R580 artifact and routing appear consistent, but this production GPU driver transition warrants human review and real-hardware validation.

Review effort: Balanced
Findings: None

What changed in this PR

Pins A10 GRID workloads to patched R580 LTS while retaining R595 for RTX PRO 6000 BSE.

Changes:

• Updates and Renovate-pins the A10 GRID image to R580.
• Adds exact multi-GPU driver-version validation.
• Expands SKU routing tests and CI coverage.

File	Description
README.md	Documents GRID branch separation.
parts/​common/​components.json	Pins the R580 GRID image.
.github/​renovate.json	Restricts GRID updates by branch.
pkg/​agent/​gpu_driver_selection_test.go	Tests 30 SKU mappings.
pkg/​agent/​datamodel/​gpu_components_test.go	Verifies R580/R595 branches.
e2e/​scenario/​validators.go	Adds exact-version validation.
e2e/​scenario/​validators_gpu_driver_test.go	Exercises generated validation scripts.
e2e/​scenario/​scenario.go	Applies validation to GRID scenarios.
.github/​workflows/​go-test.yml	Runs validator tests in CI.

---

💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

[Ganeshkumar Ashokavardhanan (ganeshkumarashok)]

GPU E2E verification: passed

AgentBaker GPU E2E build 184427740 succeeded on PR merge commit 1aa7e22b6c40ec89526ae458ed86041646d99edc, containing PR head ba8e715eb63f679c8aa3042fd1108f0bcecba914.

Results: 16 passed, 1 flaky (passed on retry), 177 skipped, 0 failed.

Relevant scenario	Observed driver / GRID installer	Outcome
Ubuntu2204_GPUA10	580.178.04	Passed on first attempt
Ubuntu2404_GPUA10	580.178.04	Passed on first attempt
Ubuntu2404_GPU_RTXPro6000_GridV20	595.91.07	Passed on first attempt

The versions were verified in the scenario cluster-provision.log artifacts; these are not inferred from image tags. The new exact-version checks passed.

The sole flaky case was Ubuntu2204_GPUNC on the unchanged T4 CUDA path: its first attempt failed after guest-agent goal-state/Wireserver HTTP timeouts, and attempt 2 passed. Neither A10 nor RTX GRID required a retry. No persistent or GRID-change-related test failure was found.

Cleanup: all 19 explicitly logged E2E VMSS targets are absent, verified through read-only Azure queries. No resources were manually deleted.

Relevant Go tests, main-module lint, CUE/component schema, version consistency, DCGM compatibility, and workflow lint checks also passed. Broader VHD/general E2E gates are still pending at the time of this comment; this is not a claim that every PR gate is complete.

This verifies GPU bootstrap/runtime behavior on the tested nodes. Isaac Sim renderer compatibility remains untested.