Skip to content

gate_nvtier: load the all-RAM arm before the paged arm, and declare its real host need #633

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
juliankang4 merged 2 commits into from
Oct 21, 2026
Merged

gate_nvtier: load the all-RAM arm before the paged arm, and declare its real host need #633

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
7a395c7
gate_nvtier: the all-RAM arm loads before the paged arm
juliankang4 Oct 21, 2026
13ba942
gate_nvtier: the pack's resource row carries the all-RAM arm's host need
juliankang4 Oct 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions crates/gpu-gates/src/bin/gate_nvtier.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1996,6 +1996,12 @@ fn run() -> Result<(), GateError> {
// `grant` (clause 13)'s children run before the paged arm holds its
// arena; their answer is read after the `bits` line.
let grant = grant_run(&grant_terms);
// The all-RAM arm loads first: the paged arm's tier, which the clauses
// below read, holds its arena until the stepunion arms, and the host's
// reading at the all-RAM arm's load would lose those bytes.
let ram = arm(
path, &machine, None, residency, host, &ids, false, &probe, None,
)?;
let mut paged = arm(
path,
&machine,
Expand All @@ -2007,9 +2013,6 @@ fn run() -> Result<(), GateError> {
&probe,
band,
)?;
let ram = arm(
path, &machine, None, residency, host, &ids, false, &probe, None,
)?;

let tokens_eq = paged.tokens == ram.tokens;
let digests_eq = paged.digests == ram.digests;
Expand Down
5 changes: 4 additions & 1 deletion tools/gate-batch-resources.tsv
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,9 @@
# glm5next --place gate: need=173,015,891,968 B (the glm5next serve log's cache line)
# qwen4exp --place gate: need=92,054,154,240 B (the qwen38 serve log's cache line); the serve/residency seats add
# the churn pool 35.6e9 B beside it; iqleg loads the file twice (both resident): 2 x.
# nvtier gate_nvtier: the all-RAM arm loads first and its load need is 105,818,045,440 B (host experts 62,397,542,400 B +
# tables 28,800,138,240 B + reserves 6,694,629,376 B + residency churn pool 14,620,364,800 B − OS reserve 6,694,629,376 B);
# the paged arm loads after it, 5.5e9 B need + 23.5e9 B arena, the smaller. [derived from the load check's refusal line]
# qwen38-media: the qwen38-serve row's need, qwen4exp --place gate (the text load, the media load and the servers load one
# after the other, never two at once; the media load's rotation tables are card bytes, none are host bytes);
# the server arms may run the residency pool, whose 35.6e9 B the serve row carries [derived]
Expand All @@ -36,7 +39,7 @@ gate-gpu-ds41-long m 237600000000
gate-gpu-ds41-twocard - 237600000000
gate-gpu-glm5next-serve - 173015891968
gate-gpu-glm5next-twocard - 173015891968
gate-gpu-nvtier - 92054154240
gate-gpu-nvtier - 105818045440
gate-gpu-qwen38-media - 127654154240
gate-gpu-qwen38-residency - 127700000000
gate-gpu-qwen38-serve - 127654154240
Expand Down
Loading