Skip to content

publish, web: the run page shows memory, and a short prompt's prefill is not a measurement - #2

Merged
midagedev merged 2 commits into
mainfrom
sitemem
Oct 14, 2026
Merged

midagedev merged 2 commits into
mainfrom
sitemem

Conversation

@midagedev

@midagedev midagedev commented Oct 14, 2026 •

Copy link
Copy Markdown
Owner

The site page showed less than the tape. Two gaps:

  • Memory. The card's MEMORY block (GPU used of total, host RSS) never reached the index, so a model larger than its card looked the same on the page as one that fit. The index now copies gpu_mem and rss_* from the tape with memorySection's gates; the page prints them in the card's GiB rounding.
  • Short prompt. Under tape.MinPrefillPromptTokens (100) the prefill rate is mostly fixed cost. The card warns; the page, the description and the search printed it as a plain figure. The index now marks short_prompt (card.ShortPrompt), omits prefill_per_sec (so the search column is NULL), and carries the probe's rate and fixed cost. The page shows the probe instead.

No D1 migration: the page reads index_json. Published runs change after a toktape reindex.

Evidence: FAIL-first for each new Go and JS test (Go build failed / short_prompt = <nil>, prefill_per_sec = 206; JS 0 of 1 and 2 of 7 passed). After: ./scripts/check.sh OK, npm test 49/49.

Example runs: https://tape.midagedev.com/r/3xzgnp3srbrwzfruga4v (21.2 GB model on a 12 GB RTX 3060), https://tape.midagedev.com/r/bi7v3b74snetzbq45dsz (33-token prompt).

The implementation was drafted by an AI model (grok) and reviewed by the bloomery AI assistant.

🤖 Generated with Claude Code

midagedev and others added 2 commits October 14, 2026 11:49
The card's MEMORY block (GPU used of total, host RSS) never reached the
site: the index carried no memory, so a model larger than its card read
the same on the page as one that fit. The index now copies gpu_mem and
the RSS figures from the tape with memorySection's gates, and the page
prints them in the card's GiB rounding. No D1 column: the page reads
index_json, and a reindex repairs runs already published.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Under tape.MinPrefillPromptTokens the server's prefill rate is mostly the
fixed per-request cost; the card says so, the site printed it as a plain
figure on the run page, in the description and in the search. The index
now marks short_prompt (card.ShortPrompt, one owner), leaves the rate out
so the search column stays NULL, and carries the probe's own rate and
fixed cost. The run page shows the probe in the stat and a prefill row
("not measured: 33-token prompt · probe … on one stream · … fixed"), and
the description quotes the probe instead. The two Go-rounding helpers in
run.js are one.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@midagedev
midagedev merged commit f93b6a6 into main Oct 14, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant