Skip to content

fix(worker): skip Git metadata in model cache recovery - #129

Merged
austinjiann merged 1 commit into
mainfrom
codex/cache-archive-metadata
Nov 21, 2026
Merged

austinjiann merged 1 commit into
mainfrom
codex/cache-archive-metadata

Conversation

@austinjiann

@austinjiann austinjiann commented Nov 20, 2026 •

Copy link
Copy Markdown
Collaborator

The LHM prior archive includes a 4.68 GB duplicate Sapiens checkpoint under .git/lfs. Cache setup downloads and inventories that repository metadata even though inference uses the separate runtime .pt2. Skip exact .git components while preserving all runtime paths. Range recovery seeks past skipped payloads; fresh streaming extraction still consumes and hashes the complete source archive. Existing partial metadata is retained on disk and excluded from runtime inventory.

The pinned upstream archive audit found 145 metadata entries totaling 4,678,648,303 bytes (24.9% of the archive). Receipts now distinguish skipped member sizes from actual network bytes. Source length/ETag checks and incomplete-attempt refusal remain enforced.

Validation: 28 focused tests passed on Python 3.11 and 3.12; Ruff, repository formatting and diff checks passed. The range test verifies no request overlaps the Git blob and runtime weights remain byte-identical. Live validation on the final recovery slot completed: 145 Git entries (4,678,648,303 declared bytes) were skipped, while all required runtime files were inventoried. The call fetched 2,175,449,183 range bytes and reused 65 entries. This is not a wall-time A/B comparison: earlier attempts had different partial-cache states. Stacked on #128.

@austinjiann
austinjiann changed the base branch from codex/tracking-call-receipt to main November 21, 2026 04:17
@austinjiann
austinjiann merged commit 9a85bf6 into main Nov 21, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant