Skip to content

ci: weekly full-registry corpus refresh (cached, ETag-revalidated) - #15081

Open
benjcooley wants to merge 5 commits into
mainfrom
benjcooley/registry-census
Open

benjcooley wants to merge 5 commits into
mainfrom
benjcooley/registry-census

Conversation

@benjcooley

@benjcooley benjcooley commented Aug 12, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Corpus infrastructure for full-registry custom-node measurement: a weekly-refreshed, cache-persisted mirror of every registry pack's frontend JS (~5,000 packs, ~1GB), ETag-revalidated so it self-updates exactly when a pack's default branch moves. This is the input for the ecosystem execution matrix (stacked: #15110).

The upstream static idiom scan (L1) is deliberately not vendored - its false-positive/negative rate was judged too high to act on. Packs are measured by executing their code (#15110) instead.

Changes

  • What:
    • scripts/registry-census/ - corpus tooling vendored from Comfy-Org/ComfyUI_ECS_Compat_Check (private, migration-phase instrument slated for archival; provenance in the README): refresh_registry.py (pin the registry snapshot - the target list), fetch_corpus.py (portable tar extraction, --revalidate per-pack tarball-ETag HEAD-check against corpus.lock.json, refetching only drifted packs), paths.py. Pure stdlib; all state under one gitignored, cacheable root (.census/).
    • .github/workflows/ci-weekly-registry-census.yaml - weekly (Mon 06:17 UTC) + workflow_dispatch + self-testing paths-filtered pull_request. Corpus restored from the actions cache, re-pinned, revalidated, re-saved under a lockfile-hash key (unchanged corpus = no duplicate save; drifted corpus = new entry). corpus.lock.json uploaded per run as the measurement's provenance record.
  • Why: the E2E core gate (6 packs) and cloud gate (~90 packs) are deep but narrow; full-registry instruments need every pack's JS available cheaply (~1GB once, then delta-only).

Review Focus

  • Cache save gating: steps.fetch.outcome == 'success' && hashFiles(lockfile) != '' - a failed fetch must not poison the cache, least of all under the empty-hash key.
  • Portable extraction in fetch_corpus.py: no bsdtar-only flags; extension filtering in Python with a staged swap.

🤖 Generated with Claude Code

Vendors the census scanner from ComfyUI_ECS_Compat_Check (pure stdlib,
adapted to a single cacheable CENSUS_ROOT) and runs it weekly: registry
snapshot re-pinned, corpus restored from the actions cache, drifted packs
revalidated per-pack by tarball ETag HEAD-check (--revalidate, added
here), scan table in the run Summary, results + lockfile as artifact,
cache saved under a lockfile-hash key so it updates exactly when a pack
moves. Radar, never a gate: the job fails only on mechanical errors.

Validated locally against the study's corpus: byte-identical census
(4,983 packs, 701/14.1% confirmed-break, 37.3% of downloads); warm scan
~50s; revalidation ~1s per 30 packs at 16 workers.
@benjcooley
benjcooley requested a review from a team August 12, 2026 00:14
@dosubot dosubot Bot added the size:XL This PR changes 500-999 lines, ignoring generated files. label Aug 12, 2026
@coderabbitai

coderabbitai Bot commented Aug 12, 2026 •

Copy link
Copy Markdown
Contributor

Review Change Stack

📝 Walkthrough

Walkthrough

This change adds a registry snapshot refresh tool, a cached corpus fetcher with ETag revalidation, shared census paths, and a scheduled GitHub Actions workflow. It also documents local execution and ignores the generated census directory.

Changes

Registry Census

Layer / File(s) Summary
Snapshot and path foundation
scripts/registry-census/paths.py, scripts/registry-census/refresh_registry.py
Defines census paths and refreshes paginated registry data into a sorted snapshot.
Corpus acquisition and revalidation
scripts/registry-census/fetch_corpus.py
Parses repository URLs, fetches GitHub and GitLab archives, stages source files, records lockfile state, revalidates ETags, and reports drift or retryable failures.
Scheduled census automation
.github/workflows/ci-weekly-registry-census.yaml, scripts/registry-census/README.md, .gitignore
Adds scheduled, manual, and tooling-change workflow triggers. The workflow restores and saves corpus caches and uploads the lockfile. Documentation describes local commands and generated data. .census/ is ignored.

Estimated code review effort: 3 (Moderate) | ~30 minutes

Sequence Diagram(s)

sequenceDiagram
  participant GitHubActions
  participant refresh_registry
  participant fetch_corpus
  participant CensusCache
  GitHubActions->>refresh_registry: refresh registry snapshot
  refresh_registry-->>GitHubActions: write registry snapshot
  GitHubActions->>CensusCache: restore cached corpus
  GitHubActions->>fetch_corpus: revalidate and fetch corpus
  fetch_corpus-->>GitHubActions: write corpus and lockfile
  GitHubActions->>CensusCache: save corpus using lockfile hash
Loading

Important

Pre-merge checks failed

Please resolve all errors before merging. Addressing warnings is optional.

❌ Failed checks (1 inconclusive)

Check name Status Explanation Resolution
End-To-End Regression Coverage For Fixes ❓ Inconclusive The PR title and commit subjects are not provided, so the required bug-fix signal cannot be checked. Provide the PR title and all commit subjects, then reassess the explicit failure conditions.
✅ Passed checks (5 passed)
Check name Status Explanation
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Adr Compliance For Entity/Litegraph Changes ✅ Passed The changed files are limited to the registry-census workflow, scripts, README, and .gitignore; none are under the specified ADR-sensitive paths.
Title check ✅ Passed The title clearly and concisely describes the weekly cached, ETag-revalidated full-registry corpus refresh.
Description check ✅ Passed The description covers the summary, core changes, rationale, dependencies, review focus, and relevant validation details.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch benjcooley/registry-census

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@github-actions

github-actions Bot commented Aug 12, 2026 •

Copy link
Copy Markdown
Contributor

🎭 Playwright: ✅ 1806 passed, 0 failed · 1 flaky

📊 Browser Reports
  • chromium: View Report (✅ 1785 / ❌ 0 / ⚠️ 1 / ⏭️ 5)
  • chromium-2x: View Report (✅ 2 / ❌ 0 / ⚠️ 0 / ⏭️ 0)
  • chromium-0.5x: View Report (✅ 1 / ❌ 0 / ⚠️ 0 / ⏭️ 0)
  • mobile-chrome: View Report (✅ 18 / ❌ 0 / ⚠️ 0 / ⏭️ 0)

📦 Bundle: 8.71 MB gzip ⚪ 0 B

Details

Summary

  • Raw size: 36.8 MB baseline 36.8 MB — ⚪ 0 B
  • Gzip: 8.71 MB baseline 8.71 MB — ⚪ 0 B
  • Brotli: 6.07 MB baseline 6.07 MB — ⚪ 0 B
  • Bundles: 436 current • 436 baseline

Category Glance
Vendor & Third-Party ⚪ 0 B (16.3 MB) · Other ⚪ 0 B (14.1 MB) · Data & Services ⚪ 0 B (3.51 MB) · Graph Workspace ⚪ 0 B (1.36 MB) · Panels & Settings ⚪ 0 B (565 kB) · Utilities & Hooks ⚪ 0 B (550 kB) · + 5 more

App Entry Points — 3.67 kB (baseline 3.67 kB) • ⚪ 0 B

Main entry bundles and manifests

Status: 1 unchanged

Graph Workspace — 1.36 MB (baseline 1.36 MB) • ⚪ 0 B

Graph editor runtime, canvas, workflow orchestration

Status: 3 unchanged

Views & Navigation — 124 kB (baseline 124 kB) • ⚪ 0 B

Top-level views, pages, and routed surfaces

Status: 17 unchanged

Panels & Settings — 565 kB (baseline 565 kB) • ⚪ 0 B

Configuration panels, inspectors, and settings screens

Status: 26 unchanged

User & Accounts — 27 kB (baseline 27 kB) • ⚪ 0 B

Authentication, profile, and account management bundles

Status: 10 unchanged

Editors & Dialogs — 125 kB (baseline 125 kB) • ⚪ 0 B

Modals, dialogs, drawers, and in-app editors

Status: 8 unchanged

UI Components — 67.1 kB (baseline 67.1 kB) • ⚪ 0 B

Reusable component library chunks

Status: 14 unchanged

Data & Services — 3.51 MB (baseline 3.51 MB) • ⚪ 0 B

Stores, services, APIs, and repositories

Status: 17 unchanged

Utilities & Hooks — 550 kB (baseline 550 kB) • ⚪ 0 B

Helpers, composables, and utility bundles

Status: 38 unchanged

Vendor & Third-Party — 16.3 MB (baseline 16.3 MB) • ⚪ 0 B

External libraries and shared vendor chunks

Status: 17 unchanged

Other — 14.1 MB (baseline 14.1 MB) • ⚪ 0 B

Bundles that do not match a named category

Status: 285 unchanged

⚡ Performance Report

canvas-idle: · 60.0 avg FPS · 59.5 P5 FPS ✅ (target: ≥52) · 0ms TBT · 67.0 MB heap
canvas-mouse-sweep: · 60.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 61.7 MB heap
canvas-zoom-sweep: · 60.0 avg FPS · 59.5 P5 FPS ✅ (target: ≥52) · 0ms TBT · 69.8 MB heap
dom-widget-clipping: · 60.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 50.6 MB heap
large-graph-idle: · 60.0 avg FPS · 59.9 P5 FPS ✅ (target: ≥52) · 0ms TBT · 64.2 MB heap
large-graph-pan: · 60.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 64.4 MB heap
large-graph-zoom: · 60.0 avg FPS · 59.9 P5 FPS ✅ (target: ≥52) · 0ms TBT · 66.5 MB heap
minimap-idle: · 60.0 avg FPS · 59.9 P5 FPS ✅ (target: ≥52) · 0ms TBT · 64.1 MB heap
subgraph-dom-widget-clipping: · 60.0 avg FPS · 59.9 P5 FPS ✅ (target: ≥52) · 0ms TBT · 51.2 MB heap
subgraph-idle: · 60.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 67.1 MB heap
subgraph-mouse-sweep: · 60.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 57.9 MB heap
subgraph-transition-enter: · 60.0 avg FPS · 59.5 P5 FPS ✅ (target: ≥52) · 107ms TBT · 91.5 MB heap
viewport-pan-sweep: · 60.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 67.5 MB heap
vue-large-graph-idle: · 59.0 avg FPS · 59.7 P5 FPS ✅ (target: ≥52) · 0ms TBT · 161.6 MB heap
vue-large-graph-pan: · 58.1 avg FPS · 59.5 P5 FPS ✅ (target: ≥52) · 25ms TBT · 159.7 MB heap
workflow-execution: · 60.0 avg FPS · 59.9 P5 FPS ✅ (target: ≥52) · 0ms TBT · 65.4 MB heap

✅ No regressions detected.

All metrics
Metric Baseline PR (median) Δ Sig
canvas-idle: avg frame time 17ms 17ms -0% z=-0.1
canvas-idle: p95 frame time 17ms 17ms +1% —
canvas-idle: layout duration 0ms 0ms +0% —
canvas-idle: style recalc duration 8ms 6ms -28% z=-5.3
canvas-idle: layout count 0 0 +0% —
canvas-idle: style recalc count 9 10 +11% z=-2.1
canvas-idle: task duration 491ms 392ms -20% z=-0.1
canvas-idle: script duration 18ms 13ms -29% z=-5.5
canvas-idle: TBT 0ms 0ms +0% —
canvas-idle: heap used 67.0 MB 67.0 MB +0% —
canvas-idle: DOM nodes 18 20 +11% z=-2.0
canvas-idle: event listeners 4 6 +50% z=-1.2
canvas-mouse-sweep: avg frame time 17ms 17ms -0% z=-0.9
canvas-mouse-sweep: p95 frame time 17ms 17ms +0% —
canvas-mouse-sweep: layout duration 4ms 3ms -26% z=-4.6
canvas-mouse-sweep: style recalc duration 42ms 25ms -39% z=-5.5
canvas-mouse-sweep: layout count 12 12 +0% —
canvas-mouse-sweep: style recalc count 75 72 -4% z=-2.8
canvas-mouse-sweep: task duration 932ms 653ms -30% z=-3.6
canvas-mouse-sweep: script duration 130ms 84ms -35% z=-7.9
canvas-mouse-sweep: TBT 0ms 0ms +0% —
canvas-mouse-sweep: heap used 47.9 MB 61.7 MB +29% —
canvas-mouse-sweep: DOM nodes -280 54 -119% z=-3.2
canvas-mouse-sweep: event listeners -153 4 -103% z=-1.1
canvas-zoom-sweep: avg frame time 17ms 17ms +0% z=0.5
canvas-zoom-sweep: p95 frame time 17ms 17ms +1% —
canvas-zoom-sweep: layout duration 1ms 1ms -5% z=-0.6
canvas-zoom-sweep: style recalc duration 19ms 14ms -29% z=-3.7
canvas-zoom-sweep: layout count 6 6 +0% —
canvas-zoom-sweep: style recalc count 33 32 -5% z=0.5
canvas-zoom-sweep: task duration 438ms 311ms -29% z=-0.7
canvas-zoom-sweep: script duration 28ms 15ms -46% z=-4.0
canvas-zoom-sweep: TBT 0ms 0ms +0% —
canvas-zoom-sweep: heap used 69.9 MB 69.8 MB -0% —
canvas-zoom-sweep: DOM nodes 77 79 +2% z=-0.9
canvas-zoom-sweep: event listeners 19 20 +5% z=-0.7
dom-widget-clipping: avg frame time 17ms 17ms +0% z=-0.2
dom-widget-clipping: p95 frame time 17ms 17ms +0% —
dom-widget-clipping: layout duration 0ms 0ms +0% —
dom-widget-clipping: style recalc duration 7ms 6ms -24% z=-5.4
dom-widget-clipping: layout count 0 0 +0% —
dom-widget-clipping: style recalc count 11 13 +14% z=-1.2
dom-widget-clipping: task duration 376ms 283ms -25% z=-5.0
dom-widget-clipping: script duration 60ms 39ms -35% z=-8.8
dom-widget-clipping: TBT 0ms 0ms +0% —
dom-widget-clipping: heap used 50.7 MB 50.6 MB -0% —
dom-widget-clipping: DOM nodes 18 21 +17% z=-0.8
dom-widget-clipping: event listeners 2 2 +0% variance too high
large-graph-idle: avg frame time 17ms 17ms +0% z=-0.2
large-graph-idle: p95 frame time 17ms 17ms +0% —
large-graph-idle: layout duration 0ms 0ms +0% —
large-graph-idle: style recalc duration 9ms 6ms -31% z=-6.0
large-graph-idle: layout count 0 0 +0% —
large-graph-idle: style recalc count 8 10 +25% z=-5.1
large-graph-idle: task duration 731ms 565ms -23% z=0.4
large-graph-idle: script duration 118ms 68ms -42% z=-3.3
large-graph-idle: TBT 0ms 0ms +0% —
large-graph-idle: heap used 63.3 MB 64.2 MB +1% —
large-graph-idle: DOM nodes -283 -282 -1% z=-338.8
large-graph-idle: event listeners -149 -149 +0% z=-28.7
large-graph-pan: avg frame time 17ms 17ms +0% z=0.3
large-graph-pan: p95 frame time 17ms 17ms -0% —
large-graph-pan: layout duration 0ms 0ms +0% —
large-graph-pan: style recalc duration 14ms 10ms -26% z=-9.2
large-graph-pan: layout count 0 0 +0% —
large-graph-pan: style recalc count 68 69 +1% z=-1.7
large-graph-pan: task duration 1365ms 963ms -29% z=-2.8
large-graph-pan: script duration 448ms 294ms -34% z=-5.8
large-graph-pan: TBT 0ms 0ms +0% —
large-graph-pan: heap used 62.4 MB 64.4 MB +3% —
large-graph-pan: DOM nodes -286 -281 -2% z=-181.8
large-graph-pan: event listeners -151 -148 -2% z=-184.7
large-graph-zoom: avg frame time 17ms 17ms -0% —
large-graph-zoom: p95 frame time 17ms 17ms -1% —
large-graph-zoom: layout duration 8ms 6ms -19% —
large-graph-zoom: style recalc duration 15ms 11ms -26% —
large-graph-zoom: layout count 60 60 +0% —
large-graph-zoom: style recalc count 65 66 +1% —
large-graph-zoom: task duration 1588ms 1140ms -28% —
large-graph-zoom: script duration 548ms 359ms -34% —
large-graph-zoom: TBT 0ms 0ms +0% —
large-graph-zoom: heap used 61.7 MB 66.5 MB +8% —
large-graph-zoom: DOM nodes -288 14 -105% —
large-graph-zoom: event listeners -153 -87 -43% —
minimap-idle: avg frame time 17ms 17ms +0% z=0.1
minimap-idle: p95 frame time 17ms 17ms -1% —
minimap-idle: layout duration 0ms 0ms +0% —
minimap-idle: style recalc duration 7ms 5ms -26% z=-5.1
minimap-idle: layout count 0 0 +0% —
minimap-idle: style recalc count 8 9 +13% z=-0.8
minimap-idle: task duration 773ms 561ms -27% z=0.7
minimap-idle: script duration 126ms 69ms -45% z=-2.9
minimap-idle: TBT 0ms 0ms +0% —
minimap-idle: heap used 63.8 MB 64.1 MB +0% —
minimap-idle: DOM nodes -284 -281 -1% z=-219.1
minimap-idle: event listeners -179 -164 -8% z=-255.3
subgraph-dom-widget-clipping: avg frame time 17ms 17ms -0% z=-0.4
subgraph-dom-widget-clipping: p95 frame time 17ms 17ms -1% —
subgraph-dom-widget-clipping: layout duration 0ms 0ms +0% —
subgraph-dom-widget-clipping: style recalc duration 12ms 7ms -40% z=-5.6
subgraph-dom-widget-clipping: layout count 0 0 +0% —
subgraph-dom-widget-clipping: style recalc count 48 47 -3% z=-2.5
subgraph-dom-widget-clipping: task duration 430ms 327ms -24% z=-2.8
subgraph-dom-widget-clipping: script duration 126ms 92ms -27% z=-5.6
subgraph-dom-widget-clipping: TBT 0ms 0ms +0% —
subgraph-dom-widget-clipping: heap used 51.1 MB 51.2 MB +0% —
subgraph-dom-widget-clipping: DOM nodes 22 19 -14% z=-2.8
subgraph-dom-widget-clipping: event listeners 8 8 +0% z=-1.4
subgraph-idle: avg frame time 17ms 17ms -0% z=0.4
subgraph-idle: p95 frame time 17ms 17ms -0% —
subgraph-idle: layout duration 0ms 0ms +0% —
subgraph-idle: style recalc duration 9ms 6ms -34% z=-5.6
subgraph-idle: layout count 0 0 +0% —
subgraph-idle: style recalc count 10 11 +5% z=-0.6
subgraph-idle: task duration 506ms 390ms -23% z=0.6
subgraph-idle: script duration 17ms 12ms -31% z=-3.2
subgraph-idle: TBT 0ms 0ms +0% —
subgraph-idle: heap used 66.8 MB 67.1 MB +0% —
subgraph-idle: DOM nodes 20 21 +5% z=-0.5
subgraph-idle: event listeners 4 6 +50% variance too high
subgraph-mouse-sweep: avg frame time 17ms 17ms +0% z=0.8
subgraph-mouse-sweep: p95 frame time 17ms 17ms +0% —
subgraph-mouse-sweep: layout duration 5ms 3ms -35% z=-4.8
subgraph-mouse-sweep: style recalc duration 40ms 26ms -34% z=-4.8
subgraph-mouse-sweep: layout count 16 16 +0% —
subgraph-mouse-sweep: style recalc count 77 76 -1% z=-2.1
subgraph-mouse-sweep: task duration 871ms 580ms -33% z=-2.7
subgraph-mouse-sweep: script duration 100ms 60ms -40% z=-6.2
subgraph-mouse-sweep: TBT 0ms 0ms +0% —
subgraph-mouse-sweep: heap used 44.8 MB 57.9 MB +29% —
subgraph-mouse-sweep: DOM nodes -280 62 -122% z=-2.2
subgraph-mouse-sweep: event listeners -153 4 -103% variance too high
subgraph-transition-enter: avg frame time 17ms 17ms +0% —
subgraph-transition-enter: p95 frame time 17ms 17ms +1% —
subgraph-transition-enter: layout duration 13ms 8ms -36% —
subgraph-transition-enter: style recalc duration 30ms 25ms -19% —
subgraph-transition-enter: layout count 14 15 +7% —
subgraph-transition-enter: style recalc count 18 19 +6% —
subgraph-transition-enter: task duration 953ms 717ms -25% —
subgraph-transition-enter: script duration 36ms 27ms -25% —
subgraph-transition-enter: TBT 146ms 107ms -27% —
subgraph-transition-enter: heap used 73.0 MB 91.5 MB +25% —
subgraph-transition-enter: DOM nodes 13673 13673 +0% —
subgraph-transition-enter: event listeners 2375 2373 -0% —
viewport-pan-sweep: avg frame time 17ms 17ms +0% —
viewport-pan-sweep: p95 frame time 17ms 17ms +0% —
viewport-pan-sweep: layout duration 0ms 0ms +0% —
viewport-pan-sweep: style recalc duration 39ms 29ms -24% —
viewport-pan-sweep: layout count 0 0 +0% —
viewport-pan-sweep: style recalc count 249 249 +0% —
viewport-pan-sweep: task duration 4930ms 3464ms -30% —
viewport-pan-sweep: script duration 1490ms 983ms -34% —
viewport-pan-sweep: TBT 0ms 0ms +0% —
viewport-pan-sweep: heap used 65.9 MB 67.5 MB +2% —
viewport-pan-sweep: DOM nodes -282 -282 -0% —
viewport-pan-sweep: event listeners -133 -133 +0% —
vue-large-graph-idle: avg frame time 18ms 17ms -5% —
vue-large-graph-idle: p95 frame time 17ms 17ms -0% —
vue-large-graph-idle: layout duration 0ms 0ms +0% —
vue-large-graph-idle: style recalc duration 0ms 0ms +0% —
vue-large-graph-idle: layout count 0 0 +0% —
vue-large-graph-idle: style recalc count 0 0 +0% —
vue-large-graph-idle: task duration 17394ms 11888ms -32% —
vue-large-graph-idle: script duration 599ms 430ms -28% —
vue-large-graph-idle: TBT 0ms 0ms +0% —
vue-large-graph-idle: heap used 158.0 MB 161.6 MB +2% —
vue-large-graph-idle: DOM nodes -8312 -8312 +0% —
vue-large-graph-idle: event listeners -16387 -16390 +0% —
vue-large-graph-pan: avg frame time 18ms 17ms -3% —
vue-large-graph-pan: p95 frame time 17ms 17ms +0% —
vue-large-graph-pan: layout duration 0ms 0ms +0% —
vue-large-graph-pan: style recalc duration 20ms 13ms -36% —
vue-large-graph-pan: layout count 0 0 +0% —
vue-large-graph-pan: style recalc count 150 74 -51% —
vue-large-graph-pan: task duration 21209ms 14892ms -30% —
vue-large-graph-pan: script duration 958ms 717ms -25% —
vue-large-graph-pan: TBT 323ms 25ms -92% —
vue-large-graph-pan: heap used 161.2 MB 159.7 MB -1% —
vue-large-graph-pan: DOM nodes -8312 -8312 +0% —
vue-large-graph-pan: event listeners -16383 -16388 +0% —
workflow-execution: avg frame time 17ms 17ms +0% z=0.6
workflow-execution: p95 frame time 17ms 17ms -1% —
workflow-execution: layout duration 1ms 1ms +4% z=-5.5
workflow-execution: style recalc duration 20ms 14ms -32% z=-4.8
workflow-execution: layout count 3 3 +0% z=-3.6
workflow-execution: style recalc count 13 14 +8% z=-1.9
workflow-execution: task duration 120ms 82ms -32% z=-3.8
workflow-execution: script duration 11ms 7ms -34% z=-7.5
workflow-execution: TBT 0ms 0ms +0% —
workflow-execution: heap used 65.5 MB 65.4 MB -0% —
workflow-execution: DOM nodes 123 126 +2% z=-5.0
workflow-execution: event listeners 97 98 +1% z=10.6
Historical variance (last 15 runs)
Metric μ σ CV
canvas-idle: avg frame time 17ms 0ms 0.0%
canvas-idle: layout duration 0ms 0ms 0.0%
canvas-idle: style recalc duration 11ms 1ms 8.2%
canvas-idle: layout count 0 0 0.0%
canvas-idle: style recalc count 11 1 5.0%
canvas-idle: task duration 395ms 31ms 7.9%
canvas-idle: script duration 25ms 2ms 8.8%
canvas-idle: TBT 0ms 0ms 0.0%
canvas-idle: DOM nodes 23 1 5.6%
canvas-idle: event listeners 12 5 40.9%
canvas-mouse-sweep: avg frame time 17ms 0ms 0.0%
canvas-mouse-sweep: layout duration 4ms 0ms 5.4%
canvas-mouse-sweep: style recalc duration 43ms 3ms 7.4%
canvas-mouse-sweep: layout count 12 0 0.0%
canvas-mouse-sweep: style recalc count 79 2 3.0%
canvas-mouse-sweep: task duration 865ms 58ms 6.7%
canvas-mouse-sweep: script duration 136ms 6ms 4.8%
canvas-mouse-sweep: TBT 0ms 0ms 0.0%
canvas-mouse-sweep: DOM nodes 62 3 4.2%
canvas-mouse-sweep: event listeners 8 4 49.4%
canvas-zoom-sweep: avg frame time 17ms 0ms 0.0%
canvas-zoom-sweep: layout duration 1ms 0ms 7.0%
canvas-zoom-sweep: style recalc duration 19ms 2ms 8.0%
canvas-zoom-sweep: layout count 6 0 0.0%
canvas-zoom-sweep: style recalc count 31 0 1.5%
canvas-zoom-sweep: task duration 327ms 23ms 7.1%
canvas-zoom-sweep: script duration 27ms 3ms 11.1%
canvas-zoom-sweep: TBT 0ms 0ms 0.0%
canvas-zoom-sweep: DOM nodes 79 1 1.0%
canvas-zoom-sweep: event listeners 24 5 21.8%
dom-widget-clipping: avg frame time 17ms 0ms 0.0%
dom-widget-clipping: layout duration 0ms 0ms 0.0%
dom-widget-clipping: style recalc duration 10ms 1ms 8.0%
dom-widget-clipping: layout count 0 0 0.0%
dom-widget-clipping: style recalc count 13 0 3.8%
dom-widget-clipping: task duration 365ms 16ms 4.5%
dom-widget-clipping: script duration 68ms 3ms 4.8%
dom-widget-clipping: TBT 0ms 0ms 0.0%
dom-widget-clipping: DOM nodes 22 1 6.4%
dom-widget-clipping: event listeners 8 6 81.2%
large-graph-idle: avg frame time 17ms 0ms 0.0%
large-graph-idle: layout duration 0ms 0ms 0.0%
large-graph-idle: style recalc duration 12ms 1ms 8.6%
large-graph-idle: layout count 0 0 0.0%
large-graph-idle: style recalc count 12 0 2.7%
large-graph-idle: task duration 542ms 54ms 10.0%
large-graph-idle: script duration 102ms 11ms 10.3%
large-graph-idle: TBT 0ms 0ms 0.0%
large-graph-idle: DOM nodes 25 1 3.7%
large-graph-idle: event listeners 26 6 23.2%
large-graph-pan: avg frame time 17ms 0ms 0.0%
large-graph-pan: layout duration 0ms 0ms 0.0%
large-graph-pan: style recalc duration 17ms 1ms 4.6%
large-graph-pan: layout count 0 0 0.0%
large-graph-pan: style recalc count 70 1 0.9%
large-graph-pan: task duration 1082ms 43ms 4.0%
large-graph-pan: script duration 408ms 20ms 4.8%
large-graph-pan: TBT 0ms 0ms 0.0%
large-graph-pan: DOM nodes 19 2 8.7%
large-graph-pan: event listeners 5 1 16.8%
minimap-idle: avg frame time 17ms 0ms 0.0%
minimap-idle: layout duration 0ms 0ms 0.0%
minimap-idle: style recalc duration 10ms 1ms 8.6%
minimap-idle: layout count 0 0 0.0%
minimap-idle: style recalc count 10 1 7.1%
minimap-idle: task duration 527ms 47ms 9.0%
minimap-idle: script duration 98ms 10ms 10.1%
minimap-idle: TBT 0ms 0ms 0.0%
minimap-idle: DOM nodes 19 1 7.1%
minimap-idle: event listeners 5 1 14.4%
subgraph-dom-widget-clipping: avg frame time 17ms 0ms 0.0%
subgraph-dom-widget-clipping: layout duration 0ms 0ms 0.0%
subgraph-dom-widget-clipping: style recalc duration 13ms 1ms 7.4%
subgraph-dom-widget-clipping: layout count 0 0 0.0%
subgraph-dom-widget-clipping: style recalc count 48 1 1.2%
subgraph-dom-widget-clipping: task duration 378ms 18ms 4.9%
subgraph-dom-widget-clipping: script duration 128ms 6ms 4.9%
subgraph-dom-widget-clipping: TBT 0ms 0ms 0.0%
subgraph-dom-widget-clipping: DOM nodes 22 1 5.0%
subgraph-dom-widget-clipping: event listeners 16 6 36.0%
subgraph-idle: avg frame time 17ms 0ms 0.0%
subgraph-idle: layout duration 0ms 0ms 0.0%
subgraph-idle: style recalc duration 10ms 1ms 7.5%
subgraph-idle: layout count 0 0 0.0%
subgraph-idle: style recalc count 11 1 6.0%
subgraph-idle: task duration 370ms 31ms 8.5%
subgraph-idle: script duration 20ms 3ms 13.2%
subgraph-idle: TBT 0ms 0ms 0.0%
subgraph-idle: DOM nodes 22 1 6.9%
subgraph-idle: event listeners 10 7 64.5%
subgraph-mouse-sweep: avg frame time 17ms 0ms 0.0%
subgraph-mouse-sweep: layout duration 5ms 0ms 6.8%
subgraph-mouse-sweep: style recalc duration 42ms 3ms 7.8%
subgraph-mouse-sweep: layout count 16 0 0.0%
subgraph-mouse-sweep: style recalc count 80 2 2.4%
subgraph-mouse-sweep: task duration 766ms 69ms 9.0%
subgraph-mouse-sweep: script duration 101ms 7ms 6.5%
subgraph-mouse-sweep: TBT 0ms 0ms 0.0%
subgraph-mouse-sweep: DOM nodes 67 2 3.3%
subgraph-mouse-sweep: event listeners 8 4 52.6%
workflow-execution: avg frame time 17ms 0ms 0.0%
workflow-execution: layout duration 2ms 0ms 9.4%
workflow-execution: style recalc duration 24ms 2ms 9.1%
workflow-execution: layout count 5 1 11.0%
workflow-execution: style recalc count 18 2 11.5%
workflow-execution: task duration 123ms 11ms 8.8%
workflow-execution: script duration 29ms 3ms 10.2%
workflow-execution: TBT 0ms 0ms 0.0%
workflow-execution: DOM nodes 161 7 4.4%
workflow-execution: event listeners 52 4 8.4%
Trend (last 15 commits on main)
Metric Trend Dir Latest
canvas-idle: avg frame time ▆▃▆▁▆▃▆█▆▆▄▃▃▄▃ ➡️ 17ms
canvas-idle: p95 frame time ➡️ NaNms
canvas-idle: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
canvas-idle: style recalc duration ▇▇▆▆▃█▄▃▄▃▇▄▁▆▇ ➡️ 11ms
canvas-idle: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
canvas-idle: style recalc count █▃▅▂▅▆▃▁▂▁▂▅▆▅▆ ➡️ 12
canvas-idle: task duration ▃▃▃▆▂▃▃▅▆▂█▃▁▃▃ ➡️ 391ms
canvas-idle: script duration ▄▃▅▇▂▅▃▆▇▅█▄▁▅▆ ➡️ 27ms
canvas-idle: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
canvas-idle: heap used ➡️ NaN MB
canvas-idle: DOM nodes █▇▆▅▃▇▃▁▂▂▅▆▆▆▇ ➡️ 24
canvas-idle: event listeners ▅█▅▄▁▅▁▁▁▄▅▅▁▅▄ 📉 11
canvas-mouse-sweep: avg frame time ▆█▆▃▁▃▁▆▆▁▃▆▆▃▃ ➡️ 17ms
canvas-mouse-sweep: p95 frame time ➡️ NaNms
canvas-mouse-sweep: layout duration ▁▃▂▄▁▂▁▃▆▂█▇▆▄▃ ➡️ 4ms
canvas-mouse-sweep: style recalc duration ▄▄▂▄▁▂▃▃▅▄█▆▂▄▄ ➡️ 43ms
canvas-mouse-sweep: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 12
canvas-mouse-sweep: style recalc count █▅▄▃▂▂▁▄▄▅▆▅▂▇▄ ➡️ 79
canvas-mouse-sweep: task duration █▆▄▂▂▃▂▄▄▅█▆▁▆▄ ➡️ 868ms
canvas-mouse-sweep: script duration ▄▅▄▆▄▆▆▆▅▅█▆▁▅▆ ➡️ 139ms
canvas-mouse-sweep: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
canvas-mouse-sweep: heap used ➡️ NaN MB
canvas-mouse-sweep: DOM nodes █▅▃▃▁▂▂▃▂▄▆▅▃▅▅ ➡️ 64
canvas-mouse-sweep: event listeners █▁▁▁▁▁▇▁▁▁██▇▁█ 📈 13
canvas-zoom-sweep: avg frame time ▅▅█▄▅▁▁▁▅▁▁▅▄▅▁ ➡️ 17ms
canvas-zoom-sweep: p95 frame time ➡️ NaNms
canvas-zoom-sweep: layout duration ▆▅▅▄▁▁█▅▃▅▇▆▁▂▆ ➡️ 1ms
canvas-zoom-sweep: style recalc duration ▆▅▄▆▅▃█▆▇▅▇▄▁▃▅ ➡️ 20ms
canvas-zoom-sweep: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 6
canvas-zoom-sweep: style recalc count ▁▁▃▄▆▃▆█▄▄▆▁▆▁▆ ➡️ 32
canvas-zoom-sweep: task duration ▄▂▁▇▂▂▄▅▆▃█▄▁▁▅ ➡️ 338ms
canvas-zoom-sweep: script duration ▃▃▂▇▂▂▅▇▆▅█▄▁▂▆ ➡️ 30ms
canvas-zoom-sweep: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
canvas-zoom-sweep: heap used ➡️ NaN MB
canvas-zoom-sweep: DOM nodes ▄▃▁▅█▁▃▆▄▅▅▃▃▄▃ ➡️ 79
canvas-zoom-sweep: event listeners ▁▁▂▅█▂▁▅▁▅▅▄▁▅▁ ➡️ 19
dom-widget-clipping: avg frame time ▂▄▅▅▂▄█▇▅▇▇▅▅▁▇ ➡️ 17ms
dom-widget-clipping: p95 frame time ➡️ NaNms
dom-widget-clipping: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
dom-widget-clipping: style recalc duration ▆▆▂▆▄▃██▄▁▆▇▆▃▅ ➡️ 10ms
dom-widget-clipping: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
dom-widget-clipping: style recalc count ▇█▅█▅▄█▇▇▁▇▄▇▂▅ ➡️ 13
dom-widget-clipping: task duration ▃▃▁▅▄▃▅▆▅▂▇█▁▅▅ ➡️ 371ms
dom-widget-clipping: script duration ▅▄▄▆▆▅▇▇▆▃█▇▁▇▇ ➡️ 71ms
dom-widget-clipping: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
dom-widget-clipping: heap used ➡️ NaN MB
dom-widget-clipping: DOM nodes ▇▇▄▇▅▄█▇▅▁▅▄▇▃▄ ➡️ 21
dom-widget-clipping: event listeners ▅▅▅▅▁▅██▁▁▁▁█▁▁ 📉 2
large-graph-idle: avg frame time ▅▅▅▅▅▂▁▂▄▅▄▂▂▅█ ➡️ 17ms
large-graph-idle: p95 frame time ➡️ NaNms
large-graph-idle: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
large-graph-idle: style recalc duration ▅▅▅▆▄▅▃▄▅▅▆█▁▄▆ ➡️ 13ms
large-graph-idle: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
large-graph-idle: style recalc count █▆█▃▃▁▃▆▃▆▆▃▆██ ➡️ 12
large-graph-idle: task duration ▂▃▂▆▂▃▃▇▅▃██▁▂▅ ➡️ 569ms
large-graph-idle: script duration ▄▅▄▆▄▅▅▇▆▅█▆▁▃▆ ➡️ 110ms
large-graph-idle: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
large-graph-idle: heap used ➡️ NaN MB
large-graph-idle: DOM nodes ▆█▅▂▅▃▁▂▃▅▅▆▂▆▅ ➡️ 25
large-graph-idle: event listeners ███▇██▄▁▄▇▇█▂█▇ ➡️ 29
large-graph-pan: avg frame time ▆▃▃▆█▃▁█▆▆▆▆█▁▆ ➡️ 17ms
large-graph-pan: p95 frame time ➡️ NaNms
large-graph-pan: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
large-graph-pan: style recalc duration ▃▂▄▄▁▅▂▂▁▄▄█▃▁▂ ➡️ 17ms
large-graph-pan: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
large-graph-pan: style recalc count ▆▃█▂▃▂▂▂▁▇▅▃█▆▃ ➡️ 69
large-graph-pan: task duration ▄▃▄▆▄▄▄▆▄▄█▆▁▂▅ ➡️ 1100ms
large-graph-pan: script duration ▅▄▅▆▆▅▄▆▄▅█▄▁▄▅ ➡️ 413ms
large-graph-pan: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
large-graph-pan: heap used ➡️ NaN MB
large-graph-pan: DOM nodes ▅▃▆▂▄▁▃▁▁▅▁▂█▅▂ ➡️ 18
large-graph-pan: event listeners █▆█▁▁▆▁▁▃▆▁▃██▃ ➡️ 5
minimap-idle: avg frame time ▃▆▆▃█▁█▆▆▃▃▆█▆█ ➡️ 17ms
minimap-idle: p95 frame time ➡️ NaNms
minimap-idle: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
minimap-idle: style recalc duration ▄█▁█▅▅█▅▅▃▅▁▁▄▆ ➡️ 10ms
minimap-idle: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
minimap-idle: style recalc count ▃▅▂▄█▃▆▁▂▅▂▁▅▆▃ ➡️ 9
minimap-idle: task duration ▃▄▁▅▁▃▄▅▇▃█▅▁▁▅ ➡️ 547ms
minimap-idle: script duration ▄▆▃▇▃▅▆▆▇▅█▅▁▃▆ ➡️ 106ms
minimap-idle: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
minimap-idle: heap used ➡️ NaN MB
minimap-idle: DOM nodes ▃▅▂▄█▃▆▁▂▅▂▁▅▆▃ ➡️ 19
minimap-idle: event listeners ▃▃▆▁▁▁▃▁▁▆▁▃█▆▁ ➡️ 4
subgraph-dom-widget-clipping: avg frame time ▅▄▄▄▄▄█▄▄▄▃▁▆▃▃ ➡️ 17ms
subgraph-dom-widget-clipping: p95 frame time ➡️ NaNms
subgraph-dom-widget-clipping: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
subgraph-dom-widget-clipping: style recalc duration ▂▄▃▅▅▃▂▅▇▃▄█▁▄▆ ➡️ 14ms
subgraph-dom-widget-clipping: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
subgraph-dom-widget-clipping: style recalc count ▇█▆▃▆▃▁▆█▇▃▆▇█▅ ➡️ 48
subgraph-dom-widget-clipping: task duration ▂▃▃▆▅▅▂▅█▂▆█▁▂▇ ➡️ 398ms
subgraph-dom-widget-clipping: script duration ▃▃▃▄▅▅▂▄█▂▅▇▁▂▅ ➡️ 131ms
subgraph-dom-widget-clipping: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
subgraph-dom-widget-clipping: heap used ➡️ NaN MB
subgraph-dom-widget-clipping: DOM nodes ▅▇▅▂▅▂▁▅▅▅▁▇▅█▄ ➡️ 22
subgraph-dom-widget-clipping: event listeners ▅▅▅▂▅▁▅██▁▁█▅█▅ 📈 16
subgraph-idle: avg frame time ▆▆█▁▆▃▆▆▆▃▆▁▃▆█ ➡️ 17ms
subgraph-idle: p95 frame time ➡️ NaNms
subgraph-idle: layout duration ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
subgraph-idle: style recalc duration ▁▇▃▆▂▄▂▃▃▆▆▄▃▇█ ➡️ 12ms
subgraph-idle: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0
subgraph-idle: style recalc count ▃▆▃▃▂▅▁▂▁▆▃▃██▇ ➡️ 12
subgraph-idle: task duration ▁▃▁▇▁▁▃▆▅▂█▅▁▁▄ ➡️ 378ms
subgraph-idle: script duration ▁▃▂▇▁▂▃▇▆▂█▅▂▁▅ ➡️ 22ms
subgraph-idle: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
subgraph-idle: heap used ➡️ NaN MB
subgraph-idle: DOM nodes ▃▅▃▂▁▄▁▂▁▅▃▂▇█▇ ➡️ 24
subgraph-idle: event listeners ▁▅▁▁▁▁▁▁▁▅▄▁███ 📈 21
subgraph-mouse-sweep: avg frame time ▅▄▁▃▃▄▆▄▆▃▃█▁▃▃ ➡️ 17ms
subgraph-mouse-sweep: p95 frame time ➡️ NaNms
subgraph-mouse-sweep: layout duration ▁▄▄▄▃▃▅▅▅▂█▇▂▃▆ ➡️ 5ms
subgraph-mouse-sweep: style recalc duration ▃▂▄▅▂▃▄▅█▃█▆▁▂▅ ➡️ 43ms
subgraph-mouse-sweep: layout count ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 16
subgraph-mouse-sweep: style recalc count ▅▂▅▅▁▄▃▅█▅▆▄▂▄▅ ➡️ 81
subgraph-mouse-sweep: task duration ▃▂▄▅▂▄▄▅▇▄█▆▁▃▅ ➡️ 785ms
subgraph-mouse-sweep: script duration ▄▅▄▇▅▅▆▇▆▅██▁▄▆ ➡️ 105ms
subgraph-mouse-sweep: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
subgraph-mouse-sweep: heap used ➡️ NaN MB
subgraph-mouse-sweep: DOM nodes ▅▁▄▅▁▄▃▃█▅▅▄▂▅▃ ➡️ 66
subgraph-mouse-sweep: event listeners ▇▁▂▇▁▂▂▂█▇▂▂▇▇▂ 📈 5
workflow-execution: avg frame time ▆▆▆▄▆▆▃▄▁▄█▆▅▄▆ ➡️ 17ms
workflow-execution: p95 frame time ➡️ NaNms
workflow-execution: layout duration ▁▆▁▃▂▄▃▂▃▃▅█▄▂▅ ➡️ 2ms
workflow-execution: style recalc duration ▃▇▅▇▁▅▆▇█▁██▂▄▆ ➡️ 25ms
workflow-execution: layout count ▁█▂▃▂▃▃▁▃▃▄▃▂▃▂ ➡️ 5
workflow-execution: style recalc count ▃█▅▇▁▄▅▆▅▅▅▅▄▄▂ ➡️ 15
workflow-execution: task duration ▂▅▄▅▁▄▆▆▆▁▇█▁▃▃ ➡️ 120ms
workflow-execution: script duration ▄▃▄▄▃▅▄▅▆▂▇█▁▃▄ ➡️ 29ms
workflow-execution: TBT ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄ ➡️ 0ms
workflow-execution: heap used ➡️ NaN MB
workflow-execution: DOM nodes ▂█▃▆▁▄▃▅▃█▃▃▄▃▁ ➡️ 152
workflow-execution: event listeners ▅███▁▅███▁██▅█▅ ➡️ 49
Raw data
{
  "timestamp": "2026-08-12T04:41:01.973Z",
  "gitSha": "764a378d87f749bc876cc11e72e18224f360146d",
  "branch": "benjcooley/registry-census",
  "measurements": [
    {
      "name": "canvas-idle",
      "durationMs": 1990.9289999999942,
      "styleRecalcs": 10,
      "styleRecalcDurationMs": 6.109999999999999,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 383.61,
      "heapDeltaBytes": 5801280,
      "heapUsedBytes": 70216604,
      "domNodes": 20,
      "jsHeapTotalBytes": 24641536,
      "scriptDurationMs": 12.942,
      "eventListeners": 6,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.66333333333335,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "canvas-idle",
      "durationMs": 2014.4649999999729,
      "styleRecalcs": 10,
      "styleRecalcDurationMs": 6.101999999999999,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 400.16300000000007,
      "heapDeltaBytes": 5837664,
      "heapUsedBytes": 70206948,
      "domNodes": 20,
      "jsHeapTotalBytes": 24903680,
      "scriptDurationMs": 12.863999999999999,
      "eventListeners": 6,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.66999999999998,
      "p95FrameDurationMs": 16.799999999999272
    },
    {
      "name": "canvas-mouse-sweep",
      "durationMs": 1751.940999999988,
      "styleRecalcs": 73,
      "styleRecalcDurationMs": 26.704999999999995,
      "layouts": 12,
      "layoutDurationMs": 2.979,
      "taskDurationMs": 689.705,
      "heapDeltaBytes": 159452,
      "heapUsedBytes": 64701884,
      "domNodes": 55,
      "jsHeapTotalBytes": 24641536,
      "scriptDurationMs": 88.908,
      "eventListeners": 4,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "canvas-mouse-sweep",
      "durationMs": 1702.538000000004,
      "styleRecalcs": 71,
      "styleRecalcDurationMs": 23.736,
      "layouts": 12,
      "layoutDurationMs": 2.4499999999999997,
      "taskDurationMs": 616.5500000000001,
      "heapDeltaBytes": 185880,
      "heapUsedBytes": 64604944,
      "domNodes": 53,
      "jsHeapTotalBytes": 25427968,
      "scriptDurationMs": 79.556,
      "eventListeners": 4,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.66333333333332,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "canvas-zoom-sweep",
      "durationMs": 1685.0190000000111,
      "styleRecalcs": 32,
      "styleRecalcDurationMs": 13.356,
      "layouts": 6,
      "layoutDurationMs": 0.573,
      "taskDurationMs": 314.14200000000005,
      "heapDeltaBytes": 8771116,
      "heapUsedBytes": 73191704,
      "domNodes": 79,
      "jsHeapTotalBytes": 24379392,
      "scriptDurationMs": 14.632000000000001,
      "eventListeners": 19,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "canvas-zoom-sweep",
      "durationMs": 1740.3400000000602,
      "styleRecalcs": 31,
      "styleRecalcDurationMs": 13.687,
      "layouts": 6,
      "layoutDurationMs": 0.66,
      "taskDurationMs": 307.60200000000003,
      "heapDeltaBytes": 8759380,
      "heapUsedBytes": 73250328,
      "domNodes": 78,
      "jsHeapTotalBytes": 24641536,
      "scriptDurationMs": 15.391,
      "eventListeners": 21,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "dom-widget-clipping",
      "durationMs": 454.371999999978,
      "styleRecalcs": 13,
      "styleRecalcDurationMs": 6.091000000000001,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 280.32599999999996,
      "heapDeltaBytes": -11217692,
      "heapUsedBytes": 52888456,
      "domNodes": 22,
      "jsHeapTotalBytes": 25952256,
      "scriptDurationMs": 37.900000000000006,
      "eventListeners": 2,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666682,
      "p95FrameDurationMs": 16.799999999999727
    },
    {
      "name": "dom-widget-clipping",
      "durationMs": 496.77900000000363,
      "styleRecalcs": 12,
      "styleRecalcDurationMs": 5.0470000000000015,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 285.339,
      "heapDeltaBytes": -11353712,
      "heapUsedBytes": 53159648,
      "domNodes": 20,
      "jsHeapTotalBytes": 25165824,
      "scriptDurationMs": 40.667,
      "eventListeners": 2,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.66333333333332,
      "p95FrameDurationMs": 16.700000000000273
    },
    {
      "name": "large-graph-idle",
      "durationMs": 2024.182000000053,
      "styleRecalcs": 10,
      "styleRecalcDurationMs": 5.786999999999999,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 546.092,
      "heapDeltaBytes": 7376800,
      "heapUsedBytes": 67254328,
      "domNodes": -282,
      "jsHeapTotalBytes": 2985984,
      "scriptDurationMs": 65.054,
      "eventListeners": -149,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "large-graph-idle",
      "durationMs": 2037.399999999991,
      "styleRecalcs": 10,
      "styleRecalcDurationMs": 6.1,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 583.2230000000001,
      "heapDeltaBytes": 7331100,
      "heapUsedBytes": 67339836,
      "domNodes": -281,
      "jsHeapTotalBytes": 2461696,
      "scriptDurationMs": 71.427,
      "eventListeners": -149,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "large-graph-pan",
      "durationMs": 2099.4610000000193,
      "styleRecalcs": 69,
      "styleRecalcDurationMs": 10.546000000000001,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 978.982,
      "heapDeltaBytes": 4495852,
      "heapUsedBytes": 66983556,
      "domNodes": -280,
      "jsHeapTotalBytes": 4489216,
      "scriptDurationMs": 296.374,
      "eventListeners": -149,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "large-graph-pan",
      "durationMs": 2096.806000000015,
      "styleRecalcs": 68,
      "styleRecalcDurationMs": 9.323,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 946.626,
      "heapDeltaBytes": 4942596,
      "heapUsedBytes": 68015948,
      "domNodes": -282,
      "jsHeapTotalBytes": 3964928,
      "scriptDurationMs": 292.24899999999997,
      "eventListeners": -147,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "large-graph-zoom",
      "durationMs": 3104.241000000002,
      "styleRecalcs": 66,
      "styleRecalcDurationMs": 11.279000000000002,
      "layouts": 60,
      "layoutDurationMs": 6.2090000000000005,
      "taskDurationMs": 1149.6339999999998,
      "heapDeltaBytes": -8362704,
      "heapUsedBytes": 53923640,
      "domNodes": 14,
      "jsHeapTotalBytes": 5607424,
      "scriptDurationMs": 356.317,
      "eventListeners": -181,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.66333333333332,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "large-graph-zoom",
      "durationMs": 3069.4599999999355,
      "styleRecalcs": 65,
      "styleRecalcDurationMs": 11.015999999999998,
      "layouts": 60,
      "layoutDurationMs": 6.3340000000000005,
      "taskDurationMs": 1130.941,
      "heapDeltaBytes": 22777212,
      "heapUsedBytes": 85556104,
      "domNodes": 14,
      "jsHeapTotalBytes": 7864320,
      "scriptDurationMs": 362.665,
      "eventListeners": 8,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.66333333333332,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "minimap-idle",
      "durationMs": 2004.8320000000217,
      "styleRecalcs": 9,
      "styleRecalcDurationMs": 5.332,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 556.614,
      "heapDeltaBytes": 5142496,
      "heapUsedBytes": 66184984,
      "domNodes": -281,
      "jsHeapTotalBytes": 4296704,
      "scriptDurationMs": 70.33,
      "eventListeners": -179,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "minimap-idle",
      "durationMs": 2020.232999999962,
      "styleRecalcs": 9,
      "styleRecalcDurationMs": 5.358000000000001,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 564.4449999999999,
      "heapDeltaBytes": 6764612,
      "heapUsedBytes": 68175964,
      "domNodes": -280,
      "jsHeapTotalBytes": 3772416,
      "scriptDurationMs": 68.58900000000001,
      "eventListeners": -149,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "subgraph-dom-widget-clipping",
      "durationMs": 534.3260000000214,
      "styleRecalcs": 46,
      "styleRecalcDurationMs": 7.152000000000002,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 337.486,
      "heapDeltaBytes": -10578160,
      "heapUsedBytes": 53930612,
      "domNodes": 18,
      "jsHeapTotalBytes": 25690112,
      "scriptDurationMs": 93.931,
      "eventListeners": 8,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.663333333333338,
      "p95FrameDurationMs": 16.700000000000273
    },
    {
      "name": "subgraph-dom-widget-clipping",
      "durationMs": 527.1240000000716,
      "styleRecalcs": 47,
      "styleRecalcDurationMs": 7.693000000000002,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 316.515,
      "heapDeltaBytes": -10997352,
      "heapUsedBytes": 53482184,
      "domNodes": 20,
      "jsHeapTotalBytes": 25952256,
      "scriptDurationMs": 91.044,
      "eventListeners": 8,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "subgraph-idle",
      "durationMs": 1996.530000000007,
      "styleRecalcs": 10,
      "styleRecalcDurationMs": 5.649999999999999,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 396.02000000000004,
      "heapDeltaBytes": 5820924,
      "heapUsedBytes": 70381496,
      "domNodes": 20,
      "jsHeapTotalBytes": 24903680,
      "scriptDurationMs": 11.479,
      "eventListeners": 6,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "subgraph-idle",
      "durationMs": 2020.4779999999687,
      "styleRecalcs": 11,
      "styleRecalcDurationMs": 6.458,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 384.289,
      "heapDeltaBytes": 5934936,
      "heapUsedBytes": 70419660,
      "domNodes": 22,
      "jsHeapTotalBytes": 24641536,
      "scriptDurationMs": 12.174000000000001,
      "eventListeners": 6,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "subgraph-mouse-sweep",
      "durationMs": 1676.0949999999752,
      "styleRecalcs": 76,
      "styleRecalcDurationMs": 25.928,
      "layouts": 16,
      "layoutDurationMs": 3.11,
      "taskDurationMs": 570.1820000000001,
      "heapDeltaBytes": -3722732,
      "heapUsedBytes": 60701100,
      "domNodes": 62,
      "jsHeapTotalBytes": 24641536,
      "scriptDurationMs": 59.413999999999994,
      "eventListeners": 4,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.670000000000012,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "subgraph-mouse-sweep",
      "durationMs": 1675.5589999999643,
      "styleRecalcs": 76,
      "styleRecalcDurationMs": 26.777,
      "layouts": 16,
      "layoutDurationMs": 3.19,
      "taskDurationMs": 590.425,
      "heapDeltaBytes": -3875800,
      "heapUsedBytes": 60816296,
      "domNodes": 62,
      "jsHeapTotalBytes": 24641536,
      "scriptDurationMs": 60.92900000000001,
      "eventListeners": 4,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "subgraph-transition-enter",
      "durationMs": 932.9500000000053,
      "styleRecalcs": 19,
      "styleRecalcDurationMs": 24.562999999999995,
      "layouts": 15,
      "layoutDurationMs": 8.148,
      "taskDurationMs": 716.739,
      "heapDeltaBytes": 28601816,
      "heapUsedBytes": 95983216,
      "domNodes": 13673,
      "jsHeapTotalBytes": 16777216,
      "scriptDurationMs": 26.678999999999995,
      "eventListeners": 2373,
      "totalBlockingTimeMs": 107,
      "frameDurationMs": 16.66333333333332,
      "p95FrameDurationMs": 16.800000000000182
    },
    {
      "name": "viewport-pan-sweep",
      "durationMs": 8111.953999999969,
      "styleRecalcs": 249,
      "styleRecalcDurationMs": 30.743,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 3496.4719999999998,
      "heapDeltaBytes": 8971152,
      "heapUsedBytes": 72025752,
      "domNodes": -281,
      "jsHeapTotalBytes": 8683520,
      "scriptDurationMs": 991.347,
      "eventListeners": -133,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "viewport-pan-sweep",
      "durationMs": 8112.972000000013,
      "styleRecalcs": 249,
      "styleRecalcDurationMs": 27.836999999999996,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 3432.459,
      "heapDeltaBytes": 9953316,
      "heapUsedBytes": 69506132,
      "domNodes": -282,
      "jsHeapTotalBytes": 3964928,
      "scriptDurationMs": 973.8469999999999,
      "eventListeners": -133,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.799999999999272
    },
    {
      "name": "vue-large-graph-idle",
      "durationMs": 12280.342000000019,
      "styleRecalcs": 0,
      "styleRecalcDurationMs": 0,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 12254.829,
      "heapDeltaBytes": -34635532,
      "heapUsedBytes": 171833848,
      "domNodes": -8312,
      "jsHeapTotalBytes": -11476992,
      "scriptDurationMs": 461.966,
      "eventListeners": -16389,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.799999999999272
    },
    {
      "name": "vue-large-graph-idle",
      "durationMs": 11539.904999999977,
      "styleRecalcs": 0,
      "styleRecalcDurationMs": 0,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 11522.005,
      "heapDeltaBytes": -55784620,
      "heapUsedBytes": 166965116,
      "domNodes": -8312,
      "jsHeapTotalBytes": -10690560,
      "scriptDurationMs": 397.30000000000007,
      "eventListeners": -16391,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 17.219999999999953,
      "p95FrameDurationMs": 16.700000000000728
    },
    {
      "name": "vue-large-graph-pan",
      "durationMs": 15465.168000000005,
      "styleRecalcs": 75,
      "styleRecalcDurationMs": 13.279000000000012,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 15421.270999999999,
      "heapDeltaBytes": -28927800,
      "heapUsedBytes": 176870492,
      "domNodes": -8312,
      "jsHeapTotalBytes": -3153920,
      "scriptDurationMs": 706.6179999999999,
      "eventListeners": -16387,
      "totalBlockingTimeMs": 35,
      "frameDurationMs": 17.223333333333237,
      "p95FrameDurationMs": 16.799999999999272
    },
    {
      "name": "vue-large-graph-pan",
      "durationMs": 14404.854999999998,
      "styleRecalcs": 72,
      "styleRecalcDurationMs": 12.568999999999997,
      "layouts": 0,
      "layoutDurationMs": 0,
      "taskDurationMs": 14362.612000000003,
      "heapDeltaBytes": -59917992,
      "heapUsedBytes": 158101716,
      "domNodes": -8312,
      "jsHeapTotalBytes": -8589312,
      "scriptDurationMs": 727.3629999999999,
      "eventListeners": -16389,
      "totalBlockingTimeMs": 14,
      "frameDurationMs": 17.219999999999953,
      "p95FrameDurationMs": 16.799999999999272
    },
    {
      "name": "workflow-execution",
      "durationMs": 427.35699999997223,
      "styleRecalcs": 14,
      "styleRecalcDurationMs": 12.261999999999999,
      "layouts": 2,
      "layoutDurationMs": 0.31499999999999984,
      "taskDurationMs": 75.85799999999999,
      "heapDeltaBytes": 5069128,
      "heapUsedBytes": 68653448,
      "domNodes": 128,
      "jsHeapTotalBytes": 5242880,
      "scriptDurationMs": 6.796999999999999,
      "eventListeners": 97,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000273
    },
    {
      "name": "workflow-execution",
      "durationMs": 433.8639999999714,
      "styleRecalcs": 14,
      "styleRecalcDurationMs": 15.05,
      "layouts": 4,
      "layoutDurationMs": 1.1790000000000003,
      "taskDurationMs": 87.95100000000002,
      "heapDeltaBytes": 5056296,
      "heapUsedBytes": 68592012,
      "domNodes": 123,
      "jsHeapTotalBytes": 4980736,
      "scriptDurationMs": 7.075999999999999,
      "eventListeners": 99,
      "totalBlockingTimeMs": 0,
      "frameDurationMs": 16.666666666666668,
      "p95FrameDurationMs": 16.700000000000273
    }
  ]
}

@codecov

codecov Bot commented Aug 12, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

@@            Coverage Diff             @@
##             main   #15081      +/-   ##
==========================================
- Coverage   80.81%   80.71%   -0.11%     
==========================================
  Files        1873     1882       +9     
  Lines      121954   122466     +512     
  Branches    37495    37739     +244     
==========================================
+ Hits        98558    98847     +289     
- Misses      22859    23056     +197     
- Partials      537      563      +26     
Flag Coverage Δ
unit 72.55% <ø> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 37 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@benjcooley benjcooley left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated review — posted by an AI agent (Claude Code)

Weekly full-registry census: new workflow + vendored Python scripts. The headline problem is that the corpus fetch silently extracts nothing on GNU tar (ubuntu-latest), and every downstream failure mode scores the affected pack as clean — so the census would report a confident zero.

Severity Count
BLOCKER 3
SHOULD FIX 4
TRIVIAL 1
Total 8

Comment thread scripts/registry-census/fetch_corpus.py Outdated
if frozen and prev.get('etag') and etag and etag != prev['etag']:
return (pack_id, 'drifted', etag)

args = ['tar', '-xz', '-f', tar_path, '-C', dest]

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BLOCKER — tar -xz --include=*.js is a bsdtar-only option. ubuntu-latest ships GNU tar, which errors out on it. The return code is discarded, so on CI every pack extracts to nothing, gets marked .done with status empty, and the zeroed corpus is cached and never revalidated.

This validated locally on macOS (bsdtar) — that's why it looked fine. GNU equivalent is --wildcards '*.js'.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0 - and this was the catch of the PR: validated on macOS bsdtar, would have shipped a silently-empty corpus reporting 100% clean on CI. The fix avoids tar filter dialects entirely: extract whole to scratch (universal flags only), filter extensions in Python, check the return code, swap in only on success. Revalidated by force-refetching two packs through the new path (extension-filtered trees, markers written, census unchanged).

timeout-minutes: 60
steps:
- name: Checkout repository
uses: actions/checkout@v7

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BLOCKER — actions/checkout@v7 isn't in .pinact.yaml's ignore list (repo standard is v6), and the actions/cache/restore@v5 / save@v5 sub-action names aren't exempted either. Confirmed: the validate-pins check is currently failing on this PR.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0: the two cache sub-action lines are SHA-pinned (caa29612…# v5) - you were right that pinact matches names exactly, so the actions/cache ignore entry never covered cache/restore/cache/save; checkout@v7 itself is ignore-listed and passes. validate-pins' own log flags exactly lines 47/92, both now pinned.

n = len(rx.findall(line))
if n:
counts[k] += n
results[x['id']] = {

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BLOCKER — Packs that failed to fetch / bad-url / unsupported-host still get a zero-count result row and stay in the denominator, so they're counted as clean. The scanner never reads corpus.lock.json, so fetch_corpus's "honest status" tracking never reaches the census. Combined with the tar bug above, a fully-empty corpus reports 100% clean.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0, via the disk rather than the lockfile: the .done marker is written only after a successful fetch+extract, so marker-on-disk is the fetch-status ground truth and survives lockfile schema drift (a lock-status filter turned out to exclude 4,960 legacy entries that predate status recording). Unfetched packs are excluded from the scanned population and reported as their own census line: unscannable (excluded) 9 packs … unknown, not clean. Combined with the tar fix, an empty corpus now reports 0 scanned and exits 2 instead of 100% clean.

Comment thread scripts/registry-census/fetch_corpus.py Outdated
live = _head_etag(url)
if live is None or not prev.get('etag') or live == prev['etag']:
return (pack_id, 'cached', prev.get('etag'))
shutil.rmtree(dest, ignore_errors=True)

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SHOULD FIX — --revalidate rmtrees the cached pack before the refetch. If the refetch fails, the pack is gone and the run scores it as clean — directly contradicting the "a network blip must not evict corpus" comment right here. Fetch to a temp dir and swap on success.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0: no rmtree before refetch anywhere - the download extracts to scratch, filters into a staged tree, and only on success replaces dest. A failed refetch leaves the previous copy untouched, which is what that comment always promised.

# not evict corpus.
live = _head_etag(url)
if live is None or not prev.get('etag') or live == prev['etag']:
return (pack_id, 'cached', prev.get('etag'))

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SHOULD FIX — not prev.get('etag') short-circuits to cached, so a pack whose ETag was never recorded (host sends none, or the lockfile was lost) is pinned to its first fetch forever. Also _head_etag (no -L, first ETag) vs the GET path (-L, last ETag) compare different values, so redirecting hosts will look permanently changed.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0: a missing recorded ETag with a live one present now refetches once to establish the record (no more first-fetch-forever pin; a host sending no ETag at all stays cached since there is nothing to compare), and _head_etag now follows redirects (-L) keeping the LAST ETag, mirroring the GET parse - redirecting hosts compare the same value both ways.

uses: actions/cache/save@v5
with:
path: .census
key: registry-corpus-${{ hashFiles('.census/corpus.lock.json') }}

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SHOULD FIX — hashFiles on a missing lockfile yields '', so an if: always() save after an early failure writes a partial .census under key registry-corpus- — the exact string used as the restore-keys prefix. That poisoned entry is then the best prefix match for every later run.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0: the save gates on steps.fetch.outcome == 'success' && hashFiles(…) != '' - an early failure can no longer save a partial .census, least of all under the empty-hash key that doubles as the restore-keys prefix.

return '/'.join(parts[-2:])


def fetch(x):

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SHOULD FIX — This dead fetch() builds a shell string from the registry-supplied repo URL and runs it with shell=True (command injection if ever wired up), and re-introduces the unconditional .done marker the real fetcher was fixed to avoid. Delete it rather than leaving it as a trap for the next editor.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Deleted in 00e45f0 - fetch(), slug_of, the INC shell string, and the ThreadPoolExecutor import are gone; the scanner reads the corpus and nothing else.

unc = [v for v in results.values() if any(v['counts'].get(k) for k in UNCOND)]
vue = [v for v in results.values() if any(v['counts'].get(k) for k in VUE)]
both = [v for v in results.values() if any(v['counts'].get(k) for k in {**UNCOND, **VUE})]
n = len(results)

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TRIVIAL — len(s)/n*100 and /TOT are unguarded, so an empty snapshot crashes with ZeroDivisionError. The module-level snapshot load also bypasses the friendly "corpus not fetched" guard.

Posted by an AI agent (Claude Code).

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 00e45f0: missing snapshot exits 2 with the refresh instruction before the module-level load, zero scannable packs exits 2 with its own message, and the download denominators guard against zero.

…nsus

tar --include is bsdtar-only: on GNU tar (ubuntu CI) it errors with the
return code discarded, producing an empty corpus that scanned 100% clean
- caught in review, invisible to the macOS validation. Extraction now
uses only universal flags (extract whole, filter extensions in Python),
checks the return code, and stages the replacement tree before swapping,
so a failed refetch never evicts the previous copy. --revalidate treats
a missing recorded ETag as drift (refetch once to establish it) and the
HEAD check follows redirects taking the last ETag, matching the GET
path. The scanner excludes unfetched packs from the scanned population
via the .done marker (disk ground truth; unknown is never clean) and
reports them as their own census line; the dead shell=True fetch() is
deleted; empty-registry and missing-snapshot paths exit with messages
instead of ZeroDivisionError. The workflow pins the cache sub-actions by
SHA (pinact matches names exactly; the actions/cache ignore entry does
not cover restore/save) and gates the save on the fetch step plus a
present lockfile so a partial .census can never save under the
empty-hash key, which equals the restore-keys prefix.

Revalidated end-to-end locally: two packs force-refetched through the
new extraction (extension-filtered trees, markers written), full census
byte-identical on the break figures (701 / 14.1% / 37.3%) over 4,974
scanned packs with 9 unscannable now explicitly excluded.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@scripts/registry-census/fetch_corpus.py`:
- Around line 254-261: Update the return logic in the function containing the
counts.get('failed') check so any failed fetch reports the error and returns a
nonzero status. Preserve the existing successful return of 0 when no fetches
failed, ensuring the workflow cannot publish or cache a partial census
successfully.
- Around line 153-154: Update the frozen-mode validation in the corpus fetch
flow so an existing previous ETag requires the response ETag to be present and
equal to it; return the existing drifted result when the response ETag is
missing or differs. Keep normal-mode behavior and the existing lockfile ETag
handling unchanged.

In `@scripts/registry-census/scan_registry.py`:
- Around line 113-131: The download percentages in the summary loop over
shipsjs, api, unc, vue, and both use TOT, which excludes unscannable packs,
while the label says “of registry downloads.” Update this reporting in the
census summary to either use reg_dl as the denominator and identify the values
as registry-wide lower bounds, or keep TOT and relabel them as percentages of
scanned downloads.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: 444e9aca-8f6e-4e53-8525-20f2c7b944c1

📥 Commits

Reviewing files that changed from the base of the PR and between 53e569e and 00e45f0.

📒 Files selected for processing (7)
  • .github/workflows/ci-weekly-registry-census.yaml
  • .gitignore
  • scripts/registry-census/README.md
  • scripts/registry-census/fetch_corpus.py
  • scripts/registry-census/paths.py
  • scripts/registry-census/refresh_registry.py
  • scripts/registry-census/scan_registry.py

Comment on lines +153 to +154
if frozen and prev.get('etag') and etag and etag != prev['etag']:
return (pack_id, 'drifted', etag)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Fail frozen mode when the response has no ETag.

If prev['etag'] exists and the GET response has no ETag, this condition is false. The code then replaces the cached corpus but keeps the old lockfile ETag. The frozen run reports success without verifying the pinned artifact.

Proposed fix
-        if frozen and prev.get('etag') and etag and etag != prev['etag']:
+        if frozen and prev.get('etag') and etag != prev['etag']:
             return (pack_id, 'drifted', etag)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@scripts/registry-census/fetch_corpus.py` around lines 153 - 154, Update the
frozen-mode validation in the corpus fetch flow so an existing previous ETag
requires the response ETag to be present and equal to it; return the existing
drifted result when the response ETag is missing or differs. Keep normal-mode
behavior and the existing lockfile ETag handling unchanged.

Comment on lines +254 to +261
# A failed fetch is not a clean pack. Surface it rather than caching it.
if counts.get('failed'):
print(
f"\n{counts['failed']} fetches failed; re-run to retry "
f'(they are not marked done and will not be skipped)',
file=sys.stderr,
)
return 0

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🎯 Functional Correctness | 🟠 Major | ⚡ Quick win

Return failure when a pack fetch fails.

The workflow continues to scan, publish, and cache after a failed fetch because this function returns zero. A failed fetch is a mechanical pipeline error. Return nonzero after reporting it so the weekly job cannot publish a partial census as successful.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@scripts/registry-census/fetch_corpus.py` around lines 254 - 261, Update the
return logic in the function containing the counts.get('failed') check so any
failed fetch reports the error and returns a nonzero status. Preserve the
existing successful return of 0 when no fetches failed, ensuring the workflow
cannot publish or cache a partial census successfully.

Comment on lines +113 to +131
TOT = sum(v['downloads'] for v in results.values()) or 1
shipsjs = [v for v in results.values() if v['js_loc'] > 0]
api = [v for v in results.values() if v['counts'].get('uses_api')]
unc = [v for v in results.values() if any(v['counts'].get(k) for k in UNCOND)]
vue = [v for v in results.values() if any(v['counts'].get(k) for k in VUE)]
both = [v for v in results.values() if any(v['counts'].get(k) for k in {**UNCOND, **VUE})]
n = len(results)
reg_dl = sum(dl.values()) or 1
print(f'\n=== FULL REGISTRY CENSUS (n={n} scanned packs, {TOT:,} downloads) ===')
print(
f'{"unscannable (excluded)":24s} {len(unfetched):5d} packs '
f'{sum(dl.get(x["id"], 0) for x in unfetched) / reg_dl * 100:5.1f}% of registry downloads '
f'(failed/bad-url/unsupported/never fetched - unknown, not clean)'
)
for lbl, s in (('ships frontend JS', shipsjs), ('uses Comfy JS API', api),
('UNCONDITIONAL break', unc), ('VUE-MODE break', vue),
('ANY confirmed break', both)):
print(f'{lbl:24s} {len(s):5d} packs ({len(s)/n*100:5.1f}%) '
f'{sum(v["downloads"] for v in s)/TOT*100:5.1f}% of registry downloads')

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

Correct the download-percentage denominator label.

TOT excludes unscannable packs, but Lines 130-131 label each value as a percentage “of registry downloads.” This overstates the coverage of the reported percentage when excluded packs have downloads. Either divide by reg_dl and label the result as a registry-wide lower bound, or retain TOT and say “of scanned downloads.”

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@scripts/registry-census/scan_registry.py` around lines 113 - 131, The
download percentages in the summary loop over shipsjs, api, unc, vue, and both
use TOT, which excludes unscannable packs, while the label says “of registry
downloads.” Update this reporting in the census summary to either use reg_dl as
the denominator and identify the values as registry-wide lower bounds, or keep
TOT and relabel them as percentages of scanned downloads.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.github/workflows/ci-weekly-registry-census.yaml:
- Line 47: Update the cache action references in the workflow’s restore and save
steps to use the repository-approved mutable `v5` tags: change
`actions/cache/restore` and `actions/cache/save` to their respective `@v5`
references, removing the SHA pins.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: 870a2c19-2c08-451f-82fb-ac2df53b3395

📥 Commits

Reviewing files that changed from the base of the PR and between 00e45f0 and 8a6e0a2.

📒 Files selected for processing (1)
  • .github/workflows/ci-weekly-registry-census.yaml

# Restore the newest corpus regardless of key: the primary key never
# hits (run-scoped), so restore-keys always serves the latest save.
- name: Restore corpus cache
uses: actions/cache/restore@caa296126883cff596d87d8935842f9db880ef25 # v5.1.0

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/usr/bin/env bash
set -euo pipefail

config="$(fd -HI -t f '^\.pinact\.yaml$' . | head -n 1)"
test -n "$config" || { echo "No .pinact.yaml found" >&2; exit 1; }

rg -n -C 3 'ignore|actions/(cache|checkout)' "$config" || true
rg -n 'uses:\s*actions/cache/(restore|save)@' \
  .github/workflows/ci-weekly-registry-census.yaml

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 615


🏁 Script executed:

#!/usr/bin/env bash
set -euo pipefail

printf '%s\n' '--- .pinact.yaml ---'
cat -n .pinact.yaml

printf '%s\n' '--- pinact references and validation commands ---'
rg -n -i -C 2 'pinact|action.?pin|workflow.*lint|lint.*workflow' \
  .github package.json Makefile* README.md 2>/dev/null || true

printf '%s\n' '--- cache action references ---'
rg -n -C 1 'actions/cache/(restore|save)@' .github/workflows

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 3502


🏁 Script executed:

#!/usr/bin/env bash
set -euo pipefail
cat -n .github/workflows/ci-validate-action-pins.yaml

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 721


Use the repository-approved actions/cache references.

.pinact.yaml excludes actions/cache from SHA pinning at v5. Change lines 47 and 97 to actions/cache/restore@v5 and actions/cache/save@v5.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.github/workflows/ci-weekly-registry-census.yaml at line 47, Update the
cache action references in the workflow’s restore and save steps to use the
repository-approved mutable `v5` tags: change `actions/cache/restore` and
`actions/cache/save` to their respective `@v5` references, removing the SHA
pins.

Source: Learnings

Paths-filtered pull_request trigger: self-testing for census changes,
and the registration path that lets workflow_dispatch resolve before
the file reaches the default branch.

@benjcooley benjcooley left a comment

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

APPROVED — posted by an AI agent (Claude Code)

(GitHub blocks a formal Approve on your own PR, so this is a comment review.)

00e45f06 + 8a6e0a24 resolve all eight findings. One inline TRIVIAL nit remains, and I owe a correction on my own earlier finding — see #2.

# Severity Status
1 BLOCKER ✅ Extraction now uses only universal flags, checks the return code, filters extensions in Python, and stages before swapping. Verified INCLUDES is a tuple (line 44) — required, since str.endswith rejects a list — so the new filter is sound.
2 BLOCKER ✅ Fixed, but my diagnosis was half wrong. The real cause was that pinact matches names exactly, so the actions/cache ignore entry never covered actions/cache/restore / save; SHA-pinning those fixes it. The checkout@v7 half of my finding was incorrect — validate-pins now passes with @v7 still in place. Sorry for the misdirection.
3 BLOCKER ✅ The .done marker is now the fetch-status ground truth, and it's written only after a successful extract (the rc != 0 path returns before it). Unfetched packs are excluded from the denominator and get their own census line. "Unknown is never clean" is the right invariant.
4 SHOULD FIX ✅ The cached tree stays until the replacement is fully staged; a failed refetch no longer evicts it.
5 SHOULD FIX ✅ Both halves — a missing recorded ETag now refetches once to establish the record, and _head_etag uses -L + last-ETag to match the GET path.
6 SHOULD FIX ✅ Save gated on steps.fetch.outcome == 'success' && hashFiles(...) != '', so the empty-hash key that collides with the restore-keys prefix is unreachable.
7 SHOULD FIX ✅ Dead shell=True fetch() deleted outright.
8 TRIVIAL ✅ or 1 guards, plus an explicit missing-snapshot exit and an empty-results exit, both with real messages.

The end-to-end revalidation — census byte-identical on the break figures (701 / 14.1% / 37.3%) over 4,974 scanned packs with 9 now explicitly excluded — is the right way to prove the extraction rewrite didn't change what's measured.

timeout-minutes: 60
steps:
- name: Checkout repository
uses: actions/checkout@v7

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TRIVIAL — Consistency only, not a gate: validate-pins passes with @v7, but all 80 other actions/checkout uses in .github/workflows/ are @v6, and .pinact.yaml records ref: v6 for it. Worth matching so this file isn't the lone outlier.

Posted by an AI agent (Claude Code).

@benjcooley

Copy link
Copy Markdown
Collaborator Author

First CI execution (run 31555968423, green, ~6 minutes total cold): every reviewed behavior visible in the logs.

  • Cold fetch: 5,096 packs in 3.7m on the live registry (grown +113 packs since the local snapshot) - 1,990 ok / 2,951 ship-no-JS / 145 failed.
  • GNU tar extraction works - the bsdtar bug would have made this exact run report 100% clean on an empty corpus; instead: 1,981 packs ship JS, 735 confirmed-break carrying 37.9% of downloads, coherent with the local snapshot (701 / 37.3%) plus registry growth.
  • The honesty line, live: unscannable (excluded) 155 packs 0.9% of downloads (…unknown, not clean) - the 145 failed fetches are excluded and will retry next run (no .done marker), not counted clean.
  • Cache saved under the lockfile-hash key; scan 1.4m; registry refresh 0.5m.

Steady-state weekly cost: ~3-4 minutes (ETag revalidation + scan). The next census-touching push doubles as the warm-path proof.

The scan's false-positive/negative rate was judged too high to act on;
packs are measured by executing their code (the ecosystem matrix, stacked
PR) instead. The weekly job now maintains the pack corpus - registry
re-pin, fetch, ETag revalidation, lockfile-keyed cache - as the matrix's
input.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@dosubot dosubot Bot added size:L This PR changes 100-499 lines, ignoring generated files. and removed size:XL This PR changes 500-999 lines, ignoring generated files. labels Aug 12, 2026
@benjcooley benjcooley changed the title ci: weekly full-registry custom-node census ci: weekly full-registry corpus refresh (cached, ETag-revalidated) Aug 12, 2026

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 3

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In @.github/workflows/ci-weekly-registry-census.yaml:
- Around line 60-67: Update the weekly registry census flow around Refresh
registry snapshot and fetch_corpus.py --revalidate to remove packs no longer
present in the refreshed registry snapshot, including stale corpus directories
and lockfile entries restored from cache. Implement pruning before or within
fetch_corpus.py, ensure all consumers exclude removed pack IDs, and add coverage
using a removed-pack fixture.
- Around line 69-76: Update fetch_corpus.py so the fetch step exits
unsuccessfully whenever counts.failed is nonzero, including partial-fetch
failures that retain previous lock entries. Then change the “Upload corpus
lockfile” step to run only after a fully successful fetch instead of always(),
preserving artifact upload for complete results while preventing stale
lockfiles.

In `@scripts/registry-census/README.md`:
- Around line 29-35: Update the “In CI” section of the README to document that
the workflow also runs on pull requests, limited by changes to
scripts/registry-census/** and .github/workflows/ci-weekly-registry-census.yaml,
while preserving the existing weekly and dispatch behavior.
🪄 Autofix

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Pro Plus

Run ID: 4feb5b14-63df-44df-9bb4-073288b45e9a

📥 Commits

Reviewing files that changed from the base of the PR and between 9ee17a0 and 96f23b2.

📒 Files selected for processing (2)
  • .github/workflows/ci-weekly-registry-census.yaml
  • scripts/registry-census/README.md

Comment on lines +60 to +67
# Re-pin the registry snapshot every run: it is the corpus's target
# list, and new packs only enter the corpus through it.
- name: Refresh registry snapshot
run: python3 scripts/registry-census/refresh_registry.py

- name: Fetch corpus and revalidate drifted packs
id: fetch
run: python3 scripts/registry-census/fetch_corpus.py --revalidate

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🗄️ Data Integrity & Integration | 🟡 Minor | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/usr/bin/env bash
set -euo pipefail

ast-grep outline scripts/registry-census/fetch_corpus.py --items all
rg -n -C 6 \
  'rmtree|remove|CORPUS|LOCKFILE|registry_snapshot|registry_js|\.done' \
  scripts .github --glob '*.py' --glob '*.yaml' --glob '*.yml'

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 26066


🏁 Script executed:

#!/usr/bin/env bash
set -euo pipefail

printf '%s\n' '--- registry-census files ---'
git ls-files scripts/registry-census .github/workflows/ci-weekly-registry-census.yaml | sort

printf '%s\n' '--- fetch_corpus.py ---'
cat -n scripts/registry-census/fetch_corpus.py | sed -n '95,260p'

printf '%s\n' '--- registry-census outlines ---'
for f in $(git ls-files scripts/registry-census '*.py' | sort); do
  echo "### $f"
  ast-grep outline "$f" --items all
done

printf '%s\n' '--- workflow cache and census steps ---'
cat -n .github/workflows/ci-weekly-registry-census.yaml | sed -n '35,125p'

printf '%s\n' '--- references to registry_js and corpus.lock.json ---'
rg -n -C 5 'registry_js|corpus\.lock\.json|CORPUS|LOCKFILE|registry_snapshot\(\)|registry\.json' \
  scripts/registry-census .github/workflows/ci-weekly-registry-census.yaml \
  --glob '*.py' --glob '*.yaml' --glob '*.yml'

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 33896


🏁 Script executed:

#!/usr/bin/env bash
set -euo pipefail

printf '%s\n' '--- all registry-census references ---'
rg -n -C 5 \
  'registry-census|registry_js|corpus\.lock\.json|\.census|ecosystem matrix|census' . \
  --glob '!node_modules/**' --glob '!dist/**' --glob '!build/**' \
  --glob '!*.lock' --glob '!pnpm-lock.yaml' \
  | sed -n '1,500p'

printf '%s\n' '--- registry-census README ---'
cat -n scripts/registry-census/README.md

printf '%s\n' '--- workflow tail ---'
cat -n .github/workflows/ci-weekly-registry-census.yaml | sed -n '78,180p'

printf '%s\n' '--- tests and fixtures near registry census ---'
git ls-files | rg '(^|/)(test|tests|__fixtures__|fixtures)(/|$)|registry.*census|census.*registry' || true

printf '%s\n' '--- static contract check ---'
python3 - <<'PY'
import ast
from pathlib import Path

path = Path("scripts/registry-census/fetch_corpus.py")
tree = ast.parse(path.read_text())
calls = []
for node in ast.walk(tree):
    if isinstance(node, ast.Call):
        fn = node.func
        if isinstance(fn, ast.Attribute):
            name = f"{ast.unparse(fn.value)}.{fn.attr}"
        else:
            name = ast.unparse(fn)
        if any(term in name.lower() for term in ("rmtree", "remove", "listdir", "scandir", "walk")):
            calls.append((node.lineno, name))
print("filesystem calls relevant to cleanup/enumeration:")
for item in calls:
    print(item)
print("has target snapshot load:", any(
    isinstance(n, ast.Call)
    and isinstance(n.func, ast.Name)
    and n.func.id == "json.load"
    for n in ast.walk(tree)
))
print("has corpus-root enumeration outside fetch payload check:",
      any(
          isinstance(n, ast.Call)
          and isinstance(n.func, ast.Attribute)
          and n.func.attr in {"listdir", "scandir"}
          for n in ast.walk(tree)
      ))
PY

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 50384


Remove packs absent from the refreshed snapshot. fetch_corpus.py processes only current targets and never removes stale directories or lockfile entries. A restored cache can therefore retain removed packs under .census/corpus/registry_js. Prune stale pack IDs, or filter them in every consumer, and add a removed-pack fixture.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.github/workflows/ci-weekly-registry-census.yaml around lines 60 - 67,
Update the weekly registry census flow around Refresh registry snapshot and
fetch_corpus.py --revalidate to remove packs no longer present in the refreshed
registry snapshot, including stale corpus directories and lockfile entries
restored from cache. Implement pruning before or within fetch_corpus.py, ensure
all consumers exclude removed pack IDs, and add coverage using a removed-pack
fixture.

Comment on lines +69 to +76
- name: Upload corpus lockfile
if: always()
uses: actions/upload-artifact@v6
with:
name: corpus-lock
path: .census/corpus.lock.json
retention-days: 30
if-no-files-found: warn

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -eu
file=".github/workflows/ci-weekly-registry-census.yaml"
printf '%s\n' '--- workflow excerpt ---'
sed -n '1,120p' "$file"
printf '%s\n' '--- relevant references ---'
rg -n -C 3 'corpus\.lock|fetch|refresh|cache|upload-artifact|steps\.' "$file" .github 2>/dev/null || true
printf '%s\n' '--- repository files related to census ---'
git ls-files | rg '(^|/)(census|corpus|registry)|ci-weekly-registry-census' || true

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 50383


🏁 Script executed:

#!/bin/bash
set -eu
for file in scripts/registry-census/refresh_registry.py scripts/registry-census/fetch_corpus.py; do
  printf '\n--- %s: size ---\n' "$file"
  wc -l "$file"
  printf '%s\n' '--- outline ---'
  ast-grep outline "$file" || true
done
printf '\n--- lockfile operations ---\n'
rg -n -C 5 'corpus\.lock|write_text|open\(|rename|replace|unlink|remove|os\.|Path\(' \
  scripts/registry-census/refresh_registry.py scripts/registry-census/fetch_corpus.py

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 16263


🏁 Script executed:

#!/bin/bash
set -eu
printf '%s\n' '--- refresh_registry.py ---'
cat -n scripts/registry-census/refresh_registry.py
printf '%s\n' '--- fetch_corpus.py main and fetch result handling ---'
sed -n '193,265p' scripts/registry-census/fetch_corpus.py | cat -n
printf '%s\n' '--- repository references to corpus-lock artifact ---'
rg -n -C 4 'corpus-lock|corpus\.lock\.json|fetch_corpus\.py' --glob '!scripts/registry-census/fetch_corpus.py' --glob '!scripts/registry-census/refresh_registry.py' .

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 10911


🏁 Script executed:

#!/bin/bash
set -eu
python3 - <<'PY'
from pathlib import Path
import re

workflow = Path(".github/workflows/ci-weekly-registry-census.yaml").read_text()
refresh = Path("scripts/registry-census/refresh_registry.py").read_text()
fetch = Path("scripts/registry-census/fetch_corpus.py").read_text()

checks = {
    "cache restores .census": "path: .census" in workflow,
    "upload runs always": re.search(
        r"- name: Upload corpus lockfile\s+if:\s+always\(\)", workflow
    ) is not None,
    "fetch has id": re.search(
        r"- name: Fetch corpus and revalidate drifted packs\s+id:\s+fetch", workflow
    ) is not None,
    "fetch reads existing lock": re.search(
        r"if os\.path\.exists\(LOCKFILE\):\s+with open\(LOCKFILE, encoding='utf-8'\)", fetch
    ) is not None,
    "fetch writes lock after worker results": fetch.index(
        "with open(LOCKFILE, 'w', encoding='utf-8')"
    ) > fetch.index("results = list("),
    "refresh can exit before writing snapshot": (
        "raise SystemExit(f'registry API request failed on page {page}')" in refresh
        and refresh.index("raise SystemExit") < refresh.index("with open(dest, 'w'")
    ),
    "partial fetch failures return success": re.search(
        r"if counts\.get\('failed'\):.*?return 0", fetch, re.S
    ) is not None,
}
for name, passed in checks.items():
    print(f"{'PASS' if passed else 'FAIL'}: {name}")
if not all(checks.values()):
    raise SystemExit(1)

upload = re.search(
    r"- name: Upload corpus lockfile(?P<body>.*?)(?=\n\s*# Key derived|\Z)",
    workflow,
    re.S,
).group("body")
print("upload condition:", re.search(r"if:\s*(.+)", upload).group(1))
print("fetch failure policy: returns 0 after reporting failed packs")
print("lockfile write occurs only after all fetch results are collected")
PY

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 558


Gate the lockfile artifact on a complete fetch result.

always() can upload a restored lockfile when refresh fails. fetch_corpus.py also returns success when individual fetches fail, while retaining their previous lock entries. Therefore, checking only steps.fetch.outcome == 'success' does not prevent stale ETags. Return a failure when counts.failed is nonzero, then gate the upload on that outcome or create a run-scoped lockfile.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In @.github/workflows/ci-weekly-registry-census.yaml around lines 69 - 76,
Update fetch_corpus.py so the fetch step exits unsuccessfully whenever
counts.failed is nonzero, including partial-fetch failures that retain previous
lock entries. Then change the “Upload corpus lockfile” step to run only after a
fully successful fetch instead of always(), preserving artifact upload for
complete results while preventing stale lockfiles.

Comment on lines +29 to +35
## In CI

`.github/workflows/ci-weekly-registry-census.yaml` runs weekly and on
dispatch: corpus restored from the actions cache, registry re-pinned,
drifted packs revalidated by ETag, `corpus.lock.json` uploaded as an
artifact, cache re-saved under a lockfile-hash key (so the cache updates
exactly when a pack moves).

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -eu

workflow=".github/workflows/ci-weekly-registry-census.yaml"
if [ -f "$workflow" ]; then
  printf '%s\n' "--- workflow triggers ---"
  sed -n '1,90p' "$workflow"
else
  printf '%s\n' "Workflow not found at expected path; locating candidates:"
  fd -i 'registry.*census|census.*registry' .github scripts 2>/dev/null || true
fi

printf '%s\n' "--- README section ---"
sed -n '20,45p' scripts/registry-census/README.md

printf '%s\n' "--- trigger references ---"
rg -n -C 3 'pull_request|paths:|ci-weekly-registry-census|schedule:|workflow_dispatch' .github/workflows scripts/registry-census 2>/dev/null || true

Repository: Comfy-Org/ComfyUI_frontend

Length of output: 50385


Document the pull-request trigger.

Document the pull_request trigger and these path filters: scripts/registry-census/** and .github/workflows/ci-weekly-registry-census.yaml.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In `@scripts/registry-census/README.md` around lines 29 - 35, Update the “In CI”
section of the README to document that the workflow also runs on pull requests,
limited by changes to scripts/registry-census/** and
.github/workflows/ci-weekly-registry-census.yaml, while preserving the existing
weekly and dispatch behavior.

@benjcooley

Copy link
Copy Markdown
Collaborator Author

Corpus evidence after the L1 removal - the corpus job on run 31563501583 (stacked #15110 branch, which includes this tip): warm-cache restore, registry re-pin, ETag revalidation, and lockfile-keyed save in 1m42s, then feeding four matrix shards downstream. With the static idiom scan gone, this branch maintains the measurement input; #15110 is the measurement.

benjcooley added a commit that referenced this pull request Aug 13, 2026
…criteria (#15146)

Follow-through on the maintainability audit: the weekly must not red (or
hollow out) for reasons unrelated to custom nodes. Stacked on #15145 (->
#15110 -> #15081) so this diff is only the hardening.

## Plumbing (no measurement change)
- **The runner is now typechecked** (`tsconfig` includes
`scripts/registry-census/**/*.ts`; 6 real errors fixed, all inside the
harness file). A frontend rename of
`registerNodeDef`/`createReroute`/`graphToPrompt` now breaks the
renaming PR loudly instead of red-ing the next weekly as a false
ecosystem FAIL. Generated `src/__ecs_matrix__` stays excluded.
- **Registry refresh survives the network**: curl `--retry 5`, falls
back to the cached snapshot on failure, and refuses a snapshot that
shrank >10% (API shape drift, not mass unpublishing). Previously one 5xx
killed corpus -> shards -> verdict for the week.
- **Corpus fetch refuses partial completeness**: curl retries; >5%
failed fetches fails the run instead of green-shipping a shrunken
denominator.
- **Cache economics**: superseded ~1GB `registry-corpus-*` entries are
pruned after each save (repo budget is 10GB shared; unpruned, the census
would evict other workflows' caches within weeks). A Thursday cron keeps
the cache inside GitHub's 7-day eviction window.
- **`matrix-verdict` runs `if: always()`**: one failed shard degrades to
a partial verdict, not a skipped check.
- **build_matrix**: the rewrite regex required a non-empty relative
prefix (it could hijack a pack's own `./scripts/utils.js` to OUR module
- wrong-code-under-test); entry-cap truncation is now recorded in the
manifest (the comment claimed it already was); missing corpus fails
friendly.

## Measurement changes
- **Real timers.** `setupFiles: []` was a mergeConfig-concatenation
no-op, so all 1,879 packs executed under the unit suite's
`vi.useFakeTimers()` by accident. Now assigned explicitly:
`vitest.setup.ts` kept, fake timers dropped. Poison proof re-validated
under real timers (14/14 channels).
- **Criteria reworked against measured full-registry baselines** (1,879
packs, run 31563501583):

| criterion | floor | baseline |
|---|---|---|
| entry JS loads (any entry per pack) | >= 95% | 97.4% |
| **entry files load clean (new)** | >= 91% | 94.1% |
| registerNodeDef OK | >= 99% | 100% |
| every operation clean | >= 99% | 99.8% |
| **entry-clean delta vs previous run (new)** | >= -1.5pp | metrics
carried by actions cache |

The old gated metric was only "pack had >=1 entry load" - 59-of-60
entries failing still counted as loaded. The delta gate catches gradual
erosion (97.4 -> 95.9) that absolute floors ignore.
- **Harness gate before any criterion**: the runner self-checks that the
default workflow materialized (>=7 nodes, KSampler with widgets - the
op-break poison proved a 0-node graph passes 15 if-guarded ops "clean").
If most packs fail self-check the verdict is **withheld as HARNESS
FAILURE (exit 2)** - a degraded harness can no longer report a vacuously
clean ecosystem or a false FAIL.

## Validated locally
- `pnpm typecheck` green with the runner included
- Poison corpus: `DETECTION PROOF PASSED` (14 checks incl. the two new
self-check assertions), summarizer exit 1 naming three breaches
- Real 1,879-row corpus: **PASS** exit 0, metrics.json written (anyPct
97.392 / entryPct 94.091 / worstOp load 99.84)
- Simulated delta breach (prev entryPct 96.5): exit 1, `entry files
clean dropped 2.4pp`
- Simulated broad self-check failure: exit 2, verdict withheld

Note: the fake-timer removal shifts measurement conditions; the first CI
run of this PR re-baselines under real timers, and if entry-clean lands
under the 91% floor the floor gets adjusted here before merge (that is
what the review run is for).

Deferred by design (discussed): shard autoscaling vs registry growth;
registerNodeDef floor kept as a pure harness canary; V1 DEFS drift is
now loud via the self-check.

---------

Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@benjcooley

Copy link
Copy Markdown
Collaborator Author

I have read and agree to the Contributor License Agreement

@christian-byrne christian-byrne self-assigned this Aug 26, 2026

@christian-byrne christian-byrne left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Superseded by #15175. Recommend closing this PR instead of rebasing it.

Full context for agent readers

Current main already contains the replacement corpus and ecosystem-matrix implementation from #15175. It preserves the same .census/corpus/registry_js contract while adding checked-in corpus pins, a readiness marker, population validation, required provenance artifacts, detection proofs, and focused tests.

This branch now conflicts with main in .gitignore and all four shared scripts/registry-census files. Rebasing it would replace the newer implementation with the older one, including its known fail-open partial-fetch behavior. The standalone weekly workflow is also absent from current main because the replacement owns the corpus lifecycle in ci-ecosystem-matrix.yaml.

No merge or auto-merge action taken.

@christian-byrne

Copy link
Copy Markdown
Contributor

Status check from the corpus pin work (FRONT-3698): main now measures a pinned corpus instead of a weekly floating refresh. scripts/registry-census/corpus.pins.json fixes every pack's commit, fetch_corpus.py and refresh_registry.py are already on main, and update-corpus-pins.yaml opens a reviewed bump PR (first automated run: #22687; monthly schedule in #22507). A weekly self-updating refresh would bring back the drift the pins remove, so as far as I can tell this PR is superseded.

@benjcooley, could you close it, or say what in here is still missing from main? Assigning back to you for that call.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants