Skip to content

Latest commit

 

History

History
534 lines (436 loc) · 101 KB

reference-matrix.md

File metadata and controls

534 lines (436 loc) · 101 KB

InferRSI Reference Matrix

Branch: opus/meta-skill-bootstrap | Integration date: 2026-10-16 | Comparison anchor: d96ff8d3

Current skill links resolve to the complete categorized skill library. Hardware-specific procedures live under their hardware owner; this relocation does not change the source-inspection or maturity claims below.

The 22-owner hardware source inventory separates direct implementation reads, retained supplier reads, skill/document imports and mirror/pack lineage. It is source navigation, not a third matrix or a validation score; native and service results remain separately qualified.

Paper source inspection below is carried from Dot's 2026-10-15 readsets and the owner's scoped review, not repeated full-paper extraction. The 2026-10-16 integration adds links and reconciles candidate guidance; packaging checks and publication status are reported separately. No paper result is a local measurement.

One of exactly two primary matrices (decision D01, 2026-10-15). The official name and path are Reference Matrix, docs/reference-matrix.md. The user subsequently authorized this filename change on 2026-10-15, superseding only D02's temporary filename-retention clause; the two-matrix contract is unchanged.

  • SearchSpace Matrix (docs/searchspace-matrix.md) — resource × optimization-stage coverage.
  • Reference Matrix (this file) — sources, inspected scope, provenance, and extraction: repositories, papers, official documentation, PRs, and expert material; where the intelligence comes from and what remains unread. Skills, knowledge, and cases link the two (D03). Methodology sources live in §2, not in a third matrix.

Status key (per cell): mined (source intelligence extracted into a candidate skill/case — not experimentally validated) · located-not-mined (relevant material identified, not yet extracted) · unknown (not investigated at this revision) · out-of-scope (reference does not establish that layer within its approved scope).

Reading rules:

  • Sparse / skill-doc-only checkouts carry curated methodology, not implementation code. Not present in a sparse checkout does NOT mean absent upstream.
  • A cloned repo is not necessarily a mined repo.
  • Negative findings are scoped to the paths and revisions actually inspected (see "Negative findings" below).
  • Upstream benchmark numbers are author-reported, never local validation.

1 · Systems sources

Reference (origin @ revision) Inspected scope Accelerator RAM / Host SSD / Storage Communication OS / System
cann/hccl @ 96fab0a2acb761e7f8ab0f94aeb5138f200a345b (CANN Open Software License Agreement Version 2.0) Direct canonical GitCode implementation read, 2026-10-30; 17-file readset, multi-rank path; simulator test definitions inspected, not run mined (narrow) — AICPU mesh scratch/chunking and local reduction ownership; no general accelerator or graph qualification out-of-scope — HCCL scratch is not host RAM out-of-scope mined (one native path) — positive-count, multi-rank OPBASE AICPU mesh one-shot AllReduce selection, peer writes, joins and local reduction -> ascend-distributed-parallel; HCOMM/ACL physical transport, legacy/other engines and numerical/performance behavior unqualified out-of-scope — collective threads are not OS placement
pytorch/pytorch @ ba56102387ef21a3b04b357e5b183d48f0afefc7 (v2.8.0, BSD-3-Clause) Direct bounded implementation/document read, 2026-10-30; CPU/CUDA copy, caching host allocator and stream/device-storage contract; nine-file readset mined (narrow) — copy-stream ordering and device allocator lifetime; no graph/kernel qualification mined — host mutation versus allocator release, completion-gated pinned-block reuse and D2H readiness → host-memory-management; candidate, CUDA/native/service not_run out-of-scope — pinned DRAM is not SSD coverage out-of-scope — local H2D/D2H is not network transport out-of-scope — allocator lifetime is not OS placement
python/cpython @ 60403a5409ff2c3f3b07dd2ca91a7a3e096839c7 (v3.13.0, PSF-2.0) Direct official documentation read, 2026-10-30; free-threading readset; no interpreter implementation read out-of-scope mined (document only) — build/runtime GIL checks and extension compatibility boundaries → host-memory-management; no interpreter/inference-stack execution out-of-scope out-of-scope out-of-scope — free threading does not establish affinity/NUMA controls
Ascend/torchair @ e1118e8b0fc1b95190ab53b732c0872989550e20 (BSD-3-Clause) Direct bounded Python implementation/document/test-definition read, 2026-10-30; 12-file readset, call-chain map mined — configuration versus backend callable, generated ACL runtime, capture key/recapture, persistent eager fallback, input staging and output lifetime → ascend-graph-mode; TorchNPU/CANN native graph/allocator and GE executor uninspected; NPU/model/service not_run out-of-scope — host launch attribution is not host allocator coverage out-of-scope — graph startup is not a storage implementation out-of-scope — graph call sites do not establish native collectives out-of-scope — graph scheduling is not OS scheduling
vllm-project/vllm @ 537a79f0fc5ba564d2bef43d54915b2f80f9f77d (root Apache-2.0; in-file Tri Dao adaptation notice and separate vendored FLA MIT notice) Direct bounded source inspection, 2026-10-27; Qwen3-Next caller, in-tree conv wrappers, GDN metadata, state shapes, row-resolution helper, selector defaults and two upstream test intents; source ledger mined — effective prefill/decode selection, mixed/speculative phase guards, state-row initialization and accepted-token offset → kernel-writing-guide; four source cases; native execution not_run, agent efficacy not_evaluated out-of-scope — device state is not host-RAM evidence out-of-scope out-of-scope — packed state metadata is not network evidence out-of-scope — metadata phase classification is not OS scheduling
huggingface/transformers @ 0dad7b822255a0ae261ec45ae937371e859ffd1a (v5.10.2) and 856157a2f3e9594954310df18fdccc31ffddebe9 (v5.17.0), Apache-2.0 Bounded source inspection, 2026-10-29: imported Qwen3.5 module, original-package/Hub binding, forward/cache/padding and local numeric contracts; 13 files matched to server Git blobs, exact readset; two existing worker seams are secondary context only mined (narrow) — constructor versus global binding, independent conv/GDN fallback, first/cached/chunk phases and cache-free classification conditions → kernel-writing-guide, contract and five source cases; candidate, native/model/numerical/performance not_run, efficacy not_evaluated out-of-scope — device states do not establish host-memory optimization out-of-scope out-of-scope out-of-scope — layer state is not OS scheduling
sgl-project/sglang @ 16176278d0180f1a1a578e53e6eef432577876c2 (Apache-2.0; conv adaptation notices credit vLLM and Tri Dao) Bounded source inspection, 2026-10-29; Qwen3.5/Qwen3-Next caller, GDN phase/architecture policy, separate conv wrappers, state shapes/row mapping and selected upstream test intent; readset and file identities mined (narrow) — per-runner prefill/decode, CUDA/Triton conv stride/alias branches, state write-back and conditional one-shot prefill transfer → kernel-writing-guide, four source cases; HF-worker/engine cross-map adds separate PPLX caller context (worker license UNKNOWN); candidate/not_run, agent efficacy not_evaluated out-of-scope — device state is not host RAM out-of-scope out-of-scope — row metadata is not network evidence out-of-scope — engine phase classification is not OS scheduling
NVlabs/kda @ acdd79343c5e9d0c7cb96289f26fd3f1051ce785 → mit-han-lab/KernelWiki gitlink @ 76d27b56f804e7e7295d4c570e1e5d7eef4b0a75 Direct bounded distillation, 2026-10-23; cutoff 2026-04-27. All 48 synthesis headers and 2,217 source headers screened; 171 SM90 source headers retained, selected bodies and independently matched DeepGEMM/CUTLASS code plus versioned NVIDIA sections inspected. Readset/coverage/license qualifications; remaining PR bodies/algorithms unmined; KW pin has no root LICENSE, KDA MIT/sanitization assertions qualified mined (conditional) — Hopper TMA/mbarrier/WGMMA ownership, resource/layout/pipeline/software scheduling and selected FP8 scaling → reason-hopper-kernels; SM100 recipes and unsafe snippet generalizations excluded; native/precision/performance not_run out-of-scope — device registers/SMEM/HBM are not host RAM out-of-scope — no storage implementation extracted out-of-scope — CTA/cluster synchronization is not network transport out-of-scope — tile scheduling is not OS scheduling
antirez/h3.c @ 8974cc055ea9c02fcd14cc27dfda3e1027c05153 (MIT; retained ccv BSD-3-Clause notice) Direct bounded source distillation, 2026-10-23; 34 selected file bytes matched to pinned Git blobs; readset/architecture. Loader, generation/cache, TE/vision/input-output VAEs, AdaLN, selected Metal/int8/SSD paths and native test assertions; full kernels/driver/media internals unread. Prior model-header observations reused, not rerun mined — joint audio/video schedule and row-map dependencies, BF16 rounding/fusion versus numerical approximation, actual TensorOps dispatch → audit-h3-runtime-residency; native/quality/performance not_run mined — shared/file-backed weights, Qwen prefetch ring, phase/cache/preview overlap and complete host output; tensor counters are not physical footprint or 64 GiB qualification mined — exact raw BF16/F32 schema, direct/mapped reads and two-slot BF16 matrix streaming with completion/join boundaries; uncached-read request is not measured cache bypass or useful overlap out-of-scope — local GPU/I/O ordering is not network transport out-of-scope — no OS scheduling/control implementation extracted
lithos-ai/lithos-metal @ 6653b7df5f2c4392ec7b038960f2796b1499923f (Apache-2.0; notices retained) Bounded compiler/Program/StepState/DSpark, backend identity and serving/pack/prefix/idle paths; selected contract/runtime assertions; readset. Candidate; software/CPU/synthetic Metal checks do not qualify full-model numerics, DSpark or service performance mined — chip-qualified task fusion, normalized controls, hazards/scratch and committed generation state → lithos-metal; empirical efficacy not_run mined — program/pipeline versus GPU allocation and exact host-prefix ownership; unified-memory residency/performance unqualified mined — derived pack validity, exact-prefix disk identity/integrity, bounded persistence and quota; weight-byte authentication and crash durability not established out-of-scope — HTTP adapters are not distributed transport out-of-scope — idle lifecycle is not OS scheduling
zuiho-kai/h3-metal @ 4ba47a3eabdbebf801ac6664b31f8ec168bc57a8 (inspected MIT; retained BSD-3-Clause notice; machine resolver unavailable) Bounded source distillation, 2026-10-28; 21 identity-checked files with selected ranges; scope/readset. Fork-specific FastH3 params, tensor/schedule/RoPE and VSA dispatch, test/script limits; full engine/external FastVideo/model surface not mined mined — requested versus effective controls, ambient conflicts, head-interleaved QKV/FC1 swap/BF16 schedule, real partial VSA tiles/double top-k and dense-plus-coarse fallback → audit-h3-metal-fasth3-semantics; native/numerical/quality/performance not_run out-of-scope — tile arithmetic is not measured host footprint or memory-fit qualification out-of-scope — FastH3 disables requested SSD parameter; no new storage optimization or payload validation out-of-scope — local attention/dispatch is not network transport out-of-scope — runtime selection is not OS scheduling
Comfy-Org/ComfyUI @ b1a247c9cf9dbfda4b2c0a0c1d50950667eeaa0c (GNU GPL v3) Source-reading archive, inspected 2026-10-21; bounded execution/cache/graph/model-management/static-dynamic-patcher/sampler paths and selected tests; readset; not full-model/custom-node/provider-native coverage mined — managed weight/patch identity, partial unload versus detach and dynamic-backend boundary → comfy-ui; device behavior unverified mined — output versus object identity, ancestor fingerprints, lazy consumer references and retention versus validity; host/pin ownership out-of-scope — no storage implementation extracted out-of-scope — no transport implementation extracted out-of-scope — workflow scheduling is not OS scheduling
leejet/stable-diffusion.cpp @ b13a48219d5cdf408edcb93da6cd69b612ed03d3 (MIT) Supplied archive, inspected 2026-10-22: 18 bounded paths plus separately identity-checked README (19 blobs); historical receipt preserved. 2026-10-23 extension: 12 selected C++ blobs plus retained MIT text identity-checked, with line-scoped catalog/non-ZIP safetensors read/staging/mapping and immediate consumer cleanup; readsets. File identity is not full-file review; archive/submodules, model kernels and other-format implementations remain outside the bounded audit mined — native weight/runtime capacity, protected segment/prefetch lifetime → audit-sd-cpp-residency; native/backend behavior unverified mined — parameter storage versus compute staging and retained runtime ownership; loader host read/conversion buffers versus mapped owners; host peaks unmeasured mined — bounded catalog stamps versus content identity, range admission versus actual reads, mapping/shared-owner and newly created block cleanup → loader/storage boundaries; full other-format parsing, native failure/SSD/performance qualification remain open out-of-scope — device copies are not network transport out-of-scope — runner scheduling is not OS scheduling
NVIDIA/TensorRT-LLM @ f33e0e5fd skill-doc-only (.claude/skills/) mined — evidence taxonomy, kernel writing, casebook, roofline refs → dense-performance-evidence, kernel-writing-guide, inference-optimization-casebook, performance-ceiling-analysis mined — host overhead verdict + line-profiling loop → host-overhead-profiling, host-overhead-optimization mined — weight-movement/overlap + KV host-cache patterns → weight-loading-optimization; disk-level: negative (see below) out-of-scope — host/device weight-movement overlap remains in RAM/Storage, not network coverage mined — CPU affinity rule + env preflight → os-process-placement
Ascend/MindIE-SD @ 8481d39 skill-doc-only (.agents/skills/) mined — 5-layer analysis, bottleneck casebook → ascend-performance-analysis, ascend-optimization-casebook mined — host-opt async/pattern sections → weight-loading-optimization mined — load-path judgment, fixed-overhead accounting, offload tiers, weights-prep → weight-loading-optimization mined — USP strategy, masking formula, topology rules → ascend-distributed-parallel mined — device health, card-group contracts, measurement discipline → ascend-device-health
ascend-ai-coding/awesome-ascend-skills @ 75ec89c Historical skill/document import (skills/, external/cannbot/), not whole native repository mining; separate communication-wrapper source slice pinned to 75ec89ce9d401be8ac95980e1c3f42f8d4315057 mined — graph mode, operator profiling/tuning, tiling design → ascend-graph-mode, ascend-operator-profiling, ascend-operator-tuning, ascendc-tiling-design assessed/deferred — KV overview and async-stream recipe lack a complete transfer/completion implementation and retain cannbot license UNKNOWN; boundary/readset; no new RAM capability mined — device-side prefetch + diffusers CPU-offload playbook → weight-loading-optimization; disk-level: negative mined (wrapper-source only) — native/PyTorch test selection, tensor-byte meaning, timing/oracle coverage and rank-map counterexamples → ascend-distributed-parallel; full-pin readset; no native-collective or transport audit mined — env checks, device-busy preflight, thread/env tables → os-process-placement
cann/cannbot @ c0e2ad23ee1a73e3c0f84c8df1cc459e2aae3110 (selected official plugin: CANN-2.0) Direct canonical Git source inspection, 2026-10-23; fixed-stage model-inference workflow, three role instructions, registered callbacks and archive helper; readset/trace/license; dependent skills/recipes and host execution unread/unrun mined (one source-derived rule) — current-stage execution, actual quality result and comparable baseline versus lexical callback completion → ascend-performance-analysis; no numerical/backend/performance qualification out-of-scope — no host-memory mechanism extracted out-of-scope — progress-file I/O is not storage optimization out-of-scope — workflow instructions do not establish collective/transport implementation out-of-scope — agent workflow is not OS scheduling
vllm-project/vllm-ascend @ bc8115ed skill-doc-only (.agents/); version/responsibility routing mined — FP8/KV-replication/multimodal adaptation → ascend-model-adaptation unknown — runtime host logic not in sparse checkout mined — FP8 paired-tensor loading pattern → ascend-model-adaptation (Configure cell); runtime loader not in checkout unknown mined — Dockerfile thread/env ship defaults → os-process-placement (historical defaults only)
vllm-project/vllm @ 7f730b4cea9a66520a9200265928ebe016b48a39 (Apache-2.0) Dot bundle-mediated; scheduler.py admission/budgets/preemption/deferred frees and connector v1/base.py contracts/consumers; concrete connector, worker, cache-manager internals, config schema and tests unread mined — independent admission budgets and async-KV readiness → diagnose-vllm-admission-pressure; completion/retention/failure ownership → audit-vllm-kv-lifetimes; conditional proposals and unrun verification only out-of-scope — device KV is not host RAM out-of-scope — external-hit API establishes no physical tier out-of-scope — connector contract is not transport implementation out-of-scope — engine scheduling is not OS priority control
vllm-project/vllm-ascend @ 8a8e1e05ecb64a30804c99c8f362909f9a0cb5bf (Apache-2.0; separate runtime pin) Dot bundle-mediated; compilation/acl_graph.py, pinned graph-mode guide and selected test_acl_graph.py cases; tests inspected by supplier, not run; caller/ENPU ordering and helpers untraced; native single-tier spec/worker, registration and DMA binding read directly (seven-file ledger); external vLLM dependencies unpinned; separate model-adapter routing mined — effective dispatch, caller-owned stable inputs, branch-specific replay/update order and capture-resource failures → ascend-aclgraph-capture-replay; separate from the older skill-doc pin mined — normal event-query-gated CPU descriptor-pool ownership and wait/recycle distinction → host-memory-management; source candidate, native tests not run; shared/tiering and allocator behavior excluded out-of-scope out-of-scope — offloader synchronization is not network evidence out-of-scope — ACLGraph runtime supplies no new OS-control evidence; older Dockerfile/thread-env defaults remain scoped to bc8115ed
Ascend/pytorch (TorchNPU) @ 67511c53cd4c88014f6123de7097677e60e85faa (upstream attribution notices retained in source notes) Dot bundle-mediated; device/host allocators and bounded copy/record-stream/config/stats/binding/test paths in linked ledgers; underlying ATen host allocator and broader capture/IPC/driver behavior unread mined — stream-use lifetime versus ordering, HBM counters/fragmentation and feature-gated controls → torchnpu-device-memory-lifecycle; tests unrun mined — owned/external pinned buffers, host-specific counters, default/expandable paths and unresolved registration-version warning → torchnpu-pinned-host-memory-lifecycle; tests unrun out-of-scope out-of-scope — H2D/D2H, registration and IPC are not network coverage out-of-scope — no OS-priority implementation
Dao-AILab/causal-conv1d @ cd81f0413cad2fc1e6f17e785ac39f59aae690cd (BSD-3-Clause) Bounded source distillation, 2026-10-27; 10 retained files / 119,136 bytes matched to Git blobs; forward/update wrappers, compiled gates, selected packed/state branches, CUDA build/binding paths and test intent; readset/notice mined (narrow) — forward versus in-place update, dtype/layout/packed history, gathered state rows and circular cursors; build targets versus observed dispatch → kernel-writing-guide; native/integration/numerical/performance not_run; sm_89 compatibility unqualified out-of-scope — device convolution state is not host RAM out-of-scope — wheel retrieval is not storage optimization out-of-scope — no transport implementation extracted out-of-scope — request-state ownership is not OS scheduling
mindspore-ai/akg @ 5aa15f3fe4d856eb60cd3b27447e04f5f1fb4dff (Apache-2.0) Earlier discovery retained; 2026-10-23 bounded AKG-MLIR CUDA Affine tiling pass/options/pipeline/driver and one static elementwise FileCheck fixture; readset mined (narrow) — target/option/loop gates, full point-loop bounds and guarded body placement → kernel-writing-guide; compiler/device execution and gains unverified; no Ascend qualification unknown — host implementation not extracted negative — scanned 2026-10-15, no LLM storage material (carried finding, not rescanned) unknown — transport not extracted negative — 2026-10-15 OS scan: identifier false-positives only (carried finding, not rescanned)
mindie-agent/mindie-agent @ 6a81b41 full out-of-scope — agent tooling, not serving performance out-of-scope mined (narrow) — logical-vs-physical I/O + cache-flush measurement caveat → weight-loading-optimization out-of-scope out-of-scope
hahnyuan/LLM-Viewer @ 1893e4b full mined — roofline model + hardware params → performance-ceiling-analysis (L1) out-of-scope out-of-scope out-of-scope out-of-scope
ebugger/Empirical-Roofline-Toolkit @ 0771fa9 full mined — empirical roofline method → performance-ceiling-analysis (L2) out-of-scope out-of-scope out-of-scope out-of-scope
foundation-model-stack/fastsafetensors @ 219e256 full (shallow pin, wave 5) out-of-scope — loading/collective delivery only mined (partial) — pinned bounce-buffer staging, reader NUMA binding → weight-loading-optimization §7 mined — loading I/O mechanics (no-mmap design, bounce reader, GDS, readiness overlap, partial reads, static planner) + measurement protocol → weight-loading-optimization §7; wave-6 approved saver.py semantics → §8 (carried evidence; not re-mined this wave) mined (source-only) — file owner → whole-tensor broadcast / TP scatter; PyTorch coalesced-run selection, readiness, storage ownership and early close → weight-loading-optimization §9; full-pin readset; local copies excluded, transport/performance unverified mined (narrow) — reader worker NUMA binding + O_DIRECT per-filesystem policy → weight-loading-optimization §7
LMCache/LMCache @ c3b875a full (shallow pin, wave 5) out-of-scope — approved scope was CPU/local-storage KV management mined — L1 DRAM tier, admission dial, watermark eviction, multi-L1 overflow → kv-tier-management mined — L2 local adapters (fs/nixl/raw_block/dax), serde capacity lever, persist/recover → kv-tier-management out-of-scope — remote adapters noted only mined (narrow) — MP process/thread concurrency model (isolation, client-affinity pools, TTL locks) → kv-tier-management
sgl-project/sglang @ df13d5dce31abfeff0e701a62e8c39a136758e6c (Apache-2.0; independent diffusion supplement) Bounded multimodal_gen monolithic client/scheduler/worker, composed pipeline and stage/component-use call chain; readset; supplier checked one selected blob, not whole tree mined — stage/use readiness, retention and executor rank boundaries → audit-sglang-diffusion-lifetimes; native tests not run mined — host request/job/scheduler-object and finalizer lifetimes only; device memory is not RAM out-of-scope — output-file API is not storage-I/O intelligence out-of-scope — H2D/IPC and barrier declarations do not qualify network transport out-of-scope — engine queues are not OS scheduling
ggml-org/llama.cpp @ 3e390af18de1131dda27913c00511725b4274c8a (MIT; loading/host snapshot) full (shallow pin, wave 5); owner scope/pin map; static inspection 2026-10-22 carried out-of-scope — approved scope was loading modes and host placement mined — mmap/mlock residency, lazy tensors, host weight placement (--cpu-moe family), KV host offload → weight-loading-optimization §6 mined — loading modes (mmap/mlock/dio/lazy), page-cache interactions, fit-probe bypass → weight-loading-optimization §6 out-of-scope mined — NUMA modes (distribute/isolate/numactl), gen-vs-batch thread/affinity splits, numa_balancing rule → os-process-placement
ggml-org/llama.cpp @ 707616feb5f379e99ff7442680a55b4a1704c7c9 (MIT; separate runtime snapshot, static inspection 2026-10-21 carried) Owner scope/pin map; reading bundle; bounded context/memory/graph/scheduler and server task/slot call path; native assertions inspected, not run; all model builders, memory variants and backend kernels/capture caches not audited mined — partial-ubatch progress, topology/input graph-reuse gates and backend copy/event obligations → audit-llama-runtime-state; actual backend execution unverified mined (narrow) — host-owned task/result waiters and slot prompt-token bookkeeping; stateful retention versus cancellation; device KV is not host RAM out-of-scope — older loading owner/pin retained out-of-scope — scheduler copies do not establish network/RPC coverage out-of-scope — no new placement or OS controls
axboe/fio @ acb7a302 pack-mediated (wave 6; HOWTO.rst targeted sections + examples/aio-read.fio) out-of-scope located-not-mined — cache-state and run-shape material partially feeds the ledger/run-classification rules mined — workload matching, requested-vs-achieved depth, cache-state ledger, run-shape classification, output schema/units → storage-io-measurement out-of-scope out-of-scope
sysstat/sysstat @ efd0c445 pack-mediated (wave 6; man/iostat.in, man/pidstat.1) out-of-scope mined (narrow) — per-process I/O/fault attribution caveats → storage-io-measurement §8 mined — per-device attribution, saturation guards (%util/%iowait) → storage-io-measurement §6-7 out-of-scope mined (narrow) — CPU-side scheduling-pressure vs disk-hypothesis rules (%wait, context switches) → storage-io-measurement §8
Linux cgroup v2 docs — kernel.org live 2026-10-15 (revision unidentified) + v6.12 cgroup-v2.rst (reproducible baseline) pack-mediated (wave 6; core/CPU/Memory/IO/Cpuset interface sections) out-of-scope mined — memory pressure/events triage, high/low/max semantics → cgroup-resource-controls mined (conditional) — io.max caps gated on confirmed block-backed traffic → cgroup-resource-controls out-of-scope mined — cpu.max/weight quota-vs-contention (cpu.stat vs .local), requested/effective cpuset, hierarchy/delegation preflight → cgroup-resource-controls
cann/oam-tools @ 8440935f (!302 import; later master f3cf4115 labeled [V2], never merged into !302 claims) pack-mediated (wave 6; cann-perf-breakdown, cann-multistream-optimize, cann-npu-perfanalysis + selected references/scripts). Lineage: jinyingqi/* originals → !302 import — one lineage, not independent corroboration; original SHAs/byte equivalence unverified mined — representative-step selection, code_ref source ownership, attribution-aware diagnosis, dependency DAG (data/state/event/collective_order), bounded overlap, correctness-first acceptance, metric separation, device-memory domain qualification → cann-attribution-overlap out-of-scope (host RAM not established; device HBM/UB evidence must not fill the RAM row) out-of-scope mined — exposed-communication diagnosis, wait pollution, evidence-gated compute/comm overlap → cann-attribution-overlap mined (bridge only) — host-event coverage of device bubbles, uncertainty-aware → cann-attribution-overlap
C1 / DCP async-save-only approval — pytorch/pytorch @ 7d239835e773c91689eb298692097f4a3340491f; live async recipe retrieved 2026-10-15 state_dict_saver.py async path, staging.py, directly called _state_dict_stager.py, _async_thread_executor.py, filesystem.py staging/finalization; BSD-style implementation license mined — training-visible staging pause/mutation boundary → dcp-async-save-performance; no NPU qualification mined — separate staging/upload futures, cached pinned CPU buffers, reuse only after prior upload, CPU/RAM contention mined — bounded in-flight saves and upload timing, writer-specific completion/durability distinction; no distributed restore audit out-of-scope — D2H and same-host IPC are not network coverage mined (narrow) — background-worker contention and caller-owned stager cleanup; no OS scheduling changes
B1 / NVIDIA DALI @ 6fe47c48d3b0ca335f5e1afd3c77c750b2c7e041 (Apache-2.0) pipeline.py constructor/API, executor_statistics, queue deserialization; Python surface only mined — CPU/GPU stage overlap and executor-mode gates → training-input-pipeline mined — queue/buffer sizing and per-output real/reserved memory statistics; legacy stats require exec_dynamic=False out-of-scope out-of-scope — host/device copies and local buffers are not network evidence out-of-scope
B2 / Mosaic Streaming @ d99bf9c7cdf2dd4ed62a4960ed35270b93337a5f (Apache-2.0) dataset.py configuration, cache admission/eviction, prepare/ready/yield loops out-of-scope mined — per-worker sample look-ahead versus memory/cache budget → training-input-pipeline mined — raw+compressed shard admission, cache minimum and LRU/redownload trade-off mined — remote dataset download look-ahead/cache-churn decisions only; no collective optimization out-of-scope
B3 / FFCV @ 3a12966b3afe3a81733a732e633317d747bfaac7 (Apache-2.0; historical 2024 pin) loader.py configuration/manager selection, complete os_cache.py; process-cache algorithm not read out-of-scope mined — dataset-fits-RAM versus process cache, batches-ahead buffers → training-input-pipeline mined — read-only mmap and documented quasi-random read-locality choice; .beton required out-of-scope mined — cache ownership and traversal configuration; distributed QUASI_RANDOM excluded, current compatibility unverified
C3 / DLRover FlashCheckpoint @ e35b1ad90e2928ca6bacf5d22117f713566c5cb0 (Apache-2.0) DDP/full engine → common-directory saver → POSIX storage; full/sharded CPU/Gloo replicas and restore consumer; readset located-not-mined — HCCL device branch observed; NPU compatibility not validated mined — memory readiness/step gates and replica byte/metadata ownership → checkpoint-recovery-consistency; restored values unverified mined — queued save versus shard/done/tracker completion; serializer/synchronization boundaries, no durability proof mined — actual full/sharded Gloo byte/metadata paths and world-position groups; gather/consumer correctness and throughput unverified mined — worker versus helper/host lifetime; fallback daemon cannot persist after parent exits
C4 / NVIDIA Resiliency Extension @ 49af0b03f14550d36a60dcfebd573848b5fd8435 (Apache-2.0 source headers; Megatron-Core lineage) local base_manager.py complete-iteration selection/save/finalizer and local_manager.py dirty/final file lifecycle mined (contract only) — CUDA D2H synchronized before async request returns; no NPU qualification mined — snapshot/replica lifetime constraints → checkpoint-recovery-consistency mined — clean/dirty publication, complete-rank generation selection and incomplete-save rejection; no power-loss proof mined — all-rank availability/finalization and replica failure domains, not transport throughput out-of-scope
CR1 / DeepSpeed ZeRO-Infinity @ 5f266e26d216a705d9c64cac88fb813cefdbac4b (Apache-2.0) complete short offload_config.py, official ZeRO-3 live offload-field docs; no runtime/checkpoint audit mined — parameter stage-3 and optimizer stage-1/2/3 boundaries → training-resource-budget mined — CPU optimizer budget, pinned RAM, element-count residency and gated core share mined — NVMe buffer pools and tiled read/compute/write overlap intent; buffer-size units unresolved in approved excerpt out-of-scope — CPU/device transfer is not network coverage mined — CPU resource-budget qualification; no privileged changes
CR5 / Ascend MindSpeed adaptive memory — historical core_r0.8.0 document @ 53193db8bf5def407c4041a9beb3f4c9e9773daf (root default BSD-3-Clause terms; identified file exceptions) 2026-10-15 document inspection retained; 2026-10-30 pinned readset: feature guard, allocator/callback, saved-storage rescue, wrapper and affinity branch mined (historical source candidate) — spare-memory/recompute/swap decision and effective selection → training-resource-budget; changed-layer comparison rejected as controlled gain mined — eligible shared-storage CPU rescue/return and allocator prerequisites; no whole-model validation out-of-scope out-of-scope — NPU/CPU copies not network evidence mined (historical conditions) — validation versus dispatch exclusions; 910A/910B binding, topology/tools and CPU-share assumptions; no current compatibility claim
InferMatrixLab/vllm-rlt (legacy ThinkFlowLab/vllm-rlt) @ 4a350344027960a48384626aa646f1765fda6d4f (root Apache-2.0; model attribution in NOTICE) Bounded manager/runner/scheduler/Ouro/host-metadata/Torch-consumer chain; candidate, source map, construction/cases; historical intake retained source-guidance — synchronous LAST_EXITED copying versus SHARED, written-prefix validity, later deeper attention and normal release/wait/free; candidate, native runtime and efficacy not_run out-of-scope — host bookkeeping does not establish host-RAM coverage out-of-scope — no storage mechanism extracted out-of-scope — local tensor copies; no transport mechanism extracted out-of-scope — no OS mechanism extracted
vllm-project/afd-plugin @ df8d6a0c403c3ca1b4ed9cf1687e7204908bebec (Apache-2.0 selected Python readset; retained MIT CAM subset notice) Fixed-pin topology/factory/runner/metadata/DeepSeek dense proxy and P2pNccl reads; full ledger; historical intake retained mined (bounded source-only candidate) — role/world/subgroup rank ledger and eager dense-FFN per-stage/per-peer payload ownership → audit-afd-p2p-exchanges; native/backend/model validation not_run out-of-scope — no host-memory mechanism extracted out-of-scope — no storage mechanism extracted source call chain mined — actual NCCL-backed send/recv consumer identified; underlying completion, graph and multi-host/physical transport unqualified; no Network coverage credit out-of-scope — no OS mechanism extracted

Wave-8 implementation provenance (Dot bundles integrated 2026-10-15): admission, KV lifetimes, ACLGraph, device HBM, pinned host RAM. These preserve the supplier's 2026-10-15 code/docs inspection; upstream reads were not repeated locally. F denotes pinned behavior or an identified contract; P denotes an unvalidated procedure. The three source pins are independent, not a tested dependency set. This batch extracts no paper-derived mechanism; papers linked by discovery material remain unmined, with no coverage credit.

Home-repo note: InferMatrixLab/InferRSI @ 4c8e128 is the scaffold this branch lives in (evidence/claim discipline, benchmark hygiene, RunSpec) — not an external mining source. The local sibling clone at codex/skill-eval-bootstrap (82218b4) is a different fork lineage; see §2.

PyTorch compiler and asynchronous-save responsibilities

The compiler/checkpoint scope map links the f15b476814ebc5eade36fb40512e379ebf79dd60 technical-document dependency card with the separately inspected 7d239835e773c91689eb298692097f4a3340491f DCP implementation readset and its independently retrieved live recipe. It preserves document versus implementation evidence, source/recipe dates and attribution, and different mutation, completion and measurement boundaries. The two sources do not establish a tested combined runtime stack.

TensorRT-LLM retained source responsibilities

The source and shared-assumption map connects the historical f33e0e5fd skill-document row to the separately pinned c9b18eefa731dc59b0091bdfff6d890aa9d1e98e PD/KV-transfer peer card. It distinguishes startup and request-time denominators, local H2D and network transport, and the workload/layout/resource controls needed for a PD comparison. Original prefix precision, missing methodology inspection dates, mixed-source attribution, owner readsets and candidate/imported limits remain unchanged.

vLLM retained source responsibilities

Use the existing engine/scheduler/KV responsibility map to distinguish the 2521446ac8c92937b5a32b7dc2a84ef7fa8e99c5 engine guide (inspection 2026-10-14) from the 7f730b4cea9a66520a9200265928ebe016b48a39 admission and connector-lifetime ledgers (supplier inspection 2026-10-15). The existing source rows and paper inventories keep their own evidence scope; navigation does not repeat an upstream inspection or qualify concrete worker/connector conformance, cross-pin compatibility or a physical transport.

Reviewed systems-paper mechanisms

mined below means scoped extraction into the linked candidate artifacts; the evidence column distinguishes retained packs from direct public-paper reads. Readsets preserve exact sections, equations, tables, source hashes where supplied, metric denominators and unreported limitations. Versions are paper identities, not fabricated implementation SHAs or a version-matched runtime stack.

Original source / version Inspected scope and local evidence Mechanism / consumer Evidence limits
Vidur — 2405.05465v2 A readset; §§3–7, A.1–A.2 mined — operator/queue model calibration and joint-SLO shortlist → calibrate-serving-simulation, ceiling analysis Empirical prediction, not physical bound; near-capacity CPU overhead and 12.65% maximum error in the specified appendix case; no current runtime calibration
Mooncake — FAST '25 proceedings, pp. 155-170 Direct public-paper read, retained qualification 2026-10-31; source condition and readset, §2.2, Table 1, Eqs. 1-2 mined — conditional prefix-KV transfer versus saved-prefill-work comparison → performance-ceiling-analysis Analytical gate only; current inputs and E2E benefit unverified. SSD mechanics excluded. Original transfer-gates extraction history remains positive; missing synthesis novelty UNKNOWN. Raw-paper redistribution permission UNKNOWN.
FlexGen — ICML 2023 / PMLR 202:31094–31116, official ten-author edition Direct scoped public-paper qualification, 2026-10-31; condition, exact digest and readset, §§3–4.3 and selected Appendix A.3 formulas; Figures 1–3, Algorithm 1, Eq. 1, Tables 2–3 mined — joint weights/KV/activation placement, resident plus working-storage peaks and offline latency/throughput conditions → performance-ceiling-analysis Source-derived candidate; empirical not_run. Perfect-overlap fitted model, relaxed-placement OOM and unresolved bls < 20 versus 32 × 8 wording retained; no current runtime, quality or gain qualification. Attributed CC BY 4.0 synthesis; missing-archive novelty UNKNOWN.
Orca — OSDI 2022 proceedings Exact readset; §§3–6, Algorithm 1 mined — iteration eligibility, selective batching, FCFS/reservation → assess-serving-preemption Historical engine/harness and normalized-median denominators; not present vLLM behavior or fairness proof
Sarathi-Serve — OSDI 2024 proceedings, pp. 117–134 Fresh official-edition grounding, 2026-10-30; full text and artifact appendix; §§4.1–4.3, §5 setup, Figures 9/14 and Table 4 checked for the case record mined — decode/partial-prefill/new-request token accounting and chunk-cost tradeoffs → one optimization-search-policy case Source-derived candidate; empirical not_run. Combined design has worse P50 TTFT than hybrid-only in both Table 4 traces; no current-engine, universal-budget or fairness claim. Raw source reuse rights UNKNOWN; no archive recovery or novelty over unavailable supplier synthesis claimed.
FastServe — 2305.05920v3 Exact readset mined — service priority, promotion and suspended-state host residency → serving-preemption candidate Aggregate tail improvement is not tenant fairness; same-engine contrast distinct from historical-vLLM comparison
Llumnix — 2406.03243v1 Exact readset mined — replica migration, virtual headroom, pre-copy/downtime and host staging → evaluate-elastic-serving-placement Virtual headroom is not physical capacity; normal-class cost and evaluated-artifact fault-tolerance limit retained
LoongServe — 2404.09526v2 Exact readset mined — elastic sequence groups, phase-dependent state placement and ongoing attention communication → elastic-placement candidate Distributed device KV is not host RAM; group transitions have different migration costs; no current engine/NPU claim
ZeRO-Offload — 2101.06840v1 C readset, ZO1–ZO3 mechanisms mined — CPU optimizer ownership, update/return pipeline and separately gated delayed updates → training-resource-budget Restricted graph-cut model; Table 1 discrepancy; delayed updates change semantics; not the DeepSpeed config pin
Checkmate — 1910.02653v3 C readset, CM1–CM2 mined — event-level retain/recompute and dependency versus capacity feasibility → plan-activation-residency Static-cost model and rounded-plan limits; activation rematerialization is not recovery checkpointing
OLLA — 2210.12924v2 C readset, OL1–OL2 mined — lifetime shortening and static address packing → activation-residency candidate Device address placement is not host/SSD tiering; runtime amortization estimate is not measured E2E gain
Alpa — 2201.12023v3 C readset, AL1–AL2 mined — stage/mesh/sharding and cross-mesh resharding → choose-parallel-training-plan Conditional hierarchical plan, not global optimum; intra-op compute simplification does not describe all stage costs
Zero Bubble — 2401.10241v1 C readset, ZB1–ZB3 mined — split input/weight gradients, activation caps, V schedules and optimizer rollback → assess-split-backward-schedule Calculated bubbles versus measured throughput; activation cap versus total HBM; rollback is distinct from stale updates
FlashAttention — 2205.14135v2 D readset and mechanisms mined — online statistics, tiled IO and backward recomputation → diagnose-attention-bottlenecks Scoped dense exact-attention/fast-memory assumptions; operation mix can change after IO reduction
FlashAttention-2 — 2307.08691v1 Same D readset mined — non-matmul work, output ownership and independent query tiles → attention diagnosis Combined interventions are not isolated causal ablations; Accelerator only
FlashAttention-3 — 2407.08608v2 Same D readset; author-reported cases mined — async dependencies, compiler/register trade-offs and FP8 layout/accuracy → attention diagnosis Hopper primitives establish no Ascend support; synthetic accuracy is not model-quality validation

FlashVector's host materialization/assembly and Agentic Kernel Optimization's regime-specific kernel cases are cross-links to the same source identities in §2 below, not independent corroboration. B/C decision cases are hypothetical; D experiments are author-reported. No new SSD or OS mechanism is credited from A–F; Network links require actual inter-node state/collective transfer.

Missing foundation input: the approved earlier archive omnirsi-paper-intelligence-2026-10-15.zip (ZeRO-Infinity, FlexGen, Sarathi-Serve, DistServe, PagedAttention, Mooncake) is referenced by the packs but absent from the supplied local directory. Its six-paper extraction and standalone candidates are not imported or counted here. Existing DeepSpeed configuration evidence and Mooncake transport discovery are not substitutes for those paper readsets. The separate public-source Mooncake condition above does not recover that archive or import its earlier standalone candidate.

The separate public-source FlexGen reference above also leaves the foundation archive and its supplier synthesis unavailable; it neither imports that synthesis nor establishes novelty against its unseen text.

The separate Sarathi-Serve case above uses a freshly pinned official edition; it does not recover or import that archive or its supplier-authored synthesis.

Separately, the fresh official OSDI 24 DistServe edition is retained in the phase-placement reference under optimization-search-policy (candidate, empirical validation not_run). The 2026-10-30 full-paper qualification and selected visual checks support the independent-versus-paired-stage feasible sets, joint-SLO per-GPU denominator and simulation limits; the source record retains the exact edition, readset and UNKNOWN rights. This source requalification does not recover the archive, establish novelty over its unseen synthesis or validate a current serving engine.

Negative findings (scoped to inspected paths and revisions)

  • Disk-level storage I/O mechanics (mmap/pinned staging buffers, shard-parallel loading, fio/iostat/page-cache benchmarking, checkpoint save/restore I/O, disk-tier offload): zero material in the 8 first-layer repos listed above, as visible in their checkout coverage (TRT-LLM .claude/, MindIE-SD .agents/, vllm-ascend .agents/ are skill-doc-only sparse checkouts). Queries used: safetensors, mmap, memory_map, pinned, O_DIRECT, posix_fadvise, readahead, page cache, fio, iostat, nvme, startup time, load latency, async save. Recorded 2026-10-15; also embedded in src/inferrsi/data/skill_library/methods/weight-loading-optimization/SKILL.md.
  • cgroups / cpuset / isolcpus / nice / ionice / SCHED_FIFO: zero hits in the same 8 repos and scope. os-process-placement covers placement, affinity, thread env, and container flags/ulimits only.
  • Wave evidence files (grep logs, per-theme verdicts, mechanism extractions) are session-local under the research tmp directory and not committed to this branch.
  • Wave-5 approved mining (2026-10-15) closed part of the first negative finding: loading modes and mmap/mlock placement (llama.cpp), pinned-staging parallel-read mechanics and a load-path measurement protocol (fastsafetensors), runtime KV-to-disk tiering (LMCache).
  • Wave-6 pack-mediated mining (2026-10-15) closed the rest: checkpoint save/restore semantics (weight-loading-optimization §8) and block-device measurement methodology (storage-io-measurement). Pack mediation: the gate owners supplied read-only research packs (fio, sysstat, kernel cgroup-v2 docs, cann/oam-tools); receiving a pack is not mining — extraction into the linked skills happened in this workspace. Pack facts are documentation-level; no benchmarks were run, no caches manipulated, no settings changed.
  • Approval is scoped per reference × inspected subject × SearchSpace gap — repository paths, paper sections, documentation versions and expert-case boundaries are recorded rather than treating every reference as a repository.

2 · Methodology and corpus references

Role key: history learning · corpus · distillation · evolution · search · evaluation · reference. Methodology references are not scored against the SSD/OS systems columns.

Reference (upstream @ revision) Role Used for Consumed by
LearningToCommit/LearningToCommit @ 7e5a1d7 history learning temporal-split method (train/test cutoff discipline) repository-evolution-analysis
yetone/magpie @ 77800032 corpus carried 3,428-commit history and subsystem analysis; not causal proof of speed or automation repository-evolution-analysis; new coordination case pending Dot delivery and owner review
VectorSpaceLab/AREX-Skill @ ac3fe1af distillation repo→skill distillation model, artifact lifecycle, refresh/provenance policy npu-skill-factory
microsoft/SkillOpt @ 343db22 evolution bounded-edit skill evolution npu-skill-factory, skill-evolution-playbook, dense-performance-evidence, optimization-search-policy
Qwen-Applications/Trace2Skill @ 3d0b52a evolution Trace2Skill pool consolidation skill-evolution-playbook
JiusiServe/vllm-evolve @ 43cc82c search scheduling-algorithm evolution, search policy optimization-search-policy, dense-performance-evidence, inference-benchmark-design
Dong1017/OmniRSI @ codex/skill-eval-bootstrap (82218b4) evaluation skill_distill / skill_eval harness, no_skill/human/distilled contract, Tier A pilot npu-skill-factory (evaluation contract)
InferMatrixLab/InferRSI PR #9 @ 4ad551a9 reference skill_library/ layout + knowledge records npu-skill-factory (bundle layout)
RRSI — arXiv 2609.24972v3 search; mined via reviewed Pack F bounded harness proposals; calibrated noise/cost/novelty gates; grouped-ablation limits, replacing the earlier generic constraint summary optimization-search-policy; exact ledger
arXiv 2608.01867 (CRISP) search critical-step classification optimization-search-policy
A1 / Agent Skills @ 69ef37e9424c0a7ea9dd2293b559e43ec8176379 reference; Dot A-approved minimal consumption Specification frontmatter/body/progressive disclosure and client guide catalog/activation/resource sections directly verified 2026-10-15; format guidance, not an execution permission grant src/inferrsi/skill_catalog.py, existing CLI/arguments; metadata projection + explicit selection + resource resolution; no installer/router/client configuration
CR6 / Stas Bekman ML Engineering Open Book @ ee7517e0f562ff0e7d56c3e88c619d0c0c496ba7 (CC BY-SA 4.0 declared by source skill) expert methodology skills/ml-engineering/SKILL.md scoped principles, skills/evaluate-cluster/SKILL.md first 100 lines, targeted performance README MFU/HFU/NUMA/GC sections; scripts identified only, excluded storage/input/recovery lanes not mined training-resource-budget + explicitly attributed/share-alike references/stas-decision-notes.md; Accelerator/RAM/Network/OS diagnosis and proposed verification, no local results

Reviewed paper methodology and cases

The following paper versions supplement, rather than replace or certify, the repository pins above. mined means accepted candidate content. Source inspection is supplier/owner evidence dated 2026-10-15; no methodology efficacy was measured in InferRSI. These rows do not create hardware coverage merely from experimental hardware or agent-development activity.

Original source / version Inspected scope / source notes Accepted contribution and consumer Boundary
Vidur v2 (same identity as §1) A readset mined — calibration/queueing uncertainty and constrained shortlist → ceiling/calibration/search A cross-link, not a second independent source
InferenceBench — 2607.20468v1 Audit, A readset §§1–6, A–G mined — bounded search, independent timing integrity, incumbent/final-artifact preservation → search policy and benchmark design Within-vLLM two-hour main comparison differs from per-engine grid; displayed date/ID anomaly unresolved
FlashVector — 2609.17391v1 Audit, §§4–5, Algorithm 1, Tables 1–4 mined — noise-aware cross-layer redirection, host assembly/materialization, full-stack validation → ceiling/host guidance Component versus service denominators; Model B SLO inconsistency retained; no Network from gRPC alone
Agentic Kernel Optimization — 2608.14560v1 Audit, main text and A–C mined — regime dispatch, exactness/timing integrity and stalled-direction correction → search/ceiling cases PyTorch versus FlashInfer baselines differ; SM utilization versus throughput is unresolved without matched definitions; date anomaly retained
Repo-To-Skill — 2609.02749v1 Ledger, E readset §§2–5, A.1–A.2 mined — case/knowledge/amendment/new-skill admission and independent verification axes → factory Task-conditioned benchmark pools are not the entire public library; no AREX execution
Learning to Commit — 2603.26664v1 Ledger, §§1–5 mined — contrastive historical lesson, scope/contradiction/expiration → repository evolution Accepted implementation is not a timeless invariant; chronology does not prove every contamination path absent
Trace2Skill — 2603.25158v5 Ledger, E readset §§2–4, A–I mined — causal error analysis, successful-behavior preservation, consolidation and interaction checks → evolution playbook Consensus is not acceptance; no universal trace count; code pin not matched to paper
SkillOpt — 2605.23904v2 Ledger, §§3–4, A–C mined — bounded edits, versioned rejection context and optimizer-memory separation → factory/evolution/evidence Protocol and cost-denominator discrepancies retained; no automatic promotion
Dream-RSI — 2609.14858v2 F2 ledger mined — prefix-safe replay and supported actions → search-policy interface knowledge Replay does not generate unseen branches or prove online improvement; no controller implemented
AIDE² — 2609.26457v1 F3 ledger mined — inner/private/outer evaluation and solver-versus-improver distinction → evolution/search Task-solving gains coexist with an inconclusive improver experiment; costs differ by benchmark
JitRL — 2601.18510v4 F4 ledger mined — candidate-scoring/reward access and finite-memory evidence → adaptation-interface knowledge Logit/scoring access is a prerequisite, not a Markdown capability; conditional theorem and matched counter-results retained

Applied owner-review decisions: R1–R6. E-U1 maps to repository evolution; E-U2 to factory admission; E-U3/E-U4 to the evolution playbook; E-U5 to the evidence-cost note. Pack F's semantic amendment is reconciled with search policy, not applied blindly or turned into a new framework. The source packs' integration notes remain historical proposals; the current bodies and these two matrices record their actual destinations.

A1 preserves Dot A's Vercel/OpenCode observations as supplied context only; those clients were not installed, configured or independently runtime-tested. Their version-specific APIs are not advertised as this CLI's behavior. No third matrix or automatic discovery/update layer was added.

Direct wave-7 source readsets and restrictions: inputs B1–B3, recovery C3–C4, cross-resource CR1/CR5/CR6. CR6's adapted note retains named attribution and CC BY-SA 4.0 share-alike; CR5 retains its 2026-10-15 documentation snapshot; the 2026-10-30 bounded source follow-up resolves the historical full pin/default license and selected allocator/wrapper/affinity paths. Current runtime compatibility remains unqualified.

DCP source/version reconciliation, exact links and tutorial snapshot hash: dcp-async-save-performance/references/sources.md. The live tutorial and pinned implementation differ on caller-side state-dict construction and cleanup details; claims follow the inspected implementation. Approval is save-performance only, not the broader C1 recovery proposal.

Notes:

  • Same-name repos are not the same project: InferMatrixLab/InferRSI (upstream scaffold) ≠ Dong1017/OmniRSI (sibling evaluation fork). The two local magpie checkouts share HEAD 77800032.
  • Wave-5 additions (fastsafetensors, LMCache, llama.cpp) are systems sources and appear in §1 only, under their approved scopes.

RFC 17 reconciliation: inspected main corpus

Local records below were inspected on 2026-10-16 after merging upstream main c13027983b853fee3700de6aabde52b72e61885a. Their source inspections remain carried at the dates/pins in each record; original repositories/papers were not reread. That reconciliation added navigation to already imported mechanisms, not new candidate skills or measured coverage, and left catalog IDs, tiers, languages and licenses unchanged. The later English-only library update retains the English procedures linked below.

Canonical source group Locally inspected scope / extraction Canonical material and limits
diffusers / dependency @ efe46a5b177af67c64b3666da8ddddac7ee12163 Group/leaf offload and asynchronous prefetch offer different memory-latency tradeoffs; hook compatibility and host allocation must be evaluated. diffusers.cuda.diffusion.group_offload_transfer_overlap; imported, locally_verified=false; preserve source readset and counter-signals
flashattention / dependency @ 1fc0221183e799363001394a12dd9e78e15f5dda Select an attention generation using its actual GPU, dtype and interface requirements; package names and installation paths are not interchangeable. flashattention.cuda.attention.generation_specific_dispatch; imported, locally_verified=false; preserve source readset and counter-signals
flashinfer / dependency @ 3637083a3a3d08538cce60937cd876b17779c6f0 Paged attention separates planning from execution; auto dispatch and CUDA graph buffer ownership are part of the reproducibility boundary. flashinfer.cuda.llm.paged_decode_dispatch; imported, locally_verified=false; preserve source readset and counter-signals
pytorch / dependency @ f15b476814ebc5eade36fb40512e379ebf79dd60 CUDA graph replay can reduce host launch overhead, but shape specialization, pointer stability and output lifetime remain independent constraints. pytorch.cuda.compiler.cudagraph_shapes_and_lifetimes; imported, locally_verified=false; preserve source readset and counter-signals
transformers / dependency @ 2126f65b0ab267e113e78a002447fc7094de83d5 Dynamic, static, offloaded and quantized KV caches have different contracts; select by workload and API support rather than a universal ranking. transformers.common.llm.kv_cache_strategy_contracts; imported, locally_verified=false; preserve source readset and counter-signals
triton / dependency @ 4eda6cc91e86553a2517d1c764ea2967985553ad Fuse a bandwidth-bound reduction when its working set fits on chip; choose launch geometry using the compiled resource footprint. triton.common.kernel.bandwidth_fusion_resource_limits; imported, locally_verified=false; preserve source readset and counter-signals
cache_dit / peer @ a57c826d3527736a0d1f1b0243d47568c350eb5f DBCache skips intermediate transformer work using residual similarity, with computed boundary blocks and warmup controlling approximation. cache_dit.common.diffusion.residual_cache_calibration; imported, locally_verified=false; preserve source readset and counter-signals
lmdeploy / peer @ 822dddb8b3bc895eaf6cffb45a5514768e7ecb84 KV compression can increase cache capacity yet reduce throughput; distinguish engine-specific quantizers and validate long-context quality. lmdeploy.cuda.llm.kv_quantization_capacity_cost; imported, locally_verified=false; preserve source readset and counter-signals
sglang / peer @ f7ad4345b86d147a1c3095a3cebabca9a33ebaa1 Move reusable prefix KV across device, host and storage tiers while accounting for sharing scope, layout conversion and prefetch policy. sglang.cuda.llm.hierarchical_prefix_cache; imported, locally_verified=false; preserve source readset and counter-signals
tensorrt_llm / peer @ c9b18eefa731dc59b0091bdfff6d890aa9d1e98e Separate prefill and decode resources when workload interference dominates the added transfer, queueing and layout-conversion costs. tensorrt_llm.cuda.llm.prefill_decode_disaggregation; imported, locally_verified=false; preserve source readset and counter-signals
xdit / peer @ f7c16aa958379a9f0a0302350fe0e1bfcec5f23c USP, CFG splitting and PipeFusion have different topology, memory and quality tradeoffs; qualify each before combining them. xdit.cuda.diffusion.parallelism_freshness_and_topology; imported, locally_verified=false; preserve source readset and counter-signals
strata / contribution @ 296b59d2f73c8f04a805df29c2fa97655adace78 Family geometry, expert residency, CPU/PCIe balance and native engine gates; three existing abstracts inspected strata.common.llm.architecture_search_space; strata.common.llm.controlled_execution_tuning; strata.common.llm.engine_validation_contract; English source procedures retained, no device/service validation
vllm / contribution @ 2521446ac8c92937b5a32b7dc2a84ef7fa8e99c5 V1 token/KV ownership, bounded serving measurements and extension gates; three existing abstracts inspected vllm.common.llm.bounded_serving_measurement; vllm.common.llm.extension_correctness_gates; vllm.common.llm.runtime_and_kv_ownership; English source procedures retained, no device/service validation
sglang / contribution @ 16176278d0180f1a1a578e53e6eef432577876c2 Radix/HiCache state, TP/DP/EP and controlled tuning; three existing abstracts inspected sglang.common.llm.parallelism_and_extension; sglang.common.llm.runtime_radix_hicache; sglang.common.llm.tuning_and_validation; English source procedures retained, no device/service validation
sglang_omni / contribution @ 2cfb3b67becb437b70751defe37e63d3af4eedb0 Stage DAG/process transport, preparation/abort lifecycle and audio quality; three existing abstracts inspected sglang_omni.common.audio.serving_and_streaming_quality; sglang_omni.common.omni.extension_lifecycle_validation; sglang_omni.common.omni.pipeline_state_and_transport; English source procedures retained, no device/service validation
vllm_omni / contribution @ 52194f24fa42e14d1c5e096f4bea4dc7f95cffa1 Stage/replica ownership, diffusion state/output and streaming audio measurement; three existing abstracts inspected vllm_omni.common.audio.streaming_serving_measurement; vllm_omni.common.diffusion.step_state_and_output_validation; vllm_omni.common.omni.stage_ownership_and_search; English source procedures retained, no device/service validation
Internal Drama3 issue #10 Recorded continuous-admission versus drain occupancy; diagnostic section inspected, original trace not reread One reusable case; INCONCLUSIVE campaign, reported artifact hash, no new gain claim
Main audio source guidance Scheduler-step, graph/state/stream ownership, actual dispatch and complete-service limits at the record's source pin Existing audio record; imported guidance stays unverified

Rejected-direction extraction reuses the same pinned main source summaries: Qwen B300, Qwen Ascend and Drama3 B300. These are three additional Case bundles, not new source mechanisms, skills, independent corroboration or hardware validation. Each separates recorded disposition from a proposed diagnostic check and retains the source limits.

The knowledge-base contract owns field and mode semantics. Missing early six-paper input stays blocked. Historical reports and A–F readsets, comparisons and cases remain preserved; catalog translation/import does not add independent corroboration or a new source-mechanism count.

Issue #27 reconciliation: Drama3 NPU readiness

Supplement scope only; no new mined coverage or measured cell is credited. The Drama3 NPU readiness supplement maps the RFC-pinned GPU source and existing imported records to a stage/state execution map, a state-correctness contract and a measurement/quality contract.

Source group Pin / scope Lineage note
david6666666/drama-3-single-b300-inference 58a1882a4d941f8d21bfce6be37d3d5e7c9fde80; RFC-selected commits only (a6e660cc, ec51ba1e, a7118fb7, 6ff8d808, 33f6d723) and benchmark.py/results; no broad history scan External GPU reference engine motivating NPU questions; shares the design family of the existing vllm_omni.cuda.audio.concurrency_scaling_state_and_overlap import (not independent corroboration)

The supplement links the existing Drama3 B300 rejected-directions case rather than restating it; that case shares this campaign lineage.

The two primary matrices are unchanged in authority; this is a reconciliation note, not a third inventory. All NPU status for Drama3 remains unverified.

MLX framework source extraction

Source / revision Inspected scope Extraction and limits
ml-explore/mlx @ bff10220c742907f0c68e55ff174aaea56f74e3d (MIT) ops.cpp::add, Python eval bindings, transforms.cpp::eval_impl, array availability/detach, CPU/Metal/CUDA eval retention paths, selected native test source and build conditions lazy-evaluation-stream-lifetimes, with pinned readset: three framework mechanisms; CODE and unexecuted TEST-SOURCE, empirical validation not_run; no model/service/performance or installed-backend qualification

This framework owner does not implement MLX discovery or claim the separate MLX-LM application/cache layer. The generated abstract is a discovery projection, not an additional source or validated mechanism.

vLLM-Omni incremental abort/cleanup readset

The source and responsibility map links the original engine guide (52194f24fa42e14d1c5e096f4bea4dc7f95cffa1, inspected 2026-10-14) and this incremental abort readset (18c3bd5d2d4323bc7adca1ac3c465c4a53bbfb6e, inspected 2026-10-22). Follow the validation route for actual caller, receipt and cleanup questions. Existing readsets and the three catalog records retain their own source attribution and validation limits.

Source / revision Inspected scope Reuse, extraction and limits
vllm-project/vllm-omni @ 18c3bd5d2d4323bc7adca1ac3c465c4a53bbfb6e (Apache-2.0) Engine-base abort/ack APIs, correlated waiter/router, orchestrator companion and logical cleanup, stage-pool partial outputs and queued release; selected upstream test source and test bootstrap Extend existing omni-validation with three bounded mechanisms and pinned readset. Reuse the original 52194f24... engine guide and catalog ownership; no new skill or parallel database. CODE / TEST-SOURCE only; actual device, connector, model, service and performance not_run. Full duplex/session behavior and native abort guarantees deferred.

MLX-LM application source extraction

Source / revision Inspected scope Extraction and limits
ml-explore/mlx-lm @ ab7f7048dc341ced2d84b1887eeb17d60b0d1b02 (MIT) generate_step/stream_generate, BatchGenerator stage/removal and row filtering, cache factory/KV/BatchKV/LRU prefix paths, selected server model-key/batching/stop branches and native test source generation-cache-lifecycle, with pinned readset: three application mechanisms; CODE and unexecuted TEST-SOURCE; empirical validation not_run, no model/service/backend or matched-performance qualification

MLX-LM owns request/token/cache policy. This source pin does not qualify its compatibility with the separately pinned MLX framework or implement discovery. The generated abstract is a projection, not independent corroboration.

Diffusers invocation source extraction

Source / revision Inspected scope Extraction and limits
huggingface/diffusers @ aea7b70be0f594bcdc15a6f2677ee2ca85e49e8e (Apache-2.0) FluxPipeline construction/call, register_modules/components/from_pipe, FlowMatchEulerDiscreteScheduler schedule/index/step and Flux interrupt/callback/normal output tail; selected native fixture and dependency declarations diffusers-invocation-state, with pinned source map: CODE and unexecuted TEST-SOURCE; candidate, empirical validation not_run. The supplied manifest verifies a selected pipeline_utils Git blob, not the full archive tree. No model, concurrent-call, backend or performance qualification.

The existing Diffusers offload card retains its earlier source pin. This bounded invocation readset does not establish caller serialization, general thread safety or exception cleanup. The generated abstract adds discovery, not corroboration.

For entry selection, use the two-pin responsibility comparison. The offload dependency record retains its 2026-10-15 documentation access; the invocation source map retains its 2026-10-22 archive read. These dates are not refreshed by navigation checks, and normal-tail hooks do not establish offload compatibility or exceptional/asynchronous cleanup.

DeepInfer source extraction

Source / revision Inspected scope Reuse, extraction and limits
deepseek-ai/DeepInfer @ 8b16149741a4935e1dec8cea27853f273b374c5b (Apache-2.0; direct vendors retain separate licenses) Bounded DFlash producer/verification budget, scheduler confidence/round counters, worker ZOS metadata repair, YoCo boundary/full-layout KV, SWA metadata/ring sizing and released serving hooks; selected test/harness source Two source-derived candidates: verification budget, bounded query replay; reuse host scheduling case and capability audit. Their F labels mean pinned CODE, P means proposed procedure; test/harness reading is not execution. Native/model/device/sampling/quality/performance not_run.

The source-reading bundle preserves six direct vendor snapshots but omits nine media assets and ten nested gitlinks. Parent-code observations do not certify those dependencies, a build-complete checkout or a complete serving system. The three peer cards summarize related source observations; generated abstracts point to the complete procedures. Neither independently corroborates or promotes the candidate mechanisms.

Task-specific benchmark selection (issue #60)

Source / revision Inspected scope Reuse, extraction and limits
Issue #60 report, 2026-10-21; eight Git source inventories in the owner metadata Task/quality/workload separation across text, agentic coding, work agents, TTS, full-duplex interaction and image/video; selected pinned AIPerf/realtime/FDB/video sources rechecked and the current InferRSI metric contract inspected Extend inference-benchmark-design with task selection and command templates. Candidate guidance; source review and bounded smoke do not qualify all tasks or establish a performance gain. Replay scores, reference parity and task quality retain separate meanings.
NVIDIA/NeMo-Speech.cpp @ 20999cc9, inspected 2026-11-01 Selected cache-aware encoder/config, runner, SDK bounds, endpoint policy, geometry test/CMake and ASR benchmark; complete 14-file readset and Apache-2.0 / parakeet MIT attribution retained in the reference Extend inference-benchmark-design with cache-aware ASR stream boundaries: first/steady mel geometry and decoded clock, stream-slot reset/reuse, EOU/EOF/reset and model-test SKIP boundaries. Source-derived candidate / empirical not_run; benchmark figures remain author-reported with precision, FE and trial limits. No model/device/quality/long-audio/load/service qualification.

SGLang versioned entry selection

The three-pin responsibility comparison links the existing LLM engine snapshot, CUDA HiCache peer and bounded diffusion readset. Original contribution access (2026-10-14), HiCache access (2026-10-15) and diffusion archive inspection (2026-10-22) remain separate. This navigation adds no upstream reinspection, common dependency tuple or validation result; source maps, notices and imported/candidate states stay with their owners.

DwarfStar portable AREX extraction

Source / revision Inspected scope Reuse, extraction and limits
antirez/ds4 @ ee7e8405232c8971000cc7ba2b945b00bf6d20d3; AREX-Skill method @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected SSD budgeting, shared prefill workspace, session/token/image identity, disk KV/tool replay, speculation and topology/test contracts DwarfStar operating graph with bounded source hashes, bundled request helper and owner-local references. Actual portable create/verify method, not an unexecuted CLI run. Native C adaptation and partial drafting were user-approved. Accelerated/model/physical-distributed/quality/performance verification remains blocked; CPU checks do not establish those claims. Source MIT notice retained; NO_LICENSE is the unauthenticated resolver fallback, not a legal conclusion.

Splash portable AREX extraction

Source / revision Inspected scope Reuse, extraction and limits
incoai/splash @ 39a97385f8560cf8a93972cec9b0a963c9195250; AREX method @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected format/memory planning, scheduler/cache/state/persistence, API/security/protocol, DFlash2/ANE/numerical and benchmark contracts Splash graph with bounded file hashes, three safe offline helpers and retained notices. Actual compatible-agent portable workflow with user-approved native/source-module adaptation. Python checks are not Metal/ANE/model/disk-state or service qualification; required native evidence remains blocked. Source Apache-2.0 and third-party notices are independent of the NO_LICENSE unauthenticated-CLI fallback.

Lily portable AREX extraction

Source / revision Inspected scope Reuse, extraction and limits
perplexityai/pplx-garden lily/ @ 1ed972ed3f0bd5616c997c9507c25616c63394fc; AREX method @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected exact architecture/affine packing, Metal ownership, strict API/session prefixes, native-test gating and versioned benchmark methods Lily graph, bounded hashes, safe offline helpers and Apache-2.0/NOTICE retention. Actual portable native-Rust/Metal adaptation, not a DisCo CLI/model run. Cargo/native/model/quality/performance evidence unavailable; later long-context prefill negatives and runner/report version mismatch are retained. NO_LICENSE is the unauthenticated resolver fallback, not a legal finding.

Husky document-only research adaptation

Source / version Inspected scope Reuse and limits
Official https://husky.underdog.ai/; displayed2026-09-20, read2026-10-27; unversioned Public-page report only; no canonical source repository, implementation revision or retained receipts identified Document-research candidate, bounded attribution and original verification questions. User-approved AREX-informed document adaptation, not complete repo-to-skill/native verification. Source license UNKNOWN; NO_LICENSE resolver unavailable. No new measured coverage.

LoopX Goal governance source knowledge

Source / revision Inspected scope Reuse, extraction and limits
loopx-project/loopx @ f094b2cfb2acde7a4a0d4d875bba52f64ac31ba9 (Apache-2.0; original NOTICE and historical MIT text retained) Direct bounded source inspection, 2026-10-26: TypeScript run/spend owners, Python adapters and health guidance, selected canonical Todo provider/read seams, direct local accounting transaction/admission dependencies, retired Todo-event guard/document, and named tests; exact bytes and inspected sections in source ledger mined — existing rsi-evidence owner gains authority/projection distinctions, ordered next-action and local receipt-recovery mechanisms with counterexamples; optimization-search-policy links that owner. Source-derived candidate; empirical not_run, agent efficacy not evaluated. No LoopX installation/execution, external exactly-once, provider hard cost cap, new runtime or hardware/network coverage is established.

The current readset does not replace RFC #137's historical a6f28057b49fe03bb234fa6ce1bac5d61df0c58f reference or implement its checkpoint proposal. Provider storage internals, distributed leases, UI and the complete controller remain outside this extraction. Reading test assertions and packaging resources do not reproduce runtime behavior or promote the candidate.

Project Maya source and CPU-slice extraction

Source / revision Inspected scope Reuse and limits
mw00/project-maya @ 249f9a87d1a9d72bec2b684d704b0aa9296b1c9c, VERSION1.1.34; AREX @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Bounded GLM/DS4/MM3 model/residency/state/control and quality/calibration evidence, plus shallow new Qwen dispatch/format/guard/license map Complete candidate,82-file source inventory, source MIT notices and3 offline helpers. Actual portable native-C++ adaptation with4 original pure host policy tests passed. Required GPU/model/state/vision/quality/service evidence remains blocked; no DisCo CLI/model run or automatic promotion. NO_LICENSE is the actual unavailable gh resolver fallback, not legal absence.

vLLM Metal portable AREX source and CPU extraction

Source / revision Inspected scope Reuse and limits
vllm-project/vllm-metal @ e7df7a6ff215f99c7842552d230fdbc709835934, package0.32.0; AREX @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected platform/config/ABI/loading, cache/offload owner-consumer and speculative/deferred/GQA measurement contracts; explicit analysis spans in the readset Candidate graph, upstream Apache-2.0 notice and3 offline helpers. Installed pure Python API/parser checks only; dependency health failed and required Apple MLX/Metal/MPS/model/quality/service evidence remains blocked. Actual portable workflow adaptation, not DisCo CLI/model or managed import. NO_LICENSE is the actual unauthenticated resolver fallback.

mistral.rs Metal paged-attention extraction

Source / revision Inspected scope Reuse and limits
EricLBuehler/mistral.rs @ 9459891e7697238225885518119682ac8209a612, workspace 0.9.5; AREX @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected Rust owner/native MSL consumer/test assertions for decode, prefill and actual-model preparation; bounded readset. Candle 66a8cf184a5a519671454066b1b9efd446ec9f5c is declared lineage, not a full dependency audit Candidate graph, root MIT and component Apache-2.0/NOTICE, three offline helpers. Actual portable Rust/source adaptation; no Rust compilation, native Metal/kernel/model/quality/service or efficacy run. Required backend blocked; no DisCo CLI/model or managed import. NO_LICENSE is actual unauthenticated resolver fallback.

MLX Swift LM lifecycle and recurrent Metal extraction

Source / revision Inspected scope Reuse and limits
ml-explore/mlx-swift-lm @ 3d066d3a0ffdc7e70c476a3d31488ea62dfdd0ac; AREX @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected actual container/mutex/iterator/worker/loop and embedded GatedDelta MSL/host/caller/test contracts; bounded readset. MLX Swift manifest range is not a resolved dependency pin Candidate graph, retained MIT, two offline support helpers, source-only masked-output parity gap. Actual partial Swift/source adaptation; no compile/original host-control/native/Metal/model/quality/service or efficacy run. Required native blocked; no DisCo CLI/model/managed import. NO_LICENSE is actual unauthenticated resolver fallback.

MLC LLM compiled Metal and runtime contracts

Source / revision Selected scope Reuse and boundary
mlc-ai/mlc-llm @ 8978ea9aec626d64096aaa92fbc89bda2e3ea802; TVM gitlink mlc-ai/relax @ 201fa0001c81431ccce05419b442c47779ea917c Canonical artifact/task/parameter metadata and consumer boundary; Apple target/export; generic cache lowering/config; actual pinned TVM Metal codegen/module/storage/stream/test assertions. Exact two-owner readset Candidate graph, both Apache LICENSE/NOTICE owners, three declaration helpers. Opt-in WebLLM manifest is not native ABI support; kind=metal fallback may not run. No original compiled CPU/native/compiler/Metal/model/fit/quality/service or efficacy execution; native blocked.

Flare preparation and complete-session source knowledge

Source / revision Inspected scope Reuse, extraction and limits
NVIDIA/flare-local-inference → NVIDIA/local-inference @ bce032c014bae34502ba22d3304fa084d5b40afe (Apache-2.0) Bounded source inspection, 2026-10-28: preparation/package documentation, actual ABI/prepared validators and call path, cache/scheduler/worker, offload geometry/index/record/transfer, server test assertions and qualification/provenance; 20-file pin/blob/readset ledger mined — existing weight-loading preparation owner plus one Flare session candidate: full KV/recurrent/convolution/tail state, cancellation/transfer/fences, five restore-admission outcomes and timing/namespace/cost diagnostics. Research prototype SM120/SM121, GDS deferred; native/model/device/service and efficacy not_run/not evaluated. Root source license does not grant model/dependency rights.

The redirect preserves the fixed source commit; no ABI/version upgrade is implied. Construction and evaluation plan uses AREX methods with InferRSI's native registration/projections. This does not create a repo runtime descriptor, backend port or measured resource effect.

Local Dream Android diffusion boundary source

Reference (origin @ revision) Inspected scope Extraction and remaining limits
xororz/local-dream @ db162df4d9bb6efc6595250423d8df26241f4c27; AREX-Skill @ ac3fe1afa80fb9a09775ecfb2b6cc3ba850a2db6 Selected Android backend/host/generation consumers, native dispatch/shared-lock/cancellation/prompt-cache/selected residency, separate core/DiT packaging/ABI and host-test definitions; bounded readset and rights, exact identity ledger. Dependency bodies, full app and guide site excluded local-dream candidate plus one declaration-only helper. Actual source CC BY-NC 4.0; API NOASSERTION is not permission or relicensing. Android/MNN/QNN/Hexagon/model/media/fit/thermal/service/performance and skill efficacy not_run. No measured resource cell or managed DisCo import.