Repository navigation
docs(quack): audit DuckDB vector techniques against DR landing zones - #1787
Conversation
|
Important
This repository does not receive automatic reviews because it has fewer than 10 stars.
|
Codex Review SummaryThis comment shows the latest Codex review activity on this pull request.
ℹ️ About Codex in GitHubYour team has set up Codex to review pull requests in this repo. Reviews are triggered when you
Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings. |
Amend six open fruit rows. They are re-read at main 87b2899 and ndarray 195844bd: - ISS-DURABLEREF: D-DR64/D-DRF focus cache (G5) and D-DTM-1 (EXO-148) now also wait on it. - ISS-BF16: ndarray #374's FMA did not touch the per-element vec! in bf16_tile_gemm_16x16. - ISS-FISHERZ: codec8 is out of scope for Fisher-Z, so the fix stays in bgz-tensor. - ISS-CAUSAL-EDGE clippy: give the section a Status line. - TD-BGZ: there are now 11 test files and CI still runs --lib. - TD-STATUS-BOARD: Status line, plus a Haiku census of 34 ids. Two substring hits are collisions. The #1787 DuckDB plan defines no D-ids, only M0-M4. Add two fruits: - Low-hanging: D-MPF-2's fold numbers and its "scalar is 3x faster" verdict predate ndarray #376. That PR implemented D-MPF-2's own proposal. - High-signal: the D-NAM-2 TFLite int8 leaf and codec8's phase-(f) lance-graph facade are the same PR. The PZL-1 "no new codec" tension has to be settled first. Regenerate FRUITS.md (27 open, 1 closed) and record the Haiku runs in AGENT_LOG, with their hits and misses. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01ArVbbq3DsToBM7r79zGeEf
docs(D-DQM): DR64 ↔ DuckDB ↔ Lance 13 capability crosswalk (follow-up to #1787)
Amend six open fruit rows. They are re-read at main 87b2899 and ndarray 195844bd: - ISS-DURABLEREF: D-DR64/D-DRF focus cache (G5) and D-DTM-1 (EXO-148) now also wait on it. - ISS-BF16: ndarray #374's FMA did not touch the per-element vec! in bf16_tile_gemm_16x16. - ISS-FISHERZ: codec8 is out of scope for Fisher-Z, so the fix stays in bgz-tensor. - ISS-CAUSAL-EDGE clippy: give the section a Status line. - TD-BGZ: there are now 11 test files and CI still runs --lib. - TD-STATUS-BOARD: Status line, plus a Haiku census of 34 ids. Two substring hits are collisions. The #1787 DuckDB plan defines no D-ids, only M0-M4. Add two fruits: - Low-hanging: D-MPF-2's fold numbers and its "scalar is 3x faster" verdict predate ndarray #376. That PR implemented D-MPF-2's own proposal. - High-signal: the D-NAM-2 TFLite int8 leaf and codec8's phase-(f) lance-graph facade are the same PR. The PZL-1 "no new codec" tension has to be settled first. Regenerate FRUITS.md (27 open, 1 closed) and record the Haiku runs in AGENT_LOG, with their hits and misses. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01ArVbbq3DsToBM7r79zGeEf
…#1802 - PR_ARC_INVENTORY: compact entries for #1772, #1774–#1787, #1794–#1803, recorded from merge commits, changed files and each PR's own Status line. #1773 and #1793 are board-hygiene-only and get none. - INTEGRATION_PLANS: one index row for thirteen plans merged without one (D-NAM-1..5 + PZL, DT64-1..5 + QB pointer, D-ONNX-INTAKE-0). - LATEST_STATE: "main after #1803" section. - d-onnx-relalg-cap-v1: OP-ONNX-2 status cell names #1802's Burn onnx-ir vs Tract proposal; still OPEN. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01VncKoyG6JkpsoqhqTGTv3f
Why
We were about to re-invent vector-execution mechanisms that DuckDB already documents and that Quack already audited in September. The missing job is narrower: harvest only useful implementation techniques against the now-existing DR global→local sealed index and D-DRF landing-zone economics, without creating a second executor or violating the zero-copy fold rule.
The existing DuckDB→V3 matrix and lane-fold integration are authoritative. Lane-fold item 8 explicitly has no timed DuckDB column yet. The existing D-DRF-P2 benchmark establishes warm build vs direct vs amortized cached fold, while #1774 corrects the original cache-line/page attribution.
What this PR changes
.claude/board/INTEGRATION_PLANS.md.Vector::Slice/SelCache,ToUnifiedFormat, scalar specializations and conjunction selection loops (read-only; snapshot1641475ef1db08ec063631ff6a8f08d9d6736ae7).u16pointer map, borrowed SoA and optional derived facet cache; don't call the latter zero-copy.Existing measurement, NOT reproduced here
At 4,096 slots over 65,536 rows, random map, full mask, warm: P2 reported direct 20,982 ns, focus build 23,256 ns, cached fold 670 ns, crossover 2 folds. These are host/fixture-bound; TLB attribution is not established, and no huge-page control is claimed.
Invariants
Checks
main: only the plan and integration index change..claude/board/entries/item).Decision requested: review this audit and select the first tiny follow-up PR (M1 timed differential) rather than opening a broad refactor.