Repository navigation
v0.0.6 — one reference × many queries (--query-list), hits-estimate - #7
Closed
alejandrogzi wants to merge 3 commits into
Closed
alejandrogzi wants to merge 3 commits into
alejandrogzi wants to merge 3 commits into
Conversation
…uery-list batch (experimental 29e9e436fef97a39aa67909368d062bb679bd1f9)
Member
Author
|
Superseded: rounds 83-96 are collapsed into a single v0.0.4 release (one branch, one changelog entry, one PR). Nothing here is dropped — the replacement PR carries this branch's tree plus the on-disk reference index and multi-GPU batching. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked on #6 (v0.0.5), which is stacked on #5 (v0.0.4). Merge and tag in order; this PR then retargets to master.
Syncs the tested experimental tree (alejandrogzi/hspZ
experimental@ 29e9e43) into production with the production packaging kept (file headers, clap attribute). Sources are experimental's byte-for-byte except those.What changes
--query-list: one reference, many queries in one process.hspz run --reference ref.fa --query-list queries.txt --output OUTbuilds and uploads each reference bin once for all listed queries; every query keeps its own plan, cap, seed batches, dedup scopes and-Dhistory, so its output underOUT/000001/…is byte-identical to a standalone run.-Zgives one archive per job;OUT/queries.tsvrecords job → path, size, sha256, blocks, units, HSPs, completion. This release: W=1; identical reference bins required across jobs;-B 0,--kegalign-bins,--from-manifestrejected in batch mode; a failing job aborts the batch.hspz hits-estimate(CPU only). Exact per-work-unit seed-hit counts before any GPU work (matches the--timeledger on the whole genome, 6.12e12 hits); a planning/diagnostic tool.Measurements (Delta L4, W=1, hg38 reference, ABBA, per-query outputs byte-identical to standalone)
--query-list(a / b)Exactness: 149 unit tests; ZLUDA gate with three queries incl. several blocks, masked/N + empty output and duplicate record names,
-D -Zarchives and reversed list order; 100/100 jobs identical on the L4 in both reps; frozen single-query digests unchanged. Reviews: grok-4.6 PORT WITH FIXES (all applied).Release check:
Cargo.tomlversion 0.0.6 (release.yml asserts tag == version); CLI reference regenerated.🤖 Generated with Claude Code