Skip to content

Split mates in fastq-dump retry fallback - #11

Merged
jbrestel merged 1 commit into
mainfrom
fix/fastq-dump-retry-split
Oct 26, 2026
Merged

jbrestel merged 1 commit into
mainfrom
fix/fastq-dump-retry-split

Conversation

@weili-apidb

Copy link
Copy Markdown
Member

Problem

SRATOOLS_FASTERQDUMP retries with fastq-dump, which, unlike fasterq-dump, does not split mates unless asked. A paired run that hits the retry comes back as one file of concatenated mates.

  • Multi-run samples fail in mergeRuns: Sample Brazil15: runs must be all paired or all single-end; found a mix. (all three Brazil15 runs — SRR1568233, SRR1565062, SRR1564632 — are PAIRED per ENA; one hit the retry).
  • Single-run samples pass silently as single-end with double-length reads.

Fix

fastq-dump --split-3 on retry, matching the default fasterq-dump _1/_2/unpaired layout, so the existing third-file handling and normalizeReads work unchanged.

Not in this PR

  • Validating fasterq-dump output against SRA library_layout metadata, to catch any other paired-to-single-file path.
  • groupKey(id, nRuns) in RETRIEVE_FROM_SRA so samples with many technical replicates proceed as soon as their own runs finish rather than after all downloads.

🤖 Generated with Claude Code

On retry, SRATOOLS_FASTERQDUMP falls back to fastq-dump, which does not
split mates by default. Paired runs came back as a single file of
concatenated mates: multi-run samples failed in mergeRuns with a
paired/single mix, and single-run samples would silently pass as
single-end with double-length reads.

Use --split-3 so the fallback produces the same _1/_2/unpaired layout
as fasterq-dump.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@jbrestel
jbrestel self-requested a review October 26, 2026 20:24
@jbrestel
jbrestel merged commit d5f9df4 into main Oct 26, 2026
2 checks passed
@jbrestel
jbrestel deleted the fix/fastq-dump-retry-split branch October 26, 2026 20:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants