Skip to content

Add READS assigned_accessions table into multiqc.report #70

Closed

Description

@KateSakharova

Difficulty: Medium

Why this matters: once a submission to ENA (European Nucleotide Archive) finishes, the pipeline builds a MultiQC report summarising the run. For metagenomic assemblies and MAGs/bins modes, that report includes two tables: one with the ENA accessions assigned to each record, and one with the metadata that got submitted for each record. Reads mode is missing both. The accessions data is actually already produced and passed to MultiQC, but assets/multiqc_config.yml has no matching entry telling MultiQC to render it as a table, so it's silently dropped. The metadata table doesn't exist at all yet for reads mode.

Some terms: ENA (European Nucleotide Archive) is the public repository this pipeline submits data to, and Webin is ENA's account and authentication system needed to submit anything (free, self-service registration). MultiQC is the tool that builds the summary report at the end of the run. MultiQC only turns a file into a custom table if multiqc_config.yml has a matching sp (search pattern) entry and a custom_data entry describing its columns, otherwise the file is ignored even if it reaches MultiQC.

Skills / experience: a contained, well scoped Nextflow and YAML config change, a good task for getting familiar with how a workflow feeds files into MultiQC. If nf-test is new to you, the nf-core nf-test testing guide is a good place to start, since you'll want to check both tables actually render in a test run.

Suggested approach:

  1. Read the reads mode section of docs/usage.md to refresh what fields are collected for a read entry, and check docs/output.md for how the multiqc report's contents are currently documented.
  2. Run the pipeline in reads mode locally and open the generated multiqc report to confirm what's missing.
  3. In assets/multiqc_config.yml, add a sp and custom_data entry for reads_accessions.tsv, following the pattern of submission_results_assemblies/submission_results_genomes, so the accessions table that's already being generated actually shows up.
  4. Look at how CREATE_ASSEMBLY_METADATA_CSV is used in workflows/assemblysubmit.nf, both the module itself and its assembly_metadata entry in multiqc_config.yml, that's the pattern to copy for the metadata table.
  5. Create a similar small module for reads mode that writes one row per read entry, using the fields that were actually submitted (things like sample_accession, platform, library_source, etc.), wire it into workflows/readsubmit.nf, and add its own sp/custom_data entry in multiqc_config.yml.
  6. Update tests to check both tables actually appear in the report output, not just that the pipeline runs.
  7. Update docs/output.md if it documents what the multiqc report contains.

Activity

  1. KateSakharova commented on Oct 27, 2026

    @KateSakharova
    ContributorAuthor

    resolved #119

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions