Skip to content

Support gzipped FASTA#162

Merged
muffato merged 8 commits into
devfrom
support-gzip
May 28, 2026
Merged

Support gzipped FASTA#162
muffato merged 8 commits into
devfrom
support-gzip

Conversation

@sainsachiko
Copy link
Copy Markdown
Contributor

  • Uncompressed input FASTA to avoid samtools error with gzipped inputs

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the pipeline conventions in the contribution docs
  • Make sure your code lints (nf-core pipelines lint).
  • Ensure the test suite passes (nextflow run . -profile test,docker --outdir <OUTDIR>).
  • Check for unexpected warnings in debug mode (nextflow run . -profile debug,test,docker --outdir <OUTDIR>).
  • Usage Documentation in docs/usage.md is updated.
  • Output Documentation in docs/output.md is updated.
  • CHANGELOG.md is updated.
  • README.md is updated (including new tool citations and authors/contributors).

Co-authored-by: Copilot <copilot@github.com>
Copilot AI review requested due to automatic review settings May 18, 2026 11:46
@sanger-tolsoft
Copy link
Copy Markdown
Contributor

Warning

Newer version of the nf-core template is available.

Your pipeline is using an old version of the nf-core template: 3.5.2.
Please update your pipeline to the latest version.

For more documentation on how to update your pipeline, please see the nf-core documentation and Synchronisation documentation.

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 18, 2026

nf-core pipelines lint overall result: Passed ✅ ⚠️

Posted for pipeline commit 747693e

+| ✅ 167 tests passed       |+
#| ❔  28 tests were ignored |#
!| ❗  13 tests had warnings |!
Details

❗ Test warnings:

  • files_exist - File not found: conf/igenomes_ignored.config
  • nextflow_config - Config manifest.version should end in dev: 2.0.1
  • pipeline_todos - TODO string in main.nf: Optionally add in-text citation tools to this list.
  • pipeline_todos - TODO string in main.nf: Optionally add bibliographic entries to this list.
  • pipeline_todos - TODO string in main.nf: Only uncomment below if logic in toolCitationText/toolBibliographyText has been filled!
  • pipeline_todos - TODO string in nextflow.config: Specify any additional parameters here
  • local_component_structure - pacbio_filter.nf in modules/local should be moved to a TOOL/SUBTOOL/main.nf structure
  • local_component_structure - convert_stats.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - filter_pacbio.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - input_filter_split.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - deepvariant_caller.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - align_pacbio.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure
  • local_component_structure - input_merge.nf in subworkflows/local should be moved to a SUBWORKFLOW_NAME/main.nf structure

❔ Tests ignored:

  • files_exist - File is ignored: CODE_OF_CONDUCT.md
  • files_exist - File is ignored: assets/nf-core-variantcalling_logo_light.png
  • files_exist - File is ignored: docs/images/nf-core-variantcalling_logo_light.png
  • files_exist - File is ignored: docs/images/nf-core-variantcalling_logo_dark.png
  • files_exist - File is ignored: .github/ISSUE_TEMPLATE/config.yml
  • files_exist - File is ignored: .github/workflows/awstest.yml
  • files_exist - File is ignored: .github/workflows/awsfulltest.yml
  • files_exist - File is ignored: assets/multiqc_config.yml
  • files_exist - File is ignored: conf/igenomes.config
  • nextflow_config - Config variable ignored: manifest.name
  • nextflow_config - Config variable ignored: manifest.homePage
  • nextflow_config - Config default ignored: params.vector_db
  • files_unchanged - File ignored due to lint config: .gitattributes
  • files_unchanged - File ignored due to lint config: LICENSE or LICENSE.md or LICENCE or LICENCE.md
  • files_unchanged - File ignored due to lint config: .github/CONTRIBUTING.md
  • files_unchanged - File ignored due to lint config: .github/ISSUE_TEMPLATE/bug_report.yml
  • files_unchanged - File does not exist: .github/ISSUE_TEMPLATE/config.yml
  • files_unchanged - File ignored due to lint config: .github/PULL_REQUEST_TEMPLATE.md
  • files_unchanged - File ignored due to lint config: .github/workflows/branch.yml
  • files_unchanged - File ignored due to lint config: .github/workflows/linting.yml
  • files_unchanged - File ignored due to lint config: assets/email_template.html
  • files_unchanged - File ignored due to lint config: assets/sendmail_template.txt
  • files_unchanged - File does not exist: assets/nf-core-variantcalling_logo_light.png
  • files_unchanged - File does not exist: docs/images/nf-core-variantcalling_logo_light.png
  • files_unchanged - File does not exist: docs/images/nf-core-variantcalling_logo_dark.png
  • files_unchanged - File ignored due to lint config: .gitignore or .prettierignore
  • actions_awstest - 'awstest.yml' workflow not found: /home/runner/work/variantcalling/variantcalling/.github/workflows/awstest.yml
  • multiqc_config - multiqc_config

✅ Tests passed:

Run details

  • nf-core/tools version 3.5.2
  • Run at 2026-05-28 13:02:03

This comment was marked as resolved.

Copilot AI review requested due to automatic review settings May 18, 2026 14:19
@sanger-tol sanger-tol deleted a comment from Copilot AI May 18, 2026

This comment was marked as resolved.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 2 comments.

Comments suppressed due to low confidence (1)

workflows/variantcalling.nf:80

  • The comment about adding a .gzi for bgzip-ed genomes is now misleading in this workflow: ch_genome_uncompressed gunzips .gz references so SAMTOOLS_FAIDX will never emit a .gzi (and the fa.name.endsWith('.gz') check will always be false). Update the comment (and/or the condition) to reflect the new uncompressed-reference behavior.
    // generate fai that is used to determine the maximum length of chromosome
    // also add the gzi if present as it is needed for bgzip-ed genomes
    ch_genome_info = ch_genome_uncompressed
       .join( SAMTOOLS_FAIDX.out.fai )
       .join( SAMTOOLS_FAIDX.out.gzi, remainder: true )
       .map { meta, fa, _no_fai, fai, gzi ->
           def index_file = (fa.name.endsWith('.gz') && gzi) ? [fai, gzi] : fai
           [meta + get_sequence_map(fai), fa, index_file]

Comment thread workflows/variantcalling.nf Outdated
Comment thread workflows/variantcalling.nf
@sainsachiko
Copy link
Copy Markdown
Contributor Author

@copilot apply changes based on the comments in this thread

Agent-Logs-Url: https://github.com/sanger-tol/variantcalling/sessions/62c07573-3dce-4a0f-a13d-51c39cd32a80

Co-authored-by: sainsachiko <134130358+sainsachiko@users.noreply.github.com>

This comment was marked as resolved.

Copy link
Copy Markdown
Member

@muffato muffato left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check the latest gunzip module in nf-core. I think it extracts the name and extension the way you want to

Copilot AI review requested due to automatic review settings May 28, 2026 08:21

This comment was marked as resolved.

Copilot AI review requested due to automatic review settings May 28, 2026 13:00
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 9 out of 9 changed files in this pull request and generated no new comments.

@muffato muffato merged commit 2ff6cd7 into dev May 28, 2026
11 checks passed
@muffato muffato deleted the support-gzip branch May 28, 2026 16:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants