Skip to content

Release 2.6#279

Merged
SusiJo merged 38 commits intomasterfrom
dev
Jul 3, 2025
Merged

Release 2.6#279
SusiJo merged 38 commits intomasterfrom
dev

Conversation

@SusiJo
Copy link
Copy Markdown
Collaborator

@SusiJo SusiJo commented Jun 17, 2025

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've fixed a bug or added code that should be tested, add tests!
  • If you've added a new tool - have you followed the pipeline conventions in the contribution docs
  • Make sure your code lints (nf-core lint).
  • Ensure the test suite passes (nextflow run . -profile test,docker --outdir <OUTDIR>).
  • Usage Documentation in docs/usage.md is updated.
  • Output Documentation in docs/output.md is updated.
  • CHANGELOG.md is updated.
  • README.md is updated (including new tool citations and authors/contributors).

SusiJo added 10 commits May 5, 2025 14:52
* add enh. volcano

* update docu

* add comment

* rm comments, add omitNa

* ch version to dev

* add volcano to tests

* fix deprecated key-value

* update docs,changelog

* prettier test rsem profile

* fix contrast names
* add colors to plotly volcano

* add color scale
* hotfix switch volcano colors

* fix colors

* add abs, rm space

* rm "feature" text

* update titles, legends

* add subtitle for interactive plot

* ch y-axis label

* rm outcommented lines
* put gprofiler in tabs

* revert

* linting

* trim whitespace

* mod plot title
* raise max dimensions limit

* concat ensembl ids with gene names

* update changelog & usage

update changelog & usage

update changelog & usage

Co-authored-by: Famke Bäuerle <45968370+famosab@users.noreply.github.com>

fix typo
* change report name

* modify report

* update report & tests & fix volcano colors

* add to changelog, references

* fix citation

* fix df RIN

* fix linting & ci

* fix padding

* update md5sums due to sampleNames

* apply suggestions

* update confs

* apply suggestion

* add num all genes

* change icon

* adjust docs text
* incorporate feedback

* update report

* fix typos

* update changelog

* fix pre-commit

* fix spaces

* fix colored cells

* linting

* fix typos

* adjust table border

* fix typos

* apply suggestions

* apply suggestions
* fix contrast

* update usage

* add to changelog

* update test

* PR num

* ch md5sum
* adjust md5sums due to gtf biotypes

* update branch

* fix assignment

* add biotype to final DE table

* update md5sums
@github-actions
Copy link
Copy Markdown

This PR is against the master branch ❌

  • Do not close this PR
  • Click Edit and change the base to dev
  • This CI test will remain failed until you push a new commit

Hi @SusiJo,

It looks like this pull-request is has been made against the qbic-pipelines/rnadeseq master branch.
The master branch on nf-core repositories should always contain code from the latest release.
Because of this, PRs to master are only allowed if they come from the qbic-pipelines/rnadeseq dev branch.

You do not need to close this PR, you can change the target branch to dev by clicking the "Edit" button at the top of this page.
Note that even after this, the test will continue to show as failing until you push a new commit.

Thanks again for your contribution!

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 17, 2025

                                       ,--./,-.
          ___     __   __   __   ___     /,-._.--~\
    |\ | |__  __ /  ` /  \ |__) |__         }  {
    | \| |       \__, \__/ |  \ |___     \`-._,-`-,
                                          `._,._,'

    nf-core/tools version 2.14.1 - https://nf-co.re
    There is a new version of nf-core/tools available! (3.3.1)


INFO     Testing pipeline: .                                                                                                                                                                                         

╭─ [?] 17 Pipeline Tests Ignored ───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                                                                                                                   │
│ files_exist: File is ignored: lib/nfcore_external_java_deps.jar                                                                                                                                                   │
│ nextflow_config: Config variable ignored: manifest.name                                                                                                                                                           │
│ nextflow_config: Config variable ignored: manifest.homePage                                                                                                                                                       │
│ nextflow_config: Config default ignored: params.report_file                                                                                                                                                       │
│ nextflow_config: Config default ignored: params.references_file                                                                                                                                                   │
│ nextflow_config: Config default ignored: params.css                                                                                                                                                               │
│ nextflow_config: Config default ignored: params.logo                                                                                                                                                              │
│ nextflow_config: Config default ignored: params.custom_config_base                                                                                                                                                │
│ files_unchanged: File ignored due to lint config: LICENSE or LICENSE.md or LICENCE or LICENCE.md                                                                                                                  │
│ files_unchanged: File ignored due to lint config: .github/CONTRIBUTING.md                                                                                                                                         │
│ files_unchanged: File ignored due to lint config: .github/ISSUE_TEMPLATE/bug_report.yml                                                                                                                           │
│ files_unchanged: File ignored due to lint config: .github/PULL_REQUEST_TEMPLATE.md                                                                                                                                │
│ files_unchanged: File ignored due to lint config: .github/workflows/branch.yml                                                                                                                                    │
│ files_unchanged: File ignored due to lint config: assets/email_template.txt                                                                                                                                       │
│ files_unchanged: File ignored due to lint config: assets/sendmail_template.txt                                                                                                                                    │
│ files_unchanged: File ignored due to lint config: docs/README.md                                                                                                                                                  │
│ files_unchanged: File ignored due to lint config: .gitignore or .prettierignore                                                                                                                                   │
│                                                                                                                                                                                                                   │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─ [!] 3 Pipeline Test Warnings ────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                                                                                                                   │
│ nextflow_config: Config manifest.version should end in dev: 2.6                                                                                                                                                   │
│ readme: README did not have a Nextflow minimum version badge.                                                                                                                                                     │
│ schema_lint: Parameter input is not defined in the correct subschema (input_output_options)                                                                                                                       │
│                                                                                                                                                                                                                   │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─ [!] 10 Module Test Warnings ─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                              ╷                                             ╷                                                                                                                                      │
│ Module name                  │ File path                                   │ Test message                                                                                                                         │
│╶─────────────────────────────┼─────────────────────────────────────────────┼─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╴│
│ report                       │ modules/local/report.nf                     │ Unable to connect to container registry, code:  405, url: https://ghcr.io/qbic-pipelines/rnadeseq:2.6                                │
│ report                       │ modules/local/report.nf                     │ Container versions do not match                                                                                                      │
│ report                       │ modules/local/report.nf                     │ No process 'output' block found                                                                                                      │
│ samplesheet_check            │ modules/local/samplesheet_check.nf          │ Module does not emit software version                                                                                                │
│ report                       │ modules/local/report.nf                     │ Process name not used for versions.yml                                                                                               │
│ report                       │ modules/local/report.nf                     │ Missing emit statement: path "*.yml"                                                                                                 │
│ report                       │ modules/local/report.nf                     │ Missing emit statement: path "*.zip"                                                                                                 │
│ custom/dumpsoftwareversions  │ modules/nf-core/custom/dumpsoftwareversions │ New version available                                                                                                                │
│ report                       │ modules/local/report.nf                     │ Process label not specified                                                                                                          │
│ report                       │ modules/local/report.nf                     │ when: condition has been removed                                                                                                     │
│                              ╵                                             ╵                                                                                                                                      │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

╭─ [!] 3 Subworkflow Test Warnings ─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                            ╷                                                ╷                                                                                                                                     │
│ Subworkflow name           │ File path                                      │ Test message                                                                                                                        │
│╶───────────────────────────┼────────────────────────────────────────────────┼────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╴│
│ utils_nextflow_pipeline    │ subworkflows/nf-core/utils_nextflow_pipeline   │ New version available                                                                                                               │
│ utils_nfcore_pipeline      │ subworkflows/nf-core/utils_nfcore_pipeline     │ New version available                                                                                                               │
│ utils_nfvalidation_plugin  │ subworkflows/nf-core/utils_nfvalidation_plugin │ New version available                                                                                                               │
│                            ╵                                                ╵                                                                                                                                     │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭───────────────────────╮
│ LINT RESULTS SUMMARY  │
├───────────────────────┤
│ [✔] 207 Tests Passed  │
│ [?]  17 Tests Ignored │
│ [!]  16 Test Warnings │
│ [✗]   0 Tests Failed  │
╰───────────────────────╯

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 17, 2025

Linting fails in CI due to latest nf-core tools version 3.3.1 and the pipeline here relies on nf-core tools 2.14.1

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 17, 2025

Branch protection could probably be fixed in the .github/workflows.branch.yml with:

[[ ${{github.event.pull_request.head.repo.full_name }} == qbic-pipelines/rnadeseq && $GITHUB_HEAD_REF == "dev" ]] || [[ $GITHUB_HEAD_REF == "patch" ]]

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 18, 2025

locally, the download works with nf-core tools version 2.14.1

nf-core download qbic-pipelines/rnadeseq --revision dev --outdir '.' --compress "none" --container-system 'singularity' --container-library 'quay.io' -l 'docker.io' -l 'ghcr.io' --container-cache-utilisation 'amend' --download-configuration

                                          ,--./,-.
          ___     __   __   __   ___     /,-._.--~\
    |\ | |__  __ /  ` /  \ |__) |__         }  {
    | \| |       \__, \__/ |  \ |___     \`-._,-`-,
                                          `._,._,'

    nf-core/tools version 2.14.1 - https://nf-co.re
    There is a new version of nf-core/tools available! (3.3.1)

INFO     Saving 'qbic-pipelines/rnadeseq'                                                                                                       
          Pipeline revision: 'dev'                                                                                                              
          Use containers: 'singularity'                                                                                                         
          Container library: 'quay.io, docker.io, ghcr.io'                                                                                      
          Using $NXF_SINGULARITY_CACHEDIR': testing'                                                         
          Output directory: '.'                                                                                                      
          Include default institutional configuration: 'True'                                                                                   
INFO     Downloading centralised configs from GitHub                                                                                            
INFO     Downloading workflow files from GitHub                                                                                                 
INFO     Processing workflow revision dev, found 3 container images in total.                                                                   
Pulling singularity images ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% • 3/3 completed

@CaroAMN
Copy link
Copy Markdown

CaroAMN commented Jun 18, 2025

Linting fails in CI due to latest nf-core tools version 3.3.1 and the pipeline here relies on nf-core tools 2.14.1

I'm playing around with the CI right now for my pipeline. So what i saw in my .github/workflows/linting.yml this:

      - name: read .nf-core.yml
        uses: pietrobolcato/action-read-yaml@1.1.0
        id: read_yml
        with:
          config: ${{ github.workspace }}/.nf-core.yml

      - name: Install dependencies
        run: |
          python -m pip install --upgrade pip
          pip install nf-core==${{ steps.read_yml.outputs['nf_core_version'] }}`
          
      which is not in your current linting.yml and i guess it checks the version in your nf-core.yml and installs the required tools version. ... maybe unnecessary but could resolve linting errors

Copy link
Copy Markdown

@famosab famosab left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To me this looks good but note that I am not an expert on pytests and R haha :D

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Jun 23, 2025

nf-core lint overall result: Passed ✅ ⚠️

Posted for pipeline commit e8b4ae1

+| ✅ 170 tests passed       |+
#| ❔  18 tests were ignored |#
!| ❗   3 tests had warnings |!
Details

❗ Test warnings:

  • nextflow_config - Config manifest.version should end in dev: 2.6
  • readme - README did not have a Nextflow minimum version badge.
  • schema_lint - Parameter input is not defined in the correct subschema (input_output_options)

❔ Tests ignored:

✅ Tests passed:

Run details

  • nf-core/tools version 2.14.1
  • Run at 2025-07-03 08:36:18

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 23, 2025

Linting fails in CI due to latest nf-core tools version 3.3.1 and the pipeline here relies on nf-core tools 2.14.1

I'm playing around with the CI right now for my pipeline. So what i saw in my .github/workflows/linting.yml this:

      - name: read .nf-core.yml
        uses: pietrobolcato/action-read-yaml@1.1.0
        id: read_yml
        with:
          config: ${{ github.workspace }}/.nf-core.yml

      - name: Install dependencies
        run: |
          python -m pip install --upgrade pip
          pip install nf-core==${{ steps.read_yml.outputs['nf_core_version'] }}`
          
      which is not in your current linting.yml and i guess it checks the version in your nf-core.yml and installs the required tools version. ... maybe unnecessary but could resolve linting errors

Awesome, thanks!

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 23, 2025

Branch protection is failing because of a typo in the master branch which I cannot/wont fix.

"{ [[ ${{github.event.pull_request.head.repo.full_name }} == qbic-pipelines/rnadeseq ]] && [[ $GITHUB_HEAD_REF = "dev" ]]; } || [[ $GITHUB_HEAD_REF == "patch" ]]"

Comment thread assets/rnadeseq_report.Rmd Outdated

The image below displays the two-step analysis workflow from your input data to differential gene expression analysis.
In the first step, reads were aligned and assigned to genomic features using nf-core pipelines.
In the second step, the gene counts were analyzed for differential expression with the secondary analysis pipeline rnadeseq.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we have 2x second in here, nut-picking maybe...but could be modified to : "In the next step, the resulting gene counts were analyzed for differential expression with the secondary analysis pipeline rnadeseq."

Comment thread assets/rnadeseq_report.Rmd Outdated
# Workflow overview

The image below displays the two-step analysis workflow from your input data to differential gene expression analysis.
In the first step, reads were aligned and assigned to genomic features using nf-core pipelines.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"In the first step, reads were aligned and assigned to genomic features (e.g. genes) using nf-core pipelines.

Comment thread assets/rnadeseq_report.Rmd Outdated
- `Heatmaps_of_distances.pdf/.png/.svg`: heatmap of the pairwise Euclidean distances among samples, when the `r norm_method_text` normalized gene counts are considered.
- `PCA_plot.pdf`: PCA of the `r norm_method_text` normalized gene counts.
- **DE_genes_tables:** folder containing one tab-separated table for each of the contrasts in the analysis. Each table contains a list of all differentially expressed genes in the contrast, specifying the mean gene expression across all samples (baseMean), and the log2 fold change value and p-adjusted values (padj) for this contrast. If a `gtf` file is provided, the tables will also contain a column with the gene biotypes of the differentially expressed genes.
- **final_gene_table/final_gene_list_DESeq2.tsv**: table containing a list of all genes considered in the analysis. Here a summary of the log2 Fold Change and p-adjusted values for all contrasts is displayed. Additionally, the column **filter** shows if this gene was differentially expressed (DE) in any of the contrasts, or not (not_DE). The column **contrast_vector** contains for each contrast considered in the analysis a 1 if the gene was differentially expressed for this contrast or a 0 if it was not.
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would also add this sentence here as that column is also added to the final aggregated DE table: "If a gtf file is provided, the tables will also contain a column with the gene biotypes of the differentially expressed genes."

Copy link
Copy Markdown
Collaborator

@qbicStefanC qbicStefanC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks fine to me. Before merging let us wait for the checks on the 4 mentioned previously run projects and then see what is missing.

@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jun 30, 2025

Overall looks fine to me. Before merging let us wait for the checks on the 4 mentioned previously run projects and then see what is missing.

Are there any updates on the runs of the 4 projects? @qbicStefanC @MAKirch

* switch back to githubusercontent

* add to changelog
@SusiJo
Copy link
Copy Markdown
Collaborator Author

SusiJo commented Jul 3, 2025

Overall looks fine to me. Before merging let us wait for the checks on the 4 mentioned previously run projects and then see what is missing.

Are there any updates on the runs of the 4 projects? @qbicStefanC @MAKirch

Note: 4 Projects passed the tests

@SusiJo SusiJo merged commit 1311f0b into master Jul 3, 2025
36 of 37 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants