Skip to content

Integrate QPX Parquet and MuData export into workflow#87

Merged
ypriverol merged 9 commits into
bigbio:devfrom
Shen-YuFei:dev
May 7, 2026
Merged

Integrate QPX Parquet and MuData export into workflow#87
ypriverol merged 9 commits into
bigbio:devfrom
Shen-YuFei:dev

Conversation

@Shen-YuFei
Copy link
Copy Markdown
Contributor

@Shen-YuFei Shen-YuFei commented May 6, 2026

PR checklist

  • This comment contains a description of changes (with reason).
  • If you've added a new tool - have you followed the pipeline conventions in the contribution docs
  • Usage Documentation in docs/usage.md is updated.
  • Output Documentation in docs/output.md is updated.
  • CHANGELOG.md is updated.

Description

Integrate QPX (v1.0.2) into the DIA workflow for standardized Parquet + MuData export.

QPX converts DIA-NN results into the QPX Parquet format and generates MuData (.h5mu) files for downstream analysis in the scverse ecosystem.

Changes (16 files)

New modulemodules/bigbio/qpx/

  • main.nf — QPX_EXPORT process: runs qpxc convert diann + MuData export
  • meta.yml — module metadata (input/output channel definitions)
  • environment.yml — conda environment spec
  • tests/ — nf-test with snapshot

Workflow integrationworkflows/dia.nf

  • Added QPX_EXPORT step after DIA-NN quantification, gated by params.qpx_export

Configuration

  • nextflow.config — new params.qpx_export (default: true) and params.matrix_qvalue
  • nextflow_schema.json — registered new parameters
  • conf/modules/shared.configQPX_EXPORT process config
  • conf/tests/test_dia_qpx.config — dedicated test profile

CI

  • .github/workflows/extended_ci.yml — added test_dia_qpx profile

Docs

  • docs/usage.md — QPX export usage and parameters
  • docs/output.md — QPX output description
  • CHANGELOG.md — added entry

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 6, 2026

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 12b7b81c-fca7-421d-acbf-28293274094f

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Tip

💬 Introducing Slack Agent: The best way for teams to turn conversations into code.

Slack Agent is built on CodeRabbit's deep understanding of your code, so your team can collaborate across the entire SDLC without losing context.

  • Generate code and open pull requests
  • Plan features and break down work
  • Investigate incidents and troubleshoot customer tickets together
  • Automate recurring tasks and respond to alerts with triggers
  • Summarize progress and report instantly

Built for teams:

  • Shared memory across your entire org—no repeating context
  • Per-thread sandboxes to safely plan and execute work
  • Governance built-in—scoped access, auditability, and budget controls

One agent for your entire SDLC. Right inside Slack.

👉 Get started


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@Shen-YuFei Shen-YuFei marked this pull request as ready for review May 7, 2026 09:26
Copilot AI review requested due to automatic review settings May 7, 2026 09:26
@qodo-code-review
Copy link
Copy Markdown

ⓘ You've reached your Qodo monthly free-tier limit. Reviews pause until next month — upgrade your plan to continue now, or link your paid account if you already have one.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR integrates QPX into the DIA workflow to export DIA-NN quantification outputs as a standardized QPX Parquet dataset plus a MuData (.h5mu) artifact for downstream analysis.

Changes:

  • Added a new QPX_EXPORT Nextflow module (with nf-test coverage) to run qpxc convert diann and generate a .h5mu.
  • Wired QPX_EXPORT into workflows/dia.nf, gated by --enable_qpx_export, and published outputs under ${outdir}/qpx.
  • Added a dedicated CI test profile (test_dia_qpx), updated docs, and updated the changelog.

Reviewed changes

Copilot reviewed 16 out of 16 changed files in this pull request and generated 5 comments.

Show a summary per file
File Description
workflows/dia.nf Includes and conditionally runs QPX_EXPORT, emits qpx_dataset and mudata.
nextflow.config Adds enable_qpx_export default and test_dia_qpx profile entry.
nextflow_schema.json Adds a schema section for QPX export toggle.
modules/bigbio/qpx/main.nf New QPX_EXPORT process implementation (QPX convert + MuData export + versions).
modules/bigbio/qpx/meta.yml Module metadata describing inputs/outputs and tool info.
modules/bigbio/qpx/environment.yml Conda env definition for QPX execution.
modules/bigbio/qpx/tests/main.nf.test nf-test coverage for stub mode outputs.
modules/bigbio/qpx/tests/main.nf.test.snap Snapshot for stub-mode test outputs.
modules/bigbio/qpx/tests/nextflow.config Test config for module execution (incl. matrix_qvalue).
modules.json Registers the qpx module source metadata.
conf/modules/shared.config Publishes QPX_EXPORT outputs to ${outdir}/qpx.
conf/tests/test_dia_qpx.config New minimal DIA+QPX test profile.
.github/workflows/extended_ci.yml Adds test_dia_qpx to CI matrix.
docs/usage.md Documents QPX export usage and the new test profile.
docs/output.md Documents QPX output artifacts.
CHANGELOG.md Adds release notes for QPX export and test profile.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .github/workflows/extended_ci.yml
Comment thread nextflow.config Outdated
Comment thread modules/bigbio/qpx/environment.yml Outdated
Comment thread modules/bigbio/qpx/main.nf
Comment thread CHANGELOG.md Outdated
@ypriverol ypriverol self-requested a review May 7, 2026 15:08
@ypriverol ypriverol merged commit 2e60aad into bigbio:dev May 7, 2026
67 of 94 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants