Skip to content

Conversation

greged93
Copy link
Collaborator

@greged93 greged93 commented Oct 6, 2025

Introduces a derivation pipeline benchmark running with network calls to the AWS S3 blob storage. Also runs the benchmark in CI using codspeed.

Copy link

codspeed-hq bot commented Oct 6, 2025

CodSpeed Performance Report

Congrats! CodSpeed is installed 🎉

🆕 2 new benchmarks were detected.

You will start to see performance impacts in the reports once the benchmarks are run from your default branch.

Detected benchmarks

  • pipeline_derive_in_file_blobs (27.4 ms)
  • pipeline_derive_s3_blobs (2.3 s)

jonastheis
jonastheis previously approved these changes Oct 7, 2025
Copy link
Contributor

@jonastheis jonastheis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm. just need to fix test and lint

@greged93 greged93 merged commit 6852bf6 into main Oct 8, 2025
15 checks passed
@greged93 greged93 deleted the feat/bench-derivation-pipeline branch October 8, 2025 05:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants