Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: allow for more extensive benchmark file in jsonl format #2691

Merged
merged 23 commits into from
Apr 24, 2024

Conversation

fgvieira
Copy link
Contributor

@fgvieira fgvieira commented Feb 10, 2024

Description

Another try at #2176, where we try to gather more information about a job; for example, not only resources used, but also resources requested and size of input files.
Here, the original benchmark file is left as is, but there is an option to request an extended benchmark file if the extension is .jsonl.

Is there any other relevant info to include?

@SichongP @corneliusroemer feel free to comment.

QC

  • The PR contains a test case for the changes or the changes are already covered by an existing test case.
  • The documentation (docs/) is updated to reflect the changes or this is not necessary (e.g. if the change does neither modify the language nor the behavior or functionalities of Snakemake).

Copy link

sonarcloud bot commented Feb 10, 2024

Quality Gate Passed Quality Gate passed

Issues
1 New issue

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

@SichongP
Copy link
Contributor

Is this a replacement of my PR? Sorry I haven't looked much into it. Just want to know if I still need to refactor my PR to the new format (I should have some more time to work on it in the next two weeks)

@fgvieira
Copy link
Contributor Author

fgvieira commented Feb 10, 2024

Not sure... I started it just to explore a simpler way to do it (just adding more info to the benchmark file), but I don't know if this is the best way to go (hence all the questions).

PS - that is also why I haven't added the docs and tests yet; will only do it if it is the right way to go.

@fgvieira fgvieira mentioned this pull request Feb 26, 2024
2 tasks
Copy link

sonarcloud bot commented Mar 13, 2024

Quality Gate Passed Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

@fgvieira fgvieira changed the title feat: add extra info on benchmark file feat: allow for more extensive benchmark file in jsonl format Mar 14, 2024
Copy link
Contributor

@johanneskoester johanneskoester left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work!

docs/snakefiles/rules.rst Outdated Show resolved Hide resolved
Copy link

sonarcloud bot commented Apr 24, 2024

Quality Gate Passed Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

@fgvieira fgvieira merged commit de12463 into snakemake:main Apr 24, 2024
35 checks passed
@fgvieira fgvieira deleted the extra_benchmark branch April 24, 2024 19:54
johanneskoester pushed a commit that referenced this pull request Apr 25, 2024
🤖 I have created a release *beep* *boop*
---


##
[8.11.0](v8.10.8...v8.11.0)
(2024-04-25)


### Features

* allow for more extensive benchmark file in jsonl format
([#2691](#2691))
([de12463](de12463))


### Bug Fixes

* only download input for local jobs in the main process, not within
remote groups
([#2842](#2842))
([97f428b](97f428b))
* remove non-empty local copies of remote storage dirs
([#2845](#2845))
([71b2b87](71b2b87))
* retrieve files from storage if necessary when calling their open
method (e.g. when accessing output files from a checkpoint)
([#2839](#2839))
([5448208](5448208))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants