-
Notifications
You must be signed in to change notification settings - Fork 526
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: allow for more extensive benchmark file in jsonl format #2691
Conversation
|
Is this a replacement of my PR? Sorry I haven't looked much into it. Just want to know if I still need to refactor my PR to the new format (I should have some more time to work on it in the next two weeks) |
Not sure... I started it just to explore a simpler way to do it (just adding more info to the PS - that is also why I haven't added the |
6db05b8
to
b10f6af
Compare
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great work!
|
🤖 I have created a release *beep* *boop* --- ## [8.11.0](v8.10.8...v8.11.0) (2024-04-25) ### Features * allow for more extensive benchmark file in jsonl format ([#2691](#2691)) ([de12463](de12463)) ### Bug Fixes * only download input for local jobs in the main process, not within remote groups ([#2842](#2842)) ([97f428b](97f428b)) * remove non-empty local copies of remote storage dirs ([#2845](#2845)) ([71b2b87](71b2b87)) * retrieve files from storage if necessary when calling their open method (e.g. when accessing output files from a checkpoint) ([#2839](#2839)) ([5448208](5448208)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please). Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Description
Another try at #2176, where we try to gather more information about a job; for example, not only resources used, but also resources requested and size of input files.
Here, the original
benchmark
file is left as is, but there is an option to request an extendedbenchmark
file if the extension is.jsonl
.Is there any other relevant info to include?
@SichongP @corneliusroemer feel free to comment.
QC
docs/
) is updated to reflect the changes or this is not necessary (e.g. if the change does neither modify the language nor the behavior or functionalities of Snakemake).