Skip to content

ENH: dump runtime stats to cloud storage systems#243

Merged
aresnow1 merged 13 commits intoxorbitsai:mainfrom
UranusSeven:enh/dump_task_info_to_cloud_storage
Mar 7, 2023
Merged

ENH: dump runtime stats to cloud storage systems#243
aresnow1 merged 13 commits intoxorbitsai:mainfrom
UranusSeven:enh/dump_task_info_to_cloud_storage

Conversation

@UranusSeven
Copy link
Contributor

Related issue number

Resolves #214

Check code requirements

  • tests added / passed (if needed)
  • Ensure all linting tests pass

@XprobeBot XprobeBot added the enhancement New feature or request label Feb 27, 2023
@XprobeBot XprobeBot added this to the v0.2.1 milestone Feb 27, 2023
@codecov
Copy link

codecov bot commented Feb 27, 2023

Codecov Report

Merging #243 (7db47d0) into main (80878f9) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #243   +/-   ##
=======================================
  Coverage   99.74%   99.74%           
=======================================
  Files          35       35           
  Lines        1162     1162           
  Branches      222      222           
=======================================
  Hits         1159     1159           
  Partials        3        3           
Flag Coverage Δ
unittests 99.74% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@aresnow1
Copy link
Contributor

aresnow1 commented Mar 6, 2023

So we dump each subtask info into one file now? Is there a significant overhead?

@UranusSeven
Copy link
Contributor Author

So we dump each subtask info into one file now? Is there a significant overhead?

Right. There'll be a file for each subtask. The overhead is about 7% when running on my laptop with TPC-H SF10.

aresnow1
aresnow1 previously approved these changes Mar 7, 2023
Copy link
Contributor

@aresnow1 aresnow1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@UranusSeven UranusSeven force-pushed the enh/dump_task_info_to_cloud_storage branch from 3ed7a64 to 7db47d0 Compare March 7, 2023 02:58
Copy link
Contributor

@aresnow1 aresnow1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@aresnow1 aresnow1 merged commit 208e4c4 into xorbitsai:main Mar 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

ENH: dump collected runtime stats to cloud storage

4 participants