Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added hardware metric tracking #10

Merged
merged 14 commits into from
May 3, 2024
Merged

added hardware metric tracking #10

merged 14 commits into from
May 3, 2024

Conversation

mraess
Copy link
Collaborator

@mraess mraess commented May 2, 2024

Pull Request

Short Summary

Added cpu, network, and memory metrics logging

Context

Concurrent hardware metric logging added to active_run. This will run in the background of an active run for its duration, continuously logging hardware metrics.

@mraess mraess self-assigned this May 2, 2024
Copy link

github-actions bot commented May 2, 2024

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Manifest Files

poetry.lock
  • google-api-core@2.19.0
  • grpcio@1.63.0
  • huggingface-hub@0.23.0
  • joblib@1.4.2
  • lightning@2.2.4
  • plotly@5.22.0
  • pytorch-lightning@2.2.4
  • tensorflow-io-gcs-filesystem@0.37.0
  • google-api-core@2.18.0
  • grpcio@1.62.2
  • huggingface-hub@0.22.2
  • joblib@1.4.0
  • lightning@2.2.3
  • plotly@5.21.0
  • pytorch-lightning@2.2.3
  • tensorflow-io-gcs-filesystem@0.36.0
pyproject.toml
  • psutil@^ 5.9.0

from collections import namedtuple
#from opsml.projects.active_run import ActiveRun

LOGGER = logging.getLogger(__name__)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

im going to change this up to use the opsml logger

LOGGER = logging.getLogger(__name__)


class BaseMetricsDataLogger(abc.ABC):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥

@thorrester
Copy link
Member

I'm going to add some unit tests in

Copy link

codecov bot commented May 3, 2024

Codecov Report

Attention: Patch coverage is 92.98246% with 12 lines in your changes are missing coverage. Please review.

Project coverage is 92.70%. Comparing base (0d7eb3f) to head (5b3ab9a).

Additional details and impacted files
@@           Coverage Diff            @@
##             main      #10    +/-   ##
========================================
  Coverage   92.70%   92.70%            
========================================
  Files         113      114     +1     
  Lines        8483     8649   +166     
========================================
+ Hits         7864     8018   +154     
- Misses        619      631    +12     
Files Coverage Δ
opsml/projects/active_run.py 97.14% <ø> (ø)
opsml/projects/project.py 94.18% <100.00%> (ø)
opsml/projects/types.py 100.00% <100.00%> (ø)
opsml/projects/_run_manager.py 95.65% <88.88%> (-1.72%) ⬇️
opsml/projects/_hw_metrics.py 93.28% <93.28%> (ø)

@mraess mraess merged commit 45c0a62 into main May 3, 2024
14 checks passed
@thorrester thorrester mentioned this pull request May 5, 2024
@thorrester thorrester deleted the mraess/hardwareMetrics branch May 6, 2024 16:57
@thorrester thorrester restored the mraess/hardwareMetrics branch May 8, 2024 20:05
@thorrester thorrester deleted the mraess/hardwareMetrics branch May 8, 2024 20:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants