Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use consistent logging #1611

Merged
merged 20 commits into from Jan 30, 2024
Merged

Use consistent logging #1611

merged 20 commits into from Jan 30, 2024

Conversation

szysad
Copy link
Contributor

@szysad szysad commented Dec 21, 2023

Before submitting checklist

  • Did you update the CHANGELOG? (not for test updates, internal changes/refactors or CI/CD setup)
  • Did you ask the docs owner to review all the user-facing changes?

Copy link

codecov bot commented Dec 21, 2023

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (df946da) 79.94% compared to head (4c70d32) 79.97%.

Files Patch % Lines
src/neptune/cli/sync.py 66.66% 1 Missing ⚠️
src/neptune/cli/utils.py 66.66% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1611      +/-   ##
==========================================
+ Coverage   79.94%   79.97%   +0.03%     
==========================================
  Files         293      293              
  Lines       14634    14669      +35     
==========================================
+ Hits        11699    11732      +33     
- Misses       2935     2937       +2     
Flag Coverage Δ
e2e 71.51% <98.29%> (+0.11%) ⬆️
e2e-management 56.44% <96.58%> (+0.10%) ⬆️
e2e-s3 56.22% <96.58%> (+0.28%) ⬆️
e2e-s3-gcs 56.22% <96.58%> (+0.25%) ⬆️
e2e-standard 71.33% <98.29%> (+0.11%) ⬆️
macos 79.74% <98.29%> (-0.01%) ⬇️
py3.10 71.47% <98.29%> (-8.42%) ⬇️
py3.7 79.55% <98.29%> (+0.04%) ⬆️
py3.7.16 70.70% <98.29%> (-8.60%) ⬇️
py3.8 ?
py3.9 ?
ubuntu 79.81% <98.29%> (+0.03%) ⬆️
unit 74.03% <98.29%> (-0.49%) ⬇️
windows 79.78% <98.29%> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@szysad szysad marked this pull request as ready for review December 28, 2023 08:46
@@ -184,33 +182,32 @@ def _verify_version(self):
parsed_version = version.parse(self.client_lib_version)

if self._client_config.min_compatible_version and self._client_config.min_compatible_version > parsed_version:
click.echo(
styled_msg = click.style(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we also call logger.error(styled_msg) right after that?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this change was removed as its part of legacy client

@szysad szysad marked this pull request as draft January 4, 2024 15:31
@szysad szysad force-pushed the dev/consistent-logging branch 3 times, most recently from 89e7484 to ab28e41 Compare January 11, 2024 09:41
@szysad szysad marked this pull request as ready for review January 11, 2024 09:51
src/neptune/internal/utils/logger.py Outdated Show resolved Hide resolved
src/neptune/internal/utils/logger.py Outdated Show resolved Hide resolved
Raalsky
Raalsky previously approved these changes Jan 29, 2024
@Raalsky
Copy link
Contributor

Raalsky commented Jan 30, 2024

Sample output after changes:

[neptune] [info   ] Neptune initialized. Monitor the logging in the app: https://app.neptune.ai/rafal.neptune/test/e/TES-1274
[neptune] [warning] Info (NVML): NVML Shared Library Not Found. GPU usage metrics may not be reported. For more information, see https://docs.neptune.ai/help/nvml_error/
[neptune] [info   ] Shutting down background jobs, please wait a moment...
[neptune] [info   ] Done!
[neptune] [info   ] Waiting for the remaining 18 operations to synchronize with Neptune. Do not kill this process.
[neptune] [info   ] All 18 operations synced, thanks for waiting!
[neptune] [info   ] Explore the metadata in the Neptune app: https://app.neptune.ai/rafal.neptune/test/e/TES-1274/metadata
[neptune] [info   ] Neptune initialized. Monitor the logging in the app: https://app.neptune.ai/rafal.neptune/test/e/TES-1275
[neptune] [info   ] Shutting down background jobs, please wait a moment...
[neptune] [info   ] Done!
[neptune] [info   ] Waiting for the remaining 18 operations to synchronize with Neptune. Do not kill this process.
[neptune] [info   ] All 18 operations synced, thanks for waiting!
[neptune] [info   ] Explore the metadata in the Neptune app: https://app.neptune.ai/rafal.neptune/test/e/TES-1275/metadata

Comment on lines 67 to 70
warning = (
"Info (NVML): %s. GPU usage metrics may not be reported. For more information, "
"see https://docs-legacy.neptune.ai/logging-and-managing-experiment-results"
"/logging-experiment"
"-data.html#hardware-consumption "
)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Under which circumstances does this show? Just wondering whether we should update the ancient docs link.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks to be quite consistent with the circumstances etc. and up-to-date: https://docs.neptune.ai/help/nvml_error/ ?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yep! And if the page is not up to snuff, I'll fix it 😉

AleksanderWWW
AleksanderWWW previously approved these changes Jan 30, 2024
Copy link
Contributor

@AleksanderWWW AleksanderWWW left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@AleksanderWWW
Copy link
Contributor

Copy link
Contributor

@AleksanderWWW AleksanderWWW left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

E2E tests failed (see link above). This will need to be addressed before merging

normandy7
normandy7 previously approved these changes Jan 30, 2024
@Raalsky
Copy link
Contributor

Raalsky commented Jan 30, 2024

E2E one more time: https://github.com/neptune-ai/neptune-client/actions/runs/7713014109

@Raalsky Raalsky merged commit 6088343 into master Jan 30, 2024
29 checks passed
@Raalsky Raalsky deleted the dev/consistent-logging branch January 30, 2024 15:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants