Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decode cmsRun output before writing log files #11933

Merged
merged 1 commit into from
Mar 15, 2024

Conversation

germanfgv
Copy link
Contributor

Fixes #11932

Status

ready

Description

Uses decodeBytesToUnicodeConditional() to decode error and output streams from cmsRun

Is it backward compatible (if not, which system it affects?)

YES

Related PRs

External dependencies / deployment changes

@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 1 changes in unstable tests
  • Python3 Pylint check: failed
    • 9 warnings and errors that must be fixed
    • 2 warnings
    • 31 comments to review
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded
    • 4 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/14973/artifact/artifacts/PullRequestReport.html

@amaltaro
Copy link
Contributor

These changes look good to me. The decode to unicode followed by a casting to string seems to be redundant, but it won't hurt.
I am applying this patch to vocms0193 to try my luck in reproducing this error (well, validating this patch).

@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 1 changes in unstable tests
  • Python3 Pylint check: failed
    • 9 warnings and errors that must be fixed
    • 2 warnings
    • 31 comments to review
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded
    • 4 comments to review

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/14974/artifact/artifacts/PullRequestReport.html

@germanfgv
Copy link
Contributor Author

germanfgv commented Mar 15, 2024

@amaltaro I remove the cast and tested with T0 workflows. The log files are now properly formatted.

@germanfgv
Copy link
Contributor Author

germanfgv commented Mar 15, 2024

As an example, this is the error log from one of the jobs with the fix:

WARNING: In non-interactive mode release checks e.g. deprecated releases, production architectures are disabled.
WARNING: There already exists /srv/job/WMTaskSpace/cmsRun1/CMSSW_14_0_1 area for SCRAM_ARCH el8_amd64_gcc12.

@germanfgv germanfgv requested a review from amaltaro March 15, 2024 17:43
Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much, German!

@amaltaro amaltaro merged commit 3b94a2b into dmwm:master Mar 15, 2024
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

cmsRun logs not usable because of lack of decoding
3 participants