Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add rse=ALL_DOCS to the MSUnmerged info REST API. #11025

Conversation

todor-ivanov
Copy link
Contributor

Fixes #10995

Status

ready

Description

With the current PR we implement ad a simple addition of rse=ALL_DOCS to the info REST API for MSUnmerged, so that we can get the counters for all the RSEs with the gfal errors.

NOTE:
This will not get the whole document stored in MongoDB. This interface is to serve only for collecting all gfal errors for all RSEs.

Is it backward compatible (if not, which system it affects?)

YES

Related PRs

None

External dependencies / deployment changes

None

@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
    • 2 changes in unstable tests
  • Python3 Pylint check: succeeded
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12849/artifact/artifacts/PullRequestReport.html

@todor-ivanov todor-ivanov force-pushed the feature_MSUnmerged_RseAllDocsApi_fix_10995 branch from 4391ccd to 9b4abed Compare March 7, 2022 14:04
@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
    • 2 changes in unstable tests
  • Python3 Pylint check: succeeded
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12850/artifact/artifacts/PullRequestReport.html

@todor-ivanov todor-ivanov changed the title Add rse=ALL_DOCS. Add rse=ALL_DOCS to the MSUnmerged info REST API. Mar 7, 2022
Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This code looks good to me, Todor. I left a question along the code though.
Similar to the PR title, could you please update the commit message to something more meaningful?

mongoProjection = {
"_id": False,
"name": True,
"isClean": True,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Don't you want to have rucioConMonStatus attribute on this query as well?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a good idea actually. Let me add it into the projection before we merge. And I will also update the commit message.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

Add type check of kwargs[rse].

Add rucioConMonStatus to the MongoDBProjection for rse=ALL_DOC.
@todor-ivanov todor-ivanov force-pushed the feature_MSUnmerged_RseAllDocsApi_fix_10995 branch from 9b4abed to d7e4714 Compare March 7, 2022 19:06
@todor-ivanov
Copy link
Contributor Author

Thanks for the quick review @amaltaro ! I just added rucioConMonStatus to the MongoDBProjection. Please take another look, before merging.

@cmsdmwmbot
Copy link

Jenkins results:

  • Python3 Unit tests: succeeded
    • 7 tests added
  • Python3 Pylint check: succeeded
  • Pylint py3k check: succeeded
  • Pycodestyle check: succeeded

Details at https://cmssdt.cern.ch/dmwm-jenkins/view/All/job/DMWM-WMCore-PR-test/12852/artifact/artifacts/PullRequestReport.html

Copy link
Contributor

@amaltaro amaltaro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Todor.

@amaltaro amaltaro merged commit 1592300 into dmwm:master Mar 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

MSUnmerged: Create a REST API for all RSEs' state
3 participants