Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GEM online DQM updates #1028

Merged
merged 1 commit into from Feb 19, 2021
Merged

GEM online DQM updates #1028

merged 1 commit into from Feb 19, 2021

Conversation

quark2
Copy link
Contributor

@quark2 quark2 commented Feb 4, 2021

PR description:

This PR updates and extends the part of onlineDQM for GEM. The details are following:

  • Most of plots in the Quick collection page is removed but compressed plots are provided
  • Detailed plots for each chambers are moved into directories

This PR is related to PRs on cms-sw; see
cms-sw/cmssw#32792 (to master)
cms-sw/cmssw#32791 (backport)

For more detail, please see this to check more details

@jshlee @watson-ij

@muhammadimranfarooqi
Copy link
Contributor

@quark2

Don't you need to have any PR in cmsdist repository for these changes? Is this PR is ready to merge? Thanks

@muhammadimranfarooqi
Copy link
Contributor

@quark2

Could you please reply to the above comment. Thanks

@muhammadimranfarooqi
Copy link
Contributor

@quark2

I did not hear back from you regarding this PR. Do you want to include it in next month release or not? please comment. Thanks

@quark2
Copy link
Contributor Author

quark2 commented Feb 19, 2021

Hi @muhammadimranfarooqi,

Sorry for my super late response...
Actually I have no idea about cmsdist... But my colleague advised that I had to mail to T0. Could you inform about that?
Btw this PR is already reported in a DQM General meeting [1]. I hope it is useful.

Best regards,
Byeonghak Ko

[1] https://indico.cern.ch/event/1005033/#12-simplification-of-online-dq

@muhammadimranfarooqi
Copy link
Contributor

@quark2

I am including this PR then. I dont' attend GEM DQM general meetings. Any specific request for deployment in cmsweb should be made accordingly.

@muhammadimranfarooqi muhammadimranfarooqi merged commit 0aca53b into dmwm:master Feb 19, 2021
@quark2
Copy link
Contributor Author

quark2 commented Feb 19, 2021

@muhammadimranfarooqi

Ahh, yep I should do so... Many thanks!

Best regards,
Byeonghak Ko

@muhammadimranfarooqi
Copy link
Contributor

@quark2

I have deployed this PR in http://cmsweb-testbed.cern.ch cluster. Please test and provide validation results at this ticket https://gitlab.cern.ch/cms-http-group/doc/-/issues/253

@muhammadimranfarooqi
Copy link
Contributor

@quark2

Have you tested this PR in the testbed ?

@muhammadimranfarooqi
Copy link
Contributor

@quark2

Despite sending you messages about validation results, I did not get any reply from you regarding this PR. As Tuesday 2nd March is production upgrade, I'll remove this PR from deployment in the production nodes if I don't hear anything from you regarding validation results by Monday morning.

@muhammadimranfarooqi
Copy link
Contributor

@quark2

I have already created revert PR for this which will remove these changes after merging it.

@quark2
Copy link
Contributor Author

quark2 commented Feb 26, 2021

Sorry for my forget of reply...

But also I had no idea how to do when I got your reply after the merge. I found that there is nothing I can do but just watch all the GEM onlineDQM GUI are working as desired. How can I test it in the testbed? I tried to find an instruction for that but I cannot. Or, just reporting everything is fine/something is weird is all of what I should do? (But yep, then I should ask these questions much earlier...)

Best regards,
Byeonghak Ko

@muhammadimranfarooqi
Copy link
Contributor

@quark2

You can test it on the testbed cluster https://cmsweb-testbed.cern.ch. This is relevant URL https://cmsweb-testbed.cern.ch/dqm/dev/

@quark2
Copy link
Contributor Author

quark2 commented Feb 26, 2021

You mean upload any GEM DQM root file into https://cmsweb-testbed.cern.ch/dqm/dev/ (by visDQMUpload) and check if the GUI shows everything well?
Btw the site in the link looks like an offlineDQM, not an onlineDQM. Is it okay?

Best regards,
Byeonghak Ko

@quark2
Copy link
Contributor Author

quark2 commented Feb 26, 2021

And also I checked all of Online, Online-playback, Online-test in https://cmsweb-testbed.cern.ch/ and GEM GUI is working well, as I mentioned.

@muhammadimranfarooqi
Copy link
Contributor

@quark2

Well, yes this is offlineDQM. I don't know how it can be testbed. Currently, this PR is deployed in this node only.

@quark2
Copy link
Contributor Author

quark2 commented Feb 26, 2021

Then... what should I do? I mean, where should I upload my DQM plots and check if it is okay or not?

@muhammadimranfarooqi
Copy link
Contributor

I don't know how to test it. CMSWEB only provides the infrastructure to deploy and run services. How to test services is the developer's responsibility. You may ask DQM folks about this.

@quark2
Copy link
Contributor Author

quark2 commented Feb 26, 2021

Okay, then what should I show for the validation?

Actually I saw that all GEM onlineDQM plots from MWGR No. 1 in 2021 are displayed in the P5 onlineDQM during the run and the desired plots are also found in all onlineDQM sites (Online, Online-playback, Online-test) in https://cmsweb-testbed.cern.ch/, and then I thought it was enough. But it seems like I have to show something more.

@muhammadimranfarooqi
Copy link
Contributor

@quark2

You don't need to show me anything. Just confirm that this PR is ready to deploy in the production nodes. Then, I'll deploy it.

@vkuznet
Copy link
Contributor

vkuznet commented Feb 26, 2021

Byeonghak, on cmsweb all service responsible should properly test their services before putting changes to production. How to test the service is up to dev team which responsible for it. It can be a simple test to query API, or more comprehensive suit of tests including remote/local API access, testing web interfaces. Everything is up to dev team to define. For CMSWEB operator, we should only say if it is ok or not to include new code to production release. You represent now DQM dev team and you should define your own set of tests and based on them just say if your new release is ok or not.

@quark2
Copy link
Contributor Author

quark2 commented Feb 26, 2021

Hi @vkuznet,

Well, I already tested in a local and private site and checked everything was okay, and also (sorry to mention it too frequently) saw the new version displays all plots well in sites (both central and testbed) in CMSWEB. I thought it would be enough to say that it is confirmed, but now I think I need to ask to DQM folks what I should do more in this stage to make sure everything, like how to test the query to the testbed by myself. I'll ask and check more ASAP. Sorry for this mess up.

Best regards,
Byeonghak Ko

@quark2
Copy link
Contributor Author

quark2 commented Mar 1, 2021

Hi @muhammadimranfarooqi,

I found that I already have confirmations in the level of DQM dev team. The updates are presented in [1] and DQM dev team already tested and confirmed the updates. If you want, I can forward the mail about that. I asked again to DQM dev team and have got that it is enough for the confirmation. Sorry for this late.

Best regards,
Byeonghak Ko

@muhammadimranfarooqi
Copy link
Contributor

Hi @quark2
thanks for confirmation. I'll include this PR in production upgrade. Cheers

@quark2
Copy link
Contributor Author

quark2 commented Mar 1, 2021

Thanks a lot! I should ask and make sure about that earlier...

Best regards,
Byeonghak Ko

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants