Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New Commondata Format] Old Jets datasets #1886

Closed
wants to merge 22 commits into from

Conversation

comane
Copy link
Collaborator

@comane comane commented Dec 7, 2023

This PR converts the following datasets (and versions therein) into the new commondata format

  • CMS_2JET_7TEV
  • CMS_1JET_8TEV
  • ATLAS_2JET_7TEV_R06
  • ATLAS_1JET_8TEV_R06
  • ATLAS_1JET_8TEV_R06_DEC

A report comparing legacy vs New:
https://vp.nnpdf.science/BAIRR312QyuMF3hKa5-9HQ==

@comane
Copy link
Collaborator Author

comane commented Dec 7, 2023

See #1813

Copy link
Member

@scarlehoff scarlehoff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you very much! (and thank you as well for the very detailed report!). I've left some comments with some modifications. Some of them I've added locally to add the report with the plot (like the kinematics_override key in CMS_1JET_8TEV which might make the plot look differently to what you expected)

Please have a look at the plot and check whether everything looks as you expected:
https://vp.nnpdf.science/yWSiPUzmTfyZwHKQttJY-g==

(please add units for the different m12/pt)

As per the datasets themselves:

  • ATLAS_1JET_8TEV_R06:
    • no variant: the t0 chi2 is different, which points to some difference in the treatment of MULT / ADD
    • decorrelated: the covmats are quite different (shouldn't they be the same for DEC?) which obviously leads to a very different chi2
  • CMS_1JET_8TEV_PTY: there is a difference of a factor of two between the computed chi2, the off-diagonal entries of the covmat is different. They are also different with the bugged version which I expected would reproduce the old dataset (or maybe I should not expect the old one to be reproducible at all?)

For these two the results are completely equivalent (including t0 and everything)

  • ATLAS_2JET_7TEV_R06_M12Y: I needed to use the bugged variant (so I've added that to dataset_names.yaml
  • CMS_2JET_7TEV_M12Y

buildmaster/dataset_names.yml Outdated Show resolved Hide resolved
buildmaster/CMS_1JET_8TEV/metadata.yaml Outdated Show resolved Hide resolved
buildmaster/dataset_names.yml Outdated Show resolved Hide resolved
buildmaster/ATLAS_1JET_8TEV_R06/metadata.yaml Outdated Show resolved Hide resolved
buildmaster/ATLAS_2JET_7TEV_R06/metadata.yaml Outdated Show resolved Hide resolved
plot_x: y
figure_by:
- p_T2
kinematic_coverage: [y, p_T2, sqrt_s]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You are missing plotting information for this one from PLOTTINGTYPE_JET

kinematics_override: jet_sqrt_scale

buildmaster/ATLAS_2JET_7TEV_R06/metadata.yaml Outdated Show resolved Hide resolved
buildmaster/CMS_1JET_8TEV/metadata.yaml Outdated Show resolved Hide resolved
buildmaster/CMS_2JET_7TEV/metadata.yaml Outdated Show resolved Hide resolved
buildmaster/ATLAS_1JET_8TEV_R06/metadata.yaml Outdated Show resolved Hide resolved
@comane
Copy link
Collaborator Author

comane commented Dec 10, 2023

  • ATLAS_1JET_8TEV_R06:

    • no variant: the t0 chi2 is different, which points to some difference in the treatment of MULT / ADD

This should have been fixed now.

  • decorrelated: the covmats are quite different (shouldn't they be the same for DEC?) which obviously leads to a very different chi2

The covariance matrices are supposed to be quite different (see https://vp.nnpdf.science/5DpNBePRSne1TZ1Sfky6Kg==/#dataset-atlas_1jet_8tev_r06_dec-variant-decorrelated) and the chi2 too (old value ~ 0.7, new value = 2.6).

@comane
Copy link
Collaborator Author

comane commented Dec 10, 2023

  • CMS_1JET_8TEV_PTY: there is a difference of a factor of two between the computed chi2, the off-diagonal entries of the covmat is different. They are also different with the bugged version which I expected would reproduce the old dataset (or maybe I should not expect the old one to be reproducible at all?)

This I find surprising and it is possibly a mistake. I had found a bug for this dataset that was changing the chi2, but not by a factor of 2.
In the old report https://vp.nnpdf.science/5DpNBePRSne1TZ1Sfky6Kg==/#dataset-cms_1jet_8tev-variant-nominal

Did you compute the chi2 with the cuts applied?

comane and others added 8 commits December 10, 2023 14:54
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
comane and others added 5 commits December 10, 2023 15:01
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
Co-authored-by: Juan M. Cruz-Martinez <juacrumar@lairen.eu>
scarlehoff added a commit that referenced this pull request Feb 1, 2024
@scarlehoff scarlehoff closed this Feb 1, 2024
scarlehoff added a commit that referenced this pull request Feb 6, 2024
scarlehoff added a commit that referenced this pull request Feb 7, 2024
scarlehoff added a commit that referenced this pull request Feb 7, 2024
scarlehoff added a commit that referenced this pull request Feb 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants