Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't allow PCs to compute affinity scores if there are over 2k submissions #2041

Merged
merged 9 commits into from
Mar 14, 2024

Conversation

enrubio
Copy link
Member

@enrubio enrubio commented Mar 7, 2024

Edit:
Decided to fix the other paper matching issues in separate PRs.

pretty_role = role_name.replace('_', ' ')

if compute_affinity_scores and 'upload_affinity_scores' in note.content:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would leave this if before checking the submission count that is needed later.

@melisabok
Copy link
Member

Could you please fix this issue in this PR too:#2016

it will require changing the preprocess function too.

@enrubio
Copy link
Member Author

enrubio commented Mar 7, 2024

Yes, I will also fix #2015 in this PR

@enrubio enrubio changed the title Fix/paper matching fixes Don't allow PCs to compute affinity scores if there are over 2k submissions Mar 12, 2024
@enrubio enrubio marked this pull request as ready for review March 12, 2024 16:02
domain = client_v2.get_group(venue_id)
submission_venue_id = domain.content['submission_venue_id']['value']
senior_area_chairs_name = domain.content.get('senior_area_chairs_name', {}).get('value')
compute_affinity_scores = note.content.get('compute_affinity_scores') == 'Yes'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you check the value No instead? we are going to add more options that represent the affinity model but "No" will stay: https://github.com/openreview/openreview-py/pull/1843/files

if compute_affinity_scores and 'upload_affinity_scores' in note.content:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess you are missing not compute_affinity_scores is it is reading the yes value.


matching_group = note.content['matching_group']
role_name = matching_group.split('/')[-1]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

instead of parsing the matching_group can you check if matching.group.ends_with(senior_area_chairs_name)?

role_name = matching_group.split('/')[-1]
pretty_role = role_name.replace('_', ' ')
_, num_submissions = client_v2.get_notes(content={ 'venueid':submission_venue_id }, limit=1, with_count=True)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you don't need to get the notes if the role is SAC, so you can check:

if matching.group.ends_with(senior_area_chairs_name):
  return
...get_notes()

matching_group = note.content['matching_group']
senior_area_chairs_name = domain.get_content_value('senior_area_chairs_name')
if senior_area_chairs_name and matching_group.endswith(senior_area_chairs_name): return
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is no Python convention about this but our code put the return statement in a new line. We would like to keep consistency in the code style.

@melisabok
Copy link
Member

The changes look good!

matching_group = note.content['matching_group']
senior_area_chairs_name = domain.get_content_value('senior_area_chairs_name')
if matching_group.endswith(senior_area_chairs_name):
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure why you deleted the check that senior_area_chairs_name is not None.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oops, I thought the senior_area_chairs_name was always a part of the domain and thought it was redundant. Fixed now.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

senior_area_chairs_name is only present if the venue has SAC.

@celestemartinez celestemartinez merged commit 354d35c into master Mar 14, 2024
1 check passed
@celestemartinez celestemartinez deleted the fix/paper-matching-fixes branch March 14, 2024 20:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Paper Matching Setup: don't let compute affinity scores to venues with more than 2k submissions
3 participants