Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Add circular eval #610

Merged
merged 6 commits into from
Nov 23, 2023
Merged

Conversation

Leymore
Copy link
Collaborator

@Leymore Leymore commented Nov 21, 2023

No description provided.

opencompass/datasets/circular.py Outdated Show resolved Hide resolved
return circular_patterns


class CircularMixIN:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The CircularMixIN seems unnecessary here since it does not mix with any classes and all the method is static.

  1. if use class, does circular_patterns, option_keys etc. can be set as class attribute? The inputs of each func seems redundant
  2. or can we just use function here?

configs/eval_circular.py Outdated Show resolved Hide resolved
opencompass/datasets/circular.py Show resolved Hide resolved
Copy link
Contributor

@yingfhu yingfhu Nov 22, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW, will this modification break other summerizers?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

NO

Copy link
Contributor

@yingfhu yingfhu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yingfhu yingfhu merged commit d949e3c into open-compass:main Nov 23, 2023
4 checks passed
liushz pushed a commit to liushz/opencompass that referenced this pull request Nov 27, 2023
* refactor default, add circular summarizer

* add circular

* update impl

* update doc

* minor update

* no more to be added
liuyaox pushed a commit to liuyaox/opencompass that referenced this pull request Jun 26, 2024
* refactor default, add circular summarizer

* add circular

* update impl

* update doc

* minor update

* no more to be added
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants