Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to get Brain-Score? #15

Closed
donghaiwang opened this issue Feb 27, 2021 · 2 comments
Closed

How to get Brain-Score? #15

donghaiwang opened this issue Feb 27, 2021 · 2 comments

Comments

@donghaiwang
Copy link

After I get the output features of test image (eg. CORnet-S_decoder_avgpool_feats.npy), how to get the Brain-Score. Can you show me the detailed steps? Thanks.

@qbilius
Copy link
Contributor

qbilius commented Feb 27, 2021

The Brain-Score repo you referred to and the repos it links have some explanations how to compute Brain-Score from model features. I agree those are not very straightforward to follow, but that's all we have at the moment.

@qbilius qbilius closed this as completed Feb 27, 2021
@mschrimpf
Copy link
Member

To get the full set of scores, you would submit the model to the Brain-Score platform. See here on how to do that and here for how this is implemented for CORnet. There are also examples for scoring models on e.g. the public benchmarks here for a generic model and here for a pre-defined model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants