Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NaN values on KADID10k for IS #309

Open
snk4tr opened this issue Mar 26, 2022 · 0 comments
Open

NaN values on KADID10k for IS #309

snk4tr opened this issue Mar 26, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@snk4tr
Copy link
Contributor

snk4tr commented Mar 26, 2022

Describe the bug
Computation of IS for some images in KADID10k dataset causes NaN results, which is not a valid output.

To Reproduce
Steps to reproduce the behavior:

  1. Checkout to feature/extend_bench
  2. Run tests/resutls_benchmark.py with --dataset=kadid10k and --metrics IS
  3. Print out computed metrics' values and observe torch.tensor(nan) as output for some images
  4. Alternatively, finish computation of IS on all DB metrics and observe an error during computation of correlation values

Expected behavior
No NaN values are expected.

Screenshots
image

Additional context
Other DB metrics such as FID, MSID, KID and GS might me vulnerable.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant