Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Misaligned diagonals for DataFrame #7

Closed
jjzha opened this issue Oct 27, 2021 · 2 comments
Closed

Misaligned diagonals for DataFrame #7

jjzha opened this issue Oct 27, 2021 · 2 comments

Comments

@jjzha
Copy link

jjzha commented Oct 27, 2021

Hi,

Love this repo, thanks for doing this!

Issue

I have a small issue with respect to the new DataFrame feature that you implemented. Here I have misaligned diagonals where I would get close to stochastic dominance of a model compared to itself.

Reproduce Issue

I have the following dictionary:
d = {'x': array([59.13, 58.03, 59.18, 58.78, 58.5 ]), 'y': array([58.13, 59.19, 59.94, 60.08, 59.85]), 'z': array([58.77, 58.86, 59.58, 59.59, 59.64]), 'w': array([58.16, 58.49, 59.87, 58.94, 58.96])}

I use the following line of code:
print(multi_aso(d, confidence_level=0.05, return_df=True))

I get the following result:

    x         y            z            w
x    1.000000  1.000000     0.202027       0.0
y    1.000000  0.101093     0.000000       0.0
z    0.202027  0.000000     1.000000       0.0
w    0.000000  0.000000     0.000000       1.0

Where I think the diagonal for the (y, y) pair shouldn't be correct.

Thanks for reading!

@jjzha
Copy link
Author

jjzha commented Oct 27, 2021

I also checked it without returning df. The same error persists. So there might be a different underlying issue.

Kaleidophon added a commit that referenced this issue Oct 27, 2021
…a issue #7 (see below)

* Fix bug where symmetry property wouldn't be used to correctly to fill eps_min matrix
* Fix bug where indices would be misaligned, filling the wrong matrix entries with scores
* Add Mike's example from issue #7 as explicit test cases
@Kaleidophon
Copy link
Owner

Fixed in the above commit and version 1.1.3 is already published on PyPI! Thank you so much for discovering and reporting this bug.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants