Skip to content

Improving entropy calculations#123

Merged
matteobecchi merged 16 commits intoGMPavanLab:mainfrom
matteobecchi:entropy
Oct 2, 2025
Merged

Improving entropy calculations#123
matteobecchi merged 16 commits intoGMPavanLab:mainfrom
matteobecchi:entropy

Conversation

@matteobecchi
Copy link
Copy Markdown
Collaborator

@matteobecchi matteobecchi commented Oct 1, 2025

Requested Reviewers: @andrewtarzia @SimoneMartino98
Note for Reviewers: If you accept the review request add a 👍 to this post

Following the entropic chaos of the last days, I have

  • added an argument to the functions for the entropy calculations to set the unit of measure of the output
  • added a function to compute the entropy of multivariate datasets using KL estimator
  • added a recipe that explains how to compute the entropy of different variables

Everything should be done so that old code still works correclty.

En passant, I also have solved a couple of minor bugs, both in the entropy calculations and in the recipes (the download link wasn't working).

I think I want to improve/clarify the "information gain" stuff, then we should be OK.

@matteobecchi matteobecchi self-assigned this Oct 1, 2025
@matteobecchi matteobecchi added the enhancement New feature or request label Oct 1, 2025
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
Comment thread src/dynsight/_internal/analysis/entropy.py
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
Comment thread src/dynsight/_internal/analysis/entropy.py
Comment thread src/dynsight/_internal/analysis/entropy.py Outdated
@matteobecchi
Copy link
Copy Markdown
Collaborator Author

Ok, if everything runs smoothly, I am done here!

@matteobecchi matteobecchi merged commit 2813886 into GMPavanLab:main Oct 2, 2025
11 checks passed
@matteobecchi matteobecchi deleted the entropy branch October 2, 2025 11:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants