-
Notifications
You must be signed in to change notification settings - Fork 3
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
About calculating transfer entropy details #3
Comments
The author has been answered the question in the article,‘𝐻(𝐹) is propor- |
Do you find the calculation code for transfer entropy? |
Hi, Sorry if you misunderstood the calculation of transfer entropy. The code in 'model_shrink.py' is the result of entropy. The transfer entropy is calculated via Eq. (7). These constant terms can be neglected by subtraction. You may refer to the discussion in #1. Best, Sihao |
Thank you for your reply! I overlooked that question. |
Further to my previous answer, here are a few additional details.
|
Thank you for your careful answer. I also have a question: Does the transfer entropy size or rank of a certain layer change with the increase of epochs? |
Hello, May I ask if we need to compare the entropy difference when calculating the transfer entropy, does this require training the model twice? |
Hello! Why doesn't the code include the log(2π) part in the formula for calculating entropy in 'model_shrink.py'? This is a bit different from equation (5) in the paper.
The text was updated successfully, but these errors were encountered: