New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
the update of the hybrid memory #15
Comments
Did you setup the code again ( |
i did not re-setup the code. But i have tried, whether to setup the code again do nothing to the debuging results. I wonder whether the memory is updated, and how can i see the updates in real time. I have treid to print the self.features in hm.py, but it is not changed. |
Did you check the memory after loss backpropagation? Since the features in the memory would be updated when doing |
Which means that, you need to print the features after the line of |
it really updates when in the loss.backward(), but in the next iteration, in the forward phase, the memory is kept the same as the initialization. I am confusing that, as the backward has been done, the memory is supposed to be updated in the next iteration, but i cannot see the difference. |
Did you print the whole memory? Only a mini-batch's samples would be updated, you need to check whether the corresponding batch has been updated. |
I will have more trial, thank you for your time. |
how can i debug the hybrid memory's features. i just change the moemtumn update function to the simple ctx.features = ctx.features +1 . And when i debug the hm.py, the self.features is never changed.
The text was updated successfully, but these errors were encountered: