-
Notifications
You must be signed in to change notification settings - Fork 487
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
recover input stats from frozen models #1482
Conversation
Before, only NN parameters were recovered.
Codecov Report
@@ Coverage Diff @@
## devel #1482 +/- ##
==========================================
+ Coverage 75.99% 76.02% +0.02%
==========================================
Files 93 93
Lines 7674 7711 +37
==========================================
+ Hits 5832 5862 +30
- Misses 1842 1849 +7
Continue to review full report at Codecov.
|
The suffix of the scope | ||
""" | ||
self.davg = get_tensor_by_name(model_file, 'descrpt_attr%s/t_avg' % suffix) | ||
self.tavg = get_tensor_by_name(model_file, 'descrpt_attr%s/t_std' % suffix) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I found I made a typo here
tavg
-> dstd
commit 12e224b Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 18:17:20 2022 -0400 adjust variable name commit 6ac8207 Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 17:58:29 2022 -0400 add unittests commit 1dcc218 Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 17:38:02 2022 -0400 supports increasing sel commit 1f1fcda Merge: 58a5dfd d8a0844 Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 17:01:41 2022 -0400 Merge branch 'devel' into adjust_sel commit 58a5dfd Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 17:01:14 2022 -0400 support recovering sel<original_sel commit a6ee102 Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 16:25:55 2022 -0400 fix a typo in deepmodeling#1482 commit 65dd1ab Author: Jinzhe Zeng <jinzhe.zeng@rutgers.edu> Date: Mon Mar 14 02:18:53 2022 -0400 save checkpoints after training if it's not saved
@@ -106,6 +106,8 @@ def init_variables(self, | |||
The suffix of the scope | |||
""" | |||
self.embedding_net_variables = get_embedding_net_variables(model_file, suffix = suffix) | |||
self.davg = get_tensor_by_name(model_file, 'descrpt_attr%s/t_avg' % suffix) | |||
self.tavg = get_tensor_by_name(model_file, 'descrpt_attr%s/t_std' % suffix) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Same typo introduced here....
* save checkpoints after training if it's not saved * fix a typo in #1482 * support recovering sel<original_sel * supports increasing sel * add unittests * adjust variable name * add doc
Before, only NN parameters were recovered.