Port #1476 ('dict' option for weights_initializer and bias_initializer) to tf_legacy #1599
Conversation
|
@justinxzhao Should I add the pre-commit.yaml file to |
Feel free to ignore the pre-commit check in this branch, since we've never fixed all of the linting/formatting errors on |
| weights_initializer: str = schema.InitializerOptions(default='glorot_uniform') | ||
| bias_initializer: str = schema.InitializerOptions(default='zeros') | ||
| weights_initializer: Union[str, Dict] = schema.InitializerOrDict(default='glorot_uniform') | ||
| bias_initializer: Union[str, Dict] = schema.InitializerOrDict(default='zeros') |
There was a problem hiding this comment.
Out of curiosity, what's an example of a bias initializer configured using a dict?
There was a problem hiding this comment.
Don't have a concrete example for you 😅 but it's explicity supported by the developer guide, traces to TF documentation for initializer parameters
Port of https://github.com/ludwig-ai/ludwig/pull/1476/files to
tf_legacy.