Skip to content

Add initializer arguments to TransformerEncoder/TransformerDecoder #48

@mattdangerw

Description

@mattdangerw

We should add kernel_initializer and bias_initializer arguments to the TransformerEncoder/TransformerDecoder. These initializer should be passed to the dense and multi head attention layers with the encoder/decoder, and saved in the config.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions