Questions about Transformer architecture implemention status in Keras library

[TaiXeflar]

Hello guys, I'm beginner learning Keras.
Is Keras library have existed transformer layers class can use? (Just like torch nn.TransformerEncoderLayer)
If not, does it mean have to build by self?
Any awnsers or guides will be appreciated.

[roebel]

Hello, no there does not exist such a layer. You can look through the examples under https://keras.io/examples/ and will find a few that use transformers and that you may use for starting your own implementation.

[TaiXeflar]

Yes, I was thrown this question at where keras-hub version 0.18.0 engaging keras-hub requires tensorflow's install fail.
Now I'm using keras-hub 0.19 and PyTorch backends and work with transformer well. Thanks!