This repository was archived by the owner on Jul 7, 2023. It is now read-only.
This repository was archived by the owner on Jul 7, 2023. It is now read-only.
What are the transformers that is obviously better than transformer-2017? #1877
Description
The transformer-2017 is described in the paper 《attention is all you need》.
Now 3 years past. Are there any transformers that surpass transformer-2017 in most of the task?
Speedup without accuracy decreasing is also considered as a better one.