Skip to content

v0.2.1
Compare
Choose a tag to compare
@speedcell4 speedcell4 released this 03 Nov 05:01
· 71 commits to master since this release
v0.2.1
b24422f

Bug Fixes

  • Fix trivial bugs of transformer.py
  • Resolve vocab size bug

Documentation

  • Add shape annotations

Features

  • Add MultiHeadAttention
  • Add TransformerFfn
  • Add TransformerEncoderLayer
  • Add TransformerDecoderLayer
  • Add Transformer
  • Update initialization functions
  • Add padding_mask
  • Add PosEmbedding and TriangularPosEmbedding
  • Add IWSLT14 dataset
  • Add PaddedListTensorPipe, PackedListTensorPipe, and CattedListTensorPipe
  • Move PaddedListTensorPipe to padding.py
  • Move PackedListTensorPipe to packing.py
  • Remove original format.py
Assets 2