v0.0.5
What's Changed
- Refactor optimizers by @jessegrabowski in #31
- Add serialization of network and state by @jessegrabowski in #32
- Add erf-based activations: gelu, swish by @jessegrabowski in #33
- Add LayerNorm by @jessegrabowski in #34
- Add Embedding layer with integer-index lookup by @jessegrabowski in #35
- Mypy cleanup by @jessegrabowski in #36
- Add MultiheadAttention layer by @jessegrabowski in #37
- Update to pytensor>=3.2.3 by @jessegrabowski in #40
- Update repo owner by @jessegrabowski in #39
- Add TransformerBlock and MLP helpers by @jessegrabowski in #38
Full Changelog: v0.0.4...v0.0.5