Repository navigation
v0.7.17
Zygote v0.7.17
Merged pull requests:
- Bump JuliaRegistries/TagBot from 1.25.14 to 1.25.15 (#1739) (@dependabot[bot])
- fix:
ZeroTangenterror onback(ZeroTangent)(#1740) (@lenianiva) - Keep scalar cotangents deferred through
accumand scalar rules (#1742) (@CarloLucibello) - Defer the cotangents of broadcast data and of later scalar arguments (#1743) (@CarloLucibello)
- Differentiate nested and
Dualcaptures of GPU broadcasts (#1725) (#1744) (@CarloLucibello) - Differentiate nested dot-broadcasts on the GPU as one broadcast (#1695) (#1745) (@CarloLucibello)
- Sum the cotangents of a branch's arguments only when it is taken (#1747) (@CarloLucibello)
Closed issues:
- Nested
@.broadcasts are materialised node by node in the adjoint (LSTM/GELU-style code is launch-bound) (#1695) - Performance audit: tracking issue (#1702)
- Broadcast: scalar cotangents still computed eagerly for 3rd+ arguments and the generic path (#1720)
- Broadcast: defer cotangents of data array operands (#1722)
- GPU map/broadcast: gradients of the function's scalar parameters still wrong or missing (#1725)
- Deferred scalar cotangents are still computed by
accumand by scalar rules (#1741) - Gradient fails when a branch reassigns a variable to an array of another size (#1746)