Be notified of new releases
Create your free GitHub account today to subscribe to this repository for new releases and build software alongside 28 million developers.Sign up
MXNet Change Log
[MXNET-953] Fix oob memory read (v1.3.x) / #13118
Simple bugfix addressing an out-of-bounds memory read.
[MXNET-969] Fix buffer overflow in RNNOp (v1.3.x) / #13119
This fixes an buffer overflow detected by ASAN.
CudnnFind() usage improvements (v1.3.x) / #13123
This PR improves the MXNet's use of cudnnFind() to address a few issues:
- With the gluon imperative style, cudnnFind() is called during forward(), and so might have its timings perturbed by other GPU activity (including potentially other cudnnFind() calls).
- With some cuda drivers versions, care is needed to ensure that the large I/O and workspace cudaMallocs() performed by cudnnFind() are immediately released and available to MXNet.
- cudnnFind() makes both conv I/O and workspace allocations that must be covered by the GPU global memory headroom defined by MXNET_GPU_MEM_POOL_RESERVE. Per issue #12662, large convolutions can result in out-of-memory errors, even when MXNet's storage allocator has free memory in its pool.
This PR addresses these issues, providing the following benefits:
- Consistent algo choice for a given convolution type in a model, both for instances in the same GPU and in other GPUs in a multi-GPU training setting.
- Consistent algo choice from run to run, based on eliminating sources of interference of the cudnnFind() timing process.
- Consistent model global memory footprint, both because of the consistent algo choice (algo's can have markedly different workspace requirements) and changes to MXNet's use of cudaMalloc.
- Increased training performance based on being able to consistently run with models that approach the GPU's full global memory footprint.
- Adds a unittest for and solves issue #12662.
[MXNET-922] Fix memleak in profiler (v1.3.x) / #13120
Fix a memleak reported locally by ASAN during a normal inference test.
Fix lazy record io when used with dataloader and multi_worker > 0 (v1.3.x) / #13124
Fixes multi_worker data loader when record file is used. The MXRecordIO instance needs to require a new file handler after fork to be safely manipulated simultaneously.
fixed symbols naming in RNNCell, LSTMCell, GRUCell (v1.3.x) / #13158
This fixes #12783, by assigning all nodes in hybrid_forward a unique name. Some operations were in fact performed without attaching the appropriate (time) prefix to the name, which makes serialized graphs non-deserializable.
_MXClassPropertyMetaClass(v1.3.x) / #13157
Infer dtype in SymbolBlock import from input symbol (v1.3.x) / #13117
Fix for the issue - #11849
Currently, Gluon symbol block cannot import any symbol with type other than fp32. All the parameters are created as FP32 leading to failure in importing the params when it is of type fp16, fp64 etc,
In this PR, we infer the type of the symbol being imported and create the Symbol Block Parameters with that inferred type.
Added the tests
fix broken links (v1.3.x) / #13155
This PR fixes broken links on the website.
This PR manually specifies members of the IO module so that the docs will render as expected. This is workaround in the docs to deal with a bug introduced in the Python code/structure since v1.3.0. See the comments for more info.
This PR also fixes another issue that may or may not be related. Cross references to same-named entities like name, shape, or type are confusing Sphinx and it seems to just link to whatever it last dealt with that has the same name, and not the current module. To fix this you have to be very specific. Don't use type, use np.type if that's what you want. Otherwise you might end up with mxnet.kvstore.KVStore.type. This is a known Sphinx issue, so it might be something we have to deal with for the time being.
This is important for any future modules - that they recognize this issue and make efforts to map the params and other elements.
add/update infer_range docs (v1.3.x) / #13153
This PR adds or updates the docs for the infer_range feature.
Clarifies the param in the C op docs
Clarifies the param in the the Scala symbol docs
Adds the param for the the Scala ndarray docs
Adds the param for the Python symbol docs
Adds the param for the Python ndarray docs
- [MXNET-1179] Enforce deterministic algorithms in convolution layers (v1.3.x) / #13152
Some of the CUDNN convolution algorithms are non-deterministic (see issue #11341). This PR adds an env variable to enforce determinism in the convolution operators. If set to true, only deterministic CUDNN algorithms will be used. If no deterministic algorithm is available, MXNet will error out.
- update mshadow (v1.3.x) / #13122
Update mshadow for omp acceleration when nvcc is not present
The test test_operator.test_dropout has issues and has been disabled on the branch:
- Disable flaky test test_operator.test_dropout (v1.3.x) / #13200
For more information and examples, see full release notes