You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Recent changes #664 have added in place kernel methods to a bunch of kernel operations, that attempt to reuse the input's allocation if possible. The changes were mainly aimed at training, but there is an additional optimization we can add for inference. We can check if the tape is tracing T::OWNS_TAPE, and if so, try to reuse the memory.
The text was updated successfully, but these errors were encountered:
Recent changes #664 have added in place kernel methods to a bunch of kernel operations, that attempt to reuse the input's allocation if possible. The changes were mainly aimed at training, but there is an additional optimization we can add for inference. We can check if the tape is tracing
T::OWNS_TAPE
, and if so, try to reuse the memory.The text was updated successfully, but these errors were encountered: