See #672 for context.
We should increase our constant that sets the paging threshold and probably also allow users to override it or disable it. Another idea I discussed with @nsthorat would be whether we could detect that a single tensor was larger than this threshold and disable paging if that occurs.
See #672 for context.
We should increase our constant that sets the paging threshold and probably also allow users to override it or disable it. Another idea I discussed with @nsthorat would be whether we could detect that a single tensor was larger than this threshold and disable paging if that occurs.