memory reporting issue

[denizyuret]

CUDA.memory_status() now reports a discrepancy. The reason seems to be the CUDA.used_memory() function which does not report the number of bytes used any more.

[maleadt]

There was a report by @marius311 on Slack about this as well:

Marius Millea 22:23
Is the last line in this error I'm getting:

Out of GPU memory trying to allocate 8.016 MiB
Effective GPU memory usage: 91.54% (14.446 GiB/15.782 GiB)
CUDA allocator usage: 13.984 GiB (capped at 14.000 GiB)
binned usage: 15.141 KiB (15.141 KiB allocated, 0 bytes cached)
Discrepancy of 13.984 GiB between memory pool and allocator!

a sign that something has gone wrong? (and could potentially be fixed?)