Ref resolution leaves uncollectable objects on Python 3

I haven't diagnosed this yet.

But you can see it if you run the test suite on Py3, you'll get a `ResourceWarning` on quit for the uncollectable objects.

This sounds unfun to diagnose and I don't use Py3, so this is likely to be very low priority for me.
