Give up on NonZeroUsize memory layout optimization with unstable feat…
…ures. I’m not confident of the implications regarding variance, dropck, struct aliasing, etc. when this is extended to generic `*const T` and `*mut T`. Release builds should use `unstable` to enable other optimizations anyway.