Use a single ptr::drop_in_place call instead of a loop …
This is what the standard Vec does; see rust-lang/rust#32012.