Right now, we do the (very simple) rustup install, then install stable. If stable fails, then the installation is reported as failed, but rustup is still installed.
I'm not sure off hand if it's better to report a successful install with caveats or to try to revert the install completely.
Mentioned in #260