Visibility pass

[sgrif]

pub(restricted) is going to be stable in a few days. There are a lot of things in the library that are technically public, but only to avoid public_in_private violations, or to avoid putting to much in one module. We should see if we can use pub(crate) in these cases to protect ourselves from breakage post-1.0.