[serve] Use placement groups to bypass autoscaler throttling

[edoakes]

Why are these changes needed?

Creates a placement group for each actor to bypass the autoscaler's throttling in autoscaling clusters.

Also removes the resource check now that we can gracefully handle incrementally scaling backends. I added a warning message that will print when backends take a long time to startup to avoid user confusion if things "just hang."

Related issue number

Checks

• I've run scripts/format.sh to lint the changes in this PR.
• I've included any doc changes needed for https://docs.ray.io/en/master/.
• I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
• Testing Strategy
  • Unit tests
  • Release tests
  • This PR is not tested :(

[ijrsvt]

Looks good!

[simon-mo]

This means we are turning off admission control in create_backend right? Anyway to update the documentation about this or some sort of create_backend(_creation_timeout=...) so it won't block?

[edoakes]

@simon-mo yeah that's right. I think we should add a top-level flag that toggles whether we block on the operation or not.

[edoakes]

FYI waiting to merge this because it causes a bunch of spam about the actors not being schedulable due to a placement group implementation detail (cc @rkooo567)