Validate and address recent apparent flakiness in v2 server tests

[axsaucedo]

Recently it seems there has been an increase in flakiness in the v2 server tests. We should validate whether indeed something that has been added recently increased flakiness of tests. It is currently suspected that potential reason for the tests could be that requests may be sent faster than they can be processed, or that the initial requests are sent before the model is ready.