Let ArraysToArraysServiceClient
choose from a list of possible servers
#14
Labels
ArraysToArraysServiceClient
choose from a list of possible servers
#14
Instead of passing just one
host, client
combination, theArraysToArraysServiceClient
could take a list of servers to choose from.Each server must, of course, behave identically.
Doing this allows for a failover mechanism (#9) but also enables client-side load-balancing in situations where the
ArraysToArraysServiceClient
is forked/spawned into tens or hundres of copies.For the load balancing, we probably need some
get_numer_of_connected_clients
endpoint on the server so the clients cannp.argmin(np.random.permutation(options))
.The text was updated successfully, but these errors were encountered: