Support random delay before upload blocks on sidecar

[Wing924]

Is your proposal related to a problem?

Currently, all sidecars upload blocks at the same time.
It make huge bandwidth usage to object storage.

It will be a problem when you run sidecars in on-premises and use public cloud object storage
because the dedicated line has limited bandwidth.

Describe the solution you'd like

I propose add some random delay before uploading blocks.

Let's dd the --shipper.upload-jitter flag.
When sidecar upload blocks, it sleep random time between 0 and jitter.

Describe alternatives you've considered

I tried to manage QoS, but it's very hard to config.

[yeya24]

I think it is ok to add some jitter when uploading blocks. The question is, do we add jitter to the shipper itself? I understand we want to jitter the caller loop. For example, in sidecar we will add it here.

https://github.com/thanos-io/thanos/blob/main/cmd/thanos/sidecar.go#L365

[Vanshikav123]

Hello ! @yeya24 can i work on this issue?