Query from object store

[cyriltovena]

Currently we can only query data from ingesters, to query data from the storage we want to introduce a store-gateway that syncs blocks and cache respective metadata such as symbols, labels, etc..

Tasks

Beta Give feedback

1. Hook into the Pyroscope components.go
2. Add defaults config
3. Implements tenant listing
4. Implements block listing per tenant.
5. Speed block initial sync.
6. Partially load and reload blocks to disk
7. Investigate why opening block fails when using a remote bucket
8. Create query iterators.
9. Implement the Pyroscope Read API on the gateway side
10. Discover and use store gateway in the queriers.
11. Update helm chart
12. Parallel rollout (already the default)
13. Add storage-gateway component to default micro-services #731
    +0
14. All bucket providers should have this fix https://github.com/simonswine/objstore/commit/890519321a99558ed34df71b72e5f3d313c403fd
15. Implement a component store-gateway with ring exposing read subset of the IngesterService interface for blocks from object store. I think this is best done by looking at https://github.com/grafana/mimir/blob/main/pkg/storegateway/gateway.go
16. Move POC block discovery into store-gatwaye code https://github.com/grafana/phlare/pull/636/files#diff-8d0d4c7633f85ca22a5b86e9557fcf05131f2a5f1620c70a5d53649513c28aa0R98
17. Implement SelectProfile using BlockQuerier #734
    +0
18. Implement prefix match for object storage provider GCS https://github.com/simonswine/objstore/commit/890519321a99558ed34df71b72e5f3d313c403fd
19. Implement prefix match for object storage provider S3
20. Implement prefix match for object storage provider Azure
21. Add memcache to helm micro-services deployment (similar to how minio operates)
22. Contribute iter changes upstream to github.com/thanos-io/objstore
23. Improve blocks page on statistics pyroscope#2052
    +0
24. Figure how to run the store-gateway when using single-binary pyroscope#2045
    +0