Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Shard ingester queries. #3852

Merged
merged 16 commits into from
Jul 7, 2021
Merged

Shard ingester queries. #3852

merged 16 commits into from
Jul 7, 2021

Commits on Jun 14, 2021

  1. Shard ingester queries. 

    This is still experimental but already yield from 2x to 6x faster for short period queries.

I'm still playing with it but I want to share how I do it early.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jun 14, 2021
    Configuration menu
    Copy the full SHA
    70fab1c View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2021

  1. Add notice of the code origin. 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jun 15, 2021
    Configuration menu
    Copy the full SHA
    5943288 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2021

  1. Update pkg/ingester/index/index.go 

    Co-authored-by: Owen Diehl <ow.diehl@gmail.com>
    @cyriltovena @owen-d
    cyriltovena and owen-d committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    5f0e245 View commit details
    Browse the repository at this point in the history

  2. Update pkg/ingester/index/index_test.go 

    Co-authored-by: Owen Diehl <ow.diehl@gmail.com>
    @cyriltovena @owen-d
    cyriltovena and owen-d committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    3d10b11 View commit details
    Browse the repository at this point in the history

  3. Align shards from ingester and storage. 

    Utimately we should have a storage that relies on fingerprint, but that's harder to change.

Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    2dffd5a View commit details
    Browse the repository at this point in the history

  4. Remove comment 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    c8a76d1 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/main' into shard-ingester

    @cyriltovena
    cyriltovena committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    e999e5a View commit details
    Browse the repository at this point in the history

  6. Fixes delete index func 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    2340488 View commit details
    Browse the repository at this point in the history

  7. Test reverting. 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 1, 2021
    Configuration menu
    Copy the full SHA
    71d9168 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2021

  1. Fixes a bug causing non deterministic hash. 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 2, 2021
    Configuration menu
    Copy the full SHA
    4a81a15 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2021

  1. Update pkg/ingester/index/index.go 

    Co-authored-by: Owen Diehl <ow.diehl@gmail.com>
    @cyriltovena @owen-d
    cyriltovena and owen-d committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    1c172cb View commit details
    Browse the repository at this point in the history

  2. Update pkg/ingester/index/index.go 

    Co-authored-by: Owen Diehl <ow.diehl@gmail.com>
    @cyriltovena @owen-d
    cyriltovena and owen-d committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    79ea3bc View commit details
    Browse the repository at this point in the history

  3. Update pkg/ingester/index/index.go 

    Co-authored-by: Owen Diehl <ow.diehl@gmail.com>
    @cyriltovena @owen-d
    cyriltovena and owen-d committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    38c01ac View commit details
    Browse the repository at this point in the history

  4. Update pkg/ingester/index/index_test.go 

    Co-authored-by: Owen Diehl <ow.diehl@gmail.com>
    @cyriltovena @owen-d
    cyriltovena and owen-d committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    d1817b5 View commit details
    Browse the repository at this point in the history

  5. Fixes build. 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    757bb6a View commit details
    Browse the repository at this point in the history

  6. got linted :( 

    Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
    @cyriltovena
    cyriltovena committed Jul 7, 2021
    Configuration menu
    Copy the full SHA
    95e6f79 View commit details
    Browse the repository at this point in the history