Skip to content
This repository has been archived by the owner on Aug 13, 2019. It is now read-only.

add prefixCompressedPostings #672

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

naivewong
Copy link
Contributor

prefixCompressedPostings corresponds to the roaring16postings in this doc.

index/index.go Outdated Show resolved Hide resolved
@krasi-georgiev
Copy link
Contributor

once this is ready lets run a Prombench test and add some relevant dashboard to the Prombench grafana dashboards to see the difference in size and performance.
Ping if you need help with adding these dashboards.

Copy link
Contributor

@codesome codesome left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is for the writing part. Taking a look at the reading part next.

index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Show resolved Hide resolved
index/postings.go Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Show resolved Hide resolved
@naivewong naivewong force-pushed the roaring16postings branch 2 times, most recently from 5e316a3 to 06eee5b Compare August 6, 2019 10:02
Copy link
Contributor

@codesome codesome left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Mostly nits. I need a couple of more scans to do before I am done.

index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
Signed-off-by: naivewong <867245430@qq.com>
@naivewong naivewong force-pushed the roaring16postings branch 2 times, most recently from 00903c0 to 8bac3f8 Compare August 7, 2019 06:12
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Show resolved Hide resolved
index/postings.go Show resolved Hide resolved
@naivewong naivewong force-pushed the roaring16postings branch 3 times, most recently from 2053a33 to 292f4ee Compare August 13, 2019 07:16
Copy link
Contributor

@codesome codesome left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some nits. I think we are good to test it on prombench now.

@krasi-georgiev how can we add new panels in the dashboard? We could use one for prometheus_tsdb_storage_blocks_bytes to check the size of blocks. For query perf we already have many panels needed.

index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
index/postings.go Outdated Show resolved Hide resolved
Signed-off-by: naivewong <867245430@qq.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants