Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

log volume with and without json parser #356

Closed
arnitolog opened this issue Oct 16, 2023 · 2 comments
Closed

log volume with and without json parser #356

arnitolog opened this issue Oct 16, 2023 · 2 comments
Assignees

Comments

@arnitolog
Copy link

Hello,

I faced a weird issue: the same qryn with the same query returns a different log volume value depending on whether I specified or not json parser. Here is a screenshot:
image

My current deployment:
Clickhouse 3 shards with 2 replicas -> chproxy (1 instance) -> qryn (1 instance)
I've tried to remove chproxy, but got the same result - different log volume value.

In the qryn logs I see below:
for query with json parser:

WITH sel_a AS (select `samples`.`string` as `string`,`samples`.`fingerprint` as `fingerprint`,samples.timestamp_ns as `timestamp_ns`,JSONExtractKeysAndValues(time_series.labels, 'String') as `labels` from cloki.samples_v3_dist as `samples` left any join `cloki`.`time_series` AS time_series on `samples`.`fingerprint` = time_series.fingerprint where (`samples`.`timestamp_ns`   between 1697222530351000000 and 1697308930351000000) and (samples.fingerprint IN (select `sel_1`.`fingerprint` from (select `fingerprint` from `cloki`.`time_series_gin` where ((`key` = 'Product') and (`val` = 'Platform'))) as `sel_1`  inner any  join (select `fingerprint` from `cloki`.`time_series_gin` where ((`key` = 'service') and (`val` = 'platform-users-service'))) as `sel_2` on `sel_1`.`fingerprint` = `sel_2`.`fingerprint`)) order by `timestamp_ns` desc limit 1000) select * from sel_a order by `labels` desc,`timestamp_ns` desc

for query without json parser:

WITH sel_a AS (select `samples`.`string` as `string`,`samples`.`fingerprint` as `fingerprint`,samples.timestamp_ns as `timestamp_ns` from cloki.samples_v3_dist as `samples` where (`samples`.`timestamp_ns`   between 1697222530351000000 and 1697308930351000000) and (samples.fingerprint IN (select `sel_1`.`fingerprint` from (select `fingerprint` from `cloki`.`time_series_gin` where ((`key` = 'Product') and (`val` = 'Platform'))) as `sel_1`  inner any  join (select `fingerprint` from `cloki`.`time_series_gin` where ((`key` = 'service') and (`val` = 'platform-users-service'))) as `sel_2` on `sel_1`.`fingerprint` = `sel_2`.`fingerprint`)) order by `timestamp_ns` desc limit 1000) select JSONExtractKeysAndValues(time_series.labels, 'String') as `labels`,sel_a.* from sel_a left any join `cloki`.`time_series_dist` AS time_series on `sel_a`.`fingerprint` = time_series.fingerprint order by `labels` desc,`timestamp_ns` desc
@akvlad akvlad mentioned this issue Oct 17, 2023
akvlad added a commit that referenced this issue Oct 17, 2023
@akvlad
Copy link
Collaborator

akvlad commented Oct 17, 2023

@arnitolog v2.4.3 should fix the case. Please check.

@arnitolog
Copy link
Author

@akvlad thanks a lot. 2.4.3 works perfectly!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants