select * ... LIMIT 100 on a large table would crash the CH instance #48116

patrickdung · 2023-03-28T15:48:07Z

patrickdung
Mar 28, 2023

ok, I have a table with about 2GB data.
With traditional DB, I can run something like this
SELECT * FROM table1 LIMIT 100

But in CH, doing that would load all the rows and crash the instance.

There is a field that store the timestamp, if I use something like
SELECT * from table1 WHERE ts BETWEEN parseDateTime64BestEffort('2023-03-28 12:00:00.000',3) AND parseDateTime64BestEffort('2023-03-28 12:01:00.000',3) LIMIT 100

It would be quick.

So is it by design?
Also, I am using DBWeaver and Clickhouse JDBC connection. The data viewer of DBWeaver would limit 200 record by default but this would just crash the CH instance when the table size is large.

Thank you in advance.

Warning: this question is related to an alternative (not officially supported) build of ClickHouse, that may not be functioning properly.

den-crane · 2023-03-28T22:21:51Z

den-crane
Mar 28, 2023

No, nothing like this.

Here is select from table (600 columns) / 200TB.

select count() from csp_ad_fact_event;
┌───────count()─┐
│ 2042773666545 │
└───────────────┘

select * from csp_ad_fact_event limit 100;

Peak memory usage (for query): 307.95 MiB.
100 rows in set. Elapsed: 0.557 sec.

0 replies

marcelbirkner · 2023-03-29T07:10:01Z

marcelbirkner
Mar 29, 2023

Hi @patrickdung

I cannot reproduce the error you mentioned. I have a table with 9GB and 100million rows.

SELECT formatReadableSize(total_bytes), total_rows FROM "tables" WHERE name = 'hits' LIMIT 31 OFFSET 0;

Running the LIMIT query returns the first 100 records almost instantly.

select * from default.hits LIMIT 100

Can you post your table schema and some sample data to better understand what might be causing the problems.
Did you check the clickhouse server logs when the error appeared. Could you attach them as well please to this issue.

Thank you

0 replies

patrickdung · 2023-03-29T12:38:38Z

patrickdung
Mar 29, 2023
Author

Here's is a fast query

SELECT parsed_timestamp AS ts, kubernetes_pod_namespace, kubernetes_pod_name, message FROM logdb.vector_k8s_logs WHERE (ts >= parseDateTime64BestEffort('2023-03-28 13:00:00.000', 3)) AND (ts <= parseDateTime64BestEffort('2023-03-28 13:01:00.000', 3)) LIMIT 1

Query id: 90598dd1-eb12-4d06-a84f-096d09fb810d

┌────────────────────────────ts─┬─kubernetes_pod_namespace─┬─kubernetes_pod_name───────┬─message────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ 2023-03-28 13:00:00.006448806 │ coralproject │ talk-app-5c5c7844c9-xkzqf │ {"name":"coral","hostname":"talk-app-5c5c7844c9-xkzqf","pid":7,"jobName":"Hourly Notification Digesting","jobFrequency":"0 * * * *","scheduledExecutionID":"72864b50-cd68-11ed-ac4b-1b86f1ce7b20","level":30,"msg":"now starting scheduled job","time":"2023-03-28T13:00:00.006Z","src":{"file":"/usr/src/app/src/core/server/cron/scheduled/job.ts","line":43},"v":0} │
└───────────────────────────────┴──────────────────────────┴───────────────────────────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘

1 row in set. Elapsed: 0.081 sec. Processed 8.33 thousand rows, 3.85 MB (102.70 thousand rows/s., 47.54 MB/s.)

Here's is a very slow query

SELECT parsed_timestamp AS ts, kubernetes_pod_namespace, kubernetes_pod_name, message FROM logdb.vector_k8s_logs WHERE (ts >= parseDateTime64BestEffort('2023-03-28 13:00:00.000', 3);

.... about 9999 records not displayed for brevity
│ 2023-03-29 04:11:11.737638926 │ pravega-zk │ zk-cluster2-0 │ + cp -f /conf/log4j-quiet.properties /data/conf
.... about 9999 records not displayed for brevity
│
└───────────────────────────────┴──────────────────────────┴───────────────────────────────────────────┴────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
Showed first 10000.

37505925 rows in set. Elapsed: 193.842 sec. Processed 37.56 million rows, 6.24 GB (193.74 thousand rows/s., 32.18 MB/s.)

Here's the server log

2023.03.29 12:19:59.128515 [ 3078 ] {81b2119b-7055-4ad5-bc02-e20a9951bcc1}  executeQuery: Read 4873 rows, 2.83 MiB in 0.131118167 sec., 37164 rows/sec., 21.61 MiB/sec.
2023.03.29 12:20:11.255969 [ 3078 ] {ed074047-0a84-402f-a5e0-13af8553de3a}  executeQuery: Read 4952 rows, 3.09 MiB in 0.134471125 sec., 36825 rows/sec., 22.96 MiB/sec.
2023.03.29 12:20:12.956569 [ 2987 ] {149b252f-6cd3-4c61-8c40-2a5723de17e0}  executeQuery: Read 4826 rows, 2.98 MiB in 0.23418839 sec., 20607 rows/sec., 12.71 MiB/sec.
2023.03.29 12:20:14.361479 [ 2747 ] {16b9bb63-ef0c-4495-810a-2d929779a520}  executeQuery: Read 3 rows, 1.20 KiB in 0.300295312 sec., 9 rows/sec., 3.98 KiB/sec.
2023.03.29 12:20:16.207477 [ 2747 ] {617fa938-9437-4e7a-8b44-e27421f07649}  executeQuery: Read 3 rows, 1.20 KiB in 0.004958877 sec., 604 rows/sec., 241.24 KiB/sec.
2023.03.29 12:20:20.620453 [ 3078 ] {f13c09f9-250c-49d0-aa9b-a67a71c4c290}  executeQuery: Read 2559 rows, 1.49 MiB in 0.068259882 sec., 37489 rows/sec., 21.86 MiB/sec.
2023.03.29 12:20:24.598509 [ 3078 ] {fa7b6117-e4f1-4468-9e15-82d6b1bae723}  executeQuery: Read 5047 rows, 2.92 MiB in 0.160522631 sec., 31441 rows/sec., 18.20 MiB/sec.
2023.03.29 12:20:35.206982 [ 2987 ] {3a673f1d-ff7d-4a73-8041-ce8e7b521e3a}  executeQuery: Read 6 rows, 2.39 KiB in 0.003188718 sec., 1881 rows/sec., 750.33 KiB/sec.
2023.03.29 12:20:35.664637 [ 3078 ] {6d21fd4d-08d3-49eb-9a01-3119369a6344}  executeQuery: Read 1284 rows, 672.72 KiB in 0.086524392 sec., 14839 rows/sec., 7.59 MiB/sec.
2023.03.29 12:20:39.415559 [ 504 ] {53a406ae-6136-4287-8782-0e5c5fbee342}  executeQuery: Read 8326 rows, 3.68 MiB in 0.293561076 sec., 28362 rows/sec., 12.52 MiB/sec.
2023.03.29 12:20:41.678699 [ 2987 ] {923acedf-b6c5-452a-9e84-4d7a32f5c866}  executeQuery: Read 4916 rows, 2.95 MiB in 0.277665324 sec., 17704 rows/sec., 10.64 MiB/sec.
2023.03.29 12:20:41.702151 [ 3078 ] {10ae7c81-7bc1-4bc5-adb0-f7c089e1c6d1}  executeQuery: Read 1 rows, 558.00 B in 0.007288116 sec., 137 rows/sec., 74.77 KiB/sec.
2023.03.29 12:20:43.567890 [ 504 ] {ee1e4dd7-cf83-4280-87a9-6e6b40e8b788}  executeQuery: Read 8326 rows, 3.68 MiB in 0.015940472 sec., 522318 rows/sec., 230.59 MiB/sec.
2023.03.29 12:20:45.873414 [ 3078 ] {b2bf9ef1-78a8-4ac4-a09a-09bdb3797b0c}  executeQuery: Read 3 rows, 1.20 KiB in 0.008601475 sec., 348 rows/sec., 139.08 KiB/sec.
2023.03.29 12:20:52.823772 [ 3078 ] {646172b7-50ae-44a9-bc46-fef0c22f80c2}  executeQuery: Read 1999 rows, 1.30 MiB in 0.101122024 sec., 19768 rows/sec., 12.81 MiB/sec.
2023.03.29 12:20:54.595852 [ 504 ] {36826358-7c6c-42b4-9dec-9991066565ce}  executeQuery: Read 8326 rows, 3.68 MiB in 0.009510714 sec., 875433 rows/sec., 386.48 MiB/sec.
2023.03.29 12:20:54.697464 [ 2987 ] {14122add-ce60-4a67-bc4f-a5f9d6eeeb2f}  executeQuery: Read 18 rows, 7.63 KiB in 0.006175316 sec., 2914 rows/sec., 1.21 MiB/sec.
2023.03.29 12:20:58.244067 [ 504 ] {90598dd1-eb12-4d06-a84f-096d09fb810d}  executeQuery: Read 8326 rows, 3.68 MiB in 0.080713875 sec., 103154 rows/sec., 45.54 MiB/sec.
2023.03.29 12:20:59.581609 [ 2987 ] {a07493fd-92f2-478d-92dd-5ae74a0dde25}  executeQuery: Read 4880 rows, 2.83 MiB in 0.171518504 sec., 28451 rows/sec., 16.50 MiB/sec.
2023.03.29 12:21:00.593238 [ 3078 ] {ccdb3763-2832-44fc-8b24-0029060be60b}  executeQuery: Read 955 rows, 601.11 KiB in 0.044946255 sec., 21247 rows/sec., 13.06 MiB/sec.
2023.03.29 12:21:11.817414 [ 3078 ] {fdd77b42-f61c-4089-b365-cca2e4b23ddd}  executeQuery: Read 4955 rows, 3.08 MiB in 0.169739305 sec., 29191 rows/sec., 18.15 MiB/sec.
2023.03.29 12:21:13.973033 [ 2987 ] {b1e1d2a2-fc57-4fcc-9128-8e104847a043}  executeQuery: Read 3 rows, 1.20 KiB in 0.012506993 sec., 239 rows/sec., 95.65 KiB/sec.
2023.03.29 12:21:15.891840 [ 3103 ] {b58b16f4-15d4-4b63-8734-f05e134c24c4}  executeQuery: Read 1137 rows, 691.75 KiB in 0.105294301 sec., 10798 rows/sec., 6.42 MiB/sec.
2023.03.29 12:21:16.135477 [ 2987 ] {ae086ce3-1c68-4540-8254-e5e4a1fa9282}  executeQuery: Read 3 rows, 1.20 KiB in 0.005731917 sec., 523 rows/sec., 208.71 KiB/sec.
2023.03.29 12:21:24.679863 [ 2987 ] {fcff3ac1-31ea-41d5-b05f-123b315edbfc}  executeQuery: Read 5047 rows, 2.91 MiB in 0.262286973 sec., 19242 rows/sec., 11.10 MiB/sec.
2023.03.29 12:21:32.873671 [ 3103 ] {1db44557-ec94-419d-87bd-747be4229559}  executeQuery: Read 4445 rows, 2.74 MiB in 0.132460966 sec., 33557 rows/sec., 20.66 MiB/sec.
2023.03.29 12:21:35.169058 [ 2947 ] {fd200d05-6d50-420a-a357-acb99fcf3490}  executeQuery: Read 6 rows, 2.39 KiB in 0.029151904 sec., 205 rows/sec., 82.07 KiB/sec.
2023.03.29 12:21:35.377552 [ 2747 ] {356965ea-c18c-447c-a396-b84819031812}  executeQuery: Read 5021 rows, 3.44 MiB in 0.168398026 sec., 29816 rows/sec., 20.41 MiB/sec.
2023.03.29 12:21:40.673038 [ 2747 ] {5787ff02-c72c-4dc3-9547-be56cfb25414}  executeQuery: Read 2345 rows, 1.35 MiB in 0.112690938 sec., 20809 rows/sec., 11.99 MiB/sec.
2023.03.29 12:21:41.798760 [ 3103 ] {a28d8258-e84a-4552-a1a6-b150b8c87c3b}  executeQuery: Read 1 rows, 558.00 B in 0.006200717 sec., 161 rows/sec., 87.88 KiB/sec.
2023.03.29 12:21:45.207550 [ 3103 ] {b9217499-f119-41ce-91ec-2739403bb1fa}  executeQuery: Read 4910 rows, 2.92 MiB in 0.342293929 sec., 14344 rows/sec., 8.52 MiB/sec.
2023.03.29 12:21:45.975775 [ 2947 ] {d44cbab0-40de-4e9a-9ad5-335ae0d1b084}  executeQuery: Read 3 rows, 1.20 KiB in 0.006136756 sec., 488 rows/sec., 194.94 KiB/sec.
2023.03.29 12:21:54.719115 [ 2947 ] {3e1f1772-a6a7-4fca-ba94-2d44af28b1ca}  executeQuery: Read 18 rows, 7.63 KiB in 0.025987146 sec., 692 rows/sec., 293.68 KiB/sec.
2023.03.29 12:21:56.129043 [ 3103 ] {6235dc21-987a-4d23-ac8f-e1d5d0906cc9}  executeQuery: Read 1639 rows, 857.61 KiB in 0.081062154 sec., 20219 rows/sec., 10.33 MiB/sec.
2023.03.29 12:22:01.448149 [ 3103 ] {61d96e6a-aa6e-49d6-b34e-c51b80beb8da}  executeQuery: Read 4876 rows, 2.83 MiB in 0.156512112 sec., 31154 rows/sec., 18.07 MiB/sec.
2023.03.29 12:22:13.067259 [ 2747 ] {6ac93c28-11c8-47e7-afde-5074394e1164}  executeQuery: Read 4546 rows, 2.81 MiB in 0.280830603 sec., 16187 rows/sec., 10.00 MiB/sec.
2023.03.29 12:22:13.125952 [ 3078 ] {62ac3f1f-2982-4a54-aac8-368c7c68457f}  executeQuery: Read 5102 rows, 3.11 MiB in 0.321304101 sec., 15879 rows/sec., 9.67 MiB/sec.
2023.03.29 12:22:13.943647 [ 2987 ] {9388c7a1-495b-4699-b2b8-7b095a2ddf08}  executeQuery: Read 3 rows, 1.20 KiB in 0.007306516 sec., 410 rows/sec., 163.73 KiB/sec.
2023.03.29 12:22:16.138737 [ 2987 ] {eb21dd15-4e79-4597-93bf-db106d5d2a8c}  executeQuery: Read 14 rows, 5.69 KiB in 0.006440357 sec., 2173 rows/sec., 883.41 KiB/sec.
2023.03.29 12:22:20.627906 [ 2747 ] {2901ec7d-9d8d-43f5-9c32-6d78395d7e01}  executeQuery: Read 2510 rows, 1.46 MiB in 0.068626642 sec., 36574 rows/sec., 21.34 MiB/sec.
2023.03.29 12:22:33.068240 [ 2747 ] {58d11877-a09e-478f-8c87-81d45972d497}  executeQuery: Read 4895 rows, 2.88 MiB in 0.254152178 sec., 19260 rows/sec., 11.34 MiB/sec.
2023.03.29 12:22:35.137211 [ 3078 ] {24ae6236-c03c-4f39-b4aa-011f4b962d3d}  executeQuery: Read 6 rows, 2.39 KiB in 0.009252635 sec., 648 rows/sec., 258.58 KiB/sec.
2023.03.29 12:22:36.328027 [ 2747 ] {3ef69d1e-275b-44cb-a472-b2a7a2244f36}  executeQuery: Read 1160 rows, 599.23 KiB in 0.239584546 sec., 4841 rows/sec., 2.44 MiB/sec.
2023.03.29 12:22:41.730681 [ 3078 ] {75df5467-9617-4ebe-9d8f-49e456e996b7}  executeQuery: Read 1 rows, 558.00 B in 0.034291581 sec., 29 rows/sec., 15.89 KiB/sec.
2023.03.29 12:22:45.890109 [ 3078 ] {801c069a-ab07-4745-8e50-070adaf9df41}  executeQuery: Read 3 rows, 1.20 KiB in 0.008429316 sec., 355 rows/sec., 141.92 KiB/sec.
2023.03.29 12:22:47.255087 [ 2747 ] {6558fa4f-cbcf-4c5a-9dbd-b6d04346468c}  executeQuery: Read 4916 rows, 2.94 MiB in 0.224345875 sec., 21912 rows/sec., 13.13 MiB/sec.
2023.03.29 12:22:53.252575 [ 2747 ] {be7edfc1-2926-462c-b556-eb400652c108}  executeQuery: Read 1829 rows, 1.20 MiB in 0.354403242 sec., 5160 rows/sec., 3.39 MiB/sec.
2023.03.29 12:22:54.530046 [ 3078 ] {31305b84-50e3-40c4-8f11-6bccea49455c}  executeQuery: Read 18 rows, 7.63 KiB in 0.005117677 sec., 3517 rows/sec., 1.46 MiB/sec.
2023.03.29 12:23:00.626458 [ 3078 ] {0257370c-a404-443d-a8b0-60715c8e384b}  executeQuery: Read 915 rows, 577.00 KiB in 0.042899856 sec., 21328 rows/sec., 13.13 MiB/sec.
2023.03.29 12:23:04.677316 [ 3078 ] {6a556bb2-97ce-4627-80fd-00e03ab2c196}  executeQuery: Read 4918 rows, 2.95 MiB in 0.319142021 sec., 15410 rows/sec., 9.25 MiB/sec.
2023.03.29 12:23:13.936589 [ 3078 ] {63edd988-9678-44a7-ba3c-22c0ab9e6948}  executeQuery: Read 3 rows, 1.20 KiB in 0.008682555 sec., 345 rows/sec., 137.78 KiB/sec.
2023.03.29 12:23:16.143135 [ 3078 ] {739d6e79-ad61-4f0d-9d5a-425bab25365e}  executeQuery: Read 3 rows, 1.20 KiB in 0.03494994 sec., 85 rows/sec., 34.23 KiB/sec.
2023.03.29 12:23:16.334180 [ 2987 ] {a27f404f-a87d-45ab-bda0-1fb5c040db88}  executeQuery: Read 1046 rows, 638.62 KiB in 0.052193571 sec., 20040 rows/sec., 11.95 MiB/sec.
2023.03.29 12:23:17.030255 [ 3103 ] {70c7f409-4b37-474d-a041-a5ca367e01ef}  executeQuery: Read 5079 rows, 3.04 MiB in 0.25044274 sec., 20280 rows/sec., 12.14 MiB/sec.
2023.03.29 12:23:33.018601 [ 3078 ] {5362964c-ee2c-4ed8-bae1-73f23099b018}  executeQuery: Read 3754 rows, 2.29 MiB in 0.119636773 sec., 31378 rows/sec., 19.15 MiB/sec.
2023.03.29 12:23:34.802167 [ 2987 ] {5d4cf466-72f7-4d1b-89ef-62015aeb905a}  executeQuery: Read 4902 rows, 2.88 MiB in 0.256223057 sec., 19131 rows/sec., 11.26 MiB/sec.
2023.03.29 12:23:35.151651 [ 3103 ] {f47f98af-1f2e-4ddb-ac5a-f83168656db0}  executeQuery: Read 6 rows, 2.39 KiB in 0.013962953 sec., 429 rows/sec., 171.35 KiB/sec.
2023.03.29 12:23:40.694991 [ 3103 ] {ef31ea70-6378-4913-9441-e44e5b91a2c6}  executeQuery: Read 2318 rows, 1.33 MiB in 0.077029957 sec., 30092 rows/sec., 17.32 MiB/sec.
2023.03.29 12:23:41.739164 [ 3078 ] {24a94e34-0f61-4e0a-80b0-b8a5d5e8e7a9}  executeQuery: Read 1 rows, 558.00 B in 0.006478596 sec., 154 rows/sec., 84.11 KiB/sec.
2023.03.29 12:23:44.769748 [ 3103 ] {f461eee9-1d85-42fa-a5f4-62e005eaaa41}  executeQuery: Read 4894 rows, 2.87 MiB in 0.192316733 sec., 25447 rows/sec., 14.93 MiB/sec.
2023.03.29 12:23:45.942540 [ 2947 ] {a02247d3-ba08-4d27-a1c1-75da2ec4b0e9}  executeQuery: Read 3 rows, 1.20 KiB in 0.006797036 sec., 441 rows/sec., 176.00 KiB/sec.
2023.03.29 12:23:54.541382 [ 3103 ] {e722a49e-22fd-4b80-aa7d-ff876016768e}  executeQuery: Read 18 rows, 7.63 KiB in 0.005644397 sec., 3189 rows/sec., 1.32 MiB/sec.
2023.03.29 12:23:56.288938 [ 2947 ] {d902f44d-ead4-49e0-8e1a-4b71983e88f7}  executeQuery: Read 1599 rows, 869.06 KiB in 0.087261391 sec., 18324 rows/sec., 9.73 MiB/sec.
2023.03.29 12:24:03.544161 [ 3103 ] {e1a947c3-9af3-4cce-aab6-21fa9546ed75}  executeQuery: Read 4903 rows, 2.91 MiB in 0.205422126 sec., 23867 rows/sec., 14.18 MiB/sec.
2023.03.29 12:24:05.477030 [ 2947 ] {2bbdcb36-bc95-4bf1-91ba-9c11fba2c473}  executeQuery: Read 4879 rows, 3.04 MiB in 0.221238276 sec., 22053 rows/sec., 13.72 MiB/sec.
2023.03.29 12:24:13.942320 [ 2947 ] {ec2af2d2-712b-48da-88d9-6717b8bca66c}  executeQuery: Read 3 rows, 1.20 KiB in 0.006182517 sec., 485 rows/sec., 193.50 KiB/sec.
2023.03.29 12:24:16.127748 [ 2947 ] {c87a8165-5f0f-4a07-853a-7732bc8af76c}  executeQuery: Read 3 rows, 1.20 KiB in 0.007539595 sec., 397 rows/sec., 158.67 KiB/sec.
2023.03.29 12:24:16.129792 [ 3103 ] {329a7ad4-e4bb-424c-ab67-c0545b9a7444}  executeQuery: Read 5096 rows, 3.08 MiB in 0.166165827 sec., 30668 rows/sec., 18.56 MiB/sec.
2023.03.29 12:24:20.896156 [ 2947 ] {65859e02-27c8-4d4e-9db5-3f8ccee6606d}  executeQuery: Read 2565 rows, 1.50 MiB in 0.243364024 sec., 10539 rows/sec., 6.17 MiB/sec.
2023.03.29 12:24:28.936101 [ 2947 ] {f9c3de2f-55be-4416-9534-5deff27207a9}  executeQuery: Read 4877 rows, 2.82 MiB in 0.163647069 sec., 29801 rows/sec., 17.23 MiB/sec.
2023.03.29 12:24:35.096121 [ 2947 ] {ad5900fa-b820-41c1-ae5f-5861086cb60f}  executeQuery: Read 6 rows, 2.39 KiB in 0.007154756 sec., 838 rows/sec., 334.40 KiB/sec.
2023.03.29 12:24:36.496294 [ 3103 ] {065f129a-d26b-4523-8e7d-1b0557287d64}  executeQuery: Read 1310 rows, 686.31 KiB in 0.048310453 sec., 27116 rows/sec., 13.87 MiB/sec.
2023.03.29 12:24:41.705009 [ 2747 ] {b534f33a-61cd-487b-ac16-91b88a83432b}  executeQuery: Read 1 rows, 558.00 B in 0.006301716 sec., 158 rows/sec., 86.47 KiB/sec.
2023.03.29 12:24:45.341364 [ 2747 ] {1b4f3392-cb31-4f1d-8dcb-ab601f5ccaab}  executeQuery: Read 1946 rows, 1.27 MiB in 0.092470589 sec., 21044 rows/sec., 13.74 MiB/sec.
2023.03.29 12:24:45.877918 [ 3103 ] {ec1331c9-98ee-4f16-9f85-89c58a3adae8}  executeQuery: Read 3 rows, 1.20 KiB in 0.005150797 sec., 582 rows/sec., 232.25 KiB/sec.
2023.03.29 12:24:46.706674 [ 3078 ] {2443fe7d-3c8e-4a64-ab48-7dce120eb268}  executeQuery: Read 4917 rows, 2.95 MiB in 0.187055695 sec., 26286 rows/sec., 15.76 MiB/sec.
2023.03.29 12:24:54.674301 [ 3078 ] {c290c6b6-a23a-47d2-812b-d09e8251c888}  executeQuery: Read 18 rows, 7.63 KiB in 0.006142196 sec., 2930 rows/sec., 1.21 MiB/sec.
2023.03.29 12:24:59.992644 [ 3103 ] {7fb7b173-de82-427c-bc7f-3a2eff1810f1}  executeQuery: Read 4882 rows, 2.82 MiB in 0.182538858 sec., 26744 rows/sec., 15.46 MiB/sec.
2023.03.29 12:25:00.765501 [ 2747 ] {9e547b9f-7dca-4542-9c98-ff2b726b4996}  executeQuery: Read 969 rows, 615.27 KiB in 0.047383854 sec., 20450 rows/sec., 12.68 MiB/sec.
2023.03.29 12:25:12.947983 [ 3103 ] {8c4def92-00c0-4a2e-8f90-99575483c030}  executeQuery: Read 5084 rows, 3.06 MiB in 0.25056914 sec., 20289 rows/sec., 12.21 MiB/sec.
2023.03.29 12:25:13.942961 [ 2747 ] {9c7f5c8e-1dad-4a83-86f3-4dc5eef48f3b}  executeQuery: Read 3 rows, 1.20 KiB in 0.007243956 sec., 414 rows/sec., 165.14 KiB/sec.
2023.03.29 12:25:16.166500 [ 2747 ] {5a9f8504-0f9f-4932-995b-b84a147adce6}  executeQuery: Read 14 rows, 5.75 KiB in 0.038646778 sec., 362 rows/sec., 148.73 KiB/sec.
2023.03.29 12:25:16.487896 [ 3103 ] {f5e0d18a-42c3-4bfe-a3fc-bb54e8e42ea1}  executeQuery: Read 1121 rows, 683.36 KiB in 0.042672936 sec., 26269 rows/sec., 15.64 MiB/sec.
2023.03.29 12:25:25.561927 [ 2747 ] {b5fbe36f-23b0-4c0b-8543-60a8f55bb684}  executeQuery: Read 4806 rows, 2.96 MiB in 0.212594122 sec., 22606 rows/sec., 13.94 MiB/sec.
2023.03.29 12:25:29.877939 [ 3103 ] {6b0ab9cd-62c3-47b2-8ace-5b480d99c264}  executeQuery: Read 4912 rows, 2.93 MiB in 0.188952054 sec., 25996 rows/sec., 15.51 MiB/sec.
2023.03.29 12:25:35.171343 [ 3078 ] {3041a764-85d4-47ca-a9d7-a49eef023b57}  executeQuery: Read 6 rows, 2.39 KiB in 0.021339028 sec., 281 rows/sec., 112.12 KiB/sec.
2023.03.29 12:25:40.831298 [ 3078 ] {28de8b38-54d8-4494-a872-94efe672b50b}  executeQuery: Read 2317 rows, 1.34 MiB in 0.068917002 sec., 33620 rows/sec., 19.37 MiB/sec.
2023.03.29 12:25:41.724136 [ 2987 ] {f5dcbf7b-b06c-4467-b914-3452558ac01d}  executeQuery: Read 1 rows, 558.00 B in 0.009698674 sec., 103 rows/sec., 56.19 KiB/sec.
2023.03.29 12:25:42.980384 [ 2947 ] {6175bd98-847a-44aa-9552-bcb0f7ba742c}  executeQuery: Read 4915 rows, 2.94 MiB in 0.228317673 sec., 21527 rows/sec., 12.86 MiB/sec.
2023.03.29 12:25:45.901526 [ 3078 ] {123d74f4-aeae-408b-a4df-113033db056f}  executeQuery: Read 3 rows, 1.20 KiB in 0.009248314 sec., 324 rows/sec., 129.35 KiB/sec.
2023.03.29 12:25:54.514906 [ 2987 ] {d5d663d9-547c-4427-96a4-fa3344349a05}  executeQuery: Read 18 rows, 7.63 KiB in 0.005898437 sec., 3051 rows/sec., 1.26 MiB/sec.
2023.03.29 12:25:56.581911 [ 3078 ] {3f3c19aa-5ec7-480a-b6fb-4fd41a55fd7e}  executeQuery: Read 1566 rows, 839.16 KiB in 0.057414208 sec., 27275 rows/sec., 14.27 MiB/sec.
2023.03.29 12:26:05.601390 [ 2987 ] {bb7524fe-4733-4395-b514-b4af4d0945a5}  executeQuery: Read 4327 rows, 2.67 MiB in 0.195476371 sec., 22135 rows/sec., 13.68 MiB/sec.
2023.03.29 12:26:13.956733 [ 3078 ] {17921d63-de64-4c57-890c-c16d4a0a3d44}  executeQuery: Read 3 rows, 1.20 KiB in 0.005854077 sec., 512 rows/sec., 204.35 KiB/sec.
2023.03.29 12:26:16.140253 [ 3078 ] {cc5cd0b1-b059-41ba-a323-6305dba482c0}  executeQuery: Read 3 rows, 1.20 KiB in 0.006200916 sec., 483 rows/sec., 192.92 KiB/sec.
2023.03.29 12:26:20.828598 [ 3078 ] {0952b9fd-7e3a-4947-bb53-1777d873ec3c}  executeQuery: Read 2513 rows, 1.46 MiB in 0.063838804 sec., 39364 rows/sec., 22.92 MiB/sec.
2023.03.29 12:26:22.854515 [ 2987 ] {b996e333-6d90-4c39-ad54-de77a56f4e7b}  executeQuery: Read 3766 rows, 2.37 MiB in 0.110327298 sec., 34134 rows/sec., 21.47 MiB/sec.
2023.03.29 12:26:35.292776 [ 3103 ] {11b4d05e-85e5-4684-a20e-c70104df99f4}  executeQuery: Read 6 rows, 2.39 KiB in 0.014715672 sec., 407 rows/sec., 162.59 KiB/sec.
2023.03.29 12:26:36.671559 [ 2747 ] {f2e11578-ebf1-46ea-a135-d80db8e721d5}  executeQuery: Read 1359 rows, 691.49 KiB in 0.143998159 sec., 9437 rows/sec., 4.69 MiB/sec.
2023.03.29 12:26:37.960263 [ 3078 ] {46883e91-34ea-43eb-bb0a-78c39373d892}  executeQuery: Read 4905 rows, 2.96 MiB in 0.255553018 sec., 19193 rows/sec., 11.58 MiB/sec.
2023.03.29 12:26:38.489379 [ 3078 ] {ac823386-0308-406c-ad83-1976822e2e94}  executeQuery: Read 4855 rows, 2.83 MiB in 0.119233733 sec., 40718 rows/sec., 23.71 MiB/sec.
2023.03.29 12:26:41.784330 [ 3078 ] {70f10df3-6ac3-4894-9958-e9d2f0046be6}  executeQuery: Read 1 rows, 558.00 B in 0.08902103 sec., 11 rows/sec., 6.12 KiB/sec.
2023.03.29 12:26:45.718529 [ 3078 ] {5089a0f1-8d61-4111-a51e-a3599a0ebb97}  executeQuery: Read 2013 rows, 1.31 MiB in 0.236008588 sec., 8529 rows/sec., 5.56 MiB/sec.
2023.03.29 12:26:45.893671 [ 3103 ] {a2f233ac-b4dd-47d8-b9a6-af5fbcde08b3}  executeQuery: Read 3 rows, 1.20 KiB in 0.006439396 sec., 465 rows/sec., 185.78 KiB/sec.
2023.03.29 12:26:47.597430 [ 2747 ] {3466b5b0-ecf2-4ac9-8b4f-951476a68cd5}  executeQuery: Read 4871 rows, 2.82 MiB in 0.141890201 sec., 34329 rows/sec., 19.90 MiB/sec.
2023.03.29 12:26:54.646380 [ 3103 ] {02b37de8-0d53-4811-8780-42784838f46b}  executeQuery: Read 15 rows, 6.44 KiB in 0.006274997 sec., 2390 rows/sec., 1.00 MiB/sec.
2023.03.29 12:26:55.696105 [ 3103 ] {0fe113e3-8fbe-464f-a567-4c27275463a7}  executeQuery: Read 3 rows, 1.20 KiB in 0.005348077 sec., 560 rows/sec., 223.69 KiB/sec.
2023.03.29 12:27:00.928149 [ 2747 ] {179b4a10-502b-4dcd-8ea3-44bc9f8931f2}  executeQuery: Read 941 rows, 597.07 KiB in 0.124677571 sec., 7547 rows/sec., 4.68 MiB/sec.
2023.03.29 12:27:01.436537 [ 3103 ] {6f191a3e-3f1d-44ee-a0d5-51f067ac94a2}  executeQuery: Read 4882 rows, 2.82 MiB in 0.189756214 sec., 25727 rows/sec., 14.87 MiB/sec.
2023.03.29 12:27:13.732242 [ 3103 ] {c3753b2f-8b5e-44f9-8d96-f98abe3152b6}  executeQuery: Read 5112 rows, 3.14 MiB in 0.455102225 sec., 11232 rows/sec., 6.89 MiB/sec.
2023.03.29 12:27:14.399423 [ 2747 ] {3d78b946-4d2d-4422-abe8-2b874e981087}  executeQuery: Read 3 rows, 1.20 KiB in 0.008792555 sec., 341 rows/sec., 136.06 KiB/sec.
2023.03.29 12:27:15.451792 [ 2747 ] {0ff1bd6f-d3ed-4e32-a138-18afc0ebd153}  executeQuery: Read 3 rows, 1.20 KiB in 0.006748956 sec., 444 rows/sec., 177.26 KiB/sec.
2023.03.29 12:27:16.721370 [ 3078 ] {066dc0fb-20da-4987-8604-600e7d363488}  executeQuery: Read 889 rows, 547.20 KiB in 0.177329901 sec., 5013 rows/sec., 3.01 MiB/sec.
2023.03.29 12:27:25.724012 [ 3078 ] {ffbc4234-65b2-4f84-a62d-b9a735274858}  executeQuery: Read 4546 rows, 2.78 MiB in 0.227257433 sec., 20003 rows/sec., 12.23 MiB/sec.
2023.03.29 12:27:34.171179 [ 2987 ] {a714d597-2d68-4324-b75b-0597b0906a5c}  executeQuery: Read 3 rows, 1.20 KiB in 0.006066317 sec., 494 rows/sec., 197.20 KiB/sec.
2023.03.29 12:27:35.061635 [ 3078 ] {a845521a-58f9-4302-ad36-18575672e414}  executeQuery: Read 4903 rows, 2.90 MiB in 0.175276783 sec., 27972 rows/sec., 16.57 MiB/sec.
2023.03.29 12:27:36.498681 [ 2987 ] {47f051a6-8ed4-4596-be68-1a84fbe79d70}  executeQuery: Read 3 rows, 1.20 KiB in 0.006063117 sec., 494 rows/sec., 197.31 KiB/sec.
2023.03.29 12:27:40.757698 [ 2987 ] {70c348cf-c468-4377-b509-073ba3f640ed}  executeQuery: Read 1 rows, 558.00 B in 0.007678676 sec., 130 rows/sec., 70.97 KiB/sec.
2023.03.29 12:27:40.884708 [ 3078 ] {62d7def3-fcfc-4d93-b06f-dd5ae5ad560e}  executeQuery: Read 2312 rows, 1.33 MiB in 0.075946878 sec., 30442 rows/sec., 17.52 MiB/sec.
2023.03.29 12:27:47.015568 [ 3078 ] {7057bf43-3be4-4d0d-9e0f-b81dcf210aa3}  executeQuery: Read 3 rows, 1.20 KiB in 0.008483035 sec., 353 rows/sec., 141.02 KiB/sec.
2023.03.29 12:27:49.762832 [ 2987 ] {d01ea729-129b-48eb-80c6-593092bf2fd7}  executeQuery: Read 4908 rows, 2.90 MiB in 0.594824268 sec., 8251 rows/sec., 4.88 MiB/sec.
2023.03.29 12:27:55.339075 [ 3078 ] {a9fba8a7-8714-4f66-9e06-46afbe3b8dde}  executeQuery: Read 18 rows, 7.63 KiB in 0.005777597 sec., 3115 rows/sec., 1.29 MiB/sec.
2023.03.29 12:27:56.610965 [ 2987 ] {d7c5e0c3-bdb2-49aa-a95b-ef7ecf3b7fb7}  executeQuery: Read 1361 rows, 718.99 KiB in 0.050821492 sec., 26780 rows/sec., 13.82 MiB/sec.
2023.03.29 12:28:01.015570 [ 2987 ] {0622a66d-e6b3-4a40-ba24-b819bebfc8eb}  executeQuery: Read 5009 rows, 3.37 MiB in 0.195545771 sec., 25615 rows/sec., 17.22 MiB/sec.
2023.03.29 12:28:05.683131 [ 2987 ] {ab993805-f135-40d7-a43f-21a3029f7afb}  executeQuery: Read 4310 rows, 2.66 MiB in 0.168297666 sec., 25609 rows/sec., 15.82 MiB/sec.
2023.03.29 12:28:14.161884 [ 3103 ] {7b697113-4555-4835-804a-0901bd6dae5a}  executeQuery: Read 3 rows, 1.20 KiB in 0.006661276 sec., 450 rows/sec., 179.59 KiB/sec.
2023.03.29 12:28:16.247109 [ 3103 ] {108b319e-bf53-47be-9cd9-ccde61bbd8e7}  executeQuery: Read 14 rows, 5.69 KiB in 0.006325037 sec., 2213 rows/sec., 899.51 KiB/sec.
2023.03.29 12:28:18.235395 [ 2947 ] {78f3e33f-82df-4ef1-a013-31d6ca85fbb2}  executeQuery: Read 5008 rows, 2.80 MiB in 0.229900311 sec., 21783 rows/sec., 12.20 MiB/sec.
2023.03.29 12:28:21.109932 [ 3103 ] {44e23f42-d867-4f2d-b066-648684062c19}  executeQuery: Read 2495 rows, 1.45 MiB in 0.269799049 sec., 9247 rows/sec., 5.38 MiB/sec.
2023.03.29 12:28:35.162775 [ 3103 ] {4232511c-ca41-4179-a5b2-7152704e7969}  executeQuery: Read 6 rows, 2.39 KiB in 0.028494744 sec., 210 rows/sec., 83.97 KiB/sec.
2023.03.29 12:28:36.282717 [ 2947 ] {95fca2ae-788e-4fea-bb0d-9361b6ddb8c9}  executeQuery: Read 4880 rows, 2.82 MiB in 0.138849322 sec., 35146 rows/sec., 20.33 MiB/sec.
2023.03.29 12:28:36.637596 [ 2747 ] {4535f924-b31a-4794-a25f-17b516a8321b}  executeQuery: Read 1512 rows, 817.27 KiB in 0.047965893 sec., 31522 rows/sec., 16.64 MiB/sec.
2023.03.29 12:28:41.503146 [ 2947 ] {bead6d9a-1ef2-475d-b6dc-0c6c7fe62a8c}  executeQuery: Read 1 rows, 558.00 B in 0.010189594 sec., 98 rows/sec., 53.48 KiB/sec.
2023.03.29 12:28:44.519975 [ 3103 ] {6b99dcf2-5e19-47a2-af2f-6190de3fa78e}  executeQuery: Read 5033 rows, 3.34 MiB in 0.14379512 sec., 35001 rows/sec., 23.24 MiB/sec.
2023.03.29 12:28:45.765578 [ 2747 ] {73655b75-cd27-4990-b87f-c55e4a1867aa}  executeQuery: Read 3 rows, 1.20 KiB in 0.094266028 sec., 31 rows/sec., 12.69 KiB/sec.
2023.03.29 12:28:45.945314 [ 2947 ] {cda3064d-3463-47c8-b413-40a2f9107e59}  executeQuery: Read 2074 rows, 1.37 MiB in 0.440841394 sec., 4704 rows/sec., 3.10 MiB/sec.
2023.03.29 12:29:01.061588 [ 2947 ] {069fe24c-2d2f-4265-a258-b5d0011179b8}  executeQuery: Read 2311 rows, 1.36 MiB in 0.181584899 sec., 12726 rows/sec., 7.50 MiB/sec.
2023.03.29 12:29:04.361997 [ 2747 ] {ab219c26-6c4f-443c-9850-9351bcdd7eaf}  executeQuery: Read 4897 rows, 2.89 MiB in 0.436904396 sec., 11208 rows/sec., 6.61 MiB/sec.
2023.03.29 12:29:04.379852 [ 3078 ] {d629b381-4261-43de-85e5-582c4c793a70}  executeQuery: Read 18 rows, 7.63 KiB in 0.003814558 sec., 4718 rows/sec., 1.95 MiB/sec.
2023.03.29 12:29:05.447711 [ 3078 ] {a246a971-ff75-47fa-86a1-d1deab74d356}  executeQuery: Read 3 rows, 1.20 KiB in 0.002805759 sec., 1069 rows/sec., 426.37 KiB/sec.
2023.03.29 12:29:16.630344 [ 2747 ] {bdd20e62-fa5a-4355-a1d5-daec70980c26}  executeQuery: Read 918 rows, 563.97 KiB in 0.034466061 sec., 26634 rows/sec., 15.98 MiB/sec.
2023.03.29 12:29:18.235028 [ 3078 ] {75828594-64b3-4b7f-b00d-9bc1daebb406}  executeQuery: Read 5100 rows, 3.11 MiB in 0.409359732 sec., 12458 rows/sec., 7.61 MiB/sec.
2023.03.29 12:29:24.181209 [ 2747 ] {535d8eac-0f2f-4b1d-9862-e10b36bf5b0c}  executeQuery: Read 3 rows, 1.20 KiB in 0.003067758 sec., 977 rows/sec., 389.96 KiB/sec.
2023.03.29 12:29:25.299852 [ 2747 ] {a5425a32-39d4-47a5-a9ec-acff21bcd68b}  executeQuery: Read 3 rows, 1.20 KiB in 0.01943415 sec., 154 rows/sec., 61.56 KiB/sec.
2023.03.29 12:29:26.966218 [ 3078 ] {9da588ab-2c5a-46fb-9261-b8b3e11803a5}  executeQuery: Read 4437 rows, 2.73 MiB in 1.430638361 sec., 3101 rows/sec., 1.91 MiB/sec.
2023.03.29 12:29:33.699169 [ 3078 ] {8ef6c03b-6042-4787-88cb-8512c5683dda}  executeQuery: Read 4879 rows, 2.82 MiB in 0.372771192 sec., 13088 rows/sec., 7.56 MiB/sec.
2023.03.29 12:29:36.896524 [ 3078 ] {bd4c460e-995b-4055-9f4f-f7419c5fe39f}  executeQuery: Read 4644 rows, 2.67 MiB in 0.148799357 sec., 31209 rows/sec., 17.96 MiB/sec.
2023.03.29 12:29:44.076081 [ 3078 ] {f1321d31-3165-427b-bc85-788afe45b082}  executeQuery: Read 4 rows, 1.74 KiB in 0.008708555 sec., 459 rows/sec., 199.94 KiB/sec.
2023.03.29 12:29:45.341625 [ 2747 ] {1c3d50ed-ac09-4232-af61-9591586c2ea9}  executeQuery: Read 4916 rows, 2.94 MiB in 0.936366077 sec., 5250 rows/sec., 3.14 MiB/sec.
2023.03.29 12:29:46.196856 [ 3078 ] {afc24e66-48f5-43d0-ace4-029bf2612b73}  executeQuery: Read 3 rows, 1.20 KiB in 0.008222115 sec., 364 rows/sec., 145.50 KiB/sec.
2023.03.29 12:29:54.635895 [ 3078 ] {4d45e78e-037b-42d6-ae8e-03747c0bb0c2}  executeQuery: Read 15 rows, 6.44 KiB in 0.006942956 sec., 2160 rows/sec., 926.92 KiB/sec.
2023.03.29 12:29:55.672988 [ 3078 ] {e5d1e10b-e9f1-46be-b0fe-527583ea6f87}  executeQuery: Read 3 rows, 1.20 KiB in 0.007029996 sec., 426 rows/sec., 170.17 KiB/sec.
2023.03.29 12:29:56.729316 [ 2987 ] {b0b33dff-d29e-4a2a-a3c6-6a435dd6b20f}  executeQuery: Read 1455 rows, 774.29 KiB in 0.080259436 sec., 18128 rows/sec., 9.42 MiB/sec.
2023.03.29 12:30:00.641493 [ 2987 ] {a56cbf8d-6c75-49f4-a68c-a379ff7b8299}  executeQuery: Read 4880 rows, 2.83 MiB in 0.748738702 sec., 6517 rows/sec., 3.78 MiB/sec.
2023.03.29 12:30:05.697012 [ 2987 ] {add68148-2ddb-4fae-b8f4-8f9cef2d62b0}  executeQuery: Read 4547 rows, 2.81 MiB in 0.139031043 sec., 32704 rows/sec., 20.21 MiB/sec.
2023.03.29 12:30:09.497035 [ 2987 ] {1d5bb592-3888-416a-bf0a-bbdfacc55566}  executeQuery: Read 4944 rows, 3.04 MiB in 0.128196369 sec., 38565 rows/sec., 23.71 MiB/sec.
2023.03.29 12:30:14.507751 [ 2987 ] {11a082d9-6579-494d-a369-8038e59e2c02}  executeQuery: Read 3 rows, 1.20 KiB in 0.013161113 sec., 227 rows/sec., 90.90 KiB/sec.
2023.03.29 12:30:15.555968 [ 2987 ] {86677406-8b2e-4e3e-ab40-6d8cc8fbb0c4}  executeQuery: Read 3 rows, 1.20 KiB in 0.009315635 sec., 322 rows/sec., 128.42 KiB/sec.
2023.03.29 12:30:16.874703 [ 2947 ] {20c7d087-4a09-47b6-a4d5-cc1af539ef94}  executeQuery: Read 3763 rows, 2.14 MiB in 0.106746381 sec., 35251 rows/sec., 20.09 MiB/sec.
2023.03.29 12:30:34.347409 [ 2947 ] {fdd09165-9628-44ab-983d-abc49502137e}  executeQuery: Read 3 rows, 1.20 KiB in 0.004660238 sec., 643 rows/sec., 256.70 KiB/sec.
2023.03.29 12:30:35.393423 [ 2947 ] {340ad230-d245-4a7a-a7b6-e57d667850cf}  executeQuery: Read 3 rows, 1.20 KiB in 0.005069238 sec., 591 rows/sec., 235.99 KiB/sec.
2023.03.29 12:30:38.539159 [ 2747 ] {c86a0977-4a8c-4e92-89c9-45ce04ac4264}  executeQuery: Read 4871 rows, 2.81 MiB in 0.924962204 sec., 5266 rows/sec., 3.03 MiB/sec.
2023.03.29 12:30:38.544591 [ 2987 ] {196d9ebc-dce8-4b9e-a608-01da3009ef35}  executeQuery: Read 1395 rows, 736.99 KiB in 1.656779995 sec., 841 rows/sec., 444.83 KiB/sec.
2023.03.29 12:30:38.639649 [ 3103 ] {02e4f788-00c3-441b-aa15-a8078758317f}  executeQuery: Read 5102 rows, 3.07 MiB in 1.023941468 sec., 4982 rows/sec., 3.00 MiB/sec.
2023.03.29 12:30:41.713407 [ 3103 ] {4eee9313-f9d1-478d-83e8-c6613ba7f01c}  executeQuery: Read 1 rows, 558.00 B in 0.004860557 sec., 205 rows/sec., 112.11 KiB/sec.
2023.03.29 12:30:45.619308 [ 3103 ] {f3326320-5715-47df-98a4-5a38654e8296}  executeQuery: Read 2014 rows, 1.31 MiB in 0.063194005 sec., 31870 rows/sec., 20.75 MiB/sec.
2023.03.29 12:30:46.756334 [ 2987 ] {adad14d0-ecf3-4456-8f99-c140c844b1c6}  executeQuery: Read 3 rows, 1.20 KiB in 0.845063608 sec., 3 rows/sec., 1.42 KiB/sec.
2023.03.29 12:30:55.009659 [ 3078 ] {75204b7d-9492-4e85-afa7-26c8af645535}  executeQuery: Read 18 rows, 7.63 KiB in 0.405725773 sec., 44 rows/sec., 18.81 KiB/sec.
2023.03.29 12:30:55.147126 [ 2747 ] {7afaefec-5a8c-43d1-9413-34effaf1336d}  executeQuery: Read 4877 rows, 2.83 MiB in 1.777895648 sec., 2743 rows/sec., 1.59 MiB/sec.
2023.03.29 12:30:56.986424 [ 3174 ] {a1f9d5c0-b663-4f81-ad81-e55bddf74c93}  executeQuery: Read 3753 rows, 2.22 MiB in 0.159123991 sec., 23585 rows/sec., 13.94 MiB/sec.
2023.03.29 12:31:05.441692 [ 3078 ] {99ea62a8-bee1-4a46-90c4-24aa51b0eeeb}  executeQuery: Read 4892 rows, 2.87 MiB in 0.141114321 sec., 34666 rows/sec., 20.32 MiB/sec.
2023.03.29 12:31:16.045991 [ 2747 ] {0b3bf1da-b201-46e9-9269-29c2e9e7b76b}  executeQuery: Read 3 rows, 1.20 KiB in 1.86164748 sec., 1 rows/sec., 658.02 B/sec.
2023.03.29 12:31:16.265153 [ 2747 ] {648bac99-a7ca-4161-bdd0-eb704b648be4}  executeQuery: Read 14 rows, 5.69 KiB in 0.008324916 sec., 1681 rows/sec., 683.42 KiB/sec.
2023.03.29 12:31:17.016160 [ 3078 ] {3abf73e0-3b20-49f6-ae6c-e8fce11ba2e4}  executeQuery: Read 1007 rows, 616.52 KiB in 0.085479952 sec., 11780 rows/sec., 7.04 MiB/sec.
2023.03.29 12:31:17.997241 [ 3174 ] {d5af8837-07e6-4656-b88d-70ebd169140b}  executeQuery: Read 5107 rows, 3.14 MiB in 0.327686817 sec., 15585 rows/sec., 9.59 MiB/sec.

Here's the schema

CREATE TABLE IF NOT EXISTS
  logdb.vector_k8s_logs
(
   `timestamp` String,
   `parsed_timestamp` DateTime64(9) DEFAULT
      parseDateTime64BestEffort(timestamp, 9) CODEC(Delta(2), ZSTD(1)),
   `file` String,
   `kubernetes_container_id` LowCardinality(String),
   `kubernetes_container_image` LowCardinality(String),
   `kubernetes_container_name` LowCardinality(String),
   `kubernetes_namespace_labels` Map(LowCardinality(String), String),
   `kubernetes_pod_annotations` Map(LowCardinality(String), String),
   `kubernetes_pod_ip` LowCardinality(String),
   `kubernetes_pod_ips` Array(LowCardinality(String)),
   `kubernetes_pod_labels` Map(LowCardinality(String), String),
   `kubernetes_pod_name` LowCardinality(String),
   `kubernetes_pod_namespace` LowCardinality(String),
   `kubernetes_pod_node_name` LowCardinality(String),
   `kubernetes_pod_owner` LowCardinality(String),
   `kubernetes_pod_uid` LowCardinality(String),
   `message` String,
   `source_type` LowCardinality(String),
   `stream` Enum('stdout', 'stderr')
)
ENGINE MergeTree
PARTITION BY (toDate(parsed_timestamp), kubernetes_pod_namespace)
ORDER BY (parsed_timestamp, kubernetes_pod_namespace)
TTL toDateTime(parsed_timestamp) + INTERVAL 9 DAY;

I did not run SELECT * because it would crash the instance.
Is slow because I have low system memory (around 1.2GB free)?

0 replies

den-crane · 2023-03-29T12:50:14Z

den-crane
Mar 29, 2023

@patrickdung

You query returned 37 505 925 rows

Time partially consumed by clickhouse-client to render 10000 rows


37505925 rows in set. Elapsed: 193.842 sec.

Also you have very granular partitioning PARTITION BY (toDate(parsed_timestamp), kubernetes_pod_namespace)
Clickhouse spends time to load mrk files for each part.

Provide

explain estimate
SELECT
    parsed_timestamp AS ts,
    kubernetes_pod_namespace,
    kubernetes_pod_name,
    message
FROM logdb.vector_k8s_logs
WHERE (ts >= parseDateTime64BestEffort('2023-03-28 13:00:00.000', 3);

2 replies

patrickdung Mar 29, 2023
Author

Here's the result

EXPLAIN ESTIMATE
SELECT
    parsed_timestamp AS ts,
    kubernetes_pod_namespace,
    kubernetes_pod_name,
    message
FROM logdb.vector_k8s_logs
WHERE ts >= parseDateTime64BestEffort('2023-03-28 13:00:00.000', 3)

Query id: a08462c1-d4c2-436e-87cf-54c57bd24769

┌─database─┬─table───────────┬─parts─┬─────rows─┬─marks─┐
│ logdb    │ vector_k8s_logs │   129 │ 38364541 │ 13565 │
└──────────┴─────────────────┴───────┴──────────┴───────┘

1 row in set. Elapsed: 0.059 sec.

BTW, if my memory is correct, I originally used PARTITION BY (toDate(parsed_timestamp), it has the same behavior/problem.

Edit, adding version

┌─version()──┐
│ 22.8.15.23 │
└────────────┘

den-crane Mar 29, 2023

It is slow because of parts 129 because of PARTITION BY (toDate(parsed_timestamp), kubernetes_pod_namespace)
Anyway all of this is expected behaviour.
Query is slow, it produces 37 mil rows, it processes 129 parts.
It requires a lot of RAM because multiple parallel threads process multiple blocks.
It is expected that Clickhouse needs 10-20GB memory to solve even simple query without GROUPBY/ORDERBY.

den-crane · 2023-03-29T13:10:38Z

den-crane
Mar 29, 2023

Also I strongly suggest to change your table

PARTITION BY (toYYYYMMDD(parsed_timestamp))
ORDER BY (toStartOfHour(parsed_timestamp), kubernetes_pod_namespace, parsed_timestamp)
PRIMARY KEY (toStartOfHour(parsed_timestamp), kubernetes_pod_namespace)
TTL toStartOfDay(toDateTime(parsed_timestamp)) + INTERVAL 9 DAY;

0 replies

patrickdung · 2023-03-29T14:25:40Z

patrickdung
Mar 29, 2023
Author

@den-crane
ok, I tried to insert into new table with select *
It's very slow.
It copied 2.5GB of 2.9GB data and then crashed.
Anyway, it's testing data.

Now, it is fast for this query:


select * from logdb.vector_k8s_logs_v2 LIMIT 200```

But if I run

SELECT *
FROM logdb.vector_k8s_logs_v2
ORDER BY parsed_timestamp DESC
LIMIT 200

It is going to do full table scan?

Query id: 6077385f-30e9-4684-a832-77fa8cdde5e9

↖ Progress: 3.07 million rows, 1.97 GB (545.69 thousand rows/s., 349.84 MB/s.) ██████████████████████▉ 66%^Cancelling query.
Ok.
Query was cancelled.

0 rows in set. Elapsed: 5.866 sec. Processed 3.22 million rows, 2.07 GB (549.73 thousand rows/s., 352.43 MB/s.)

It's fast if I define the timestamp period (e.g using between).

5 replies

den-crane Mar 29, 2023

ORDER BY parsed_timestamp DESC LIMIT 200

CH is not designed for htis use case. You should use another database.

Try

ORDER BY toStartOfHour(parsed_timestamp) desc, parsed_timestamp DESC LIMIT 200

patrickdung Mar 29, 2023
Author

It took 7.6 seconds with ORDER BY toStartOfHour(parsed_timestamp) desc, parsed_timestamp DESC LIMIT 200
200 rows in set. Elapsed: 7.614 sec. Processed 820.92 thousand rows, 134.62 MB (107.81 thousand rows/s., 17.68 MB/s.)

I asked this question because I used DBeaver to view the data.
By default, it displayed the oldest 200 records (ASC) quickly.

But as an user, I frequently want to view the latest records (to see if something is working).
So if I click the sorting order of the DBeaver UI to list descending order (DESC) then it may crash the CH.

den-crane Mar 29, 2023

Yes, but Clickhouse design is unable to fulfill this requirement.

patrickdung Mar 30, 2023
Author

Yes, but Clickhouse design is unable to fulfill this requirement.

I understand. CH is a columnar database. This is not the use case.

patrickdung Apr 1, 2023
Author

ORDER BY parsed_timestamp DESC LIMIT 200
CH is not designed for htis use case. You should use another database.

Try
ORDER BY toStartOfHour(parsed_timestamp) desc, parsed_timestamp DESC LIMIT 200

@den-crane
I found

SELECT
                                         parsed_timestamp AS ts,
                                         kubernetes_pod_namespace,
                                         kubernetes_pod_name,
                                         message
                                     FROM logdb.vector_k8s_logs_v2
                                     ORDER BY toStartOfHour(parsed_timestamp) desc LIMIT 3000

3000 rows in set. Elapsed: 0.055 sec. Processed 103.31 thousand rows, 20.84 MB (1.87 million rows/s., 378.02 MB/s.)

is faster than

SELECT
                                         parsed_timestamp AS ts,
                                         kubernetes_pod_namespace,
                                         kubernetes_pod_name,
                                         message
                                     FROM logdb.vector_k8s_logs_v2
                                     ORDER BY toStartOfHour(parsed_timestamp) desc, parsed_timestmap desc LIMIT 3000

3000 rows in set. Elapsed: 1.581 sec. Processed 11.12 million rows, 2.13 GB (7.03 million rows/s., 1.34 GB/s.)

EXPLAIN
SELECT
    parsed_timestamp AS ts,
    kubernetes_pod_namespace,
    kubernetes_pod_name,
    message
FROM logdb.vector_k8s_logs_v2
ORDER BY toStartOfHour(parsed_timestamp) DESC
LIMIT 3000

Query id: 3ba081b1-559b-4b2b-ae99-6aef46f6625c

┌─explain──────────────────────────────────────────────┐
│ Expression (Projection)                              │
│   Limit (preliminary LIMIT (without OFFSET))         │
│     Sorting                                          │
│       Expression (Before ORDER BY)                   │
│         ReadFromMergeTree (logdb.vector_k8s_logs_v2) │
└──────────────────────────────────────────────────────┘

5 rows in set. Elapsed: 0.002 sec.

chi-clickhouse-installation1-cluster1-0-0-0.chi-clickhouse-installation1-cluster1-0-0.altinity-clickhouse.svc.cluster.local :) explain estimate SELECT
                                         parsed_timestamp AS ts,
                                         kubernetes_pod_namespace,
                                         kubernetes_pod_name,
                                         message
                                     FROM logdb.vector_k8s_logs_v2
                                     ORDER BY toStartOfHour(parsed_timestamp) desc LIMIT 3000

EXPLAIN ESTIMATE
SELECT
    parsed_timestamp AS ts,
    kubernetes_pod_namespace,
    kubernetes_pod_name,
    message
FROM logdb.vector_k8s_logs_v2
ORDER BY toStartOfHour(parsed_timestamp) DESC
LIMIT 3000

Query id: 673b18c9-e213-4203-8d6c-b60549d5c8f3

┌─database─┬─table──────────────┬─parts─┬─────rows─┬─marks─┐
│ logdb    │ vector_k8s_logs_v2 │    19 │ 11142856 │ 13641 │
└──────────┴────────────────────┴───────┴──────────┴───────┘

1 row in set. Elapsed: 0.007 sec.

EXPLAIN
SELECT
    parsed_timestamp AS ts,
    kubernetes_pod_namespace,
    kubernetes_pod_name,
    message
FROM logdb.vector_k8s_logs_v2
ORDER BY
    toStartOfHour(parsed_timestamp) ASC,
    parsed_timestamp DESC
LIMIT 3000

Query id: a0044418-e68b-4e87-9131-448bdb5d48f4

┌─explain──────────────────────────────────────────────┐
│ Expression (Projection)                              │
│   Limit (preliminary LIMIT (without OFFSET))         │
│     Sorting                                          │
│       Expression (Before ORDER BY)                   │
│         ReadFromMergeTree (logdb.vector_k8s_logs_v2) │
└──────────────────────────────────────────────────────┘

5 rows in set. Elapsed: 0.002 sec.

chi-clickhouse-installation1-cluster1-0-0-0.chi-clickhouse-installation1-cluster1-0-0.altinity-clickhouse.svc.cluster.local :) explain estimate SELECT
                                         parsed_timestamp AS ts,
                                         kubernetes_pod_namespace,
                                         kubernetes_pod_name,
                                         message
                                     FROM logdb.vector_k8s_logs_v2
                                     ORDER BY toStartOfHour(parsed_timestamp), parsed_timestamp desc LIMIT 3000

EXPLAIN ESTIMATE
SELECT
    parsed_timestamp AS ts,
    kubernetes_pod_namespace,
    kubernetes_pod_name,
    message
FROM logdb.vector_k8s_logs_v2
ORDER BY
    toStartOfHour(parsed_timestamp) ASC,
    parsed_timestamp DESC
LIMIT 3000

Query id: 1ed2c004-0336-407b-9376-6e44f8c88a67

┌─database─┬─table──────────────┬─parts─┬─────rows─┬─marks─┐
│ logdb    │ vector_k8s_logs_v2 │    18 │ 11126823 │ 13639 │
└──────────┴────────────────────┴───────┴──────────┴───────┘

1 row in set. Elapsed: 0.004 sec.

patrickdung · 2023-03-30T16:20:42Z

patrickdung
Mar 30, 2023
Author

@den-crane

Out of curiosity.
If the data is already partitioned and ordered by parsed_timestamp, can CH speed up the searching of record in reverse order or some sort of binary searching?

1 reply

den-crane Apr 1, 2023

#45868

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

select * ... LIMIT 100 on a large table would crash the CH instance #48116

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 7 comments 8 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

select * ... LIMIT 100 on a large table would crash the CH instance #48116

Replies: 7 comments · 8 replies

patrickdung Mar 29, 2023 Author

patrickdung Mar 29, 2023 Author

patrickdung Mar 29, 2023 Author

patrickdung Mar 29, 2023 Author

patrickdung Mar 30, 2023 Author

patrickdung Apr 1, 2023 Author

patrickdung Mar 30, 2023 Author

Replies: 7 comments 8 replies

patrickdung
Mar 29, 2023
Author

patrickdung Mar 29, 2023
Author

patrickdung
Mar 29, 2023
Author

patrickdung Mar 29, 2023
Author

patrickdung Mar 30, 2023
Author

patrickdung Apr 1, 2023
Author

patrickdung
Mar 30, 2023
Author