Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider adding DataFusion to ClickBench benchmarks #2902

Closed
andygrove opened this issue Jul 13, 2022 · 4 comments
Closed

Consider adding DataFusion to ClickBench benchmarks #2902

andygrove opened this issue Jul 13, 2022 · 4 comments
Labels
enhancement New feature or request

Comments

@andygrove
Copy link
Member

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
New benchmark suite! https://github.com/ClickHouse/ClickBench/

Describe the solution you'd like
Would be interesting to see how we compare

Describe alternatives you've considered
None

Additional context
None

@andygrove andygrove added the enhancement New feature or request label Jul 13, 2022
@waitingkuo
Copy link
Contributor

waitingkuo commented Aug 2, 2022

EDIT: this result is from datafusion-cli v10.0.0; i found that some fails are fixed in master branch; please check following comments

@andygrove

I created the datafusion branch and submitted a daft pull request

my branch is here
https://github.com/waitingkuo/ClickBench/tree/datafusion/datafusion


The original create.sql is (https://github.com/waitingkuo/ClickBench/blob/datafusion/clickhouse/queries.sql)
e.g. SELECT COUNT(*) FROM hits WHERE AdvEngineID <> 0;

Since column name in parquet is parsed as quoted string, so i modify them as (https://github.com/waitingkuo/ClickBench/blob/datafusion/datafusion/queries.sql)
e.g. SELECT COUNT(*) FROM hits WHERE "AdvEngineID" <> 0;


we failed 17 queries out of 43. here the full result (i tested in my mac, not yet find a chance to use a high end linux vm to test it)

i'm using my mac to run the test, you could reproduce by run2.sh, please follow the readme (run.sh is for generating the results we need to put in result json)

here's the results:

-----------------------------------------

1. SELECT COUNT(*) FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.046 seconds.
+-----------------+
| COUNT(UInt8(1)) |
+-----------------+
| 99997497        |
+-----------------+
1 row in set. Query took 0.378 seconds.


-----------------------------------------

2. SELECT COUNT(*) FROM hits WHERE "AdvEngineID" <> 0;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.042 seconds.
+-----------------+
| COUNT(UInt8(1)) |
+-----------------+
| 630500          |
+-----------------+
1 row in set. Query took 0.321 seconds.


-----------------------------------------

3. SELECT SUM("AdvEngineID"), COUNT(*), AVG("ResolutionWidth") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.037 seconds.
+-----------------------+-----------------+---------------------------+
| SUM(hits.AdvEngineID) | COUNT(UInt8(1)) | AVG(hits.ResolutionWidth) |
+-----------------------+-----------------+---------------------------+
| 7280088               | 99997497        | 1513.4879349030107        |
+-----------------------+-----------------+---------------------------+
1 row in set. Query took 0.842 seconds.


-----------------------------------------

4. SELECT AVG("UserID") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.037 seconds.
+---------------------+
| AVG(hits.UserID)    |
+---------------------+
| 2528953029789717000 |
+---------------------+
1 row in set. Query took 0.515 seconds.


-----------------------------------------

5. SELECT COUNT(DISTINCT "UserID") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+-----------------------------+
| COUNT(DISTINCT hits.UserID) |
+-----------------------------+
| 17630976                    |
+-----------------------------+
1 row in set. Query took 3.921 seconds.


-----------------------------------------

6. SELECT COUNT(DISTINCT "SearchPhrase") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 120 out of range for slice of length 104', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'tokio-runtime-worker' panicked at 'range end index 87 out of range for slice of length 80', library/core/src/slice/index.rs:73:5
ArrowError(ExternalError(Execution("Join Error: task 43 panicked")))


-----------------------------------------

7. SELECT MIN("EventDate"), MAX("EventDate") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+---------------------+---------------------+
| MIN(hits.EventDate) | MAX(hits.EventDate) |
+---------------------+---------------------+
| 15888               | 15917               |
+---------------------+---------------------+
1 row in set. Query took 0.349 seconds.


-----------------------------------------

8. SELECT "AdvEngineID", COUNT(*) FROM hits WHERE "AdvEngineID" <> 0 GROUP BY "AdvEngineID" ORDER BY COUNT(*) DESC;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.041 seconds.
+-------------+-----------------+
| AdvEngineID | COUNT(UInt8(1)) |
+-------------+-----------------+
| 2           | 404602          |
| 27          | 113167          |
| 13          | 45631           |
| 45          | 38960           |
| 44          | 9730            |
| 3           | 6896            |
| 62          | 5266            |
| 52          | 3554            |
| 50          | 938             |
| 28          | 836             |
| 53          | 350             |
| 25          | 343             |
| 61          | 158             |
| 21          | 38              |
| 42          | 20              |
| 16          | 7               |
| 7           | 3               |
| 22          | 1               |
+-------------+-----------------+
18 rows in set. Query took 0.331 seconds.


-----------------------------------------

9. SELECT "RegionID", COUNT(DISTINCT "UserID") AS u FROM hits GROUP BY "RegionID" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.037 seconds.
+----------+---------+
| RegionID | u       |
+----------+---------+
| 229      | 2845673 |
| 2        | 1081016 |
| 208      | 831676  |
| 169      | 604583  |
| 184      | 322661  |
| 158      | 307152  |
| 34       | 299479  |
| 55       | 286525  |
| 107      | 272448  |
| 42       | 243181  |
+----------+---------+
10 rows in set. Query took 4.839 seconds.


-----------------------------------------

10. SELECT "RegionID", SUM("AdvEngineID"), COUNT(*) AS c, AVG("ResolutionWidth"), COUNT(DISTINCT "UserID") FROM hits GROUP BY "RegionID" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+----------+-----------------------+----------+---------------------------+-----------------------------+
| RegionID | SUM(hits.AdvEngineID) | c        | AVG(hits.ResolutionWidth) | COUNT(DISTINCT hits.UserID) |
+----------+-----------------------+----------+---------------------------+-----------------------------+
| 229      | 2077656               | 18295832 | 1506.085243130785         | 2845673                     |
| 2        | 441662                | 6687587  | 1479.8386542111527        | 1081016                     |
| 208      | 285925                | 4261812  | 1285.2593246722286        | 831676                      |
| 169      | 100887                | 3320229  | 1465.9073732564832        | 604583                      |
| 32       | 81498                 | 1843518  | 1538.0376568061718        | 216010                      |
| 34       | 161779                | 1792369  | 1548.360152401654         | 299479                      |
| 184      | 55526                 | 1755192  | 1506.8082967561384        | 322661                      |
| 42       | 108820                | 1542717  | 1587.1085208758313        | 243181                      |
| 107      | 120470                | 1516690  | 1548.6028970982863        | 272448                      |
| 51       | 98212                 | 1435578  | 1579.8860354505293        | 211505                      |
+----------+-----------------------+----------+---------------------------+-----------------------------+
10 rows in set. Query took 6.069 seconds.


-----------------------------------------

11. SELECT "MobilePhoneModel", COUNT(DISTINCT "UserID") AS u FROM hits WHERE "MobilePhoneModel" <> '' GROUP BY "MobilePhoneModel" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.045 seconds.
+------------------+---------+
| MobilePhoneModel | u       |
+------------------+---------+
| iPad             | 1090347 |
| iPhone           | 45758   |
| A500             | 16046   |
| N8-00            | 5565    |
| iPho             | 3300    |
| ONE TOUCH 6030A  | 2759    |
| GT-P7300B        | 1907    |
| 3110000          | 1871    |
| GT-I9500         | 1598    |
| eagle75          | 1492    |
+------------------+---------+
10 rows in set. Query took 1.938 seconds.


-----------------------------------------

12. SELECT "MobilePhone", "MobilePhoneModel", COUNT(DISTINCT "UserID") AS u FROM hits WHERE "MobilePhoneModel" <> '' GROUP BY "MobilePhone", "MobilePhoneModel" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+-------------+------------------+--------+
| MobilePhone | MobilePhoneModel | u      |
+-------------+------------------+--------+
| 1           | iPad             | 931038 |
| 5           | iPad             | 48385  |
| 6           | iPad             | 29710  |
| 7           | iPad             | 28391  |
| 118         | A500             | 16005  |
| 6           | iPhone           | 14516  |
| 26          | iPhone           | 13566  |
| 10          | iPad             | 11433  |
| 32          | iPad             | 9503   |
| 13          | iPad             | 9417   |
+-------------+------------------+--------+
10 rows in set. Query took 2.274 seconds.


-----------------------------------------

13. SELECT "SearchPhrase", COUNT(*) AS c FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 120 out of range for slice of length 104', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'tokio-runtime-worker' panicked at 'range end index 87 out of range for slice of length 80', library/core/src/slice/index.rs:73:5
ArrowError(ExternalError(ArrowError(ExternalError(Execution("Join Error: task 43 panicked")))))


-----------------------------------------

14. SELECT "SearchPhrase", COUNT(DISTINCT "UserID") AS u FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.040 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 128 out of range for slice of length 112', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'tokio-runtime-worker' panicked at 'range end index 95 out of range for slice of length 88', library/core/src/slice/index.rs:73:5
ArrowError(ExternalError(ArrowError(ExternalError(Execution("Arrow error: External error: Execution error: Join Error: task 75 panicked")))))


-----------------------------------------

15. SELECT "SearchEngineID", "SearchPhrase", COUNT(*) AS c FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchEngineID", "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 122 out of range for slice of length 104', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'tokio-runtime-worker' panicked at 'range end index 89 out of range for slice of length 80', library/core/src/slice/index.rs:73:5
ArrowError(ExternalError(ArrowError(ExternalError(Execution("Join Error: task 43 panicked")))))


-----------------------------------------

16. SELECT "UserID", COUNT(*) FROM hits GROUP BY "UserID" ORDER BY COUNT(*) DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.040 seconds.
+---------------------+-----------------+
| UserID              | COUNT(UInt8(1)) |
+---------------------+-----------------+
| 1313338681122956954 | 29097           |
| 1907779576417363396 | 25333           |
| 2305303682471783379 | 10597           |
| 7982623143712728547 | 7584            |
| 6018350421959114808 | 6678            |
| 7280399273658728997 | 6411            |
| 1090981537032625727 | 6197            |
| 5730251990344211405 | 6019            |
| 835157184735512989  | 5211            |
| 770542365400669095  | 4906            |
+---------------------+-----------------+
10 rows in set. Query took 5.740 seconds.


-----------------------------------------

17. SELECT "UserID", "SearchPhrase", COUNT(*) FROM hits GROUP BY "UserID", "SearchPhrase" ORDER BY COUNT(*) DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 128 out of range for slice of length 112', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
thread 'ArrowError(ExternalError(ArrowError(ExternalError(Execution("Join Error: task 43 panicked")))))
tokio-runtime-worker' panicked at 'range end index 95 out of range for slice of length 88', library/core/src/slice/index.rs:73:5


-----------------------------------------

18. SELECT "UserID", "SearchPhrase", COUNT(*) FROM hits GROUP BY "UserID", "SearchPhrase" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 128 out of range for slice of length 112', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
ArrowError(ExternalError(Execution("Join Error: task 43 panicked")))
thread 'tokio-runtime-worker' panicked at 'range end index 95 out of range for slice of length 88', library/core/src/slice/index.rs:73:5


-----------------------------------------

19. SELECT "UserID", extract(minute FROM "EventTime") AS m, "SearchPhrase", COUNT(*) FROM hits GROUP BY "UserID", m, "SearchPhrase" ORDER BY COUNT(*) DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.039 seconds.
Plan("Coercion from [Utf8, Int64] to the signature OneOf([Exact([Utf8, Date32]), Exact([Utf8, Date64]), Exact([Utf8, Timestamp(Second, None)]), Exact([Utf8, Timestamp(Microsecond, None)]), Exact([Utf8, Timestamp(Millisecond, None)]), Exact([Utf8, Timestamp(Nanosecond, None)])]) failed.")


-----------------------------------------

20. SELECT "UserID" FROM hits WHERE "UserID" = 435090932899640449;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.041 seconds.
+--------------------+
| UserID             |
+--------------------+
| 435090932899640449 |
| 435090932899640449 |
| 435090932899640449 |
| 435090932899640449 |
+--------------------+
4 rows in set. Query took 0.441 seconds.


-----------------------------------------

21. SELECT COUNT(*) FROM hits WHERE "URL" LIKE '%google%';

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.040 seconds.
+-----------------+
| COUNT(UInt8(1)) |
+-----------------+
| 15908           |
+-----------------+
1 row in set. Query took 9.454 seconds.


-----------------------------------------

22. SELECT "SearchPhrase", MIN("URL"), COUNT(*) AS c FROM hits WHERE "URL" LIKE '%google%' AND "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+-------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+----+
| SearchPhrase                                                      | MIN(hits.URL)                                                                                                             | c  |
+-------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+----+
| прокур горбуши                                                    | http://smeshariki.ru/googleTBR%26ad                                                                                       | 60 |
| римском качественны for cry                                       | http:%2F%2Fwwww.googlead&aktional                                                                                         | 24 |
| стоит похуден                                                     | http://smeshariki.ru/index.ua/doc/22229/googlead%26aktion=2&input_bdsmpeople.ru/real-estate=0&state=2013070519381         | 23 |
| испанч боб новости дейская                                        | http://smeshariki.ru/recipes/show/6840872&trafkey=6d0fc12c54059/loukhaAUXI&where=all&filter/Mitsubishi/google             | 21 |
| прокур готовки видеоэндоменя                                      | http://smeshariki.ru/googleTBR%26ad                                                                                       | 14 |
| прокур гипоаллеры                                                 | http://smeshariki.ru/googleTBR%26ad                                                                                       | 11 |
| камедицинск автомобильних условодки на в крем                     | http://video.yandex.php?com=google.ru/arts/searchAutoSearch                                                               | 9  |
| универ 11.6/1366x768/4096mb ddressary of thing                    | http://smeshariki.ru/index.ua/syllanet.ru/business/hotels.turizm.ru/igooglead%26ar_sliceid%3D1216629/0/&&puid2=15&lo=http | 8  |
| вспомню о названы монстэр                                         | http://tienskaia-moda-zhienskaia-obl.irr.ru/ch/google-c-38208                                                             | 7  |
| купить трудовані резюме мертный дина кабинский лежит заднее устан | http://video.yandex.php?com=google.ru/arts/searchAutoSearch                                                               | 7  |
+-------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+----+
10 rows in set. Query took 12.830 seconds.


-----------------------------------------

23. SELECT "SearchPhrase", MIN("URL"), MIN("Title"), COUNT(*) AS c, COUNT(DISTINCT "UserID") FROM hits WHERE "Title" LIKE '%Google%' AND "URL" NOT LIKE '%.google.%' AND "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+--------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+-----------------------------+
| SearchPhrase                                           | MIN(hits.URL)                                                                                                                                                                                         | MIN(hits.Title)                                                                                                                                                                                                                                                                                                | c   | COUNT(DISTINCT hits.UserID) |
+--------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+-----------------------------+
| винки медведь смотреть фильмы 2013 смотреть            | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_action=2011/page_type=profiles/88436/currency                                                                                     | видеорегионалу Google                                                                                                                                                                                                                                                                                          | 801 | 600                         |
| секретарь оверка все серии порт                        | http://kinopoisk.ru/a-albums_scroll_to_auto_id=227&option/vacancies/liver.ru/cgi-bin/click.cgi%3Fsid%3D158197%26ad                                                                                    | @дневники Google Player 1.2.5 л,                                                                                                                                                                                                                                                                               | 214 | 182                         |
| винки медведь смотреть фильмы чеческия                 | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_action=2013-topy%2Fproduct_price_ot=&price                                                                                        | видеорегионалу Gooddock hotmail Google на толстовая комфорталенны Berlingo по давлений                                                                                                                                                                                                                         | 138 | 121                         |
| игры для дер блич                                      | http://kinopoisk.ru/a-albums_scroll_to_auto_id=363064472354&lb_id=1559843                                                                                                                             | Легко на купить автозаврам телась Google Anaissage_599-61 «Оверлок колепный рецепт: Твери                                                                                                                                                                                                                      | 114 | 106                         |
| винки медведь смотреть объятный ветерин                | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_age17/#page/Jeep,Lexus/rodimomu_vsegoddelki.ru/carbuznyj-90472-0-014031818%26height%3D901634571                                   | видеорегионалу Google - Доставщиков и актрическая                                                                                                                                                                                                                                                              | 102 | 85                          |
| кино 2009) смотреть онлайн бессмерти мк в россипед     | http://domchelove.ru/#!/search/page                                                                                                                                                                   | Далее о коллекции в GIMI LANCIA 0K3Y318104 продать Google, go-go в регистрии — Мой Крым                                                                                                                                                                                                                        | 90  | 70                          |
| винки медведь смотреть                                 | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_active/?do=showCampState/renatzija-na-brietielkakh%2F&ti=С                                                                        | видеорегионалу Google - модного языке - Пульс                                                                                                                                                                                                                                                                  | 87  | 56                          |
| тайны избавитель в владимира для университет масляться | http://smeshariki.ru/a-folder=cars/article=199980150195,0.107736/detail.aspx#location=search?text=asc&maxyear=2001216629%26sob%3D3159&input_who1=1&cid=577&oki=1&op_product_id=25&pvno=2&evlg=VC,2;VL | Амитин обувь - Яндекс.Видео+текст песен Google.com                                                                                                                                                                                                                                                             | 64  | 56                          |
| коптимиквиды юриста с роуз рая                         | https://produkty%2Fpulove.ru/booklyattion-war-sinij-9182/women                                                                                                                                        | Легко на участные участников., Цены - Стильная парнем. Саганрог догадения : Турции, купить у 10 дне кольные машинки не представки - Новая с избиение спродажа: котята 2014 г.в. Цена: 47500-10ECO060 – -------- купить квартиру Оренбург (России Galantrax Flamiliada Google, Nо 18 фотоконверк Супер Кардиган | 45  | 12                          |
| винки медведь смотрейлера начальник                    | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_active/                                                                                                                           | видеорегионалу Google - модных Челябинск                                                                                                                                                                                                                                                                       | 40  | 35                          |
+--------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+-----------------------------+
10 rows in set. Query took 34.372 seconds.


-----------------------------------------

24. SELECT README.md b.sql benchmark.sh convert-r.py create.sql hits.parquet queries-fix2.sql queries-full.sql queries.sql r.txt r2.txt result.csv run.sh run2.sh FROM hits WHERE "URL" LIKE '%google%' ORDER BY "EventTime" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
SQL(ParserError("Expected end of statement, found: ."))


-----------------------------------------

25. SELECT "SearchPhrase" FROM hits WHERE "SearchPhrase" <> '' ORDER BY "EventTime" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+------------------------------------+
| SearchPhrase                       |
+------------------------------------+
| galaxy s4 zoom фильм               |
| симптомы регистратов               |
| фильм небольшой бизнеса североятно |
| ночно китая женщины                |
| авом констеть ребенка краево       |
| компьютерапии серия нарий          |
| расписание мультиварка для         |
| отдыха чем прокат                  |
| скачать читалию в духовке          |
| анапа оперевянные волшебную        |
+------------------------------------+
10 rows in set. Query took 4.899 seconds.


-----------------------------------------

26. SELECT "SearchPhrase" FROM hits WHERE "SearchPhrase" <> '' ORDER BY "SearchPhrase" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+-----------------------------------------+
| SearchPhrase                            |
+-----------------------------------------+
|  береж                                  |
|  за русский стил видео какой            |
|  завод тандалищные прода                |
|  заочное по земли в обрезни и метро     |
|  заочное сад цены нарощения музыка визу |
|  зве                                    |
|  земные огурцы раб                      |
|  золотой сайт samsung                   |
|  прав                                   |
|  светы женске 2 сезон                   |
+-----------------------------------------+
10 rows in set. Query took 10.611 seconds.


-----------------------------------------

27. SELECT "SearchPhrase" FROM hits WHERE "SearchPhrase" <> '' ORDER BY "EventTime", "SearchPhrase" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+------------------------------------+
| SearchPhrase                       |
+------------------------------------+
| galaxy s4 zoom фильм               |
| ночно китая женщины                |
| симптомы регистратов               |
| фильм небольшой бизнеса североятно |
| авом констеть ребенка краево       |
| анапа оперевянные волшебную        |
| брита ганам котлы на шерлок        |
| компьютерапии серия нарий          |
| отдыха чем прокат                  |
| расписание мультиварка для         |
+------------------------------------+
10 rows in set. Query took 9.118 seconds.


-----------------------------------------

28. SELECT "CounterID", AVG(length("URL")) AS l, COUNT(*) AS c FROM hits WHERE "URL" <> '' GROUP BY "CounterID" HAVING COUNT(*) > 100000 ORDER BY l DESC LIMIT 25;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+-----------+--------------------+---------+
| CounterID | l                  | c       |
+-----------+--------------------+---------+
| 233773    | 453.1621381043362  | 2938865 |
| 245438    | 261.5559560703286  | 2510103 |
| 122612    | 230.6844119219688  | 3574007 |
| 234004    | 198.08934467443225 | 238660  |
| 1634      | 187.95619823716314 | 323229  |
| 786       | 180.36009060135405 | 120528  |
| 114157    | 139.11817030793685 | 216408  |
| 515       | 123.96619630106122 | 146907  |
| 256004    | 121.86098341705791 | 858171  |
| 95427     | 116.91913835204352 | 374306  |
| 199550    | 106.89178533979685 | 7115413 |
| 220992    | 103.75863804906453 | 494614  |
| 196239    | 95.01398682515553  | 163797  |
| 96948     | 92.1134607276574   | 396093  |
| 62        | 91.94268102689155  | 738150  |
| 188878    | 90.26380938339348  | 311998  |
| 249603    | 90.00927488053189  | 120325  |
| 3922      | 85.88639543083326  | 8527069 |
| 191697    | 85.03551145479048  | 124664  |
| 97467     | 82.76263550290444  | 131178  |
| 186300    | 82.05936495792844  | 802561  |
| 230962    | 74.73222907051642  | 169223  |
| 77639     | 74.65631730856313  | 253961  |
| 146891    | 74.13011535042938  | 605286  |
| 38        | 73.96797565827048  | 507770  |
+-----------+--------------------+---------+
25 rows in set. Query took 20.399 seconds.


-----------------------------------------

29. SELECT REGEXP_REPLACE("Referer", '^https?://(?:www.)?([^/]+)/.*$', '1') AS k, AVG(length("Referer")) AS l, COUNT(*) AS c, MIN("Referer") FROM hits WHERE "Referer" <> '' GROUP BY k HAVING COUNT(*) > 100000 ORDER BY l DESC LIMIT 25;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.077 seconds.
+-----------------------------------------------------------------------+-------------------+----------+-----------------------------------------------------------------------------------------------+
| k                                                                     | l                 | c        | MIN(hits.Referer)                                                                             |
+-----------------------------------------------------------------------+-------------------+----------+-----------------------------------------------------------------------------------------------+
| 1                                                                     | 81.60577248233396 | 66284655 | http://%26ad%3D1%25EA%25D0%26utm_source=web&cd=19590&input_onlist/би-2 место будущей кондицин |
| http:%2F%2Fwwww.regnancies/search&evL8gE&where=all&filmId=bEmYZc_WTDE | 69                | 207347   | http:%2F%2Fwwww.regnancies/search&evL8gE&where=all&filmId=bEmYZc_WTDE                         |
| http://loveche.html?ctid                                              | 24                | 144901   | http://loveche.html?ctid                                                                      |
| http://rukodeliveresult                                               | 23                | 226135   | http://rukodeliveresult                                                                       |
| http:%2F%2Fviewtopic                                                  | 20                | 391115   | http:%2F%2Fviewtopic                                                                          |
| http://holodilnik.ru                                                  | 20                | 133893   | http://holodilnik.ru                                                                          |
| http://smeshariki.ru                                                  | 20                | 210736   | http://smeshariki.ru                                                                          |
| http:%2F%2FviewType                                                   | 19                | 148907   | http:%2F%2FviewType                                                                           |
| http:%2F%2Fwwww.ukr                                                   | 19                | 655178   | http:%2F%2Fwwww.ukr                                                                           |
| http://новострашная                                                   | 19                | 731499   | http://новострашная                                                                           |
| http://state=2008                                                     | 17                | 139630   | http://state=2008                                                                             |
+-----------------------------------------------------------------------+-------------------+----------+-----------------------------------------------------------------------------------------------+
11 rows in set. Query took 681.318 seconds.


-----------------------------------------

30. SELECT SUM("ResolutionWidth"), SUM("ResolutionWidth" + 1), SUM("ResolutionWidth" + 2), SUM("ResolutionWidth" + 3), SUM("ResolutionWidth" + 4), SUM("ResolutionWidth" + 5), SUM("ResolutionWidth" + 6), SUM("ResolutionWidth" + 7), SUM("ResolutionWidth" + 8), SUM("ResolutionWidth" + 9), SUM("ResolutionWidth" + 10), SUM("ResolutionWidth" + 11), SUM("ResolutionWidth" + 12), SUM("ResolutionWidth" + 13), SUM("ResolutionWidth" + 14), SUM("ResolutionWidth" + 15), SUM("ResolutionWidth" + 16), SUM("ResolutionWidth" + 17), SUM("ResolutionWidth" + 18), SUM("ResolutionWidth" + 19), SUM("ResolutionWidth" + 20), SUM("ResolutionWidth" + 21), SUM("ResolutionWidth" + 22), SUM("ResolutionWidth" + 23), SUM("ResolutionWidth" + 24), SUM("ResolutionWidth" + 25), SUM("ResolutionWidth" + 26), SUM("ResolutionWidth" + 27), SUM("ResolutionWidth" + 28), SUM("ResolutionWidth" + 29), SUM("ResolutionWidth" + 30), SUM("ResolutionWidth" + 31), SUM("ResolutionWidth" + 32), SUM("ResolutionWidth" + 33), SUM("ResolutionWidth" + 34), SUM("ResolutionWidth" + 35), SUM("ResolutionWidth" + 36), SUM("ResolutionWidth" + 37), SUM("ResolutionWidth" + 38), SUM("ResolutionWidth" + 39), SUM("ResolutionWidth" + 40), SUM("ResolutionWidth" + 41), SUM("ResolutionWidth" + 42), SUM("ResolutionWidth" + 43), SUM("ResolutionWidth" + 44), SUM("ResolutionWidth" + 45), SUM("ResolutionWidth" + 46), SUM("ResolutionWidth" + 47), SUM("ResolutionWidth" + 48), SUM("ResolutionWidth" + 49), SUM("ResolutionWidth" + 50), SUM("ResolutionWidth" + 51), SUM("ResolutionWidth" + 52), SUM("ResolutionWidth" + 53), SUM("ResolutionWidth" + 54), SUM("ResolutionWidth" + 55), SUM("ResolutionWidth" + 56), SUM("ResolutionWidth" + 57), SUM("ResolutionWidth" + 58), SUM("ResolutionWidth" + 59), SUM("ResolutionWidth" + 60), SUM("ResolutionWidth" + 61), SUM("ResolutionWidth" + 62), SUM("ResolutionWidth" + 63), SUM("ResolutionWidth" + 64), SUM("ResolutionWidth" + 65), SUM("ResolutionWidth" + 66), SUM("ResolutionWidth" + 67), SUM("ResolutionWidth" + 68), SUM("ResolutionWidth" + 69), SUM("ResolutionWidth" + 70), SUM("ResolutionWidth" + 71), SUM("ResolutionWidth" + 72), SUM("ResolutionWidth" + 73), SUM("ResolutionWidth" + 74), SUM("ResolutionWidth" + 75), SUM("ResolutionWidth" + 76), SUM("ResolutionWidth" + 77), SUM("ResolutionWidth" + 78), SUM("ResolutionWidth" + 79), SUM("ResolutionWidth" + 80), SUM("ResolutionWidth" + 81), SUM("ResolutionWidth" + 82), SUM("ResolutionWidth" + 83), SUM("ResolutionWidth" + 84), SUM("ResolutionWidth" + 85), SUM("ResolutionWidth" + 86), SUM("ResolutionWidth" + 87), SUM("ResolutionWidth" + 88), SUM("ResolutionWidth" + 89) FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.110 seconds.
+---------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+
| SUM(hits.ResolutionWidth) | SUM(hits.ResolutionWidth Plus Int64(1)) | SUM(hits.ResolutionWidth Plus Int64(2)) | SUM(hits.ResolutionWidth Plus Int64(3)) | SUM(hits.ResolutionWidth Plus Int64(4)) | SUM(hits.ResolutionWidth Plus Int64(5)) | SUM(hits.ResolutionWidth Plus Int64(6)) | SUM(hits.ResolutionWidth Plus Int64(7)) | SUM(hits.ResolutionWidth Plus Int64(8)) | SUM(hits.ResolutionWidth Plus Int64(9)) | SUM(hits.ResolutionWidth Plus Int64(10)) | SUM(hits.ResolutionWidth Plus Int64(11)) | SUM(hits.ResolutionWidth Plus Int64(12)) | SUM(hits.ResolutionWidth Plus Int64(13)) | SUM(hits.ResolutionWidth Plus Int64(14)) | SUM(hits.ResolutionWidth Plus Int64(15)) | SUM(hits.ResolutionWidth Plus Int64(16)) | SUM(hits.ResolutionWidth Plus Int64(17)) | SUM(hits.ResolutionWidth Plus Int64(18)) | SUM(hits.ResolutionWidth Plus Int64(19)) | SUM(hits.ResolutionWidth Plus Int64(20)) | SUM(hits.ResolutionWidth Plus Int64(21)) | SUM(hits.ResolutionWidth Plus Int64(22)) | SUM(hits.ResolutionWidth Plus Int64(23)) | SUM(hits.ResolutionWidth Plus Int64(24)) | SUM(hits.ResolutionWidth Plus Int64(25)) | SUM(hits.ResolutionWidth Plus Int64(26)) | SUM(hits.ResolutionWidth Plus Int64(27)) | SUM(hits.ResolutionWidth Plus Int64(28)) | SUM(hits.ResolutionWidth Plus Int64(29)) | SUM(hits.ResolutionWidth Plus Int64(30)) | SUM(hits.ResolutionWidth Plus Int64(31)) | SUM(hits.ResolutionWidth Plus Int64(32)) | SUM(hits.ResolutionWidth Plus Int64(33)) | SUM(hits.ResolutionWidth Plus Int64(34)) | SUM(hits.ResolutionWidth Plus Int64(35)) | SUM(hits.ResolutionWidth Plus Int64(36)) | SUM(hits.ResolutionWidth Plus Int64(37)) | SUM(hits.ResolutionWidth Plus Int64(38)) | SUM(hits.ResolutionWidth Plus Int64(39)) | SUM(hits.ResolutionWidth Plus Int64(40)) | SUM(hits.ResolutionWidth Plus Int64(41)) | SUM(hits.ResolutionWidth Plus Int64(42)) | SUM(hits.ResolutionWidth Plus Int64(43)) | SUM(hits.ResolutionWidth Plus Int64(44)) | SUM(hits.ResolutionWidth Plus Int64(45)) | SUM(hits.ResolutionWidth Plus Int64(46)) | SUM(hits.ResolutionWidth Plus Int64(47)) | SUM(hits.ResolutionWidth Plus Int64(48)) | SUM(hits.ResolutionWidth Plus Int64(49)) | SUM(hits.ResolutionWidth Plus Int64(50)) | SUM(hits.ResolutionWidth Plus Int64(51)) | SUM(hits.ResolutionWidth Plus Int64(52)) | SUM(hits.ResolutionWidth Plus Int64(53)) | SUM(hits.ResolutionWidth Plus Int64(54)) | SUM(hits.ResolutionWidth Plus Int64(55)) | SUM(hits.ResolutionWidth Plus Int64(56)) | SUM(hits.ResolutionWidth Plus Int64(57)) | SUM(hits.ResolutionWidth Plus Int64(58)) | SUM(hits.ResolutionWidth Plus Int64(59)) | SUM(hits.ResolutionWidth Plus Int64(60)) | SUM(hits.ResolutionWidth Plus Int64(61)) | SUM(hits.ResolutionWidth Plus Int64(62)) | SUM(hits.ResolutionWidth Plus Int64(63)) | SUM(hits.ResolutionWidth Plus Int64(64)) | SUM(hits.ResolutionWidth Plus Int64(65)) | SUM(hits.ResolutionWidth Plus Int64(66)) | SUM(hits.ResolutionWidth Plus Int64(67)) | SUM(hits.ResolutionWidth Plus Int64(68)) | SUM(hits.ResolutionWidth Plus Int64(69)) | SUM(hits.ResolutionWidth Plus Int64(70)) | SUM(hits.ResolutionWidth Plus Int64(71)) | SUM(hits.ResolutionWidth Plus Int64(72)) | SUM(hits.ResolutionWidth Plus Int64(73)) | SUM(hits.ResolutionWidth Plus Int64(74)) | SUM(hits.ResolutionWidth Plus Int64(75)) | SUM(hits.ResolutionWidth Plus Int64(76)) | SUM(hits.ResolutionWidth Plus Int64(77)) | SUM(hits.ResolutionWidth Plus Int64(78)) | SUM(hits.ResolutionWidth Plus Int64(79)) | SUM(hits.ResolutionWidth Plus Int64(80)) | SUM(hits.ResolutionWidth Plus Int64(81)) | SUM(hits.ResolutionWidth Plus Int64(82)) | SUM(hits.ResolutionWidth Plus Int64(83)) | SUM(hits.ResolutionWidth Plus Int64(84)) | SUM(hits.ResolutionWidth Plus Int64(85)) | SUM(hits.ResolutionWidth Plus Int64(86)) | SUM(hits.ResolutionWidth Plus Int64(87)) | SUM(hits.ResolutionWidth Plus Int64(88)) | SUM(hits.ResolutionWidth Plus Int64(89)) |
+---------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+
| 151345005230              | 151445002727                            | 151545000224                            | 151644997721                            | 151744995218                            | 151844992715                            | 151944990212                            | 152044987709                            | 152144985206                            | 152244982703                            | 152344980200                             | 152444977697                             | 152544975194                             | 152644972691                             | 152744970188                             | 152844967685                             | 152944965182                             | 153044962679                             | 153144960176                             | 153244957673                             | 153344955170                             | 153444952667                             | 153544950164                             | 153644947661                             | 153744945158                             | 153844942655                             | 153944940152                             | 154044937649                             | 154144935146                             | 154244932643                             | 154344930140                             | 154444927637                             | 154544925134                             | 154644922631                             | 154744920128                             | 154844917625                             | 154944915122                             | 155044912619                             | 155144910116                             | 155244907613                             | 155344905110                             | 155444902607                             | 155544900104                             | 155644897601                             | 155744895098                             | 155844892595                             | 155944890092                             | 156044887589                             | 156144885086                             | 156244882583                             | 156344880080                             | 156444877577                             | 156544875074                             | 156644872571                             | 156744870068                             | 156844867565                             | 156944865062                             | 157044862559                             | 157144860056                             | 157244857553                             | 157344855050                             | 157444852547                             | 157544850044                             | 157644847541                             | 157744845038                             | 157844842535                             | 157944840032                             | 158044837529                             | 158144835026                             | 158244832523                             | 158344830020                             | 158444827517                             | 158544825014                             | 158644822511                             | 158744820008                             | 158844817505                             | 158944815002                             | 159044812499                             | 159144809996                             | 159244807493                             | 159344804990                             | 159444802487                             | 159544799984                             | 159644797481                             | 159744794978                             | 159844792475                             | 159944789972                             | 160044787469                             | 160144784966                             | 160244782463                             |
+---------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+
1 row in set. Query took 11.450 seconds.


-----------------------------------------

31. SELECT "SearchEngineID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchEngineID", "ClientIP" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.112 seconds.
+----------------+-------------+------+---------------------+---------------------------+
| SearchEngineID | ClientIP    | c    | SUM(hits.IsRefresh) | AVG(hits.ResolutionWidth) |
+----------------+-------------+------+---------------------+---------------------------+
| 2              | 1138507705  | 1633 | 35                  | 1408.0122473974282        |
| 2              | 1740861572  | 1331 | 28                  | 1577.945905334335         |
| 2              | -807147100  | 1144 | 35                  | 1553.1984265734266        |
| 2              | -497906719  | 1140 | 36                  | 1543.4140350877192        |
| 2              | -1945757555 | 1105 | 30                  | 1557.387330316742         |
| 2              | -1870623097 | 1102 | 31                  | 1555.6588021778584        |
| 2              | -631062503  | 1083 | 31                  | 1581.8171745152354        |
| 2              | -465813166  | 1082 | 30                  | 1541.253234750462         |
| 2              | -1743596151 | 1080 | 24                  | 1559.8092592592593        |
| 2              | -1125673878 | 1058 | 22                  | 1587                      |
+----------------+-------------+------+---------------------+---------------------------+
10 rows in set. Query took 17.790 seconds.


-----------------------------------------

32. SELECT "WatchID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits WHERE "SearchPhrase" <> '' GROUP BY "WatchID", "ClientIP" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.107 seconds.
+---------------------+-------------+---+---------------------+---------------------------+
| WatchID             | ClientIP    | c | SUM(hits.IsRefresh) | AVG(hits.ResolutionWidth) |
+---------------------+-------------+---+---------------------+---------------------------+
| 5639783218330720430 | 1794154196  | 1 | 1                   | 1368                      |
| 6192312418584519843 | 1794154196  | 1 | 0                   | 1368                      |
| 4939383509093326690 | 1190860152  | 1 | 0                   | 1638                      |
| 6362607697319075992 | 1190860152  | 1 | 1                   | 1638                      |
| 8597497404494430913 | 525299729   | 1 | 1                   | 1087                      |
| 6811347515867936139 | -2031623971 | 1 | 0                   | 1638                      |
| 6362706331538820401 | 2086141120  | 1 | 1                   | 253                       |
| 5591505951833012084 | 1193505452  | 1 | 0                   | 1638                      |
| 5936755026575390971 | 2001445642  | 1 | 0                   | 1828                      |
| 6628772265126493981 | 787682966   | 1 | 0                   | 1368                      |
+---------------------+-------------+---+---------------------+---------------------------+
10 rows in set. Query took 18.089 seconds.


-----------------------------------------

33. SELECT "WatchID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits GROUP BY "WatchID", "ClientIP" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.092 seconds.
+---------------------+-------------+---+---------------------+---------------------------+
| WatchID             | ClientIP    | c | SUM(hits.IsRefresh) | AVG(hits.ResolutionWidth) |
+---------------------+-------------+---+---------------------+---------------------------+
| 7904046282518428963 | 1509330109  | 2 | 0                   | 1368                      |
| 8566928176839891583 | -1402644643 | 2 | 0                   | 1368                      |
| 7224410078130478461 | -776509581  | 2 | 0                   | 1368                      |
| 6655575552203051303 | 1611957945  | 2 | 0                   | 1638                      |
| 6490075056285939109 | 1281592733  | 1 | 0                   | 1750                      |
| 4881997672397396483 | 1281592733  | 1 | 1                   | 1750                      |
| 7053567478887045102 | 1281592733  | 1 | 1                   | 1750                      |
| 8650733771763992182 | -171972925  | 1 | 1                   | 1917                      |
| 5778220860438315490 | -171972925  | 1 | 0                   | 1917                      |
| 6476023165719163408 | -171972925  | 1 | 1                   | 1917                      |
+---------------------+-------------+---+---------------------+---------------------------+
10 rows in set. Query took 116.215 seconds.


-----------------------------------------

34. SELECT "URL", COUNT(*) AS c FROM hits GROUP BY "URL" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.094 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 104 out of range for slice of length 88', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
ArrowError(ExternalError(ArrowError(ExternalError(Execution("Join Error: task 39 panicked")))))


-----------------------------------------

35. SELECT 1, "URL", COUNT(*) AS c FROM hits GROUP BY 1, "URL" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.091 seconds.
thread 'tokio-runtime-worker' panicked at 'range end index 112 out of range for slice of length 96', library/core/src/slice/index.rs:73:5
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
ArrowError(ExternalError(ArrowError(ExternalError(Execution("Join Error: task 39 panicked")))))


-----------------------------------------

36. SELECT "ClientIP", "ClientIP" - 1, "ClientIP" - 2, "ClientIP" - 3, COUNT(*) AS c FROM hits GROUP BY "ClientIP", "ClientIP" - 1, "ClientIP" - 2, "ClientIP" - 3 ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.093 seconds.
+-------------+------------------------------+------------------------------+------------------------------+-------+
| ClientIP    | hits.ClientIP Minus Int64(1) | hits.ClientIP Minus Int64(2) | hits.ClientIP Minus Int64(3) | c     |
+-------------+------------------------------+------------------------------+------------------------------+-------+
| -39921974   | -39921975                    | -39921976                    | -39921977                    | 47008 |
| -1698104457 | -1698104458                  | -1698104459                  | -1698104460                  | 29121 |
| -1175819552 | -1175819553                  | -1175819554                  | -1175819555                  | 25333 |
| 1696638182  | 1696638181                   | 1696638180                   | 1696638179                   | 20220 |
| 1138507705  | 1138507704                   | 1138507703                   | 1138507702                   | 15778 |
| -927025522  | -927025523                   | -927025524                   | -927025525                   | 12768 |
| -1262139876 | -1262139877                  | -1262139878                  | -1262139879                  | 11348 |
| 1740861572  | 1740861571                   | 1740861570                   | 1740861569                   | 11314 |
| -807147100  | -807147101                   | -807147102                   | -807147103                   | 9880  |
| -631062503  | -631062504                   | -631062505                   | -631062506                   | 9718  |
+-------------+------------------------------+------------------------------+------------------------------+-------+
10 rows in set. Query took 9.963 seconds.


-----------------------------------------

37. SELECT "URL", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "DontCountHits" = 0 AND "IsRefresh" = 0 AND "URL" <> '' GROUP BY "URL" ORDER BY PageViews DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.091 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")


-----------------------------------------

38. SELECT "Title", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "DontCountHits" = 0 AND "IsRefresh" = 0 AND "Title" <> '' GROUP BY "Title" ORDER BY PageViews DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.092 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")


-----------------------------------------

39. SELECT "URL", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 AND "IsLink" <> 0 AND "IsDownload" = 0 GROUP BY "URL" ORDER BY PageViews DESC LIMIT 10 OFFSET 1000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.092 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")


-----------------------------------------

40. SELECT "TraficSourceID", "SearchEngineID", "AdvEngineID", CASE WHEN ("SearchEngineID" = 0 AND "AdvEngineID" = 0) THEN "Referer" ELSE '' END AS Src, "URL" AS Dst, COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 GROUP BY "TraficSourceID", "SearchEngineID", "AdvEngineID", Src, Dst ORDER BY PageViews DESC LIMIT 10 OFFSET 1000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.092 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")


-----------------------------------------

41. SELECT "URLHash", "EventDate", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 AND "TraficSourceID" IN (-1, 6) AND "RefererHash" = 3594120000172545465 GROUP BY "URLHash", "EventDate" ORDER BY PageViews DESC LIMIT 10 OFFSET 100;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.091 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")


-----------------------------------------

42. SELECT "WindowClientWidth", "WindowClientHeight", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 AND "DontCountHits" = 0 AND "URLHash" = 2868770270353813622 GROUP BY "WindowClientWidth", "WindowClientHeight" ORDER BY PageViews DESC LIMIT 10 OFFSET 10000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.092 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")


-----------------------------------------

43. SELECT DATE_TRUNC('minute', "EventTime") AS M, COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-14' AND "EventDate" <= '2013-07-15' AND "IsRefresh" = 0 AND "DontCountHits" = 0 GROUP BY DATE_TRUNC('minute', "EventTime") ORDER BY DATE_TRUNC('minute', "EventTime") LIMIT 10 OFFSET 1000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.092 seconds.
Plan("Coercion from [Utf8, Int64] to the signature Exact([Utf8, Timestamp(Nanosecond, None)]) failed.")

@waitingkuo
Copy link
Contributor

waitingkuo commented Aug 3, 2022

@andygrove

after update datafusion-cli to master version

1-36 passed

37-42 passed but it's incorrect
43 failed

the issues from 37-42 are the same

37. SELECT "URL", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "DontCountHits" = 0 AND "IsRefresh" = 0 AND "URL" <> '' GROUP BY "URL" ORDER BY PageViews DESC LIMIT 10;

this is the v10.0.0 datafusion-cli result:

DataFusion CLI v10.0.0
0 rows in set. Query took 0.091 seconds.
Plan("'UInt16 >= Utf8' can't be evaluated because there isn't a common type to coerce the types to")

the original EventDate field is integer; since datafusion-cli doesnt support schema for reading external parquet, it can't be parsed as date or timestamp for now. our benchmark codes are modified from clickbench-local as it's behavior is the most similar one, it does support creating table from parquet with schema https://github.com/ClickHouse/ClickBench/blob/main/clickhouse-local/create.sql#L8 so it works.

we can't parses it as date or time so it becomes a uint16, which isn't allowed to compare to utf8. master branch's datafusion-cli does support the comparison between Uint16 and Utf8 but it looks like that Uint16 is always less than any Utf8 string so this query return 0 rows

37-42 has the same issues. I think 43 got the similar issue as well.

Things we might need to pass all the cases:

  1. support schema while creating external table from parquet
  2. to_timestamp should work for double quoted string as column name. i can't do to_timestamp("EventDate") here as to_timestamp thought EventDate is a Utf-8.
  3. support comparison between timestamp and string so that we can do to_timestamp("EventDate") > '2000-01-01'
-----------------------------------------

1. SELECT COUNT(*) FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.058 seconds.
+-----------------+
| COUNT(UInt8(1)) |
+-----------------+
| 99997497        |
+-----------------+
1 row in set. Query took 0.404 seconds.


-----------------------------------------

2. SELECT COUNT(*) FROM hits WHERE "AdvEngineID" <> 0;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.040 seconds.
+-----------------+
| COUNT(UInt8(1)) |
+-----------------+
| 630500          |
+-----------------+
1 row in set. Query took 0.381 seconds.


-----------------------------------------

3. SELECT SUM("AdvEngineID"), COUNT(*), AVG("ResolutionWidth") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.037 seconds.
+-----------------------+-----------------+---------------------------+
| SUM(hits.AdvEngineID) | COUNT(UInt8(1)) | AVG(hits.ResolutionWidth) |
+-----------------------+-----------------+---------------------------+
| 7280088               | 99997497        | 1513.4879349030107        |
+-----------------------+-----------------+---------------------------+
1 row in set. Query took 0.907 seconds.


-----------------------------------------

4. SELECT AVG("UserID") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.038 seconds.
+---------------------+
| AVG(hits.UserID)    |
+---------------------+
| 2528953029789716500 |
+---------------------+
1 row in set. Query took 0.640 seconds.


-----------------------------------------

5. SELECT COUNT(DISTINCT "UserID") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.037 seconds.
+-----------------------------+
| COUNT(DISTINCT hits.UserID) |
+-----------------------------+
| 17630976                    |
+-----------------------------+
1 row in set. Query took 3.644 seconds.


-----------------------------------------

6. SELECT COUNT(DISTINCT "SearchPhrase") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+-----------------------------------+
| COUNT(DISTINCT hits.SearchPhrase) |
+-----------------------------------+
| 6019103                           |
+-----------------------------------+
1 row in set. Query took 4.869 seconds.


-----------------------------------------

7. SELECT MIN("EventDate"), MAX("EventDate") FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+---------------------+---------------------+
| MIN(hits.EventDate) | MAX(hits.EventDate) |
+---------------------+---------------------+
| 15888               | 15917               |
+---------------------+---------------------+
1 row in set. Query took 0.392 seconds.


-----------------------------------------

8. SELECT "AdvEngineID", COUNT(*) FROM hits WHERE "AdvEngineID" <> 0 GROUP BY "AdvEngineID" ORDER BY COUNT(*) DESC;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.037 seconds.
+-------------+-----------------+
| AdvEngineID | COUNT(UInt8(1)) |
+-------------+-----------------+
| 2           | 404602          |
| 27          | 113167          |
| 13          | 45631           |
| 45          | 38960           |
| 44          | 9730            |
| 3           | 6896            |
| 62          | 5266            |
| 52          | 3554            |
| 50          | 938             |
| 28          | 836             |
| 53          | 350             |
| 25          | 343             |
| 61          | 158             |
| 21          | 38              |
| 42          | 20              |
| 16          | 7               |
| 7           | 3               |
| 22          | 1               |
+-------------+-----------------+
18 rows in set. Query took 0.332 seconds.


-----------------------------------------

9. SELECT "RegionID", COUNT(DISTINCT "UserID") AS u FROM hits GROUP BY "RegionID" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.039 seconds.
+----------+---------+
| RegionID | u       |
+----------+---------+
| 229      | 2845673 |
| 2        | 1081016 |
| 208      | 831676  |
| 169      | 604583  |
| 184      | 322661  |
| 158      | 307152  |
| 34       | 299479  |
| 55       | 286525  |
| 107      | 272448  |
| 42       | 243181  |
+----------+---------+
10 rows in set. Query took 4.487 seconds.


-----------------------------------------

10. SELECT "RegionID", SUM("AdvEngineID"), COUNT(*) AS c, AVG("ResolutionWidth"), COUNT(DISTINCT "UserID") FROM hits GROUP BY "RegionID" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.042 seconds.
+----------+-----------------------+----------+---------------------------+-----------------------------+
| RegionID | SUM(hits.AdvEngineID) | c        | AVG(hits.ResolutionWidth) | COUNT(DISTINCT hits.UserID) |
+----------+-----------------------+----------+---------------------------+-----------------------------+
| 229      | 2077656               | 18295832 | 1506.085243130785         | 2845673                     |
| 2        | 441662                | 6687587  | 1479.8386542111527        | 1081016                     |
| 208      | 285925                | 4261812  | 1285.2593246722286        | 831676                      |
| 169      | 100887                | 3320229  | 1465.9073732564832        | 604583                      |
| 32       | 81498                 | 1843518  | 1538.0376568061718        | 216010                      |
| 34       | 161779                | 1792369  | 1548.360152401654         | 299479                      |
| 184      | 55526                 | 1755192  | 1506.8082967561384        | 322661                      |
| 42       | 108820                | 1542717  | 1587.1085208758313        | 243181                      |
| 107      | 120470                | 1516690  | 1548.6028970982863        | 272448                      |
| 51       | 98212                 | 1435578  | 1579.8860354505293        | 211505                      |
+----------+-----------------------+----------+---------------------------+-----------------------------+
10 rows in set. Query took 5.756 seconds.


-----------------------------------------

11. SELECT "MobilePhoneModel", COUNT(DISTINCT "UserID") AS u FROM hits WHERE "MobilePhoneModel" <> '' GROUP BY "MobilePhoneModel" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+------------------+---------+
| MobilePhoneModel | u       |
+------------------+---------+
| iPad             | 1090347 |
| iPhone           | 45758   |
| A500             | 16046   |
| N8-00            | 5565    |
| iPho             | 3300    |
| ONE TOUCH 6030A  | 2759    |
| GT-P7300B        | 1907    |
| 3110000          | 1871    |
| GT-I9500         | 1598    |
| eagle75          | 1492    |
+------------------+---------+
10 rows in set. Query took 1.592 seconds.


-----------------------------------------

12. SELECT "MobilePhone", "MobilePhoneModel", COUNT(DISTINCT "UserID") AS u FROM hits WHERE "MobilePhoneModel" <> '' GROUP BY "MobilePhone", "MobilePhoneModel" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+-------------+------------------+--------+
| MobilePhone | MobilePhoneModel | u      |
+-------------+------------------+--------+
| 1           | iPad             | 931038 |
| 5           | iPad             | 48385  |
| 6           | iPad             | 29710  |
| 7           | iPad             | 28391  |
| 118         | A500             | 16005  |
| 6           | iPhone           | 14516  |
| 26          | iPhone           | 13566  |
| 10          | iPad             | 11433  |
| 32          | iPad             | 9503   |
| 13          | iPad             | 9417   |
+-------------+------------------+--------+
10 rows in set. Query took 1.963 seconds.


-----------------------------------------

13. SELECT "SearchPhrase", COUNT(*) AS c FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+---------------------------+-------+
| SearchPhrase              | c     |
+---------------------------+-------+
| карелки                   | 70263 |
| албатрутдин               | 34675 |
| смотреть онлайн           | 24580 |
| смотреть онлайн бесплатно | 21647 |
| смотреть                  | 19707 |
| мангу в зарабей грама     | 19195 |
| дружке помещение          | 17284 |
| galaxy table              | 16746 |
| экзоидные                 | 16620 |
| сколько мытищи            | 12317 |
+---------------------------+-------+
10 rows in set. Query took 5.336 seconds.


-----------------------------------------

14. SELECT "SearchPhrase", COUNT(DISTINCT "UserID") AS u FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY u DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+---------------------------+-------+
| SearchPhrase              | u     |
+---------------------------+-------+
| карелки                   | 23673 |
| смотреть онлайн           | 19747 |
| албатрутдин               | 18394 |
| смотреть онлайн бесплатно | 17553 |
| смотреть                  | 14603 |
| экзоидные                 | 14529 |
| мангу в зарабей грама     | 14198 |
| сколько мытищи            | 9007  |
| дружке помещение          | 8792  |
| комбинирование смотреть   | 7572  |
+---------------------------+-------+
10 rows in set. Query took 8.529 seconds.


-----------------------------------------

15. SELECT "SearchEngineID", "SearchPhrase", COUNT(*) AS c FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchEngineID", "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+----------------+---------------------------+-------+
| SearchEngineID | SearchPhrase              | c     |
+----------------+---------------------------+-------+
| 2              | карелки                   | 46258 |
| 2              | мангу в зарабей грама     | 18871 |
| 2              | смотреть онлайн           | 16905 |
| 3              | албатрутдин               | 16748 |
| 2              | смотреть онлайн бесплатно | 14909 |
| 2              | албатрутдин               | 13716 |
| 2              | экзоидные                 | 13414 |
| 2              | смотреть                  | 13108 |
| 3              | карелки                   | 12815 |
| 2              | дружке помещение          | 11946 |
+----------------+---------------------------+-------+
10 rows in set. Query took 6.004 seconds.


-----------------------------------------

16. SELECT "UserID", COUNT(*) FROM hits GROUP BY "UserID" ORDER BY COUNT(*) DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+---------------------+-----------------+
| UserID              | COUNT(UInt8(1)) |
+---------------------+-----------------+
| 1313338681122956954 | 29097           |
| 1907779576417363396 | 25333           |
| 2305303682471783379 | 10597           |
| 7982623143712728547 | 7584            |
| 6018350421959114808 | 6678            |
| 7280399273658728997 | 6411            |
| 1090981537032625727 | 6197            |
| 5730251990344211405 | 6019            |
| 835157184735512989  | 5211            |
| 770542365400669095  | 4906            |
+---------------------+-----------------+
10 rows in set. Query took 5.683 seconds.


-----------------------------------------

17. SELECT "UserID", "SearchPhrase", COUNT(*) FROM hits GROUP BY "UserID", "SearchPhrase" ORDER BY COUNT(*) DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+---------------------+--------------+-----------------+
| UserID              | SearchPhrase | COUNT(UInt8(1)) |
+---------------------+--------------+-----------------+
| 1313338681122956954 |              | 29097           |
| 1907779576417363396 |              | 25333           |
| 2305303682471783379 |              | 10597           |
| 7982623143712728547 |              | 6669            |
| 7280399273658728997 |              | 6408            |
| 1090981537032625727 |              | 6196            |
| 5730251990344211405 |              | 6019            |
| 6018350421959114808 |              | 5990            |
| 835157184735512989  |              | 5209            |
| 770542365400669095  |              | 4906            |
+---------------------+--------------+-----------------+
10 rows in set. Query took 11.284 seconds.


-----------------------------------------

18. SELECT "UserID", "SearchPhrase", COUNT(*) FROM hits GROUP BY "UserID", "SearchPhrase" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.042 seconds.
+--------------------+-----------------------------------+-----------------+
| UserID             | SearchPhrase                      | COUNT(UInt8(1)) |
+--------------------+-----------------------------------+-----------------+
| 551197320963382044 |                                   | 18              |
| 555355732403153904 |                                   | 2               |
| 556853849480989303 |                                   | 3               |
| 558001499068813267 |                                   | 9               |
| 559163664148587221 |                                   | 83              |
| 559664328086679566 |                                   | 14              |
| 559796116809734572 |                                   | 28              |
| 560776637071180173 |                                   | 2               |
| 562221816808008810 |                                   | 2               |
| 563196250018002684 | снять жидкості на за косметаллище | 2               |
+--------------------+-----------------------------------+-----------------+
10 rows in set. Query took 9.047 seconds.


-----------------------------------------

19. SELECT "UserID", extract(minute FROM "EventTime") AS m, "SearchPhrase", COUNT(*) FROM hits GROUP BY "UserID", m, "SearchPhrase" ORDER BY COUNT(*) DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
Plan("Coercion from [Utf8, Int64] to the signature OneOf([Exact([Utf8, Date32]), Exact([Utf8, Date64]), Exact([Utf8, Timestamp(Second, None)]), Exact([Utf8, Timestamp(Microsecond, None)]), Exact([Utf8, Timestamp(Millisecond, None)]), Exact([Utf8, Timestamp(Nanosecond, None)])]) failed.")


-----------------------------------------

20. SELECT "UserID" FROM hits WHERE "UserID" = 435090932899640449;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.045 seconds.
+--------------------+
| UserID             |
+--------------------+
| 435090932899640449 |
| 435090932899640449 |
| 435090932899640449 |
| 435090932899640449 |
+--------------------+
4 rows in set. Query took 0.434 seconds.


-----------------------------------------

21. SELECT COUNT(*) FROM hits WHERE "URL" LIKE '%google%';

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.046 seconds.
+-----------------+
| COUNT(UInt8(1)) |
+-----------------+
| 15908           |
+-----------------+
1 row in set. Query took 9.972 seconds.


-----------------------------------------

22. SELECT "SearchPhrase", MIN("URL"), COUNT(*) AS c FROM hits WHERE "URL" LIKE '%google%' AND "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+-------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+----+
| SearchPhrase                                                      | MIN(hits.URL)                                                                                                             | c  |
+-------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+----+
| прокур горбуши                                                    | http://smeshariki.ru/googleTBR%26ad                                                                                       | 60 |
| римском качественны for cry                                       | http:%2F%2Fwwww.googlead&aktional                                                                                         | 24 |
| стоит похуден                                                     | http://smeshariki.ru/index.ua/doc/22229/googlead%26aktion=2&input_bdsmpeople.ru/real-estate=0&state=2013070519381         | 23 |
| испанч боб новости дейская                                        | http://smeshariki.ru/recipes/show/6840872&trafkey=6d0fc12c54059/loukhaAUXI&where=all&filter/Mitsubishi/google             | 21 |
| прокур готовки видеоэндоменя                                      | http://smeshariki.ru/googleTBR%26ad                                                                                       | 14 |
| прокур гипоаллеры                                                 | http://smeshariki.ru/googleTBR%26ad                                                                                       | 11 |
| камедицинск автомобильних условодки на в крем                     | http://video.yandex.php?com=google.ru/arts/searchAutoSearch                                                               | 9  |
| универ 11.6/1366x768/4096mb ddressary of thing                    | http://smeshariki.ru/index.ua/syllanet.ru/business/hotels.turizm.ru/igooglead%26ar_sliceid%3D1216629/0/&&puid2=15&lo=http | 8  |
| вспомню о названы монстэр                                         | http://tienskaia-moda-zhienskaia-obl.irr.ru/ch/google-c-38208                                                             | 7  |
| купить трудовані резюме мертный дина кабинский лежит заднее устан | http://video.yandex.php?com=google.ru/arts/searchAutoSearch                                                               | 7  |
+-------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------+----+
10 rows in set. Query took 11.814 seconds.


-----------------------------------------

23. SELECT "SearchPhrase", MIN("URL"), MIN("Title"), COUNT(*) AS c, COUNT(DISTINCT "UserID") FROM hits WHERE "Title" LIKE '%Google%' AND "URL" NOT LIKE '%.google.%' AND "SearchPhrase" <> '' GROUP BY "SearchPhrase" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+--------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+-----------------------------+
| SearchPhrase                                           | MIN(hits.URL)                                                                                                                                                                                         | MIN(hits.Title)                                                                                                                                                                                                                                                                                                | c   | COUNT(DISTINCT hits.UserID) |
+--------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+-----------------------------+
| винки медведь смотреть фильмы 2013 смотреть            | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_action=2011/page_type=profiles/88436/currency                                                                                     | видеорегионалу Google                                                                                                                                                                                                                                                                                          | 801 | 600                         |
| секретарь оверка все серии порт                        | http://kinopoisk.ru/a-albums_scroll_to_auto_id=227&option/vacancies/liver.ru/cgi-bin/click.cgi%3Fsid%3D158197%26ad                                                                                    | @дневники Google Player 1.2.5 л,                                                                                                                                                                                                                                                                               | 214 | 182                         |
| винки медведь смотреть фильмы чеческия                 | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_action=2013-topy%2Fproduct_price_ot=&price                                                                                        | видеорегионалу Gooddock hotmail Google на толстовая комфорталенны Berlingo по давлений                                                                                                                                                                                                                         | 138 | 121                         |
| игры для дер блич                                      | http://kinopoisk.ru/a-albums_scroll_to_auto_id=363064472354&lb_id=1559843                                                                                                                             | Легко на купить автозаврам телась Google Anaissage_599-61 «Оверлок колепный рецепт: Твери                                                                                                                                                                                                                      | 114 | 106                         |
| винки медведь смотреть объятный ветерин                | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_age17/#page/Jeep,Lexus/rodimomu_vsegoddelki.ru/carbuznyj-90472-0-014031818%26height%3D901634571                                   | видеорегионалу Google - Доставщиков и актрическая                                                                                                                                                                                                                                                              | 102 | 85                          |
| кино 2009) смотреть онлайн бессмерти мк в россипед     | http://domchelove.ru/#!/search/page                                                                                                                                                                   | Далее о коллекции в GIMI LANCIA 0K3Y318104 продать Google, go-go в регистрии — Мой Крым                                                                                                                                                                                                                        | 90  | 70                          |
| винки медведь смотреть                                 | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_active/?do=showCampState/renatzija-na-brietielkakh%2F&ti=С                                                                        | видеорегионалу Google - модного языке - Пульс                                                                                                                                                                                                                                                                  | 87  | 56                          |
| тайны избавитель в владимира для университет масляться | http://smeshariki.ru/a-folder=cars/article=199980150195,0.107736/detail.aspx#location=search?text=asc&maxyear=2001216629%26sob%3D3159&input_who1=1&cid=577&oki=1&op_product_id=25&pvno=2&evlg=VC,2;VL | Амитин обувь - Яндекс.Видео+текст песен Google.com                                                                                                                                                                                                                                                             | 64  | 56                          |
| коптимиквиды юриста с роуз рая                         | https://produkty%2Fpulove.ru/booklyattion-war-sinij-9182/women                                                                                                                                        | Легко на участные участников., Цены - Стильная парнем. Саганрог догадения : Турции, купить у 10 дне кольные машинки не представки - Новая с избиение спродажа: котята 2014 г.в. Цена: 47500-10ECO060 – -------- купить квартиру Оренбург (России Galantrax Flamiliada Google, Nо 18 фотоконверк Супер Кардиган | 45  | 12                          |
| винки медведь смотрейлера начальник                    | http://smeshariki.ru/a-folder-4/#page-3.2.1; WOW64; Edition=1&input_active/                                                                                                                           | видеорегионалу Google - модных Челябинск                                                                                                                                                                                                                                                                       | 40  | 35                          |
+--------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----+-----------------------------+
10 rows in set. Query took 32.908 seconds.


-----------------------------------------

24. SELECT * FROM hits WHERE "URL" LIKE '%google%' ORDER BY "EventTime" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.045 seconds.
+---------------------+------------+-------------------------------------------------------------------------------------------------------------------------------+-----------+------------+-----------+-----------+-------------+----------+---------------------+--------------+----+-----------+-----------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+-------------------+-----------------+---------------+-------------+-----------------+------------------+-----------------+------------+------------+-------------+----------+----------+----------------+----------------+--------------+------------------+----------+-------------+------------------+--------+-------------+----------------+----------------+------------------------------------+-------------+-------------+-------------------+--------------------+----------------+-----------------+---------------------+---------------------+---------------------+---------------------+----------------------+-------------+--------+------------+-------------+---------------------+-------------+------------+--------------+---------+-------------+---------------+----------+----------+----------------+-----+-----+--------+-----------+-----------+-------------+------------+------------+---------------+-----------------+----------------+---------------+--------------+-----------+------------+-----------+---------------+---------------------+-------------------+-------------+-----------------------+------------------+------------+--------------+---------------+-----------------+---------------------+--------------------+--------------+------------------+-----------+-----------+-------------+------------+---------+---------+----------+----------------------+----------------------+------+
| WatchID             | JavaEnable | Title                                                                                                                         | GoodEvent | EventTime  | EventDate | CounterID | ClientIP    | RegionID | UserID              | CounterClass | OS | UserAgent | URL                                                                                                             | Referer                                                                                                                                                                                                | IsRefresh | RefererCategoryID | RefererRegionID | URLCategoryID | URLRegionID | ResolutionWidth | ResolutionHeight | ResolutionDepth | FlashMajor | FlashMinor | FlashMinor2 | NetMajor | NetMinor | UserAgentMajor | UserAgentMinor | CookieEnable | JavascriptEnable | IsMobile | MobilePhone | MobilePhoneModel | Params | IPNetworkID | TraficSourceID | SearchEngineID | SearchPhrase                       | AdvEngineID | IsArtifical | WindowClientWidth | WindowClientHeight | ClientTimeZone | ClientEventTime | SilverlightVersion1 | SilverlightVersion2 | SilverlightVersion3 | SilverlightVersion4 | PageCharset          | CodeVersion | IsLink | IsDownload | IsNotBounce | FUniqID             | OriginalURL | HID        | IsOldCounter | IsEvent | IsParameter | DontCountHits | WithHash | HitColor | LocalEventTime | Age | Sex | Income | Interests | Robotness | RemoteIP    | WindowName | OpenerName | HistoryLength | BrowserLanguage | BrowserCountry | SocialNetwork | SocialAction | HTTPError | SendTiming | DNSTiming | ConnectTiming | ResponseStartTiming | ResponseEndTiming | FetchTiming | SocialSourceNetworkID | SocialSourcePage | ParamPrice | ParamOrderID | ParamCurrency | ParamCurrencyID | OpenstatServiceName | OpenstatCampaignID | OpenstatAdID | OpenstatSourceID | UTMSource | UTMMedium | UTMCampaign | UTMContent | UTMTerm | FromTag | HasGCLID | RefererHash          | URLHash              | CLID |
+---------------------+------------+-------------------------------------------------------------------------------------------------------------------------------+-----------+------------+-----------+-----------+-------------+----------+---------------------+--------------+----+-----------+-----------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+-------------------+-----------------+---------------+-------------+-----------------+------------------+-----------------+------------+------------+-------------+----------+----------+----------------+----------------+--------------+------------------+----------+-------------+------------------+--------+-------------+----------------+----------------+------------------------------------+-------------+-------------+-------------------+--------------------+----------------+-----------------+---------------------+---------------------+---------------------+---------------------+----------------------+-------------+--------+------------+-------------+---------------------+-------------+------------+--------------+---------+-------------+---------------+----------+----------+----------------+-----+-----+--------+-----------+-----------+-------------+------------+------------+---------------+-----------------+----------------+---------------+--------------+-----------+------------+-----------+---------------+---------------------+-------------------+-------------+-----------------------+------------------+------------+--------------+---------------+-----------------+---------------------+--------------------+--------------+------------------+-----------+-----------+-------------+------------+---------+---------+----------+----------------------+----------------------+------+
| 7675678523794456216 | 1          | Glavnaya gorand. Цветные объявлений районе, вером                                                                             | 1         | 1372708869 | 15888     | 64469     | 1840073959  | 2        | 3714843517822510735 | 0            | 44 | 5         | http://e96.ru/search/page.googleTBR%26ad%3D0%26rnd%3D158197%26anbietersburg                                     | http://bdsmpeople.ru/obrazom_position/?page                                                                                                                                                            | 0         | 13593             | 158             | 13606         | 216         | 1638            | 1658             | 22              | 15         | 7          | 700         | 0        | 0        | 22             | nA             | 1            | 1                | 0        | 0           |                  |        | 4005373     | -1             | 0              |                                    | 0           | 0           | 1052              | 775                | 135            | 1372760422      | 0                   | 0                   | 0                   | 0                   | windows              | 1601        | 0      | 0          | 0           | 0                   |             | 213893614  | 0            | 0       | 0           | 0             | 0        | 6        | 1372766291     | 0   | 0   | 0      | 0         | 0         | 1412515749  | 63522      | -1         | 12            | S0              | �
                                                                                                                           |               |              | 0         | 0          | 0         | 0             | 445                 | 1234              | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 5972490271588207794  | 1369713899219085694  | 0    |
| 6147260061318473746 | 1          | Glavnaya gorand. Цветные объявлений районе, вером                                                                             | 1         | 1372708889 | 15888     | 64469     | 1840073959  | 2        | 3714843517822510735 | 0            | 44 | 5         | http://e96.ru/search/page.googleTBR%26ad%3D0%26rnd%3D158197%26anbietersburg                                     | http://bdsmpeople.ru/obrazom_position/?page                                                                                                                                                            | 0         | 13593             | 158             | 13606         | 216         | 1638            | 1658             | 22              | 15         | 7          | 700         | 0        | 0        | 22             | D�             | 1            | 1                | 0        | 0           |                  |        | 4005373     | -1             | 0              |                                    | 0           | 0           | 1052              | 775                | 135            | 1372760442      | 0                   | 0                   | 0                   | 0                   | windows              | 1601        | 0      | 0          | 0           | 0                   |             | 810892658  | 0            | 0       | 0           | 0             | 0        | 6        | 1372766305     | 0   | 0   | 0      | 0         | 0         | 1412515749  | 63522      | -1         | 13            | S0              | �
                                                                                                                           |               |              | 0         | 0          | 0         | 0             | 0                   | 16                | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 5972490271588207794  | 1369713899219085694  | 0    |
| 5972689683963797854 | 1          | Glavnaya gorand. Цветные объявлений районе, вером                                                                             | 1         | 1372708931 | 15888     | 64469     | 1840073959  | 2        | 3714843517822510735 | 0            | 44 | 5         | http://e96.ru/search/page.googleTBR%26ad%3D0%26rnd%3D158197%26anbietersburg                                     | http://bdsmpeople.ru/obrazom_position/?page                                                                                                                                                            | 0         | 13593             | 158             | 13606         | 216         | 1638            | 1658             | 22              | 15         | 7          | 700         | 0        | 0        | 22             | D�             | 1            | 1                | 0        | 0           |                  |        | 4005373     | -1             | 0              |                                    | 0           | 0           | 1052              | 775                | 135            | 1372760476      | 0                   | 0                   | 0                   | 0                   | windows              | 1601        | 0      | 0          | 0           | 0                   |             | 47015096   | 0            | 0       | 0           | 0             | 0        | 6        | 1372766330     | 0   | 0   | 0      | 0         | 0         | 1412515749  | 63522      | -1         | 13            | S0              | h1             |               |              | 0         | 0          | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 5972490271588207794  | 1369713899219085694  | 0    |
| 8008688361303225116 | 1          | Скачать онлайн играй! - Туризма - Крымский тренчкоты в интернет магазин Wildberries.ru (Работа - IRR.ru - модных словариумных | 1         | 1372709521 | 15888     | 63217     | 1975817788  | 229      | 804133623150786791  | 1            | 44 | 7         | http://bjdswaps.google-photo                                                                                    | http://loveche.html?ctid                                                                                                                                                                               | 0         | 12409             | 20              | 10093         | 22          | 1749            | 867              | 23              | 15         | 3          | 700.224     | 0        | 0        | 15             | D�             | 1            | 1                | 0        | 0           |                  |        | 3056753     | -1             | 0              |                                    | 0           | 0           | 1608              | 662                | 135            | 1372745995      | 4                   | 1                   | 16561               | 0                   | windows              | 1           | 0      | 0          | 0           | 5347008031302181363 |             | 766531830  | 0            | 0       | 0           | 0             | 0        | 5        | 1372766425     | 31  | 1   | 3      | 11237     | 31        | 1870660671  | -1         | -1         | -1            | E3              | _i             |               |              | 0         | 0          | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | -2736470446903004689 | 7116991598850737408  | 0    |
| 7436461208655480623 | 1          | Компании Вино в хорошие                                                                                                       | 1         | 1372710744 | 15888     | 35534     | 1741555497  | 39       | 7082047337377160280 | 0            | 44 | 5         | http://rsdn.ru/catalog/cifrovye-advertisement=little&category=22&input_bdsmpeople.ru/index,google.ru/news/39826 | http://kalina?block/?inst_the_book.php?cPath=40_57470493958402/                                                                                                                                        | 0         | 10634             | 20              | 0             | 0           | 1996            | 1781             | 37              | 15         | 7          | 700         | 0        | 0        | 22             | D�             | 1            | 1                | 0        | 0           |                  |        | 808950      | 5              | 0              |                                    | 0           | 0           | 1261              | 1017               | 433            | 1372791792      | 4                   | 1                   | 16561               | 0                   | windows-1251;charset | 1601        | 1      | 0          | 0           | 6804199628189316872 |             | 626511463  | 0            | 0       | 0           | 1             | 0        | 5        | 1372732542     | 31  | 2   | 3      | 694       | 57        | 1448806868  | -1         | -1         | -1            | E3              | _i             |               |              | 0         | 0          | 0         | 3             | 345                 | 147               | 239         | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 8931346360692564721  | 1971436513446935197  | 0    |
| 5564518777317455184 | 0          | «set» в пробег аппах и обслуживатизиров                                                                                       | 1         | 1372711469 | 15888     | 5822      | 1920787234  | 32       | 3712346975274085073 | 1            | 2  | 3         | http://auto_gruppy/christikha/hotel=-1&trafkey=605&from=&power_name=Платья&produkty%2Furl.google.ru/index       | http://rmnt.ru/cars/passenger/hellardous/42/~37/?suggest&id=3869551753&custom=0&undefined/undefined/under=28036,5;362;108;16762643539                                                                  | 0         | 8563              | 21482           | 9822          | 18528       | 1638            | 1658             | 23              | 15         | 7          | 700         | 0        | 0        | 16             | D�             | 1            | 1                | 0        | 0           |                  |        | 207348      | -1             | 0              |                                    | 0           | 0           | 1509              | 733                | 135            | 1372750392      | 4                   | 1                   | 15738               | 0                   | windows-1251;charset | 1           | 0      | 0          | 0           | 8007561756096276896 |             | 1034507462 | 0            | 0       | 0           | 0             | 0        | 5        | 1372759436     | 0   | 0   | 0      | 0         | 0         | 2016848722  | -1         | -1         | -1            | S0              | h1             |               |              | 0         | 0          | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 7820066807630413322  | -3258566084785303139 | 0    |
| 7381524648140977766 | 1          | Ploshchad' stolitsi zwy 110911923, Г официальная Прессы и Огонек                                                              | 1         | 1372712506 | 15888     | 63217     | 1638850281  | 59       | 1564939829982760596 | 1            | 44 | 5         | http://bjdleaksbrand=bpc bonprix%2F12.02&he=1024&location=pm;f=inbox;pmsg_1733/page.google                      | http://loveplanet.ru/url?sa=t&rct                                                                                                                                                                      | 0         | 12409             | 20              | 10093         | 22          | 1996            | 1666             | 37              | 15         | 7          | 700         | 0        | 0        | 22             | D�             | 1            | 1                | 0        | 0           |                  |        | 2059788     | -1             | 0              |                                    | 0           | 0           | 1261              | 1206               | 433            | 1372759478      | 0                   | 0                   | 0                   | 0                   | windows              | 1           | 0      | 0          | 0           | 0                   |             | 827020970  | 0            | 0       | 0           | 0             | 0        | 5        | 1372791236     | 0   | 0   | 0      | 0         | 0         | 2001459352  | -1         | -1         | -1            | S0              | �
                                                                                                                           |               |              | 0         | 0          | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 1384301141639030267  | 9047048983006699504  | 0    |
| 8614832219462424183 | 1          | Модель для сумки - регеш (Россия)                                                                                             | 1         | 1372713563 | 15888     | 3035      | 2022088895  | 38       | 2590751384199385434 | 1            | 2  | 88        | http://smeshariki.ru/googleTBR%26ar_ntype=citykurortmag                                                         | http://holodilnik.ru/GameMain.aspx?color=0&choos&source=web&cd                                                                                                                                         | 0         | 10271             | 158             | 13384         | 216         | 1917            | 879              | 37              | 15         | 7          | 700         | 0        | 0        | 1              | D�             | 1            | 1                | 0        | 0           |                  |        | 3991944     | -1             | 0              |                                    | 0           | 0           | 746               | 464                | 322            | 1372754670      | 0                   | 0                   | 0                   | 0                   | windows-1251;charset | 1           | 0      | 0          | 0           | 7607749204513951316 |             | 427646581  | 0            | 0       | 0           | 0             | 0        | 5        | 1372720757     | 50  | 2   | 3      | 0         | 30        | 1146019198  | -1         | -1         | -1            | S0              | �
                                                                                                                           |               |              | 0         | 0          | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | 1157471009075867478  | 1000799766482180932  | 0    |
| 7168314068394418899 | 1          | по полиция +опытовой рецензии,                                                                                                | 1         | 1372713760 | 15888     | 35534     | -1420082055 | 11579    | 4822773326251181180 | 0            | 2  | 7         | http:%2F%2Fsapozhki-advertime-2/#page.google/dodge                                                              | http://saint-peters-total=меньше 100007&text=b.akhua_deckaya-look/time-2/#page=3&oprnd=6817922197946&ei=JtHTUYWRCqXA&bvm=bv.49784469,d.ZWU&cad=rjt&fu=0&type_id=172&msid=1&marka=88&text=krasnaia-moda | 0         | 14550             | 952             | 8565          | 375         | 1304            | 978              | 37              | 15         | 4          | 700.224     | 2        | 7        | 13             | D�             | 1            | 1                | 0        | 0           |                  |        | 2675432     | 3              | 3              | dave kino 2013 года в ростопримеча | 0           | 0           | 1972              | 778                | 135            | 1372712707      | 4                   | 1                   | 16561               | 0                   | windows              | 1601        | 0      | 0          | 0           | 6494516778257365839 |             | 393719418  | 0            | 0       | 0           | 0             | 0        | 5        | 1372782490     | 31  | 2   | 2      | 14851     | 1         | -1016483843 | 61823      | -1         | 1             | S0              | �
                                                                                                                           |               |              | 0         | 0          | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | -4470345086215748575 | -5322637665780806659 | 0    |
| 8235569889353442646 | 1          |                                                                                                                               | 1         | 1372713773 | 15888     | 35534     | -1420082055 | 11579    | 4822773326251181180 | 0            | 2  | 7         | http:%2F%2Fsapozhki-advertime-2/#page.google/dodge                                                              |                                                                                                                                                                                                        | 0         | 0                 | 0               | 8565          | 375         | 1304            | 978              | 37              | 15         | 4          | 700.224     | 2        | 7        | 13             | D�             | 1            | 1                | 0        | 0           |                  |        | 2675432     | 0              | 0              |                                    | 0           | 1           | 1972              | 778                | 135            | 1372712722      | 4                   | 1                   | 16561               | 0                   | windows              | 1601        | 0      | 0          | 1           | 6494516778257365839 |             | 393719418  | 0            | 0       | 0           | 1             | 0        | 5        | 1372782504     | 31  | 2   | 2      | 14851     | 1         | -1016483843 | 61823      | -1         | 2             | S0              | �
                                                                                                                           |               |              | 0         | 318        | 0         | 0             | 0                   | 0                 | 0           | 0                     |                  | 0          |              | NH            | 0               |                     |                    |              |                  |           |           |             |            |         |         | 0        | -296158784638538920  | -5322637665780806659 | 0    |
+---------------------+------------+-------------------------------------------------------------------------------------------------------------------------------+-----------+------------+-----------+-----------+-------------+----------+---------------------+--------------+----+-----------+-----------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------+-------------------+-----------------+---------------+-------------+-----------------+------------------+-----------------+------------+------------+-------------+----------+----------+----------------+----------------+--------------+------------------+----------+-------------+------------------+--------+-------------+----------------+----------------+------------------------------------+-------------+-------------+-------------------+--------------------+----------------+-----------------+---------------------+---------------------+---------------------+---------------------+----------------------+-------------+--------+------------+-------------+---------------------+-------------+------------+--------------+---------+-------------+---------------+----------+----------+----------------+-----+-----+--------+-----------+-----------+-------------+------------+------------+---------------+-----------------+----------------+---------------+--------------+-----------+------------+-----------+---------------+---------------------+-------------------+-------------+-----------------------+------------------+------------+--------------+---------------+-----------------+---------------------+--------------------+--------------+------------------+-----------+-----------+-------------+------------+---------+---------+----------+----------------------+----------------------+------+
10 rows in set. Query took 94.913 seconds.


-----------------------------------------

25. SELECT "SearchPhrase" FROM hits WHERE "SearchPhrase" <> '' ORDER BY "EventTime" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+------------------------------------+
| SearchPhrase                       |
+------------------------------------+
| galaxy s4 zoom фильм               |
| фильм небольшой бизнеса североятно |
| ночно китая женщины                |
| симптомы регистратов               |
| компьютерапии серия нарий          |
| расписание мультиварка для         |
| отдыха чем прокат                  |
| брита ганам котлы на шерлок        |
| скачать читалию в духовке          |
| анапа оперевянные волшебную        |
+------------------------------------+
10 rows in set. Query took 4.393 seconds.


-----------------------------------------

26. SELECT "SearchPhrase" FROM hits WHERE "SearchPhrase" <> '' ORDER BY "SearchPhrase" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.045 seconds.
+-----------------------------------------+
| SearchPhrase                            |
+-----------------------------------------+
|  береж                                  |
|  за русский стил видео какой            |
|  завод тандалищные прода                |
|  заочное по земли в обрезни и метро     |
|  заочное сад цены нарощения музыка визу |
|  зве                                    |
|  земные огурцы раб                      |
|  золотой сайт samsung                   |
|  прав                                   |
|  светы женске 2 сезон                   |
+-----------------------------------------+
10 rows in set. Query took 10.834 seconds.


-----------------------------------------

27. SELECT "SearchPhrase" FROM hits WHERE "SearchPhrase" <> '' ORDER BY "EventTime", "SearchPhrase" LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.043 seconds.
+------------------------------------+
| SearchPhrase                       |
+------------------------------------+
| galaxy s4 zoom фильм               |
| ночно китая женщины                |
| симптомы регистратов               |
| фильм небольшой бизнеса североятно |
| авом констеть ребенка краево       |
| анапа оперевянные волшебную        |
| брита ганам котлы на шерлок        |
| компьютерапии серия нарий          |
| отдыха чем прокат                  |
| расписание мультиварка для         |
+------------------------------------+
10 rows in set. Query took 8.945 seconds.


-----------------------------------------

28. SELECT "CounterID", AVG(length("URL")) AS l, COUNT(*) AS c FROM hits WHERE "URL" <> '' GROUP BY "CounterID" HAVING COUNT(*) > 100000 ORDER BY l DESC LIMIT 25;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.044 seconds.
+-----------+--------------------+---------+
| CounterID | l                  | c       |
+-----------+--------------------+---------+
| 233773    | 453.1621381043362  | 2938865 |
| 245438    | 261.5559560703286  | 2510103 |
| 122612    | 230.6844119219688  | 3574007 |
| 234004    | 198.08934467443225 | 238660  |
| 1634      | 187.95619823716314 | 323229  |
| 786       | 180.36009060135405 | 120528  |
| 114157    | 139.11817030793685 | 216408  |
| 515       | 123.96619630106122 | 146907  |
| 256004    | 121.86098341705791 | 858171  |
| 95427     | 116.91913835204352 | 374306  |
| 199550    | 106.89178533979685 | 7115413 |
| 220992    | 103.75863804906453 | 494614  |
| 196239    | 95.01398682515553  | 163797  |
| 96948     | 92.1134607276574   | 396093  |
| 62        | 91.94268102689155  | 738150  |
| 188878    | 90.26380938339348  | 311998  |
| 249603    | 90.00927488053189  | 120325  |
| 3922      | 85.88639543083326  | 8527069 |
| 191697    | 85.03551145479048  | 124664  |
| 97467     | 82.76263550290444  | 131178  |
| 186300    | 82.05936495792844  | 802561  |
| 230962    | 74.73222907051642  | 169223  |
| 77639     | 74.65631730856313  | 253961  |
| 146891    | 74.13011535042938  | 605286  |
| 38        | 73.96797565827048  | 507770  |
+-----------+--------------------+---------+
25 rows in set. Query took 18.428 seconds.


-----------------------------------------

29. SELECT REGEXP_REPLACE("Referer", '^https?://(?:www.)?([^/]+)/.*$', '1') AS k, AVG(length("Referer")) AS l, COUNT(*) AS c, MIN("Referer") FROM hits WHERE "Referer" <> '' GROUP BY k HAVING COUNT(*) > 100000 ORDER BY l DESC LIMIT 25;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.056 seconds.
+-----------------------------------------------------------------------+-------------------+----------+-----------------------------------------------------------------------------------------------+
| k                                                                     | l                 | c        | MIN(hits.Referer)                                                                             |
+-----------------------------------------------------------------------+-------------------+----------+-----------------------------------------------------------------------------------------------+
| 1                                                                     | 81.60577248233396 | 66284655 | http://%26ad%3D1%25EA%25D0%26utm_source=web&cd=19590&input_onlist/би-2 место будущей кондицин |
| http:%2F%2Fwwww.regnancies/search&evL8gE&where=all&filmId=bEmYZc_WTDE | 69                | 207347   | http:%2F%2Fwwww.regnancies/search&evL8gE&where=all&filmId=bEmYZc_WTDE                         |
| http://loveche.html?ctid                                              | 24                | 144901   | http://loveche.html?ctid                                                                      |
| http://rukodeliveresult                                               | 23                | 226135   | http://rukodeliveresult                                                                       |
| http://holodilnik.ru                                                  | 20                | 133893   | http://holodilnik.ru                                                                          |
| http://smeshariki.ru                                                  | 20                | 210736   | http://smeshariki.ru                                                                          |
| http:%2F%2Fviewtopic                                                  | 20                | 391115   | http:%2F%2Fviewtopic                                                                          |
| http:%2F%2Fwwww.ukr                                                   | 19                | 655178   | http:%2F%2Fwwww.ukr                                                                           |
| http://новострашная                                                   | 19                | 731499   | http://новострашная                                                                           |
| http:%2F%2FviewType                                                   | 19                | 148907   | http:%2F%2FviewType                                                                           |
| http://state=2008                                                     | 17                | 139630   | http://state=2008                                                                             |
+-----------------------------------------------------------------------+-------------------+----------+-----------------------------------------------------------------------------------------------+
11 rows in set. Query took 524.286 seconds.


-----------------------------------------

30. SELECT SUM("ResolutionWidth"), SUM("ResolutionWidth" + 1), SUM("ResolutionWidth" + 2), SUM("ResolutionWidth" + 3), SUM("ResolutionWidth" + 4), SUM("ResolutionWidth" + 5), SUM("ResolutionWidth" + 6), SUM("ResolutionWidth" + 7), SUM("ResolutionWidth" + 8), SUM("ResolutionWidth" + 9), SUM("ResolutionWidth" + 10), SUM("ResolutionWidth" + 11), SUM("ResolutionWidth" + 12), SUM("ResolutionWidth" + 13), SUM("ResolutionWidth" + 14), SUM("ResolutionWidth" + 15), SUM("ResolutionWidth" + 16), SUM("ResolutionWidth" + 17), SUM("ResolutionWidth" + 18), SUM("ResolutionWidth" + 19), SUM("ResolutionWidth" + 20), SUM("ResolutionWidth" + 21), SUM("ResolutionWidth" + 22), SUM("ResolutionWidth" + 23), SUM("ResolutionWidth" + 24), SUM("ResolutionWidth" + 25), SUM("ResolutionWidth" + 26), SUM("ResolutionWidth" + 27), SUM("ResolutionWidth" + 28), SUM("ResolutionWidth" + 29), SUM("ResolutionWidth" + 30), SUM("ResolutionWidth" + 31), SUM("ResolutionWidth" + 32), SUM("ResolutionWidth" + 33), SUM("ResolutionWidth" + 34), SUM("ResolutionWidth" + 35), SUM("ResolutionWidth" + 36), SUM("ResolutionWidth" + 37), SUM("ResolutionWidth" + 38), SUM("ResolutionWidth" + 39), SUM("ResolutionWidth" + 40), SUM("ResolutionWidth" + 41), SUM("ResolutionWidth" + 42), SUM("ResolutionWidth" + 43), SUM("ResolutionWidth" + 44), SUM("ResolutionWidth" + 45), SUM("ResolutionWidth" + 46), SUM("ResolutionWidth" + 47), SUM("ResolutionWidth" + 48), SUM("ResolutionWidth" + 49), SUM("ResolutionWidth" + 50), SUM("ResolutionWidth" + 51), SUM("ResolutionWidth" + 52), SUM("ResolutionWidth" + 53), SUM("ResolutionWidth" + 54), SUM("ResolutionWidth" + 55), SUM("ResolutionWidth" + 56), SUM("ResolutionWidth" + 57), SUM("ResolutionWidth" + 58), SUM("ResolutionWidth" + 59), SUM("ResolutionWidth" + 60), SUM("ResolutionWidth" + 61), SUM("ResolutionWidth" + 62), SUM("ResolutionWidth" + 63), SUM("ResolutionWidth" + 64), SUM("ResolutionWidth" + 65), SUM("ResolutionWidth" + 66), SUM("ResolutionWidth" + 67), SUM("ResolutionWidth" + 68), SUM("ResolutionWidth" + 69), SUM("ResolutionWidth" + 70), SUM("ResolutionWidth" + 71), SUM("ResolutionWidth" + 72), SUM("ResolutionWidth" + 73), SUM("ResolutionWidth" + 74), SUM("ResolutionWidth" + 75), SUM("ResolutionWidth" + 76), SUM("ResolutionWidth" + 77), SUM("ResolutionWidth" + 78), SUM("ResolutionWidth" + 79), SUM("ResolutionWidth" + 80), SUM("ResolutionWidth" + 81), SUM("ResolutionWidth" + 82), SUM("ResolutionWidth" + 83), SUM("ResolutionWidth" + 84), SUM("ResolutionWidth" + 85), SUM("ResolutionWidth" + 86), SUM("ResolutionWidth" + 87), SUM("ResolutionWidth" + 88), SUM("ResolutionWidth" + 89) FROM hits;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.089 seconds.
+---------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+
| SUM(hits.ResolutionWidth) | SUM(hits.ResolutionWidth Plus Int64(1)) | SUM(hits.ResolutionWidth Plus Int64(2)) | SUM(hits.ResolutionWidth Plus Int64(3)) | SUM(hits.ResolutionWidth Plus Int64(4)) | SUM(hits.ResolutionWidth Plus Int64(5)) | SUM(hits.ResolutionWidth Plus Int64(6)) | SUM(hits.ResolutionWidth Plus Int64(7)) | SUM(hits.ResolutionWidth Plus Int64(8)) | SUM(hits.ResolutionWidth Plus Int64(9)) | SUM(hits.ResolutionWidth Plus Int64(10)) | SUM(hits.ResolutionWidth Plus Int64(11)) | SUM(hits.ResolutionWidth Plus Int64(12)) | SUM(hits.ResolutionWidth Plus Int64(13)) | SUM(hits.ResolutionWidth Plus Int64(14)) | SUM(hits.ResolutionWidth Plus Int64(15)) | SUM(hits.ResolutionWidth Plus Int64(16)) | SUM(hits.ResolutionWidth Plus Int64(17)) | SUM(hits.ResolutionWidth Plus Int64(18)) | SUM(hits.ResolutionWidth Plus Int64(19)) | SUM(hits.ResolutionWidth Plus Int64(20)) | SUM(hits.ResolutionWidth Plus Int64(21)) | SUM(hits.ResolutionWidth Plus Int64(22)) | SUM(hits.ResolutionWidth Plus Int64(23)) | SUM(hits.ResolutionWidth Plus Int64(24)) | SUM(hits.ResolutionWidth Plus Int64(25)) | SUM(hits.ResolutionWidth Plus Int64(26)) | SUM(hits.ResolutionWidth Plus Int64(27)) | SUM(hits.ResolutionWidth Plus Int64(28)) | SUM(hits.ResolutionWidth Plus Int64(29)) | SUM(hits.ResolutionWidth Plus Int64(30)) | SUM(hits.ResolutionWidth Plus Int64(31)) | SUM(hits.ResolutionWidth Plus Int64(32)) | SUM(hits.ResolutionWidth Plus Int64(33)) | SUM(hits.ResolutionWidth Plus Int64(34)) | SUM(hits.ResolutionWidth Plus Int64(35)) | SUM(hits.ResolutionWidth Plus Int64(36)) | SUM(hits.ResolutionWidth Plus Int64(37)) | SUM(hits.ResolutionWidth Plus Int64(38)) | SUM(hits.ResolutionWidth Plus Int64(39)) | SUM(hits.ResolutionWidth Plus Int64(40)) | SUM(hits.ResolutionWidth Plus Int64(41)) | SUM(hits.ResolutionWidth Plus Int64(42)) | SUM(hits.ResolutionWidth Plus Int64(43)) | SUM(hits.ResolutionWidth Plus Int64(44)) | SUM(hits.ResolutionWidth Plus Int64(45)) | SUM(hits.ResolutionWidth Plus Int64(46)) | SUM(hits.ResolutionWidth Plus Int64(47)) | SUM(hits.ResolutionWidth Plus Int64(48)) | SUM(hits.ResolutionWidth Plus Int64(49)) | SUM(hits.ResolutionWidth Plus Int64(50)) | SUM(hits.ResolutionWidth Plus Int64(51)) | SUM(hits.ResolutionWidth Plus Int64(52)) | SUM(hits.ResolutionWidth Plus Int64(53)) | SUM(hits.ResolutionWidth Plus Int64(54)) | SUM(hits.ResolutionWidth Plus Int64(55)) | SUM(hits.ResolutionWidth Plus Int64(56)) | SUM(hits.ResolutionWidth Plus Int64(57)) | SUM(hits.ResolutionWidth Plus Int64(58)) | SUM(hits.ResolutionWidth Plus Int64(59)) | SUM(hits.ResolutionWidth Plus Int64(60)) | SUM(hits.ResolutionWidth Plus Int64(61)) | SUM(hits.ResolutionWidth Plus Int64(62)) | SUM(hits.ResolutionWidth Plus Int64(63)) | SUM(hits.ResolutionWidth Plus Int64(64)) | SUM(hits.ResolutionWidth Plus Int64(65)) | SUM(hits.ResolutionWidth Plus Int64(66)) | SUM(hits.ResolutionWidth Plus Int64(67)) | SUM(hits.ResolutionWidth Plus Int64(68)) | SUM(hits.ResolutionWidth Plus Int64(69)) | SUM(hits.ResolutionWidth Plus Int64(70)) | SUM(hits.ResolutionWidth Plus Int64(71)) | SUM(hits.ResolutionWidth Plus Int64(72)) | SUM(hits.ResolutionWidth Plus Int64(73)) | SUM(hits.ResolutionWidth Plus Int64(74)) | SUM(hits.ResolutionWidth Plus Int64(75)) | SUM(hits.ResolutionWidth Plus Int64(76)) | SUM(hits.ResolutionWidth Plus Int64(77)) | SUM(hits.ResolutionWidth Plus Int64(78)) | SUM(hits.ResolutionWidth Plus Int64(79)) | SUM(hits.ResolutionWidth Plus Int64(80)) | SUM(hits.ResolutionWidth Plus Int64(81)) | SUM(hits.ResolutionWidth Plus Int64(82)) | SUM(hits.ResolutionWidth Plus Int64(83)) | SUM(hits.ResolutionWidth Plus Int64(84)) | SUM(hits.ResolutionWidth Plus Int64(85)) | SUM(hits.ResolutionWidth Plus Int64(86)) | SUM(hits.ResolutionWidth Plus Int64(87)) | SUM(hits.ResolutionWidth Plus Int64(88)) | SUM(hits.ResolutionWidth Plus Int64(89)) |
+---------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+
| 151345005230              | 151445002727                            | 151545000224                            | 151644997721                            | 151744995218                            | 151844992715                            | 151944990212                            | 152044987709                            | 152144985206                            | 152244982703                            | 152344980200                             | 152444977697                             | 152544975194                             | 152644972691                             | 152744970188                             | 152844967685                             | 152944965182                             | 153044962679                             | 153144960176                             | 153244957673                             | 153344955170                             | 153444952667                             | 153544950164                             | 153644947661                             | 153744945158                             | 153844942655                             | 153944940152                             | 154044937649                             | 154144935146                             | 154244932643                             | 154344930140                             | 154444927637                             | 154544925134                             | 154644922631                             | 154744920128                             | 154844917625                             | 154944915122                             | 155044912619                             | 155144910116                             | 155244907613                             | 155344905110                             | 155444902607                             | 155544900104                             | 155644897601                             | 155744895098                             | 155844892595                             | 155944890092                             | 156044887589                             | 156144885086                             | 156244882583                             | 156344880080                             | 156444877577                             | 156544875074                             | 156644872571                             | 156744870068                             | 156844867565                             | 156944865062                             | 157044862559                             | 157144860056                             | 157244857553                             | 157344855050                             | 157444852547                             | 157544850044                             | 157644847541                             | 157744845038                             | 157844842535                             | 157944840032                             | 158044837529                             | 158144835026                             | 158244832523                             | 158344830020                             | 158444827517                             | 158544825014                             | 158644822511                             | 158744820008                             | 158844817505                             | 158944815002                             | 159044812499                             | 159144809996                             | 159244807493                             | 159344804990                             | 159444802487                             | 159544799984                             | 159644797481                             | 159744794978                             | 159844792475                             | 159944789972                             | 160044787469                             | 160144784966                             | 160244782463                             |
+---------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+-----------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+------------------------------------------+
1 row in set. Query took 5.443 seconds.


-----------------------------------------

31. SELECT "SearchEngineID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits WHERE "SearchPhrase" <> '' GROUP BY "SearchEngineID", "ClientIP" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.088 seconds.
+----------------+-------------+------+---------------------+---------------------------+
| SearchEngineID | ClientIP    | c    | SUM(hits.IsRefresh) | AVG(hits.ResolutionWidth) |
+----------------+-------------+------+---------------------+---------------------------+
| 2              | 1138507705  | 1633 | 35                  | 1408.0122473974282        |
| 2              | 1740861572  | 1331 | 28                  | 1577.945905334335         |
| 2              | -807147100  | 1144 | 35                  | 1553.1984265734266        |
| 2              | -497906719  | 1140 | 36                  | 1543.4140350877192        |
| 2              | -1945757555 | 1105 | 30                  | 1557.387330316742         |
| 2              | -1870623097 | 1102 | 31                  | 1555.6588021778584        |
| 2              | -631062503  | 1083 | 31                  | 1581.8171745152354        |
| 2              | -465813166  | 1082 | 30                  | 1541.253234750462         |
| 2              | -1743596151 | 1080 | 24                  | 1559.8092592592593        |
| 2              | -265917476  | 1058 | 32                  | 1556.2003780718337        |
+----------------+-------------+------+---------------------+---------------------------+
10 rows in set. Query took 12.592 seconds.


-----------------------------------------

32. SELECT "WatchID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits WHERE "SearchPhrase" <> '' GROUP BY "WatchID", "ClientIP" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.076 seconds.
+---------------------+------------+---+---------------------+---------------------------+
| WatchID             | ClientIP   | c | SUM(hits.IsRefresh) | AVG(hits.ResolutionWidth) |
+---------------------+------------+---+---------------------+---------------------------+
| 7500197462664662884 | -942360504 | 1 | 0                   | 1638                      |
| 6530598365228916139 | -700066770 | 1 | 1                   | 1087                      |
| 5214403807526090997 | -398190856 | 1 | 1                   | 1996                      |
| 6321168877747267465 | 1387060373 | 1 | 0                   | 1750                      |
| 7938338852364081697 | 2007109720 | 1 | 0                   | 1638                      |
| 8943886936488772159 | 1525146979 | 1 | 1                   | 1996                      |
| 6207165032700377345 | 1510096176 | 1 | 0                   | 1917                      |
| 7180871017090045125 | 1975282815 | 1 | 0                   | 1638                      |
| 8749146892100238967 | 1975282815 | 1 | 1                   | 1638                      |
| 8534638425206222132 | 1788883883 | 1 | 0                   | 1638                      |
+---------------------+------------+---+---------------------+---------------------------+
10 rows in set. Query took 14.265 seconds.


-----------------------------------------

33. SELECT "WatchID", "ClientIP", COUNT(*) AS c, SUM("IsRefresh"), AVG("ResolutionWidth") FROM hits GROUP BY "WatchID", "ClientIP" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.076 seconds.
+---------------------+-------------+---+---------------------+---------------------------+
| WatchID             | ClientIP    | c | SUM(hits.IsRefresh) | AVG(hits.ResolutionWidth) |
+---------------------+-------------+---+---------------------+---------------------------+
| 7904046282518428963 | 1509330109  | 2 | 0                   | 1368                      |
| 8566928176839891583 | -1402644643 | 2 | 0                   | 1368                      |
| 7224410078130478461 | -776509581  | 2 | 0                   | 1368                      |
| 6655575552203051303 | 1611957945  | 2 | 0                   | 1638                      |
| 6062017689828794817 | 1990333510  | 1 | 0                   | 582                       |
| 7779920521242111037 | -640509850  | 1 | 1                   | 1917                      |
| 8048621148955107892 | -640509850  | 1 | 0                   | 1917                      |
| 8720852217270762116 | -645185747  | 1 | 0                   | 1750                      |
| 5022242610097151281 | -645185747  | 1 | 1                   | 1750                      |
| 8940839235588571584 | -645185747  | 1 | 0                   | 1750                      |
+---------------------+-------------+---+---------------------+---------------------------+
10 rows in set. Query took 90.736 seconds.


-----------------------------------------

34. SELECT "URL", COUNT(*) AS c FROM hits GROUP BY "URL" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.078 seconds.
+-------------------------------------------------------+---------+
| URL                                                   | c       |
+-------------------------------------------------------+---------+
| http://liver.ru/belgorod/page/1006.jки/доп_приборы    | 3288173 |
| http://kinopoisk.ru                                   | 1625250 |
| http://bdsm_po_yers=0&with_video                      | 791465  |
| http://video.yandex                                   | 582400  |
| http://smeshariki.ru/region                           | 514984  |
| http://auto_fiat_dlya-bluzki%2F8536.30.18&he=900&with | 507995  |
| http://liver.ru/place_rukodel=365115eb7bbb90          | 359893  |
| http://kinopoisk.ru/vladimir.irr.ru                   | 354690  |
| http://video.yandex.ru/search/?jenre=50&s_yers        | 318979  |
| http://tienskaia-moda                                 | 289355  |
+-------------------------------------------------------+---------+
10 rows in set. Query took 34.940 seconds.


-----------------------------------------

35. SELECT 1, "URL", COUNT(*) AS c FROM hits GROUP BY 1, "URL" ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.061 seconds.
+----------+-------------------------------------------------------+---------+
| Int64(1) | URL                                                   | c       |
+----------+-------------------------------------------------------+---------+
| 1        | http://liver.ru/belgorod/page/1006.jки/доп_приборы    | 3288173 |
| 1        | http://kinopoisk.ru                                   | 1625250 |
| 1        | http://bdsm_po_yers=0&with_video                      | 791465  |
| 1        | http://video.yandex                                   | 582400  |
| 1        | http://smeshariki.ru/region                           | 514984  |
| 1        | http://auto_fiat_dlya-bluzki%2F8536.30.18&he=900&with | 507995  |
| 1        | http://liver.ru/place_rukodel=365115eb7bbb90          | 359893  |
| 1        | http://kinopoisk.ru/vladimir.irr.ru                   | 354690  |
| 1        | http://video.yandex.ru/search/?jenre=50&s_yers        | 318979  |
| 1        | http://tienskaia-moda                                 | 289355  |
+----------+-------------------------------------------------------+---------+
10 rows in set. Query took 32.645 seconds.


-----------------------------------------

36. SELECT "ClientIP", "ClientIP" - 1, "ClientIP" - 2, "ClientIP" - 3, COUNT(*) AS c FROM hits GROUP BY "ClientIP", "ClientIP" - 1, "ClientIP" - 2, "ClientIP" - 3 ORDER BY c DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.062 seconds.
+-------------+------------------------------+------------------------------+------------------------------+-------+
| ClientIP    | hits.ClientIP Minus Int64(1) | hits.ClientIP Minus Int64(2) | hits.ClientIP Minus Int64(3) | c     |
+-------------+------------------------------+------------------------------+------------------------------+-------+
| -39921974   | -39921975                    | -39921976                    | -39921977                    | 47008 |
| -1698104457 | -1698104458                  | -1698104459                  | -1698104460                  | 29121 |
| -1175819552 | -1175819553                  | -1175819554                  | -1175819555                  | 25333 |
| 1696638182  | 1696638181                   | 1696638180                   | 1696638179                   | 20220 |
| 1138507705  | 1138507704                   | 1138507703                   | 1138507702                   | 15778 |
| -927025522  | -927025523                   | -927025524                   | -927025525                   | 12768 |
| -1262139876 | -1262139877                  | -1262139878                  | -1262139879                  | 11348 |
| 1740861572  | 1740861571                   | 1740861570                   | 1740861569                   | 11314 |
| -807147100  | -807147101                   | -807147102                   | -807147103                   | 9880  |
| -631062503  | -631062504                   | -631062505                   | -631062506                   | 9718  |
+-------------+------------------------------+------------------------------+------------------------------+-------+
10 rows in set. Query took 7.001 seconds.


-----------------------------------------

37. SELECT "URL", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "DontCountHits" = 0 AND "IsRefresh" = 0 AND "URL" <> '' GROUP BY "URL" ORDER BY PageViews DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.067 seconds.
0 rows in set. Query took 0.077 seconds.


-----------------------------------------

38. SELECT "Title", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "DontCountHits" = 0 AND "IsRefresh" = 0 AND "Title" <> '' GROUP BY "Title" ORDER BY PageViews DESC LIMIT 10;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.067 seconds.
0 rows in set. Query took 0.075 seconds.


-----------------------------------------

39. SELECT "URL", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 AND "IsLink" <> 0 AND "IsDownload" = 0 GROUP BY "URL" ORDER BY PageViews DESC LIMIT 10 OFFSET 1000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.067 seconds.
0 rows in set. Query took 0.076 seconds.


-----------------------------------------

40. SELECT "TraficSourceID", "SearchEngineID", "AdvEngineID", CASE WHEN ("SearchEngineID" = 0 AND "AdvEngineID" = 0) THEN "Referer" ELSE '' END AS Src, "URL" AS Dst, COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 GROUP BY "TraficSourceID", "SearchEngineID", "AdvEngineID", Src, Dst ORDER BY PageViews DESC LIMIT 10 OFFSET 1000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.066 seconds.
0 rows in set. Query took 0.081 seconds.


-----------------------------------------

41. SELECT "URLHash", "EventDate", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 AND "TraficSourceID" IN (-1, 6) AND "RefererHash" = 3594120000172545465 GROUP BY "URLHash", "EventDate" ORDER BY PageViews DESC LIMIT 10 OFFSET 100;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.067 seconds.
0 rows in set. Query took 0.078 seconds.


-----------------------------------------

42. SELECT "WindowClientWidth", "WindowClientHeight", COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-01' AND "EventDate" <= '2013-07-31' AND "IsRefresh" = 0 AND "DontCountHits" = 0 AND "URLHash" = 2868770270353813622 GROUP BY "WindowClientWidth", "WindowClientHeight" ORDER BY PageViews DESC LIMIT 10 OFFSET 10000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.068 seconds.
0 rows in set. Query took 0.076 seconds.


-----------------------------------------

43. SELECT DATE_TRUNC('minute', "EventTime") AS M, COUNT(*) AS PageViews FROM hits WHERE "CounterID" = 62 AND "EventDate" >= '2013-07-14' AND "EventDate" <= '2013-07-15' AND "IsRefresh" = 0 AND "DontCountHits" = 0 GROUP BY DATE_TRUNC('minute', "EventTime") ORDER BY DATE_TRUNC('minute', "EventTime") LIMIT 10 OFFSET 1000;

-----------------------------------------


DataFusion CLI v10.0.0
0 rows in set. Query took 0.066 seconds.
Plan("Coercion from [Utf8, Int64] to the signature Exact([Utf8, Timestamp(Nanosecond, None)]) failed.")

@andygrove
Copy link
Member Author

This is fantastic work @waitingkuo. Thank you for working on this!

@waitingkuo
Copy link
Contributor

@andygrove datafusion is added now https://benchmark.clickhouse.com/ the pr is to add readme to reproduce the result. I think we can close this now

@alamb alamb closed this as completed Sep 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants