Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Doris on ES by HTTP way #925

Merged
merged 73 commits into from
Apr 28, 2019
Merged

Doris on ES by HTTP way #925

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
73 commits
Select commit Hold shift + click to select a range
9406207
Add Elasticsearch scan reader (#802)
wuyunfeng Mar 25, 2019
5232bd4
Introduce ES http scan node (#807)
lide-reed Mar 25, 2019
88ff41f
Moidfy scan interface (#809)
wuyunfeng Mar 25, 2019
473739f
Bug-fix for some wrong logic (#810)
wuyunfeng Mar 25, 2019
40891a5
Introduce ExtLiteral and revise interface with reader (#813)
lide-reed Mar 26, 2019
519472e
Modify ESScanReader::get_next and ScrollParser
lide-reed Mar 26, 2019
e893d36
Add fill_tuple to ScrollParser
lide-reed Mar 26, 2019
d1f679d
Add member functions to ExtLiteral
lide-reed Mar 27, 2019
231b9fd
Add value_to_string in ExtLiteral
lide-reed Mar 27, 2019
70f3fa0
Fix some issues
lide-reed Mar 27, 2019
9049dc9
Improve EsPredicate related structures
lide-reed Mar 28, 2019
9799c80
Fix some issues and query successfully
lide-reed Mar 28, 2019
34efebb
Ignore new_filter_in when pushing down
lide-reed Apr 1, 2019
8387dba
Add PushDown filters for predicates
wuyunfeng Apr 1, 2019
db1434f
Add virtual destructor and delete unused variable
wuyunfeng Apr 1, 2019
34bb6a3
Bug-fix for empty predicates
wuyunfeng Apr 1, 2019
1bb8ad5
Fix some issues for predicate
lide-reed Apr 1, 2019
2331dd2
Change local used variable
wuyunfeng Apr 1, 2019
85543e2
Bug-fix: add semicolon for builder
wuyunfeng Apr 1, 2019
be7748f
Modify UT and add comment to builder
wuyunfeng Apr 1, 2019
6b56de6
Bug-fix for CMake
wuyunfeng Apr 2, 2019
1510741
Replace es_query with esquery
wuyunfeng Apr 2, 2019
06bda8e
Change to pass predicates
lide-reed Apr 3, 2019
2d4a784
Modify doris-fe support http transport mode
wuyunfeng Apr 3, 2019
8c2cd7d
Simplify processing esquery
wuyunfeng Apr 4, 2019
1d1ebde
Modify some errors
wuyunfeng Apr 4, 2019
19386e9
Add unit tests for EsHttpScanNode and EsPredicate
lide-reed Apr 8, 2019
2ca72e9
Modify some FE error and Add predicate validator for BE
wuyunfeng Apr 8, 2019
78d3a35
Delete unuseful debug log
wuyunfeng Apr 8, 2019
a225df2
Change reference for check_es_query
wuyunfeng Apr 8, 2019
784e55a
Process conjuncts to ES and doris respectively
lide-reed Apr 8, 2019
d35f437
Pushdown Like, Date and DateTime predicate to ES
lide-reed Apr 8, 2019
18b50a5
Fix shards to _shards in ESScanReader
lide-reed Apr 9, 2019
59d1ac2
Fix multithreads for EsHttpScanNode
lide-reed Apr 9, 2019
7e3f620
Add error status when data has an array in EsScrollParser
lide-reed Apr 9, 2019
bb02355
Modify FE request logic and resolve http 401 problem
wuyunfeng Apr 11, 2019
a29bde8
Modify FE request logic and resolve http 401 problem
wuyunfeng Apr 11, 2019
178f4bf
Introduce is_literal_node() to avoid get_value failure
lide-reed Apr 12, 2019
5e339bc
Fix an error that send request with empty scroll_id
lide-reed Apr 12, 2019
73d0b62
Fix a bug when converting int8_t to string
lide-reed Apr 15, 2019
40e8d2d
Return status for scanner thread of EsHttpScanner
lide-reed Apr 15, 2019
e87eee6
Fix a bug of predicate when it includes is_not_in statement
lide-reed Apr 16, 2019
53ed7b4
Fix a bug in value_to_string() by introducing to_string()
lide-reed Apr 16, 2019
f2a8c17
Fix date issue in hash join
lide-reed Apr 17, 2019
b4bfbc7
Add http client error logic for response callback and add some test t…
wuyunfeng Apr 18, 2019
1d38204
Add http client error logic for response callback and add some test t…
wuyunfeng Apr 18, 2019
32e7d9e
Improve error prompt when query from ES server
lide-reed Apr 18, 2019
dc83173
Add http client error logic for response callback and add some test t…
wuyunfeng Apr 18, 2019
8c89ada
Update http client test
lide-reed Apr 18, 2019
b7456b4
Add missed license head and align code
lide-reed Apr 18, 2019
5442f64
Adjust some code format
lide-reed Apr 18, 2019
73b5f0a
Improve the readability of code by adding const
lide-reed Apr 19, 2019
a79f38e
Optimize es_query_builder function call
wuyunfeng Apr 19, 2019
290af1c
Fix some format issues
lide-reed Apr 22, 2019
be5be89
Fix a bug when show a ES table
lide-reed Apr 22, 2019
a0323e7
Relocate es related source
wuyunfeng Apr 23, 2019
3fa5b1c
Optimize codes
lide-reed Apr 23, 2019
b23a5d3
Optimize some codes
lide-reed Apr 23, 2019
df2a7e0
Adjust unit test ES http related accordingly
lide-reed Apr 23, 2019
dedbda5
Adjust unit test ES http related accordingly
lide-reed Apr 24, 2019
10d6f97
Reconstruct ScrollParser
lide-reed Apr 24, 2019
6b7b405
Change build_disjuncts_list to return error message
lide-reed Apr 24, 2019
7431d34
Fix a memory leak in ESScanReader
lide-reed Apr 24, 2019
15fada7
Avoid memory issue by introducing unique_ptr
lide-reed Apr 24, 2019
29a6b4d
Fix unit test accordingly
lide-reed Apr 25, 2019
fc6a955
Supress ASAN error
lide-reed Apr 25, 2019
bac4634
Supress ASAN error
lide-reed Apr 25, 2019
b997c7c
Add missed delete
lide-reed Apr 25, 2019
0d492fa
Fix a memory issue
lide-reed Apr 25, 2019
c215fba
Introduce expr_without_cast() â
lide-reed Apr 28, 2019
b97ac21
Add reference for for-each (#1055)
wuyunfeng Apr 28, 2019
0c9e00e
Remove obsolete code
Apr 28, 2019
28c9162
Fix a issue introduced by rebase conflict
Apr 28, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions be/src/exec/CMakeLists.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,13 @@ set(EXEC_FILES
csv_scan_node.cpp
csv_scanner.cpp
es_scan_node.cpp
es_http_scan_node.cpp
es_http_scanner.cpp
es/es_predicate.cpp
es/es_scan_reader.cpp
es/es_scroll_query.cpp
es/es_scroll_parser.cpp
es/es_query_builder.cpp
spill_sort_node.cc
union_node.cpp
union_node_ir.cpp
Expand Down Expand Up @@ -101,6 +108,8 @@ add_library(Exec STATIC
)

# TODO: why is this test disabled?
#ADD_BE_TEST(es/es_query_builder_test)
#ADD_BE_TEST(es/es_scan_reader_test)
#ADD_BE_TEST(new_olap_scan_node_test)
#ADD_BE_TEST(pre_aggregation_node_test)
#ADD_BE_TEST(hash_table_test)
Expand Down
Loading