[fix](exchange) deadlock issue in exchange opeartor#41920
Closed
mrhhsg wants to merge 4349 commits intoapache:masterfrom
Closed
[fix](exchange) deadlock issue in exchange opeartor#41920mrhhsg wants to merge 4349 commits intoapache:masterfrom
mrhhsg wants to merge 4349 commits intoapache:masterfrom
Conversation
…pache#41289) (apache#41424) ## Proposed changes pick from master apache#41289 <!--Describe your changes.-->
…pache#41423) ## Proposed changes pick from master apache#41373 <!--Describe your changes.-->
…k because of incompatibility with new audit plugin (apache#40565) (apache#41400) bp apache#40565 Co-authored-by: caiconghui <55968745+caiconghui@users.noreply.github.com> Co-authored-by: caiconghui1 <caiconghui1@jd.com>
…s evaluate logic apache#38908 (apache#41385) cherry pick from apache#38908
… empty (apache#41438) serialization object with empty subcolumns may lost num_rows, so need to record num_rows and set back num_rows in serdes backport apache#38413
…nt_github_events_p2 apache#40957 (apache#41443) cherry pick from apache#40957
…rformace and remove useless code apache#40600 (apache#41442) cherry pick from apache#40600
…on array index apache#40907 (apache#41444) cherry pick from apache#40907
…alize compound and match predicate apache#40232 (apache#41449) cherry pick from apache#40232
…factor apache#40324 (apache#41440) cherry pick from apache#40324
…nverted index apache#40258 (apache#41448) cherry pick from apache#40258
…40802) (apache#41474) ## Proposed changes pick: apache#40802
…operation for 2.1 (apache#40440) (apache#41479) bp: apache#40440
…ery sql apache#40355 (apache#41445) cherry pick from apache#40355
…segments apache#41363 (apache#41452) cherry pick from apache#41363
…pache#40742) (apache#41470) ## Proposed changes pick: apache#40742
…plan should not check privilege (apache#40374) (apache#41450) ## Proposed changes pr: apache#40374 commitId: f3d92e4
…1021) ## Proposed changes Issue Number: close #xxx <!--Describe your changes.--> ## Proposed changes Issue Number: close #xxx <!--Describe your changes.-->
…che#41484) ## Proposed changes Backport apache#40641
…1483) ## Proposed changes Backport apache#41281
…compression max input size limit (apache#41239)" (apache#41505) ## Proposed changes LZ4 compression max supported value is LZ4_MAX_INPUT_SIZE, which is 0x7E000000(2,113,929,216 bytes). Doris use wrong max size INT_MAX, which is 2,147,483,647, to check. If input data size is between this two size, then it can pass the check but LZ4 compression will fail. This PR fix it. <!--Describe your changes.--> ## Proposed changes Issue Number: close #xxx <!--Describe your changes.-->
…e it will encoding Backend Info (apache#41515) (apache#41522) Should use status to generate protobuf message, because it will encoding Backend Info ## Proposed changes Issue Number: close #xxx <!--Describe your changes.-->
…ete job timeout (apache#41063) (apache#41475) ## Proposed changes pick: apache#41063
…t fully reported. (return -1) (apache#42209) (apache#42407) backport: apache#42209
…he#41775) (apache#42432) apache#41775 Co-authored-by: Mryange <59914473+Mryange@users.noreply.github.com>
…talog is dropped. (apache#42244) (apache#42410) backport: apache#42244
…transaction failed (apache#41946) (apache#42265) pick (apache#41946) Set NumberLoadedRows to zero when stream load failed. before: ``` stream load result: { "TxnId": 8589, "Label": "c8e7c4fe-56b2-4e3b-b4cc-4f2a94cdd003", "Comment": "", "TwoPhaseCommit": "false", "Status": "Fail", "Message": "[DATA_QUALITY_ERROR]too many filtered rows", "NumberTotalRows": 3, "NumberLoadedRows": 1, "NumberFilteredRows": 2, "NumberUnselectedRows": 0, "LoadBytes": 77, "LoadTimeMs": 78, "BeginTxnTimeMs": 0, "StreamLoadPutTimeMs": 4, "ReadDataTimeMs": 0, "WriteDataTimeMs": 72, "ReceiveDataTimeMs": 7, "CommitAndPublishTimeMs": 0, "ErrorURL": "XXX" } ``` now: ``` stream load result: { "TxnId": 8589, "Label": "c8e7c4fe-56b2-4e3b-b4cc-4f2a94cdd003", "Comment": "", "TwoPhaseCommit": "false", "Status": "Fail", "Message": "[DATA_QUALITY_ERROR]too many filtered rows", "NumberTotalRows": 3, "NumberLoadedRows": 0, "NumberFilteredRows": 2, "NumberUnselectedRows": 0, "LoadBytes": 77, "LoadTimeMs": 78, "BeginTxnTimeMs": 0, "StreamLoadPutTimeMs": 4, "ReadDataTimeMs": 0, "WriteDataTimeMs": 72, "ReceiveDataTimeMs": 7, "CommitAndPublishTimeMs": 0, "ErrorURL": "XXX" } ```
… audit log. apache#41993 (apache#42137) cherry pick from apache#41993
…t with empty strings during schema change (apache#41064) (apache#42427) ``` insert into t1 (k1, k2, v1) value(1, '', 2); delete form t1 where k1 = 1 and k2 = ''; alter table modify column v1 string select * from t1 // expect 0 rows in return, but get 1 row. ```
mrhhsg
force-pushed
the
fix_exchange
branch
2 times, most recently
from
4f7de66 to
719fd11
Compare
…le jdbc connection pool" (apache#42481) Reverts apache#42255 We have found that after closing the connection pool, there will be class loading problems and connection release problems for some data sources. We will remove this function first and re-add it after solving and testing it completely.
## Proposed changes pick apache#39991 apache#39374 apache#36663
come from: apache#39036 Crash stack: ``` (gdb) bt #0 0x00007ff5c8c6c387 in raise () from /lib64/libc.so.6 apache#1 0x00007ff5c8c6da78 in abort () from /lib64/libc.so.6 apache#2 0x0000561eb0a5e38a in __gnu_cxx::__verbose_terminate_handler () at ../../../../libstdc++-v3/libsupc++/vterminate.cc:95 apache#3 0x0000561eb0a5caf6 in __cxxabiv1::__terminate (handler=<optimized out>) at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:48 apache#4 0x0000561eb0a5cb61 in std::terminate () at ../../../../libstdc++-v3/libsupc++/eh_terminate.cc:58 apache#5 0x0000561ea4028552 in doris::io::LRUFileCache::~LRUFileCache (this=0x7ff540fed000) at /root/be/src/io/cache/block/block_lru_file_cache.h:62 apache#6 0x0000561ea402857e in doris::io::LRUFileCache::~LRUFileCache (this=0x33688) at /root/be/src/io/cache/block/block_lru_file_cache.h:54 apache#7 0x0000561ea4251cd2 in std::default_delete<doris::io::IFileCache>::operator() (this=0x7ff54101d000, __ptr=0x33688) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:85 apache#8 std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> >::~unique_ptr (this=0x7ff54101d000) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/unique_ptr.h:361 apache#9 std::destroy_at<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> > > (__location=0x7ff54101d000) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_construct.h:88 apache#10 std::_Destroy<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> > > (__pointer=0x7ff54101d000) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_construct.h:138 apache#11 std::_Destroy_aux<false>::__destroy<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> >*> (__first=0x7ff54101d000, __last=0x7ff54101d008) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_construct.h:152 apache#12 std::_Destroy<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> >*> (__first=<optimized out>, __last=0x7ff54101d008) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_construct.h:184 apache#13 std::_Destroy<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> >*, std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> > > (__first=<optimized out>, __last=0x7ff54101d008) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/alloc_traits.h:746 apache#14 std::vector<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> >, std::allocator<std::unique_ptr<doris::io::IFileCache, std::default_delete<doris::io::IFileCache> > > >::~vector (this=0x7ff596a24ba8) at /var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/stl_vector.h:680 apache#15 doris::io::FileCacheFactory::~FileCacheFactory (this=0x7ff596a24b80) at /root/be/src/io/cache/block/block_file_cache_factory.h:42 apache#16 doris::ExecEnv::destroy (this=0x561eb130b800 <doris::ExecEnv::GetInstance()::s_exec_env>) at /root/be/src/runtime/exec_env_init.cpp:651 apache#17 0x0000561ea35c3fe3 in main (argc=<optimized out>, argv=<optimized out>) at /root/be/src/service/doris_main.cpp:628 ```
mrhhsg
force-pushed
the
fix_exchange
branch
2 times, most recently
from
323bbed to
114bd3b
Compare
apache#40356 (apache#42508) cherry pick from apache#40356 --------- Co-authored-by: hui lai <1353307710@qq.com>
…own (apache#42510) ## Proposed changes Issue Number: close #xxx <!--Describe your changes.-->
…d_number_limit_percent default value apache#42224 (apache#42423)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Proposed changes
It does not mean all channels are EOF when
_busy_channelsis equal to zero