Skip to content

[cherry-pick](olap scanner) Scanner row bytes buffer is too small bug #13923

Closed
yiguolei wants to merge 853 commits intoapache:masterfrom
yiguolei:pick_scanner
Closed

[cherry-pick](olap scanner) Scanner row bytes buffer is too small bug #13923
yiguolei wants to merge 853 commits intoapache:masterfrom
yiguolei:pick_scanner

Conversation

@yiguolei
Copy link
Contributor

@yiguolei yiguolei commented Nov 3, 2022

Proposed changes

cherry-pick: #13874

Problem summary

Describe your changes.

Checklist(Required)

  1. Does it affect the original behavior:
    • Yes
    • No
    • I don't know
  2. Has unit tests been added:
    • Yes
    • No
    • No Need
  3. Has document been added or modified:
    • Yes
    • No
    • No Need
  4. Does it need to update dependencies:
    • Yes
    • No
  5. Are there any changes that cannot be rolled back:
    • Yes (If Yes, please explain WHY)
    • No

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

yangzhg and others added 30 commits August 15, 2022 13:42
* [fix](agg)disallow group by bitmap or hll data type
…1748) (apache#11813)

In row mode schema change, it will fail sometime because memory exceeded.
When the left memory is enough for sorting but not enough for next block,
it will not flush row_block_arr which data in memory and continue to alloc next block
so it can't alloc the memory and return directly.
And if it can't alloc the memory for block, it need to flush row_block_arr and
try it again unless row_block_arr is empty.

Co-authored-by: Lightman <31928846+Lchangliang@users.noreply.github.com>
* Support Iceberg on HDFS with HA mode enabled.
Add http header size parameter
…uring runtime (apache#11862)

The column id check in VSlotRef::execute function before is too strict for fuzzy test to continuously produce random query. Temporarily loosen the check logic.
Moreover, there exists some careless call to VExpr::get_const_col, it might return a nullptr but not every function call checks if it's valid. It's an underlying problem.
…external table (apache#9198)

user can add more supported ODBC Connection Parameters to resource PROPERTIES or external table PROPERTIES
…PE (apache#11886)

* [bug](inpredicate) fix in predicate in group by clause may cause NPE
morrySnow and others added 20 commits October 26, 2022 23:19
…expr (apache#13680)

We save mv column with alias as table name, and search it with original table name.
cherry-pick from master apache#13597
…e inaccurate and deadlock (apache#13697)

cherry-pick apache#13401, apache#13528, and fix bthead mem tracker dead lock
…pache#13475) (apache#13696)

string type length may set to -1 when create TypeDescriptor from thrift or protobuf, this will cause check limit overflow
cherry-pick apache#13475
)

Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>

Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
… result on vectorized engine (apache#13729)

* [Bug][Vectorized] fix json_object and json_array function return wrong result on vectorized engine

Co-authored-by: chenjie <chenjie@cecdat.com>
…exprs (apache#13757)

* [fix](plan)result exprs should be substituted in the same way as agg exprs

* remove unused code
…load loads the file apache#13804

The where condition does not take effect when spark load loads the file
…cope (apache#13877)

* [fix](planner) infer predicate could generate predicates in another scope
@yiguolei yiguolei closed this Nov 3, 2022
@github-actions github-actions bot added area/load Issues or PRs related to all kinds of load area/planner Issues or PRs related to the query planner area/routine load area/spark-load Issues or PRs related to the spark load area/sql/function Issues or PRs related to the SQL functions area/vectorization kind/docs Categorizes issue or PR as related to documentation. kind/test labels Nov 3, 2022
@yiguolei yiguolei deleted the pick_scanner branch November 3, 2022 07:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/load Issues or PRs related to all kinds of load area/planner Issues or PRs related to the query planner area/routine load area/spark-load Issues or PRs related to the spark load area/sql/function Issues or PRs related to the SQL functions area/vectorization kind/docs Categorizes issue or PR as related to documentation. kind/test

Projects

None yet

Development

Successfully merging this pull request may close these issues.