Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JDBC引擎查询的结果集与读取结果文件的记录数不一致(The result set queried by the JDBC engine is inconsistent with the number of records read from the result file) #361

Closed
bingfeng2004 opened this issue May 10, 2020 · 1 comment
Labels
bug Something isn't working

Comments

@bingfeng2004
Copy link

Describe the bug
使用jdbc引擎查询数据库返回的结果集为5000条记录,而通过接口获取结果集文件转换成数组返回给前端时变成只有3500多条,读到3500多条时候接口就提示数据读取完毕.

2020-05-10 20:03:23,477 INFO (Engine-Scheduler-ThreadPool-53) INFO JDBCEngineExecutor - 正常输出数据量:5000
2020-05-10 20:03:24,373 INFO (Engine-Scheduler-ThreadPool-53) INFO StorageResultSetWriter - Succeed to create a new file:FsPath{path=/tmp/linkis/admin/dwc/20200510/UJESCl
ient-TestBBB/962/0.dolphin; isDirectory=false; length=0; modification_time=0; access_time=0; owner=null; group=null; permission=null}2020-05-10 20:03:24,607 INFO (Engine-Scheduler-ThreadPool-53) INFO JDBCEngineExecutor - 查询的数据集记录数1: 5000
2020-05-10 20:03:24,607 INFO (Engine-Scheduler-ThreadPool-53) INFO JDBCEngineExecutor - sql execute completed
2020-05-10 20:03:24,608 INFO (Engine-Scheduler-ThreadPool-53) INFO JDBCEntranceJob - UJESClient-TestBBB_admin_51 change state Running => Succeed.
而通过获取结果集接口得到的不是5000条记录。
2020-05-10 20:03:30.620 INFO [qtp773165334-25] com.webank.wedatasphere.linkis.storage.resultset.StorageResultSetReader 42 info - Read finished(读取完毕,3556)DWCException{
errCode=51000, desc='10--读取整数失败--', ip='node07', port=29102, serviceKind='cloud-publicservice'}----errCode: 51000 ,desc: 10--读取整数失败-- ,ip: node07 ,port: 29102 ,serviceKind: cloud-publicservice

@wForget
Copy link
Member

wForget commented May 15, 2020

This may be a bug, we will fix it.

@wForget wForget added the bug Something isn't working label May 15, 2020
@wForget wForget mentioned this issue May 15, 2020
@sargentti sargentti changed the title JDBC引擎查询的结果集与读取结果文件的记录数不一致 JDBC引擎查询的结果集与读取结果文件的记录数不一致(The result set queried by the JDBC engine is inconsistent with the number of records read from the result file) Feb 9, 2022
mayinrain pushed a commit to mayinrain/incubator-linkis that referenced this issue Dec 12, 2023
* fix python reuse bug

* code& log optimize

* optimize druid pool

* optimize get creator label

* add some log info
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants