Skip to content

[Bug] Mysqlload publish timeout caused npe #20603

@lvshaokang

Description

@lvshaokang

Search before asking

  • I had searched in the issues and found no similar issues.

Version

master latest

What's Wrong?

mysql load execute regression test get null msg

2023-06-08 12:22:08.589 ERROR [suite-thread-1] (ScriptContext.groovy:121) - Run test_mysql_load_tiny_file in /home/work/pipline/OpenSourceDoris/clusterRegressionCenter/P0/Cluster7/regression-test/suites/load_p0/mysql_load/test_mysql_load_tiny_file.groovy failed
java.sql.SQLException: Unexpected exception: null
	at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
	at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
	at com.mysql.cj.jdbc.ClientPreparedStatement.executeInternal(ClientPreparedStatement.java:953)
	at com.mysql.cj.jdbc.ClientPreparedStatement.execute(ClientPreparedStatement.java:371)
	at java_sql_PreparedStatement$execute.call(Unknown Source)
	at org.apache.doris.regression.util.JdbcUtils$_executeToList_closure1.doCall(JdbcUtils.groovy:31)
	at sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:107)
	at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)
	at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:263)

fe msg

2023-06-08 12:22:08,587 WARN (mysql-nio-pool-16|7993) [MysqlLoadManager.executeMySqlLoadJobFromStmt():193] Execute mysql load 3fdfffca-9f57-4ab2-8dcf-05fdd794363a failed
java.lang.NullPointerException: null
	at org.apache.doris.load.loadv2.MysqlLoadManager.executeMySqlLoadJobFromStmt(MysqlLoadManager.java:184) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.load.loadv2.MysqlLoadManager.executeMySqlLoadJobFromStmt(MysqlLoadManager.java:152) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.StmtExecutor.handleLoadStmt(StmtExecutor.java:2080) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.StmtExecutor.executeByLegacy(StmtExecutor.java:718) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:438) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.StmtExecutor.execute(StmtExecutor.java:409) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.ConnectProcessor.handleQuery(ConnectProcessor.java:432) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.ConnectProcessor.dispatch(ConnectProcessor.java:579) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.qe.ConnectProcessor.processOnce(ConnectProcessor.java:817) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.mysql.ReadListener.lambda$handleEvent$0(ReadListener.java:52) ~[doris-fe.jar:1.2-SNAPSHOT]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_131]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_131]
	at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_131]

be msg

W0608 12:21:50.815456 17653 stream_load_executor.cpp:399] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]transaction commit successfully, BUT data will be visible later, id=df41e2a512f3fc6d-c5ac0f0bd26d7490, job_id=-1, txn_id=4433, label=4d9ed0e9-3d45-4b21-903d-b2650e6f54ce, elapse(s)=8
W0608 12:22:08.514400 17646 stream_load_executor.cpp:399] commit transaction failed, errmsg=[PUBLISH_TIMEOUT]transaction commit successfully, BUT data will be visible later, id=9f499e89715d4b76-035c55637097b5bb, job_id=-1, txn_id=4435, label=10bfef75-4b56-4785-9b46-75d9dcf1ff06, elapse(s)=11

What You Expected?

return err msg, instead of null

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions