[SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase

[zjw722188]

hi,During the integration of Flink Hudi and hive, I execute tasks and insert data normally. However, when hive metadata is synchronized, the following error messages always appear.

version: hudi 0.10.1 flink 1.13.1 scala 2.12.10
2022-06-01 10:55:03,191 ERROR org.apache.hudi.sink.StreamWriteOperatorCoordinator [] - Executor executes action [sync hive metadata for instant 2
0220601105502016] error
java.lang.NoClassDefFoundError: org/apache/thrift/TBase
at java.lang.ClassLoader.defineClass1(Native Method) ~[?:1.8.0_212]
at java.lang.ClassLoader.defineClass(ClassLoader.java:763) ~[?:1.8.0_212]
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) ~[?:1.8.0_212]
at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) ~[?:1.8.0_212]
at java.net.URLClassLoader.access$100(URLClassLoader.java:74) ~[?:1.8.0_212]
at java.net.URLClassLoader$1.run(URLClassLoader.java:369) ~[?:1.8.0_212]
at java.net.URLClassLoader$1.run(URLClassLoader.java:363) ~[?:1.8.0_212]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_212]
at java.net.URLClassLoader.findClass(URLClassLoader.java:362) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_212]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_212]
at org.apache.hudi.hive.HiveSyncTool.(HiveSyncTool.java:78) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1]
at org.apache.hudi.sink.utils.HiveSyncContext.hiveSyncTool(HiveSyncContext.java:51) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.syncHive(StreamWriteOperatorCoordinator.java:302) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.
1]
at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:93) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
Caused by: java.lang.ClassNotFoundException: org.apache.thrift.TBase
at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_212]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_212]
... 19 more

Environment Description

• Hudi version :0.10.1

• Spark version :3.0.3

• Hive version :2.3.1

• Hadoop version :2.7.3

• Storage (HDFS/S3/GCS..) :HDFS

• Running on Docker? (yes/no) :no

Stacktrace

[nsivabalan]

@yuzhaojing : can you help triage this.

[yuzhaojing]

Do you have another package conflict with this?

[nsivabalan]

closing it due to no activity. feel free to raise a new issue if you are looking for assistance.

[xushiyan]

@nsivabalan @yuzhaojing for this one we should try to reproduce the setup with the latest master version. if meta sync works properly, then we can close this

[nsivabalan]

this was reported on May 31st and we haven't heard back from the author.
thought we had some policy around closing tickets due to in activity. Do you want us to reproduce? @xushiyan

[nsivabalan]

@yuzhaojing : can you try hive sync w/ flink w/ latest master and close out the issue if things are good.

[danny0405]

Close because of chronic inactivity.