Skip to content

[Bug]: Cannot execute optimizing tasks since fail to deserilalize AuthenticatedHadoopFileIO in optimizer #3025

@xxubai

Description

@xxubai

What happened?

image

Affects Versions

master

What table formats are you seeing the problem on?

No response

What engines are you seeing the problem on?

No response

How to reproduce

java.lang.IllegalArgumentException: deserialization error
at org.apache.amoro.utils.SerializationUtil.simpleDeserialize(SerializationUtil.java:74)
at org.apache.amoro.optimizer.common.OptimizerExecutor.executeTask(OptimizerExecutor.java:133)
at org.apache.amoro.optimizer.common.OptimizerExecutor.executeTask(OptimizerExecutor.java:103)
at org.apache.amoro.optimizer.common.OptimizerExecutor.start(OptimizerExecutor.java:52)
at java.lang.Thread.run(Thread.java:750)
Caused by: java.io.InvalidClassException: org.apache.amoro.io.AuthenticatedHadoopFileIO; local class incompatible: stream classdesc serialVersionUID = 7826112849333541024, local class serialVersionUID = -1175319598256482520
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:699)
at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2005)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1852)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2186)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)
at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2431)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2355)
at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2213)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1669)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:503)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:461)
at org.apache.amoro.utils.SerializationUtil.simpleDeserialize(SerializationUtil.java:71)
... 4 more

Relevant log output

No response

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

  • I agree to follow this project's Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    type:bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions