Skip to content

[Bug]: Go Validates Runner tests failing under Flink 2.0 #37600

@Abacn

Description

@Abacn

What happened?

See #37313 (comment)

com.esotericsoftware.kryo.KryoException: java.lang.UnsupportedOperationException
Serialization trace:
fieldIndices (org.apache.beam.sdk.schemas.Schema)
schema (org.apache.beam.sdk.values.RowWithStorage)
value (org.apache.beam.sdk.values.KV)
value (org.apache.beam.sdk.values.WindowedValues$ValueInGlobalWindow)
        at com.esotericsoftware.kryo.serializers.ReflectField.read(ReflectField.java:146)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:130)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:796)
        at com.esotericsoftware.kryo.serializers.ReflectField.read(ReflectField.java:124)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:130)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:796)
        at com.esotericsoftware.kryo.serializers.ReflectField.read(ReflectField.java:124)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:130)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:796)
        at com.esotericsoftware.kryo.serializers.ReflectField.read(ReflectField.java:124)
        at com.esotericsoftware.kryo.serializers.FieldSerializer.read(FieldSerializer.java:130)
        at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:877)
        at org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:384)
        at org.apache.flink.streaming.runtime.streamrecord.StreamElementSerializer.deserialize(StreamElementSerializer.java:206)
        at org.apache.flink.streaming.runtime.streamrecord.StreamElementSerializer.deserialize(StreamElementSerializer.java:44)
        at org.apache.flink.runtime.plugable.NonReusingDeserializationDelegate.read(NonReusingDeserializationDelegate.java:53)
        at org.apache.flink.runtime.io.network.api.serialization.NonSpanningWrapper.readInto(NonSpanningWrapper.java:337)
        at org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.readNonSpanningRecord(SpillingAdaptiveSpanningRecordDeserializer.java:130)
        at org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.readNextRecord(SpillingAdaptiveSpanningRecordDeserializer.java:105)
        at org.apache.flink.runtime.io.network.api.serialization.SpillingAdaptiveSpanningRecordDeserializer.getNextRecord(SpillingAdaptiveSpanningRecordDeserializer.java:95)
        at org.apache.flink.streaming.runtime.io.AbstractStreamTaskNetworkInput.emitNext(AbstractStreamTaskNetworkInput.java:152)
        at org.apache.flink.streaming.runtime.io.StreamOneInputProcessor.processInput(StreamOneInputProcessor.java:65)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.processInput(StreamTask.java:638)
        at org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:231)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:980)
        at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:917)
        at org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:963)
        at org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:942)
        at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:756)
        at org.apache.flink.runtime.taskmanager.Task.run(Task.java:568)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.lang.UnsupportedOperationException
        at org.apache.beam.vendor.guava.v32_1_2_jre.com.google.common.collect.ImmutableMap.put(ImmutableMap.java:781)
        at com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:236)
        at com.esotericsoftware.kryo.serializers.MapSerializer.read(MapSerializer.java:42)
        at com.esotericsoftware.kryo.Kryo.readObject(Kryo.java:796)
        at com.esotericsoftware.kryo.serializers.ReflectField.read(ReflectField.java:124)
        ... 30 more

Issue Priority

Priority: 2 (default / most bugs should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions