SB5.1 - OCI - Video-stream-generator flink job deployment fails

[rjanart]

We have made some changes in video-stream-generator flink job to get the transcoding done through oci media service.
As part of this integration, we had to add a couple of dependencies mentioned below.

com.oracle.oci.sdk
oci-java-sdk-mediaservices
3.2.2


com.googlecode.json-simple
json-simple
1.1

It is building fine. When we try to deploy video-stream-generator, job manager fails with NoClassDefFoundError error in asset-enrichment.jar. However, I can see the JSONUtil in jobs-core under the location org.sunbird.job.util.

As part of troubleshooting, I tried adding the JSONUtil object directly inside JobRequestSerde. It worked fine. But it fails in JobRequest.scala which references JSONUtil.

2023-02-23 12:29:43,276 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: video-streaming-consumer (1/1) (eb550ac17c42270802f1fdcc3b77a4d0) switched from RUNNING to FAILED on 10.0.71.33:6122-643db8 @ 10-0-71-33.video-stream-generator-taskmanager-prometheus.flink-kp-dev.svc.cluster.local (dataPort=37993).
java.lang.NoClassDefFoundError: Could not initialize class org.sunbird.job.util.JSONUtil$
at org.sunbird.job.serde.JobRequestDeserializationSchema.deserialize(JobRequestSerde.scala:32) ~[asset-enrichment-1.0.0.jar:?]
at org.sunbird.job.serde.JobRequestDeserializationSchema.deserialize(JobRequestSerde.scala:23) ~[asset-enrichment-1.0.0.jar:?]
at org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema.deserialize(KafkaDeserializationSchema.java:79) ~[asset-enrichment-1.0.0.jar:?]
at org.sunbird.job.serde.JobRequestDeserializationSchema.deserialize(JobRequestSerde.scala:23) ~[asset-enrichment-1.0.0.jar:?]
at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.partitionConsumerRecordsHandler(KafkaFetcher.java:179) ~[asset-enrichment-1.0.0.jar:?]
at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.runFetchLoop(KafkaFetcher.java:142) ~[asset-enrichment-1.0.0.jar:?]
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:826) ~[asset-enrichment-1.0.0.jar:?]
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110) ~[flink-dist_2.12-1.13.5.jar:1.13.5]
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66) ~[flink-dist_2.12-1.13.5.jar:1.13.5]
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:269) ~[flink-dist_2.12-1.13.5.jar:1.13.5]

Also seeing this error when i do not have any jackson-databind dependency (no transient dependency as well - mvn dependency tree of additional pom mentioned below).
2023-02-24 11:44:07,458 DEBUG org.apache.flink.runtime.jobmaster.JobMaster [] - Archive local failure causing attempt 8b0b13f71345ebaaa388368e5a9a4832 to fail: java.lang.ExceptionInInitializerError
at org.sunbird.job.serde.JobRequestDeserializationSchema.deserialize(JobRequestSerde.scala:32)
at org.sunbird.job.serde.JobRequestDeserializationSchema.deserialize(JobRequestSerde.scala:23)
at org.apache.flink.streaming.connectors.kafka.KafkaDeserializationSchema.deserialize(KafkaDeserializationSchema.java:79)
at org.sunbird.job.serde.JobRequestDeserializationSchema.deserialize(JobRequestSerde.scala:23)
at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.partitionConsumerRecordsHandler(KafkaFetcher.java:179)
at org.apache.flink.streaming.connectors.kafka.internals.KafkaFetcher.runFetchLoop(KafkaFetcher.java:142)
at org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase.run(FlinkKafkaConsumerBase.java:826)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110)
at org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66)
at org.apache.flink.streaming.runtime.tasks.SourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:269)
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Scala module 2.10.0 requires Jackson Databind version >= 2.10.0 and < 2.11.0
at com.fasterxml.jackson.module.scala.JacksonModule.setupModule(JacksonModule.scala:61)
at com.fasterxml.jackson.module.scala.JacksonModule.setupModule$(JacksonModule.scala:46)
at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:17)
at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:835)
at org.sunbird.job.util.JSONUtil$.(JSONUtil.scala:15)
at org.sunbird.job.util.JSONUtil$.(JSONUtil.scala)
... 10 more

mvn dependency of newly added jar:
[INFO] +- org.apache.clerezza.ext:org.json.simple:jar:0.4:compile
[INFO] | - com.googlecode.json-simple:json-simple:jar:1.1:compile
[INFO] +- com.oracle.oci.sdk:oci-java-sdk-mediaservices:jar:3.2.2:compile
[INFO] - org.scala-lang:scala-library:jar:2.12.11:compile

Can someone help us understand what is causing this issue please?

[gandham-santhosh]

@maheshkumargangula @pallakartheekreddy can you please check this?

[Krishnaj20]

@pallakartheekreddy - Pls check this thread and respond.

@chitranshu-keshav

[maheshkumargangula]

@rjanart - Please share the fork or the PR to understand the changes made.
cc: @Krishnaj20 @pallakartheekreddy

[Krishnaj20]

@rjanart - Pls share the relevant information for the team to be able to assist you.

@chitranshu-keshav

[rjanart]

Thanks for checking on this Mahesh and Krishna. The issue got resolved after I made the changes on top of base branch "release-5.2.2".