Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migration of Kafka source configuration. #1992

Closed
obermeier opened this issue Oct 3, 2023 · 0 comments · Fixed by #1993
Closed

Migration of Kafka source configuration. #1992

obermeier opened this issue Oct 3, 2023 · 0 comments · Fixed by #1993
Labels
bug Something isn't working enhancement New feature or request
Milestone

Comments

@obermeier
Copy link
Member

Apache StreamPipes version

dev (current development state)

Affected StreamPipes components

Backend, Connect, Processing Elements, UI

What happened?

StreamPipes 0.93.0-SNAPSHOT has new attributes to configure a Kafka source like "Auto Offest Reset". If the configuration was created in 0.92.0 this attributes could not be accessed[1], which leads to errors in the UI and during runtime.

What do you think of the idea to use a default value if no other value is provided? If I see it correctly changing the value should still be possible.

[1]
streampipes-extensions-all-jvm-1 | Caused by: java.lang.NullPointerException: Cannot invoke "org.apache.streampipes.model.staticproperty.StaticPropertyAlternatives.getAlternatives()" because "alternatives" is null streampipes-extensions-all-jvm-1 | at org.apache.streampipes.sdk.extractor.AbstractParameterExtractor.selectedAlternativeInternalId(AbstractParameterExtractor.java:588) streampipes-extensions-all-jvm-1 | at org.apache.streampipes.pe.shared.config.kafka.kafka.KafkaConnectUtils.getConfig(KafkaConnectUtils.java:128) streampipes-extensions-all-jvm-1 | at org.apache.streampipes.connect.iiot.protocol.stream.KafkaProtocol.resolveConfiguration(KafkaProtocol.java:117) streampipes-extensions-all-jvm-1 | at org.apache.streampipes.extensions.management.api.RuntimeResolvableRequestHandler.handleRuntimeResponse(RuntimeResolvableRequestHandler.java:50) streampipes-extensions-all-jvm-1 | at org.apache.streampipes.rest.extensions.connect.RuntimeResolvableResource.fetchConfigurations(RuntimeResolvableResource.java:60) streampipes-extensions-all-jvm-1 | at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) streampipes-extensions-all-jvm-1 | at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) streampipes-extensions-all-jvm-1 | at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) streampipes-extensions-all-jvm-1 | at java.base/java.lang.reflect.Method.invoke(Unknown Source) streampipes-extensions-all-jvm-1 | at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:52)

How to reproduce?

Configure a SP 0.93.0 instance with a Kafka client and try to start this adapter after upgrading to 0.93.0-SNAPSHOT.
Try to configure a new adapter when the UI configuration was not reloaded from the extension service. (Should the reload part of the upgrade process?)

Expected behavior

No response

Additional technical information

No response

Are you willing to submit a PR?

Yes, I am willing to submit a PR!

@obermeier obermeier added bug Something isn't working enhancement New feature or request labels Oct 3, 2023
@obermeier obermeier changed the title Migration of Kakfa source configuration. Migration of Kafka source configuration. Oct 3, 2023
@bossenti bossenti added this to the 0.93.0 milestone Oct 3, 2023
obermeier added a commit that referenced this issue Oct 3, 2023
…figuration (#1992)

Set default Kafka auto offset explicitly if it is not defined (#1992)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants