Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Schema names are not compatible with Protobuf and results in Descriptors$DescriptorValidationException #62

Open
rspurgeon opened this issue May 29, 2020 · 1 comment

Comments

@rspurgeon
Copy link
Contributor

rspurgeon commented May 29, 2020

The internal Connect structure created by Avro Random contains Schema names with . which is incompatible with Protobuf and the Protobuf Converter. Ideally, eventually a resolution would be created in the Confluent Protobuf solution, If not we may need to modify the schema names. For now a workaround with the SetSchemaMetadata SMT is possible, see the config folder for an example.

@ybyzek
Copy link
Contributor

ybyzek commented May 29, 2020

Example of error message without the SMT:

Caused by: java.lang.IllegalStateException: com.google.protobuf.Descriptors$DescriptorValidationException: ksql.users: "ksql.users" is not a valid identifier.
        at io.confluent.connect.protobuf.ProtobufData.rawSchemaFromConnectSchema(ProtobufData.java:324)
        at io.confluent.connect.protobuf.ProtobufData.fromConnectSchema(ProtobufData.java:304)
        at io.confluent.connect.protobuf.ProtobufData.fromConnectData(ProtobufData.java:109)
        at io.confluent.connect.protobuf.ProtobufConverter.fromConnectData(ProtobufConverter.java:83)
        at org.apache.kafka.connect.storage.Converter.fromConnectData(Converter.java:63)

@ybyzek ybyzek changed the title Schema names are not compatible with Protobuf Schema names are not compatible with Protobuf and results in com.google.protobuf.Descriptors$DescriptorValidationException May 29, 2020
@ybyzek ybyzek changed the title Schema names are not compatible with Protobuf and results in com.google.protobuf.Descriptors$DescriptorValidationException Schema names are not compatible with Protobuf and results in Descriptors$DescriptorValidationException May 29, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants