Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Possible doco extension #26

Closed
corsc opened this issue Jun 14, 2018 · 3 comments
Closed

Possible doco extension #26

corsc opened this issue Jun 14, 2018 · 3 comments

Comments

@corsc
Copy link

corsc commented Jun 14, 2018

I am writing from Go to Kafka.

I was getting error messages like:
Couldn't decode protobuf: #<RuntimeError: CodedInputStream encountered a malformed varint.>.
And:
Couldn't decode protobuf: #<RuntimeError: Protocol message end-group tag did not match expected tag.>.
And even incorrect data sometimes. My int64 was coming through with the wrong value.

Turns out the issue not setting the serializers to the appropriate values.
In my case it was:

input {
	kafka {
		key_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
		value_deserializer_class => "org.apache.kafka.common.serialization.ByteArrayDeserializer"
	}
}

Perhaps someone more knowledgeable then I could add some comments to the documentation to help newbies like me?
Cheers

@IngaFeick
Copy link
Collaborator

Thank you, Corey, much appreciated! I will add that. Cheers!

@IngaFeick
Copy link
Collaborator

@corsc I tested this and I would like to very much apologize to you for not having pointed this out in the documentation earlier. I'm using a custom version of the kafka plugin and I didn't run into this yet. 😬 PR is written. Thanks again!

@jsvd jsvd closed this as completed in ff76187 Jun 14, 2018
@corsc
Copy link
Author

corsc commented Jun 14, 2018

No worries and definitely no need to apologise. Thanks again

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants