-
Notifications
You must be signed in to change notification settings - Fork 1.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature][kafka-connector] Does the codec in Kafka play the correct role #1353
Labels
feature-request
this is a feature requests on the product
Comments
I think, if we want data with only value, we should create a new decoder. |
agree .and I will make a try :-) |
liumengkai
added a commit
to liumengkai/chunjun
that referenced
this issue
Nov 2, 2022
9 tasks
liumengkai
added a commit
to liumengkai/chunjun
that referenced
this issue
Nov 2, 2022
9 tasks
liumengkai
added a commit
to liumengkai/chunjun
that referenced
this issue
Nov 3, 2022
liumengkai
added a commit
to liumengkai/chunjun
that referenced
this issue
Nov 3, 2022
FlechazoW
pushed a commit
that referenced
this issue
Nov 3, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Search before asking
Description
Now the kafka sink has a parameter 'codec',It is set by default to 'json',chunjun use JsonDecoder to decode data,and JsonDecoder will return a map that key is 'message'. The data in kafka like this,2 columns value has been splited by ','
When this parameter is set to 'text' , chunjun will use TextDecoder to decode data, but the TextDecoder will still return a map with 'message' as key. The data in kafka is still like this. It's also a json string
When we set codec to 'text',I think what we want data in kafka is like this:
Just the value , not a json
How about this? I can make a pr about this change after we discuss.
Use case
When we only need value to sink to kafka not a json
Related issues
No response
Are you willing to submit a PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: