Skip to content

SchemaRegistrySerde: Avro deserialization without magic byte using lookup by topic name as fallback like in serialization #4520

Open
@1-alex98

Description

@1-alex98

Issue submitter TODO list

  • I've searched for an already existing issues here
    I'm running a supported version of the application which is listed here and the feature is not present there

Is your proposal related to a problem?

I have a producer on Kafka. I have no control about the producer and the producer does not set the magic byte and schema id in avro that would tell a consumer what schema to use. However I want to inspect the messages in Kafka UI.

Describe the feature you're interested in

I want to be able to set the correct schema.
When Serializing messages the code in SchemaRegistrySerde has a look into the registry using the topic name.
Suggestion:
When Deserializing:

  1. Have a look at magic byte and schema ID
  2. If no schema ID set have a look in the registry using the topic name and try this schema
  3. Fail otherwise

-> Suggestion add step 2

Describe alternatives you've considered

Setting the magic bytes and schema ids in messages. However in a lot of cases the read does not control the producer.
Setting the correct schema via UI.

Version you're running

Applies to all versions

Additional context


Currently only reads the schema from the message it-self

Activity

github-actions

github-actions commented on Mar 4, 2025

@github-actions

Hello there 1-alex98! 👋

Thank you and congratulations 🎉 for opening your very first issue in this project! 💖

In case you want to claim this issue, please comment down below! We will try to get back to you as soon as we can. 👀

changed the title [-]Avro deserialization without magic byte[/-] [+]SchemaRegistrySerde Avro deserialization without magic byte using lookup by topic name as fallback like in serialization[/+] on Mar 4, 2025
changed the title [-]SchemaRegistrySerde Avro deserialization without magic byte using lookup by topic name as fallback like in serialization[/-] [+]SchemaRegistrySerde: Avro deserialization without magic byte using lookup by topic name as fallback like in serialization[/+] on Mar 4, 2025
added a commit that references this issue on Mar 4, 2025
678cb96
added a commit that references this issue on Mar 4, 2025
ca7aaff
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

      Development

      Participants

      @1-alex98

      Issue actions

        SchemaRegistrySerde: Avro deserialization without magic byte using lookup by topic name as fallback like in serialization · Issue #4520 · provectus/kafka-ui