Pattern for AVRO Message Validation with Glue Schema Registry in the MSK Event Source for Lambda in Java #2760
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…oducerHandler.java file to take care of correctly passing environment variables and also not have the user type in VPC, Subnets and Security Group
… Schema not getting substituted properly
* feat: Implement AVRO code generation and AvroKafkaHandler - Add Maven AVRO plugin for automatic code generation from schema - Create contact.avsc schema file with nullable fields and proper namespace - Generate Contact class from AVRO schema (implements SpecificRecord) - Add AvroKafkaHandler for proper AVRO deserialization with Lambda Powertools - Update SAM template to use AvroKafkaHandler instead of HandlerMSK - Remove manually created Contact POJO in favor of generated AVRO class This enables proper AVRO message deserialization in the MSK Lambda consumer using Lambda Powertools with auto-generated SpecificRecord classes. * feat: Update producer to use AVRO-generated Contact class - Add AVRO Maven plugin to producer pom.xml - Remove manual Contact POJO from producer - Generate Contact class from AVRO schema for producer - Ensure producer and consumer use identical AVRO-generated Contact class - Fix payload compatibility between producer and consumer This ensures both functions use the same SpecificRecord implementation for consistent AVRO serialization/deserialization. * updates to producer * Switched to simple handler * added power tools log * Logger updates
…d SchemaRegistryConfig in the Lambda MSK Event Source in the Consumer Lambda
julianwood
assigned
biswanathmukherjee and
julianwood and unassigned
biswanathmukherjee
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.