[FLINK-16123] Add E2E for auto-routable Protobuf Kafka ingress #37
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tzulitai
force-pushed
the
FLINK-16123-e2e
branch
from
652b132 to
084fc6b
Compare
… testing This is a a simple application used for testing the routable Kafka ingress. The application reads untagged messages from a Kafka ingress, binds multiple functions which has the sole purpose of tagging of messages with their own addresses (see FnSelfAddressTagger), and then sending back the tagged messages back to a Kafka egress.
…xt in StatefulFunctionsAppContainers This functionality will be required by e2e tests that need to add additional classpath files to the app image build context, e.g. adding a YAML file module definition.
End-to-end test based on the {@link RoutableKafkaVerificationModule} application.
This test writes some records to Kafka, with target function id as key
(UTF8 String) and MessageWithAddress messages as value, without the
"from" field set. The routable Kafka ingress should automatically route
them to the correct function instances, which tag the input messages
with their own address, and then forwards it back to Kafka. The test
verifies that the tagged outputs written back to Kafka are correct.
tzulitai
force-pushed
the
FLINK-16123-e2e
branch
from
084fc6b to
b06c592
Compare
Contributor
Author
|
@igalshilman I've rebased this on the latest master after merging #35. |
Contributor
|
Let’s merge it, so it won’t diverge too much. |
Contributor
Author
|
Thanks! Merging ... |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Changelog description
*-e2emodule for the new E2E test.RoutableKafkaVerificationModuleon what it does.StatefulFunctionsAppContainersthat allows the E2E to add YAML module definitions to be added to the application image build context.RoutableKafkaE2Eon how it verifies the ingress' functionality.Verifying
Run
mvn clean verify -Prun-e2e-teststo run the E2E test (or in the IDE).