Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

transform-sdks: introduce integration tests #16994

Merged
merged 3 commits into from
Mar 11, 2024

Conversation

rockwotj
Copy link
Contributor

@rockwotj rockwotj commented Mar 11, 2024

Currently only our golang SDK is tested as part of the broker tests. We want to test all of our SDKs. Since the broker's test suite is very heavy we will create a standalone test suite for this using our nightly docker image. Currently there is only a single unit test for the identity transform, but over time we'll add tests for schema registry and multiple output topics here too (as new languages come up).

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.3.x
  • v23.2.x

Release Notes

  • none

@github-actions github-actions bot added area/build area/wasm WASM Data Transforms labels Mar 11, 2024
@rockwotj rockwotj force-pushed the integration branch 4 times, most recently from ce65dcb to c4223ee Compare March 11, 2024 14:38
@rockwotj rockwotj marked this pull request as ready for review March 11, 2024 14:48
@rockwotj rockwotj requested a review from a team as a code owner March 11, 2024 14:49
@rockwotj rockwotj requested review from hobbseltoff and removed request for a team March 11, 2024 14:49
@rockwotj rockwotj self-assigned this Mar 11, 2024
@pgellert pgellert self-requested a review March 11, 2024 16:08
pgellert
pgellert previously approved these changes Mar 11, 2024
Copy link
Contributor

@pgellert pgellert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

src/transform-sdk/tests/test_util.go Outdated Show resolved Hide resolved
@rockwotj
Copy link
Contributor Author

Force push: Make test skipping explicit

@rockwotj rockwotj requested a review from pgellert March 11, 2024 16:44
Add an identity transform integration test for all the different SDKs we
will support.

This is a generic runner that will just take Wasm files as input. We
will use this to add tests for each of the SDKs to ensure they work with
the broker. These tests are less expensive than running each one within
the broker's test suite, so we have this seperate smaller test suite
that ensures the SDKs are doing the right thing, since the broker's
tests are more about validating the broker is doing the right thing.

Signed-off-by: Tyler Rockwood <rockwood@redpanda.com>
@rockwotj
Copy link
Contributor Author

Force push: fix build warning

Signed-off-by: Tyler Rockwood <rockwood@redpanda.com>
Signed-off-by: Tyler Rockwood <rockwood@redpanda.com>
@rockwotj
Copy link
Contributor Author

Force push: lower retention for integration test artifact

@rockwotj rockwotj merged commit b8bf099 into redpanda-data:dev Mar 11, 2024
15 checks passed
@rockwotj rockwotj deleted the integration branch March 11, 2024 17:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/build area/wasm WASM Data Transforms
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants