ci: migrate conformance to restatedev/e2e sdk-tests + CI job (closes #1) - #4
Merged
Conversation
restatedev/sdk-test-suite is archived; migrate the harness to its maintained successor restatedev/e2e (sdk-tests v2.2, same `run` CLI) and wire it into CI. - Makefile: `make conformance` downloads the e2e v2.2 jar and runs the default suite over the bidi (amphp) transport on a V7-enabled runtime (built from Dockerfile.restate-v7 + Dockerfile.amp) via --service-container-image; JDK >= 21 - .github/workflows/conformance.yml: runs `make conformance` on push to main, weekly, on demand, and on PRs labelled `conformance` (too heavy to gate every PR; GitHub runners have AVX2 for the suite's >= 1.6 runtime) - conformance/README.md + README.md: e2e v2.2 as the suite, the bidi 48/49 result, CI, and the archived v3.4 + Restate 1.5.2 offline fallback for AVX2-free hosts - exclusions.yaml validated against a live e2e v2.2 run, unchanged (6 documented gaps): default suite "Succeeded tests: 48 / 48", 0 class-init failures, run against the current optimized transport
7 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Migrates the cross-SDK conformance harness from the archived
restatedev/sdk-test-suiteto its maintained successorrestatedev/e2e(sdk-testsv2.2), and wires it into CI. Closes #1.Changes
make conformancedownloads the e2e v2.2 jar and runs thedefaultsuite over the SDK's default bidi (amphp) transport on a V7-enabled runtime (built fromDockerfile.restate-v7+Dockerfile.amp) via--service-container-image. JDK ≥21.make conformanceon push tomain, weekly, on demand, and on PRs labelledconformance(too heavy to gate every PR; GitHub runners have AVX2 for the suite's ≥1.6 runtime). Uploads the report artifact.Verification
Live
make conformanceagainst the current (optimized) transport:exclusions.new.yamlis identical to the committedexclusions.yaml— no new gaps.