Skip to content

[ENHANCEMENT] Conformance Profiles: An easy way for implementations to report conformance tests results #137

@tssurya

Description

@tssurya

Is your enhancement request related to a problem? Please describe.
This issue aims to track the conformance profiles effort around network-policy-api. Adapted with love from https://github.com/kubernetes-sigs/gateway-api/blob/main/geps/gep-1709.md

Describe the solution you'd like
We already have conformance tests for ANP&BANP API - basics being done already and we have two implementations OVNK and Antrea which have adopted this downstream in their repos and are running it there. I'd like to take this one step further and add support for Conformance Profiles which will help report the results of these tests back upstream that will let implementations get the "conformance" badges..

Describe alternatives you've considered
Alternatives are for us to start running implementation specific e2e's in net-pol-api repo here which is not recommended. This NPEP will help share the responsibility of maintaining the test suites to the implementors and the API designers

Additional context
Output will look like this: kubernetes-sigs/gateway-api#1967 (review) NOTE: Unlike GatewayAPI we don't have any experimental channels, so this NPEP is just going to be straight up "Implementable" status. NetPol project is going to adopt this reporting mechanism as a way the forward.

### Tasks
- [x] Create NPEP for conformance profiles: https://github.com/kubernetes-sigs/network-policy-api/pull/138
- [x] Implement conformance profiles: https://github.com/kubernetes-sigs/network-policy-api/pull/142
- [x] Create repo to maintain reports of results from implementations: https://github.com/kubernetes-sigs/network-policy-api/pull/142
- [x] Document Conformance Profiles for implemenations

Metadata

Metadata

Assignees

Labels

area/conformanceIssues or PRs related to conformance testing

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions