Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change procedure to include Consumers #409

Closed
wants to merge 1 commit into from
Closed

Conversation

egekorkan
Copy link
Contributor

As asked in the testing call, here is a PR that includes putting Consumer implementation information

You need to group them under your implementation name, like `intel-nodejs/TDs`.
- Fill in the [manual.csv](https://github.com/w3c/wot-testing/blob/main/events/2022.09.Online/Profile/manual.csv) for the Profile specification
and submit it in the Profiles directory under Results. This file is needed for the manual results.
This file should go in the folder of your implementation.
and submit it in the Profiles directory under your implementation folder. Some of the assertions apply only for Consumers, some apply only for Producers.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so we really should have a consumer.csv and producer.csv if we want to split up assertions

@mmccool
Copy link
Contributor

mmccool commented Oct 5, 2022

Discussion (Testfest mtg 2022.10.05):

  • Do need to have more discussion on how to test profiles; they make more mandatory constraints on consumers than TDs
  • Capture information about which assertions apply to producers, consumers, or both (e.g. an extra column in the manual.csv table)
  • Capture information about whether a given implementation is a producer or a consumer - can be in Implementation Description (needs cleanup, discussion of categories)
  • Generate report showing coverage of pairwise interaction, i.e. interop matrix - many need one matrix for each profile (or allowed combinations of profiles, eg. baseline + SSE)
  • Require two implementations of producers and two of consumers that can interoperate

@mmccool
Copy link
Contributor

mmccool commented Dec 12, 2022

Useful to do, and current procedures are working towards this, but I'd rather not change instructions for past events, so closing without merging. Please resubmit if you want to the current event.

@mmccool mmccool closed this Dec 12, 2022
@egekorkan egekorkan deleted the egekorkan-patch-4 branch February 1, 2023 15:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants