Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Proof of Concept: Create PoC scoring system for Workload / Application tests #30

Closed
6 of 10 tasks
taylor opened this issue Feb 20, 2020 · 4 comments
Closed
6 of 10 tasks

Proof of Concept: Create PoC scoring system for Workload / Application tests #30

taylor opened this issue Feb 20, 2020 · 4 comments
Assignees
@taylor @wvwatson @denverwilliams
Labels
5 pts scoring Scoring System for CNF Conformance Certification Levels
Projects
CNF Test Suite
Milestone
CNF Conformance S...

Comments

@taylor
Copy link
Collaborator

taylor commented Feb 20, 2020 •
edited by wvwatson
Loading

Proof of Concept: Scoring results from tests

Test Category: Scoring

Type of test (static or runtime) = N/A

Tasks:

  • Add a quick overview of the type of test you are researching/creating a POC for
  • Investigate potential tools for implementation and document findings, https://hackmd.io/new (add link to ticket)
  • Select a tool to use, minimal/least effort, and add selection to ticket
  • Add new POC test code
  • Add comment suggesting updates as needed for:
  • Tag 1 or more people to peer review

Reference:

https://docs.google.com/presentation/d/1Bci-rzXnVqlvT2hhSXCBawtsKf8HURC2K4kJSlnB43Q/edit#slide=id.g7c55edb53f_0_535

If the CNF Conformance Test Suite proves useful, it would be natural to build out a certification program for CNFs
This could replicate the self-certification process used by the Certified Kubernetes program
It can be done in conjunction with LF Networking’s OPNFV Verification Program (OVP) and the Common NFVI Telco Task Force (CNTT)
One option would to be to emulate LEED Certification and the Core Infrastructure Initiative Best Practices Badge by having the test suite specify scoring ranges as bronze, silver, etc.
We also want probably want to explicitly include a “not-so-great” result meaning that that the CNF does not implement some base level of best practices
It is not clear that there is any need for platform conformance and certification beyond what is already provided by Certified Kubernetes
@taylor taylor created this issue from a note in Specifications (To do) Feb 20, 2020
@lixuna lixuna mentioned this issue Feb 20, 2020
Closed
63 tasks
@lixuna lixuna added this to To do in CNF Test Suite via automation Mar 13, 2020
@lixuna lixuna moved this from To do to In Planning in CNF Test Suite Mar 13, 2020
@lixuna lixuna added the scoring Scoring System for CNF Conformance Certification Levels label Mar 13, 2020
@lixuna lixuna changed the title [Spec] Scoring results from tests Proof of Concept: Scoring results from tests Mar 13, 2020
@lixuna lixuna moved this from In Planning to Ready for Dev in CNF Test Suite Mar 13, 2020
@lixuna lixuna added the 3 pts label Mar 13, 2020
@taylor taylor added 5 pts and removed 3 pts labels Mar 13, 2020
@taylor
Copy link
Collaborator Author

taylor commented Mar 31, 2020

Is #115 a duplicate of this ticket?

@taylor taylor mentioned this issue Mar 31, 2020
Closed
7 tasks
@wvwatson wvwatson moved this from Ready for Dev to In progress in CNF Test Suite Apr 2, 2020
@lixuna lixuna changed the title Proof of Concept: Scoring results from tests Proof of Concept: Create PoC scoring system for Workload / Application tests Apr 6, 2020
@lixuna
Copy link
Collaborator

lixuna commented Apr 6, 2020

@taylor - not necessarily. This issue was created for CNF Conformance Test scoring for workload/application tests.

The new issue #115 was created for the new Platform Conformance tests.

wvwatson referenced this issue Apr 6, 2020
@thewolfpack
#lfn-cnti/certification/issues/30 PoC points functions now have tests
7590a3c
@lixuna lixuna moved this from To do to In progress in Specifications Apr 7, 2020
@lixuna lixuna removed this from In progress in Specifications Apr 7, 2020
wvwatson referenced this issue Apr 8, 2020
@thewolfpack
#lfn-cnti/certification/issues/30 All tests are now part of a point s…
1ac087c 
…ystem
@wvwatson
Copy link
Collaborator

wvwatson commented Apr 8, 2020

https://hackmd.io/OjLoezzRTBuwjwUnQxWr6A?both

@wvwatson
Copy link
Collaborator

wvwatson commented Apr 8, 2020

https://github.com/cncf/cnf-conformance/blob/develop/points.yml Should be reviewed for updating the initial weights (points)

@wvwatson wvwatson moved this from In progress to Needs Peer Review in CNF Test Suite Apr 8, 2020
wvwatson referenced this issue Apr 8, 2020
@thewolfpack
#lfn-cnti/certification/issues/30 result setup now part of the securi…
c9e0a19 
…ty and installability specs
@wvwatson wvwatson mentioned this issue Apr 8, 2020
Merged
20 tasks
This was referenced Apr 14, 2020
Closed
Closed
@lixuna lixuna added this to the CNF Conformance Scoring System milestone Apr 15, 2020
@lixuna lixuna closed this as completed Apr 23, 2020
CNF Test Suite automation moved this from Needs Peer Review to Done Apr 23, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@taylor taylor

@wvwatson wvwatson

@denverwilliams denverwilliams

Labels
5 pts scoring Scoring System for CNF Conformance Certification Levels
Projects
CNF Test Suite
  
Done
Milestone
CNF Conformance Scoring System
Development

No branches or pull requests
4 participants
@taylor @wvwatson @lixuna @denverwilliams