Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SAMM Benchmark #22

Open
johnellingsworth opened this issue Nov 10, 2022 · 3 comments
Open

SAMM Benchmark #22

johnellingsworth opened this issue Nov 10, 2022 · 3 comments
Assignees
Projects

Comments

@johnellingsworth
Copy link
Contributor

No description provided.

@johnellingsworth johnellingsworth created this issue from a note in SAMM Suite (Focus 2022) Nov 10, 2022
@Pat-Duarte Pat-Duarte changed the title SAMM Benchmark (Bryan) SAMM Benchmark Oct 24, 2023
@Pat-Duarte
Copy link

From September Core Team Call

Pre-meeting notes:

  • Have infrastructure and data collection available publicly
  • Have platform code available publicly
  • Add metadata to the interview tab or have a dedicated benchmark tab in toolbox (Seba)

Feedback from legal review

  • no interview notes (keep confidential info out of the dataset at all costs)
    Don’t import them
  • explicit consent for upload (practitioner stating their clients gave them permission to upload)
  • terms for researchers (stating they won't misuse the data)
  • link clients to practitioners (only for core team to access)

Action items:

  • write terms and conditions for submitters and researchers
  • Update and publish page
  • Have public code for benchmark under OWASP or SAMM
  • Have a Database set up

@Pat-Duarte
Copy link

Based on the October team call, we've updated the benchmark page and uploaded Brian's demo video to youtube.

@Pat-Duarte
Copy link

Pat-Duarte commented Nov 22, 2023

Terms & conditions:

  • Ask for OWASP legal team review
  • Publish to DAVID

Email from practitioners to clients:

  • Write an intro text for practitioners to understand what the template is about (help boostrapping benchmark by contributing datasets)
  • Send email to practitioners from benchmark account

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In Progress
SAMM Suite
Focus 2022
Development

No branches or pull requests

3 participants