Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DPV Resource Paper #131

Open
7 tasks done
coolharsh55 opened this issue Mar 14, 2024 · 6 comments
Open
7 tasks done

DPV Resource Paper #131

coolharsh55 opened this issue Mar 14, 2024 · 6 comments
Assignees
@coolharsh55 @besteves4
Labels
docs release WIP
Milestone
dpv v2.1

Comments

@coolharsh55
Copy link
Collaborator

coolharsh55 commented Mar 14, 2024 •
edited
Loading

Paper describing DPV as a resource and intended for submission to ISWC 2024 Resource Track. This issue is for assisting with discussions and keeping track of tasks.

  • create Overleaf project
  • analyse CFP requirements
  • identify existing paper describing a similar resource - e.g. DCAT v2
  • restructure sections based on identified information and content
  • analyse citations / adoption of DPV
  • prepare first draft by MAR-31
  • submit paper (deadline is APR-17)

Update: Paper submitted on APR-17. Preprints at arXiv and OSF. Awaiting reviews.
@besteves4
Copy link
Collaborator

For the "analyse citations / adoption of DPV" should we update the Adoption wiki or do you have anything else in mind? @coolharsh55

@coolharsh55
Copy link
Collaborator Author

Adoption wiki is okay - preferred since anyone from the group and edit it. In the future, the wiki is to be moved to github #129 - but I think that's some time away.

@coolharsh55 coolharsh55 added this to the dpv v2 milestone Apr 13, 2024
@coolharsh55
Copy link
Collaborator Author

Next step: post text of paper, and move this issue to next release (waiting for reviews)

@coolharsh55 coolharsh55 modified the milestones: dpv v2, dpv v2.1 Apr 23, 2024
@coolharsh55
Copy link
Collaborator Author

coolharsh55 commented Apr 24, 2024 •
edited
Loading

To add to the next/final version of the paper:

  • summary of vocabulary e.g. number of terms, classes, concepts
  • JLINC is an industry adopter of DPV
  • ARK platform uses DPV

@besteves4
Copy link
Collaborator

Inrupt's documentation mentioning use of DPV:

coolharsh55 added a commit that referenced this issue Jun 23, 2024
@coolharsh55
adds vocab metadata, removes red-text in HTML
0ada1cb 
- added following vocab metadata based on WIDOCO bestpractices
  https://dgarijo.github.io/Widoco/doc/bestPractices/index-en.html
  - bibo:status to all vocabs - only ai, eu-rights, and eu-aiact
    are drafts, the  rest are published
  - owl:versionIRI using the same vocab versioned IRI (using the generic
    unversioned IRI for vocab should be best practice, but it breaks all
    the RDF parsing code used to generate HTML)
  - dct:source which points to DPVCG page
  - rdfs:label - same as dct:title
  - dct:issued - same as dct:created
  - owl:versionInfo - same as schema:version
  - bibo:doi - points to a zenodo DOI link for the dataset (to be
    deposited when structure is finalised)
  - dct:biliographicCitation - points to the arXiv paper, see #131
  - dct:publisher - points to w3c website
  - foaf:logo - points to `media/logo.png` (added)
- tested with OOPS! (all good) and FOOPS! (73% results - will increase
  when the vocab is published at IRI, and there are false negatives
  regarding term label and definition - so result should be 100%)
- updates the HTML templates to remove red-text warning about changes
  that may happen as part of the v2 release
- adds statement to SotD section for draft vocabularies stating status
@coolharsh55
Copy link
Collaborator Author

coolharsh55 commented Jun 23, 2024 •
edited
Loading

To add to the next/final version of paper:

  • update IRI to 2.0 instead of v2.0
  • mention OOPS! and FOOPS! validation
  • Zenodo doi link: 10.5281/zenodo.12505841
  • CSV format
  • changelog link
  • updated diagram

coolharsh55 added a commit that referenced this issue Jul 13, 2024
@coolharsh55
merge dev
a92cd6f 
Squashed commit of the following:

commit 98cbe6e
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jul 10 21:40:39 2024 +0100

    minutes for 10 JUL 2024

commit 257c6ec
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jul 10 11:40:32 2024 +0100

    update packages to address security alert

    - https://github.com/w3c/dpv/security/dependabot/2

commit 8cf6364
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jul 10 08:51:56 2024 +0100

    Update issue and PR templates

commit e20acac
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jul 7 23:25:14 2024 +0100

    adds diagrams for AI, LEGAL, RISK, DPV

    - adds diagrams to DPV modules for processing context
    - adds diagrams to AI, LEGAL, LOC, and RISK extensions
    - LEGAL diagram is repeated on all legal pages

commit dffe587
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Fri Jul 5 21:53:41 2024 +0100

    add/update diagrams for DPV, TECH, PD, Primer

    - adds/updates diagrams in DPV, TECH, PD, and Primer
    - PD overview diagram
    - ProcessingContext diagram
    - Processing condition and Storage condition overview
    - Process diagram
    - diagrams are added in modules page in DPV

commit a5f6736
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jul 3 18:06:14 2024 +0100

    minutes for 26 JUN, 03 JUL 2024

commit d432113
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jul 1 17:08:08 2024 +0100

    add link to search index to HTML and README

    - added link to search index https://w3id.org/dpv/2.0/search
    - link is in DPV document macro
    - added link to README as part of summary and 2.0 section
    - removed stale issue in DPV spec about update for diagrams

commit 18967d9
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jul 1 16:55:38 2024 +0100

    added favicon, fixed search index page, 404 links

    - added favicon 32x32 and 16x16 to all web pages
    - fixed search index page which had stale path for scripts as ./media -
      the new path is ./diagrams
    - fixed 404 links in documents (same as above for scripts and css)

commit ddbb7f3
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jul 1 16:00:10 2024 +0100

    adds logo, edits README for 2.0 beta release

    - added logo
    - edited README for consolidated 2.0 instructions for release of beta
    - added badges for 2.0 and 1.0 (cosmetics)
    - removed contribution instructions and replaced it with link to wiki

commit 3ba32c6
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 29 18:53:39 2024 +0100

    update README with beta release notice

    - update repo README with beta release notice
    - update 1.0 and 2.0 notices for consistency

commit b5a0ef8
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 29 16:23:54 2024 +0100

    minor fixes, reference updates

    - changed range (includes) of DPV entity properties to dpv:Entity
      instead of dpv:EntityInvolvement - dpv:hasActiveEntity,
      dpv:hasPassiveEntity, and dpv:hasNonInvolvedEntity
    - added property tech:hasDocumentation which was missing and is needed
      to link to tech:Documentation concepts
    - fixed examples E000, E0043 for contents, and replaced non-ASCII
      quotation marks in examples where they occured
    - updated reference to DCAT which was titled with "DCAT v2" whereas we
      now have DCAT v3 as a proposed recommendation. Since the IRI will not
      be changing, the DCAT version is not mentioned in the title.

commit 5ddcf01
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 29 15:19:18 2024 +0100

    fix missing Contract in DPV Legal Basis section

    - contract was missing in DPV legal basis section (HTML)
    - fixed by generating the hierarchy without a head concept
    - issue is caused by Contract having parents from two different modules
      - dpv:LegalBasis and dpv:Agreement (Organisational measure)
    - future work here requires a fix to detect such overlapping concept and
      ensure they are not removed from the hierarchy
    - fix is in 300_generate_HTML.py function organise_hierarchy

commit a921489
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 29 15:15:25 2024 +0100

    fix search index being generated with random order

    - sort the items going into the search index so that their structure in
      the output search index page is not random in each generation
    - the random outputs showed up as git changes, which should be gone now

commit 4611ce6
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 29 14:45:00 2024 +0100

    truncate Primer by removing detailed sections

    - truncates (reduces length) Primer by removing detailed sections
    - detailed sections were those in Section 4 which provided a detailed
      explanation of concepts in DPV and had an overlap with the main DPV
      specification which also provided this information
    - the removal makes the Primer a much shorter document from 110 pages to
      47 pages (50% reduction) and limits to a superficial introduction of
      concepts present in DPV
    - the links provided after each overview of concept have been edited to
      remove references to further sections in the Primer, and only the
      links to DPV spec are now present
    - a Technology subsection has been added to the Processing Context
      section in the DPV specification for providing technology concepts

    Co-authored-by: Julian Flake <flake@uni-koblenz.de>

commit d03095f
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 29 12:33:03 2024 +0100

    rename media to diagrams, add DPV modules content

    - rename `/media` to `/diagrams` to maintain links in published v1 docs
    - rename `/2.0/media` to `/2.0/diagrams` for consistency
    - replace links in HTML documents to point to new diagrams folder
    - copy content from Primer to DPV 2.0 modules
    - fix various typos and missing links in HTML docs

commit 0395a19
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Sat Jun 29 09:13:11 2024 +0100

    adds diagrams with sources, adds to primer

    - adds diagrams with sources as PlantUML
    - adds diagrams to Primer

    Co-authored-by: Harshvardhan Pandit <me@harshp.com>

    Squashed commit of the following:

    commit 17e7b35
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Thu Jun 27 21:49:42 2024 +0100

        edit diagrams - use wbs and mindmap for taxonomies

        - includes fixes to missing concepts etc.
        - uses wbs and mindmap for taxonomy heavy diagrams by removign relations

    commit 1bc4d7c
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Thu Jun 27 09:50:33 2024 +0200

        use association name read direction instead of navigability direction

    commit b9038a4
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Thu Jun 27 09:27:17 2024 +0200

        Remaining primer diagrams replaced by PlantUML variants

    commit 23e3c38
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Tue Jun 25 10:12:38 2024 +0200

        Legal bases, Consent / Entitites diagrams

    commit cb5502f
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Mon Jun 24 22:38:30 2024 +0200

        Data / PersonalData updated

    commit 91feb94
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Mon Jun 24 08:53:18 2024 +0200

        more plantuml diagrams for primer; WiP

    commit 004bcf2
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Sun Jun 23 12:41:19 2024 +0200

        more plantuml diagrams for primer; WiP

    commit d0a179d
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Sat Jun 22 23:42:08 2024 +0200

        reorganized plantuml diagrams; WiP

    commit 892d05e
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Sat Jun 22 23:22:21 2024 +0200

        first plantuml attempts; WiP

commit f6332c6
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Thu Jun 27 19:56:48 2024 +0100

    fix duplicate scopeNote in CSV export

    - fix duplicate occurence of scopeNote in CSV export
    - solution is to SELECT DISTINCT in the SPARQL query

commit c5b5baf
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Thu Jun 27 13:45:56 2024 +0100

    fix previous version url in HTML documents

    - fixes previous version url present in HTML document header sections
      where v1.0 is replaced with 1.0
    - does not affect any concept IRI or RDF

commit f266292
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Thu Jun 27 09:33:46 2024 +0100

    adds red-text to HTML for review period

    - adds a red-text alert box in SotD section of all HTML documents
      stating there is a review/feedback period until 31 July
    - as per https://w3id.org/dpv/meetings/meeting-2024-06-26

commit d1ff146
Author: Beatriz Esteves <beatriz.gc.esteves@gmail.com>
Date:   Thu Jun 27 07:47:27 2024 +0100

    w3id config update for v2

    - updates the w3id config for v2 filepaths

commit 18e2fae
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Thu Jun 27 07:42:28 2024 +0100

    replace versioned IRI with versionless for v1

    - replaces versioned IRI e.g. https://w3id.org/dpv/1.0 with versionless
      IRI e.g. https://w3id.org/dpv
    - see commit f95cb29 for corresponding change to v2
    - change is made in different commits as the methods of changing the IRI
      are different for v1 (search+replace using sed) and v2 (use generation
      scripts for RDF and HTML)

commit f95cb29
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Thu Jun 27 07:28:52 2024 +0100

    replaces versioned IRI with versionless for terms

    - see #45 (comment)
    - affects #45 and #165
    - replaces versioned IRI e.g. https://w3id.org/dpv/2.0#Purpose for terms
      with the versionless IRI e.g. https://w3id.org/dpv#Purpose
    - following  Best practices for implementing fair vocabularies and
      ontologies on the web  https://arxiv.org/pdf/2003.13084

commit 3102267
Merge: 9d32f27 8901f9b
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jun 26 11:17:22 2024 +0100

    merge v2.0 commits

    - Merge branch 'dev'
    - see 2.0/changelog.html for detailed changes
    - see previous commits for detailed changes
    - folder structure changed to include 1.0 and 2.0 versions
    - IRIs changed to reflect versioned releases
    - new extensions added
    - various fixes
    - 1.0 IRI changed to include version info
    - examples, guides, primer updated

commit 8901f9b
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jun 26 07:19:43 2024 +0100

    fix usage notes in dpv rights

    - fix usage notes in DPV rights concepts so they don't imply the reused
      property is restricted to rights concepts e.g. "Indicates X" -> "Also
      used for indicating X"
    - added contributors to concepts in processing context, technical
      measures, tech provision

commit a6adefc
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jun 26 07:14:14 2024 +0100

    adds README to v1/v2 folders, updates changelog

    - adds README to 1.0 and 2.0 folders
    - updates v2 changelog: adds contributors and fixes references to v1/v2

commit ecdcabd
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jun 24 22:34:01 2024 +0100

    fix dpv:SensitivePersonalData parent

    - SensitivePersonalData had parent SensitiveData but not PersonalData
    - found by @nuthub -
      a3e9ec8#commitcomment-143480698

commit b57112c
Author: Beatriz Esteves <beatriz.gc.esteves@gmail.com>
Date:   Mon Jun 24 14:35:01 2024 +0200

    typo in README.md

commit 30521ff
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jun 24 13:14:24 2024 +0100

    fix IRI in DPV v1: replace "v1.0" with "1.0"

    - replaces IRI in all RDF and HTML files ; see #133
    - see #133 (comment)
    - thanks to @besteves4 for spotting the issue

commit 9d32f27
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jun 24 10:38:30 2024 +0100

    fix broken changelog link in README

commit a3e9ec8
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Mon Jun 24 09:40:03 2024 +0100

    fix DPV data taxonomy parents

    - parents were not correctly aligned in DPV data taxonomy
    - DerivedData is not GeneratedData as definition of generated data
      states it is not based on any other existing data
    - InferredData extends DerivedData
    - ObservedData extends CollectedData
    - GeneratedData definition changed to match GeneratedPersonalData
    - Derived, Inferred, Observed, Generated Personal Data parents changed
      to align them to Data concepts
    - SensitivePersonalData extends SensitiveData
    - IntellectualPropertyData and StatisticallyConfidentialData extend
      SensitiveData
    - issues identified by Julian

    Co-authored-by: Julian Flake <flake@uni-koblenz.de>

commit 6b82729
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jun 23 23:46:42 2024 +0100

    add syntax highlighting to examples

    - adds syntax highlighting to examples based on Pygments (added
      pip dependency - see requirements.txt)
    - syntax highlighting uses inline CSS and requires the ReSpec
      highlighting be disabled (manually add 'nohighlight' to <pre>)
    - includes cosmetic changes to search.html page with improved interface,
      added text in header and footer, and now showing the total number of
      classes and properties present in the index

commit d04e0db
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jun 23 23:45:49 2024 +0100

    fix incorrect HTML draft warning; sort term sources

    - In HTML pages, the warning (red text in SotD) was incorrectly being
      generated for all vocabularies as the bibo:status value was not
      correctly handled (rdflib uriref != python str), and because the value
      being compared was not equal to the full url e.g.
      bibo:status/published. This has been fixed.
    - In HTML term tables, the sources were being randomly ordered, causing
      git diffs to show these as changes even through the vocabulary had not
      changed. This has been fixed by sorting the references before putting
      them in the term table.

commit 0ada1cb
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jun 23 10:54:28 2024 +0100

    adds vocab metadata, removes red-text in HTML

    - added following vocab metadata based on WIDOCO bestpractices
      https://dgarijo.github.io/Widoco/doc/bestPractices/index-en.html
      - bibo:status to all vocabs - only ai, eu-rights, and eu-aiact
        are drafts, the  rest are published
      - owl:versionIRI using the same vocab versioned IRI (using the generic
        unversioned IRI for vocab should be best practice, but it breaks all
        the RDF parsing code used to generate HTML)
      - dct:source which points to DPVCG page
      - rdfs:label - same as dct:title
      - dct:issued - same as dct:created
      - owl:versionInfo - same as schema:version
      - bibo:doi - points to a zenodo DOI link for the dataset (to be
        deposited when structure is finalised)
      - dct:biliographicCitation - points to the arXiv paper, see #131
      - dct:publisher - points to w3c website
      - foaf:logo - points to `media/logo.png` (added)
    - tested with OOPS! (all good) and FOOPS! (73% results - will increase
      when the vocab is published at IRI, and there are false negatives
      regarding term label and definition - so result should be 100%)
    - updates the HTML templates to remove red-text warning about changes
      that may happen as part of the v2 release
    - adds statement to SotD section for draft vocabularies stating status

commit 6d88747
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jun 23 09:29:31 2024 +0100

    changes version namespace, IRI, folders as vX to X

    - see #45 #45 (comment)
    - DPV versions were expressed as "v2.0" and this string was used in the
      IRIs, folder structures, etc. Following the best practice
      recommendation of not starting versions with letters, the prefix 'v'
      has been dropped and all RDF, HTML, and other resources have been
      regenerated

commit df32012
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jun 23 09:12:14 2024 +0100

    fix DPV Processing Context parent class/property

    - DPV Processing Context EntityNonInvolvement did not have
      EntityInvolvement asserted as parent concept
    - Same as above, hasActiveEntity, hasPassiveEntity, hasNonInvolvedEntity
      did not have hasEntity asserted as parent property

commit a7c4b5c
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sun Jun 23 09:08:46 2024 +0100

    improvements to search index page

    - adds both classes and properties to the index
    - adds annotation indicating whether concept is class or property
    - adds visual enhancements to highlight concepts selected

commit fe0cbb0
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 22 20:01:02 2024 +0100

    added search index page for DPV v2.0

    - added a search index page where all concepts from DPV and all
      extensions are listed in a hierarchy, and a search bar is provided for
      searching and filtering through them
    - the HTML genreation script automatically updates the search index page
      so no manual tweaking is needed
    - page should be available at https://w3id.org/dpv/v2.0/search
    - dev version is available at https://dev.dpvcg.org/v2.0/search

commit d01c764
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jun 22 19:54:25 2024 +0100

    fix typos in concepts, types, associations

    - EU-GDPR added concept `AdequacyDecision` as an extension of A45-3, and
      the specific adequacy decisions are instances of this concept
    - EU-GDPR added concept `DataProtectionAuthority` as an extension of DPV
      DataProtectionAuthority, and all DPAs are an instance of this concept
    - EU-AIAct fixed typo in AIRegulatorySandbox parent "OrganisationMeasure"
      which should be "OrganisationalMeasure"
    - Removed `dpv:Authority` from LEGAL-US, LEGAL-GB, and others as they
      are already defined as `dpv:DataProtectionAuthority`
    - changed RDF generation so that laws and other legal concepts have a
      `skos:broader` triple added for their type e.g. `dpv:Law`
    - RISK: added concept `RiskAnalysis` which is needed for the concept
      `RiskMatrix` and its instances
    - DPV Processing Context: changed parent of hasStorageCondition from
      ProcessingCondition (which is class) to hasProcessingCondition
      (which is a property)

commit 8fc28e6
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Fri Jun 21 00:29:34 2024 +0100

    point changelog link in README to dev version

    - points the changelog link in README to
      https://dev.dpvcg.org/v2.0/changelog until the dev branch is merged
    - commit c12aeed overrides this and will replace the link back to
      https://w3id.org/dpv/v2.0/changelog when merged from dev

commit 96ba8f8
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jun 19 13:21:03 2024 +0100

    minutes for 05,12,19 JUN 2024

    - contains minutes for meetings on:
        - 05 JUN 2024
        - 12 JUN 2024
        - 19 JUN 2024

commit e167b9a
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Wed Jun 19 00:59:09 2024 +0100

    closes #159 broken modules link in DPV spec

    - thanks to @jeswr @TallTed
coolharsh55 added a commit that referenced this issue Jul 13, 2024
@coolharsh55
Merge branch diagram; fix typos; refactor guides
a240ec8 
- moved diagrams from /diagrams to /2.0/diagrams
- replaced paths for diagrams from */media to */diagrams
- all diagrams should be in 2.0/diagrams
- fixed typos in:
    - dpv entities module HTML: hasIdentifier is not present on page
    - dpv processing module HTML: Retrieving -> Retrieve
- eu-gdpr: change layout of diagrams from LR to TB, rights mindmap
- fix diagram names/paths in primer
- add external diagrams needed for ISO 27560 consent guide to repo
- see #166
- adds generation of guides to 300_generate_HTML.py
- moves diagrams for consent-27560 guide to 2.0/diagrams
- moves guides config (template, output path) to vocab_management.py
- guides now show the draft / BETA release message through common macro

Squashed commit of the following:

commit 3da07ec
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jul 13 11:49:06 2024 +0100

    adds guides HTML generation to 300 script

    - adds generation of guides to 300_generate_HTML.py
    - moves diagrams for consent-27560 guide to 2.0/diagrams
    - moves guides config (template, output path) to vocab_management.py
    - guides now show the draft / BETA release message through common macro

commit 35c3e11
Merge: fb00078 98cbe6e
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jul 13 12:22:04 2024 +0100

    Merge branch diagram and dev

commit fb00078
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jul 13 10:13:28 2024 +0100

    rebase diagrams ; fix typos

    - moved diagrams from /diagrams to /2.0/diagrams
    - replaced paths for diagrams from */media to */diagrams
    - all diagrams should be in 2.0/diagrams
    - fixed typos in:
      - dpv entities module HTML: hasIdentifier is not present on page
      - dpv processing module HTML: Retrieving -> Retrieve
    - eu-gdpr: change layout of diagrams from LR to TB, rights mindmap
    - fix diagram names/paths in primer
    - add external diagrams needed for ISO 27560 consent guide to repo

commit a92cd6f
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Sat Jul 13 08:54:24 2024 +0100

    merge dev

    Squashed commit of the following:

    commit 98cbe6e
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jul 10 21:40:39 2024 +0100

        minutes for 10 JUL 2024

    commit 257c6ec
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jul 10 11:40:32 2024 +0100

        update packages to address security alert

        - https://github.com/w3c/dpv/security/dependabot/2

    commit 8cf6364
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jul 10 08:51:56 2024 +0100

        Update issue and PR templates

    commit e20acac
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jul 7 23:25:14 2024 +0100

        adds diagrams for AI, LEGAL, RISK, DPV

        - adds diagrams to DPV modules for processing context
        - adds diagrams to AI, LEGAL, LOC, and RISK extensions
        - LEGAL diagram is repeated on all legal pages

    commit dffe587
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Fri Jul 5 21:53:41 2024 +0100

        add/update diagrams for DPV, TECH, PD, Primer

        - adds/updates diagrams in DPV, TECH, PD, and Primer
        - PD overview diagram
        - ProcessingContext diagram
        - Processing condition and Storage condition overview
        - Process diagram
        - diagrams are added in modules page in DPV

    commit a5f6736
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jul 3 18:06:14 2024 +0100

        minutes for 26 JUN, 03 JUL 2024

    commit d432113
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jul 1 17:08:08 2024 +0100

        add link to search index to HTML and README

        - added link to search index https://w3id.org/dpv/2.0/search
        - link is in DPV document macro
        - added link to README as part of summary and 2.0 section
        - removed stale issue in DPV spec about update for diagrams

    commit 18967d9
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jul 1 16:55:38 2024 +0100

        added favicon, fixed search index page, 404 links

        - added favicon 32x32 and 16x16 to all web pages
        - fixed search index page which had stale path for scripts as ./media -
          the new path is ./diagrams
        - fixed 404 links in documents (same as above for scripts and css)

    commit ddbb7f3
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jul 1 16:00:10 2024 +0100

        adds logo, edits README for 2.0 beta release

        - added logo
        - edited README for consolidated 2.0 instructions for release of beta
        - added badges for 2.0 and 1.0 (cosmetics)
        - removed contribution instructions and replaced it with link to wiki

    commit 3ba32c6
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 29 18:53:39 2024 +0100

        update README with beta release notice

        - update repo README with beta release notice
        - update 1.0 and 2.0 notices for consistency

    commit b5a0ef8
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 29 16:23:54 2024 +0100

        minor fixes, reference updates

        - changed range (includes) of DPV entity properties to dpv:Entity
          instead of dpv:EntityInvolvement - dpv:hasActiveEntity,
          dpv:hasPassiveEntity, and dpv:hasNonInvolvedEntity
        - added property tech:hasDocumentation which was missing and is needed
          to link to tech:Documentation concepts
        - fixed examples E000, E0043 for contents, and replaced non-ASCII
          quotation marks in examples where they occured
        - updated reference to DCAT which was titled with "DCAT v2" whereas we
          now have DCAT v3 as a proposed recommendation. Since the IRI will not
          be changing, the DCAT version is not mentioned in the title.

    commit 5ddcf01
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 29 15:19:18 2024 +0100

        fix missing Contract in DPV Legal Basis section

        - contract was missing in DPV legal basis section (HTML)
        - fixed by generating the hierarchy without a head concept
        - issue is caused by Contract having parents from two different modules
          - dpv:LegalBasis and dpv:Agreement (Organisational measure)
        - future work here requires a fix to detect such overlapping concept and
          ensure they are not removed from the hierarchy
        - fix is in 300_generate_HTML.py function organise_hierarchy

    commit a921489
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 29 15:15:25 2024 +0100

        fix search index being generated with random order

        - sort the items going into the search index so that their structure in
          the output search index page is not random in each generation
        - the random outputs showed up as git changes, which should be gone now

    commit 4611ce6
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 29 14:45:00 2024 +0100

        truncate Primer by removing detailed sections

        - truncates (reduces length) Primer by removing detailed sections
        - detailed sections were those in Section 4 which provided a detailed
          explanation of concepts in DPV and had an overlap with the main DPV
          specification which also provided this information
        - the removal makes the Primer a much shorter document from 110 pages to
          47 pages (50% reduction) and limits to a superficial introduction of
          concepts present in DPV
        - the links provided after each overview of concept have been edited to
          remove references to further sections in the Primer, and only the
          links to DPV spec are now present
        - a Technology subsection has been added to the Processing Context
          section in the DPV specification for providing technology concepts

        Co-authored-by: Julian Flake <flake@uni-koblenz.de>

    commit d03095f
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 29 12:33:03 2024 +0100

        rename media to diagrams, add DPV modules content

        - rename `/media` to `/diagrams` to maintain links in published v1 docs
        - rename `/2.0/media` to `/2.0/diagrams` for consistency
        - replace links in HTML documents to point to new diagrams folder
        - copy content from Primer to DPV 2.0 modules
        - fix various typos and missing links in HTML docs

    commit 0395a19
    Author: Julian Flake <flake@uni-koblenz.de>
    Date:   Sat Jun 29 09:13:11 2024 +0100

        adds diagrams with sources, adds to primer

        - adds diagrams with sources as PlantUML
        - adds diagrams to Primer

        Co-authored-by: Harshvardhan Pandit <me@harshp.com>

        Squashed commit of the following:

        commit 17e7b35
        Author: Harshvardhan Pandit <me@harshp.com>
        Date:   Thu Jun 27 21:49:42 2024 +0100

            edit diagrams - use wbs and mindmap for taxonomies

            - includes fixes to missing concepts etc.
            - uses wbs and mindmap for taxonomy heavy diagrams by removign relations

        commit 1bc4d7c
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Thu Jun 27 09:50:33 2024 +0200

            use association name read direction instead of navigability direction

        commit b9038a4
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Thu Jun 27 09:27:17 2024 +0200

            Remaining primer diagrams replaced by PlantUML variants

        commit 23e3c38
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Tue Jun 25 10:12:38 2024 +0200

            Legal bases, Consent / Entitites diagrams

        commit cb5502f
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Mon Jun 24 22:38:30 2024 +0200

            Data / PersonalData updated

        commit 91feb94
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Mon Jun 24 08:53:18 2024 +0200

            more plantuml diagrams for primer; WiP

        commit 004bcf2
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Sun Jun 23 12:41:19 2024 +0200

            more plantuml diagrams for primer; WiP

        commit d0a179d
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Sat Jun 22 23:42:08 2024 +0200

            reorganized plantuml diagrams; WiP

        commit 892d05e
        Author: Julian Flake <flake@uni-koblenz.de>
        Date:   Sat Jun 22 23:22:21 2024 +0200

            first plantuml attempts; WiP

    commit f6332c6
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Thu Jun 27 19:56:48 2024 +0100

        fix duplicate scopeNote in CSV export

        - fix duplicate occurence of scopeNote in CSV export
        - solution is to SELECT DISTINCT in the SPARQL query

    commit c5b5baf
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Thu Jun 27 13:45:56 2024 +0100

        fix previous version url in HTML documents

        - fixes previous version url present in HTML document header sections
          where v1.0 is replaced with 1.0
        - does not affect any concept IRI or RDF

    commit f266292
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Thu Jun 27 09:33:46 2024 +0100

        adds red-text to HTML for review period

        - adds a red-text alert box in SotD section of all HTML documents
          stating there is a review/feedback period until 31 July
        - as per https://w3id.org/dpv/meetings/meeting-2024-06-26

    commit d1ff146
    Author: Beatriz Esteves <beatriz.gc.esteves@gmail.com>
    Date:   Thu Jun 27 07:47:27 2024 +0100

        w3id config update for v2

        - updates the w3id config for v2 filepaths

    commit 18e2fae
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Thu Jun 27 07:42:28 2024 +0100

        replace versioned IRI with versionless for v1

        - replaces versioned IRI e.g. https://w3id.org/dpv/1.0 with versionless
          IRI e.g. https://w3id.org/dpv
        - see commit f95cb29 for corresponding change to v2
        - change is made in different commits as the methods of changing the IRI
          are different for v1 (search+replace using sed) and v2 (use generation
          scripts for RDF and HTML)

    commit f95cb29
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Thu Jun 27 07:28:52 2024 +0100

        replaces versioned IRI with versionless for terms

        - see #45 (comment)
        - affects #45 and #165
        - replaces versioned IRI e.g. https://w3id.org/dpv/2.0#Purpose for terms
          with the versionless IRI e.g. https://w3id.org/dpv#Purpose
        - following  Best practices for implementing fair vocabularies and
          ontologies on the web  https://arxiv.org/pdf/2003.13084

    commit 3102267
    Merge: 9d32f27 8901f9b
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jun 26 11:17:22 2024 +0100

        merge v2.0 commits

        - Merge branch 'dev'
        - see 2.0/changelog.html for detailed changes
        - see previous commits for detailed changes
        - folder structure changed to include 1.0 and 2.0 versions
        - IRIs changed to reflect versioned releases
        - new extensions added
        - various fixes
        - 1.0 IRI changed to include version info
        - examples, guides, primer updated

    commit 8901f9b
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jun 26 07:19:43 2024 +0100

        fix usage notes in dpv rights

        - fix usage notes in DPV rights concepts so they don't imply the reused
          property is restricted to rights concepts e.g. "Indicates X" -> "Also
          used for indicating X"
        - added contributors to concepts in processing context, technical
          measures, tech provision

    commit a6adefc
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jun 26 07:14:14 2024 +0100

        adds README to v1/v2 folders, updates changelog

        - adds README to 1.0 and 2.0 folders
        - updates v2 changelog: adds contributors and fixes references to v1/v2

    commit ecdcabd
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jun 24 22:34:01 2024 +0100

        fix dpv:SensitivePersonalData parent

        - SensitivePersonalData had parent SensitiveData but not PersonalData
        - found by @nuthub -
          a3e9ec8#commitcomment-143480698

    commit b57112c
    Author: Beatriz Esteves <beatriz.gc.esteves@gmail.com>
    Date:   Mon Jun 24 14:35:01 2024 +0200

        typo in README.md

    commit 30521ff
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jun 24 13:14:24 2024 +0100

        fix IRI in DPV v1: replace "v1.0" with "1.0"

        - replaces IRI in all RDF and HTML files ; see #133
        - see #133 (comment)
        - thanks to @besteves4 for spotting the issue

    commit 9d32f27
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jun 24 10:38:30 2024 +0100

        fix broken changelog link in README

    commit a3e9ec8
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Mon Jun 24 09:40:03 2024 +0100

        fix DPV data taxonomy parents

        - parents were not correctly aligned in DPV data taxonomy
        - DerivedData is not GeneratedData as definition of generated data
          states it is not based on any other existing data
        - InferredData extends DerivedData
        - ObservedData extends CollectedData
        - GeneratedData definition changed to match GeneratedPersonalData
        - Derived, Inferred, Observed, Generated Personal Data parents changed
          to align them to Data concepts
        - SensitivePersonalData extends SensitiveData
        - IntellectualPropertyData and StatisticallyConfidentialData extend
          SensitiveData
        - issues identified by Julian

        Co-authored-by: Julian Flake <flake@uni-koblenz.de>

    commit 6b82729
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jun 23 23:46:42 2024 +0100

        add syntax highlighting to examples

        - adds syntax highlighting to examples based on Pygments (added
          pip dependency - see requirements.txt)
        - syntax highlighting uses inline CSS and requires the ReSpec
          highlighting be disabled (manually add 'nohighlight' to <pre>)
        - includes cosmetic changes to search.html page with improved interface,
          added text in header and footer, and now showing the total number of
          classes and properties present in the index

    commit d04e0db
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jun 23 23:45:49 2024 +0100

        fix incorrect HTML draft warning; sort term sources

        - In HTML pages, the warning (red text in SotD) was incorrectly being
          generated for all vocabularies as the bibo:status value was not
          correctly handled (rdflib uriref != python str), and because the value
          being compared was not equal to the full url e.g.
          bibo:status/published. This has been fixed.
        - In HTML term tables, the sources were being randomly ordered, causing
          git diffs to show these as changes even through the vocabulary had not
          changed. This has been fixed by sorting the references before putting
          them in the term table.

    commit 0ada1cb
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jun 23 10:54:28 2024 +0100

        adds vocab metadata, removes red-text in HTML

        - added following vocab metadata based on WIDOCO bestpractices
          https://dgarijo.github.io/Widoco/doc/bestPractices/index-en.html
          - bibo:status to all vocabs - only ai, eu-rights, and eu-aiact
            are drafts, the  rest are published
          - owl:versionIRI using the same vocab versioned IRI (using the generic
            unversioned IRI for vocab should be best practice, but it breaks all
            the RDF parsing code used to generate HTML)
          - dct:source which points to DPVCG page
          - rdfs:label - same as dct:title
          - dct:issued - same as dct:created
          - owl:versionInfo - same as schema:version
          - bibo:doi - points to a zenodo DOI link for the dataset (to be
            deposited when structure is finalised)
          - dct:biliographicCitation - points to the arXiv paper, see #131
          - dct:publisher - points to w3c website
          - foaf:logo - points to `media/logo.png` (added)
        - tested with OOPS! (all good) and FOOPS! (73% results - will increase
          when the vocab is published at IRI, and there are false negatives
          regarding term label and definition - so result should be 100%)
        - updates the HTML templates to remove red-text warning about changes
          that may happen as part of the v2 release
        - adds statement to SotD section for draft vocabularies stating status

    commit 6d88747
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jun 23 09:29:31 2024 +0100

        changes version namespace, IRI, folders as vX to X

        - see #45 #45 (comment)
        - DPV versions were expressed as "v2.0" and this string was used in the
          IRIs, folder structures, etc. Following the best practice
          recommendation of not starting versions with letters, the prefix 'v'
          has been dropped and all RDF, HTML, and other resources have been
          regenerated

    commit df32012
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jun 23 09:12:14 2024 +0100

        fix DPV Processing Context parent class/property

        - DPV Processing Context EntityNonInvolvement did not have
          EntityInvolvement asserted as parent concept
        - Same as above, hasActiveEntity, hasPassiveEntity, hasNonInvolvedEntity
          did not have hasEntity asserted as parent property

    commit a7c4b5c
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sun Jun 23 09:08:46 2024 +0100

        improvements to search index page

        - adds both classes and properties to the index
        - adds annotation indicating whether concept is class or property
        - adds visual enhancements to highlight concepts selected

    commit fe0cbb0
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 22 20:01:02 2024 +0100

        added search index page for DPV v2.0

        - added a search index page where all concepts from DPV and all
          extensions are listed in a hierarchy, and a search bar is provided for
          searching and filtering through them
        - the HTML genreation script automatically updates the search index page
          so no manual tweaking is needed
        - page should be available at https://w3id.org/dpv/v2.0/search
        - dev version is available at https://dev.dpvcg.org/v2.0/search

    commit d01c764
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Sat Jun 22 19:54:25 2024 +0100

        fix typos in concepts, types, associations

        - EU-GDPR added concept `AdequacyDecision` as an extension of A45-3, and
          the specific adequacy decisions are instances of this concept
        - EU-GDPR added concept `DataProtectionAuthority` as an extension of DPV
          DataProtectionAuthority, and all DPAs are an instance of this concept
        - EU-AIAct fixed typo in AIRegulatorySandbox parent "OrganisationMeasure"
          which should be "OrganisationalMeasure"
        - Removed `dpv:Authority` from LEGAL-US, LEGAL-GB, and others as they
          are already defined as `dpv:DataProtectionAuthority`
        - changed RDF generation so that laws and other legal concepts have a
          `skos:broader` triple added for their type e.g. `dpv:Law`
        - RISK: added concept `RiskAnalysis` which is needed for the concept
          `RiskMatrix` and its instances
        - DPV Processing Context: changed parent of hasStorageCondition from
          ProcessingCondition (which is class) to hasProcessingCondition
          (which is a property)

    commit 8fc28e6
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Fri Jun 21 00:29:34 2024 +0100

        point changelog link in README to dev version

        - points the changelog link in README to
          https://dev.dpvcg.org/v2.0/changelog until the dev branch is merged
        - commit c12aeed overrides this and will replace the link back to
          https://w3id.org/dpv/v2.0/changelog when merged from dev

    commit 96ba8f8
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jun 19 13:21:03 2024 +0100

        minutes for 05,12,19 JUN 2024

        - contains minutes for meetings on:
            - 05 JUN 2024
            - 12 JUN 2024
            - 19 JUN 2024

    commit e167b9a
    Author: Harshvardhan Pandit <me@harshp.com>
    Date:   Wed Jun 19 00:59:09 2024 +0100

        closes #159 broken modules link in DPV spec

        - thanks to @jeswr @TallTed

commit 47b8b89
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Thu Jul 11 13:35:37 2024 +0200

    GDPR Diagrams as SVG WiP

commit 9858a83
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Wed Jul 10 14:41:31 2024 +0200

    GDPR diagram proposals (#166)

commit 17e7b35
Author: Harshvardhan Pandit <me@harshp.com>
Date:   Thu Jun 27 21:49:42 2024 +0100

    edit diagrams - use wbs and mindmap for taxonomies

    - includes fixes to missing concepts etc.
    - uses wbs and mindmap for taxonomy heavy diagrams by removign relations

commit 1bc4d7c
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Thu Jun 27 09:50:33 2024 +0200

    use association name read direction instead of navigability direction

commit b9038a4
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Thu Jun 27 09:27:17 2024 +0200

    Remaining primer diagrams replaced by PlantUML variants

commit 23e3c38
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Tue Jun 25 10:12:38 2024 +0200

    Legal bases, Consent / Entitites diagrams

commit cb5502f
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Mon Jun 24 22:38:30 2024 +0200

    Data / PersonalData updated

commit 91feb94
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Mon Jun 24 08:53:18 2024 +0200

    more plantuml diagrams for primer; WiP

commit 004bcf2
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Sun Jun 23 12:41:19 2024 +0200

    more plantuml diagrams for primer; WiP

commit d0a179d
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Sat Jun 22 23:42:08 2024 +0200

    reorganized plantuml diagrams; WiP

commit 892d05e
Author: Julian Flake <flake@uni-koblenz.de>
Date:   Sat Jun 22 23:22:21 2024 +0200

    first plantuml attempts; WiP
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@coolharsh55 coolharsh55

@besteves4 besteves4

Labels
docs release WIP
Projects
None yet
Milestone
dpv v2.1
Development

No branches or pull requests
2 participants
@coolharsh55 @besteves4