Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scheming support #281

Merged
merged 57 commits into from
Jul 5, 2024
Merged

Scheming support #281

merged 57 commits into from
Jul 5, 2024

Commits on May 8, 2024

  1. [#56] Allow to provide a dataset schema to profiles

    This allows to check if a field should be stored as a custom field or an
    extra
    amercader committed May 8, 2024
    Configuration menu
    Copy the full SHA
    65abb1f View commit details
    Browse the repository at this point in the history
  2. [#56] Handle list values

    amercader committed May 8, 2024
    Configuration menu
    Copy the full SHA
    9faf5f5 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a808f72 View commit details
    Browse the repository at this point in the history
  4. [#56] Add draft schema

    amercader committed May 8, 2024
    Configuration menu
    Copy the full SHA
    d0b219e View commit details
    Browse the repository at this point in the history
  5. [#56] Add some examples

    amercader committed May 8, 2024
    Configuration menu
    Copy the full SHA
    7ee354a View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. Configuration menu
    Copy the full SHA
    9b847e9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    e6583aa View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Configuration menu
    Copy the full SHA
    d86f467 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. Configuration menu
    Copy the full SHA
    000baa4 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Configuration menu
    Copy the full SHA
    2d8d969 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    c5865fb View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a77d5c2 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    35657ef View commit details
    Browse the repository at this point in the history
  5. Merge branch '56-add-schema-file-dcat-ap-2.1' of github.com:ckan/ckan…

    …ext-dcat into 56-add-schema-file-dcat-ap-2.1
    amercader committed May 20, 2024
    Configuration menu
    Copy the full SHA
    62a7962 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. [#56] e2e test DCAT -> CKAN

    amercader committed May 21, 2024
    Configuration menu
    Copy the full SHA
    e0f15f5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0b6a8dd View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    20ac269 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5375232 View commit details
    Browse the repository at this point in the history

Commits on May 23, 2024

  1. Configuration menu
    Copy the full SHA
    9b0abce View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. Configuration menu
    Copy the full SHA
    e1b5f32 View commit details
    Browse the repository at this point in the history

Commits on May 28, 2024

  1. [#56] Test fixes

    amercader committed May 28, 2024
    Configuration menu
    Copy the full SHA
    2e4b4bc View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. [#56] Consolidate and simplify publisher handling

    Values for dct:publisher are obtained from the first one of these that
    are present:
    
    1. A scheming `publisher` field (assuming the `euro_dcat_ap_scheming`
       profile is loaded)
    2. The legacy `publisher_*` extras
    3. The dataset's own organization
    
    For the last case, a sample schema for organizations has been added that
    implements all the publisher properties supported by the processors.
    amercader committed May 29, 2024
    Configuration menu
    Copy the full SHA
    f9467d4 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    214d853 View commit details
    Browse the repository at this point in the history
  3. Fix merge errors

    amercader committed May 29, 2024
    Configuration menu
    Copy the full SHA
    1bce834 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. [#56] Add temporal extent

    amercader committed May 30, 2024
    Configuration menu
    Copy the full SHA
    cd1d3f0 View commit details
    Browse the repository at this point in the history
  2. [#56] Add support for spatial_coverage

    New repeating subfield, supporting all properties for the location
    class: uri, text, geom, bbox and centroid.
    Used spatial_coverage as name to not interfere with the `spatial` field
    expected by ckanext-scheming, in a future commit we will extract the
    relevant value to index it as a geometry.
    amercader committed May 30, 2024
    Configuration menu
    Copy the full SHA
    103aa08 View commit details
    Browse the repository at this point in the history
  3. [#56] Add missing var

    amercader committed May 30, 2024
    Configuration menu
    Copy the full SHA
    a862d77 View commit details
    Browse the repository at this point in the history
  4. [#56] Update repeating subfields indexing logic

    The previous field names based on indexes didn't allow to retrieve
    results easily. We are now flattening all values for the same subfield
    to at least get a text hit.
    
    See #281 (comment)
    amercader committed May 30, 2024
    Configuration menu
    Copy the full SHA
    aa23a70 View commit details
    Browse the repository at this point in the history
  5. [#56] Store geometry in spatial field for indexing

    If the `spatial_coverage` field is present, store the first geometry
    found so ckanext-spatial can pick it up for spatial indexing.
    
    Added indexing tests
    amercader committed May 30, 2024
    Configuration menu
    Copy the full SHA
    4256e73 View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. [#56] Add rest of DCAT-AP 1 and 2.1 fields

    At least the ones supported by the current processors.
    
    TODO:
    * spatial_resolution in meters: needs a new multiple_text_decimal validator
    * hvd_category: will be done as part of the wider HVD work
    amercader committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    afb74d1 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. [#56] Add spatial_resolution_in_meters

    This required a new scheming_multiple_number validator, adapted from
    scheming_multiple_text
    amercader committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    c6fc970 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    99b4c89 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4763d2b View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    1790404 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Configuration menu
    Copy the full SHA
    73523d6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d456c00 View commit details
    Browse the repository at this point in the history
  3. [#56] Common preset for DCAT date-based fields

    Support at the validator level for year, year-month, date and datetime
    values, which are correctly typed in the RDF serialization.
    At the UI level a date input is used by default as it was difficult to
    provide one that supported all inputs.
    amercader committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    b1e1718 View commit details
    Browse the repository at this point in the history
  4. [#56] Fix dates tests

    amercader committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    209fda5 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    634ff52 View commit details
    Browse the repository at this point in the history
  6. [#56] Help texts for all fields in the schema

    Mostly taken from the DCAT-AP 2.1 spec doc, adapted for CKAN
    amercader committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    8b78139 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    15b0cc1 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2024

  1. Configuration menu
    Copy the full SHA
    da8de09 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    602d505 View commit details
    Browse the repository at this point in the history
  3. [#56] Update README

    amercader committed Jun 10, 2024
    Configuration menu
    Copy the full SHA
    614e23b View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. [#56] README tweaks

    amercader committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    c11f3c2 View commit details
    Browse the repository at this point in the history
  2. [#56] Docstrings

    amercader committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    030cd3d View commit details
    Browse the repository at this point in the history
  3. [#56] Fix function call

    amercader committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    5fffa15 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Schemas description

    Co-authored-by: Ian Ward <ian@excess.org>
    amercader and wardi committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    ad35359 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. [#56] Index subfields as extras_ Solr field

    As this is a `text` field that allows free text search
    amercader committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    b600493 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f88e433 View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Configuration menu
    Copy the full SHA
    898912c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    97e68de View commit details
    Browse the repository at this point in the history
  3. [#56] Don't serialize empty repeating subfields

    Scheming adds a dict with empty keys when empty
    repeating subfields are submitted from the form. Check that there's an
    actual value before creating the triples when serializing
    amercader committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    a8a3f25 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. 1 Configuration menu
    Copy the full SHA
    c7b8c02 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Configuration menu
    Copy the full SHA
    39b4d91 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    31a69f5 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. Configuration menu
    Copy the full SHA
    ae78f0f View commit details
    Browse the repository at this point in the history