Feature request: number of records constraints

[aborruso]

Overview

Hi,
below you have one of the official documentation yaml file. There some constraints fields related.

A lot of time I know that I know that a resource is valid only if it is made up of at least 365 rows (some annual dataset including leap years). Or that the rows shouldn't be more than 10.

I think it should be a great validate and check feature to have.

Thank you

dialect:
  delimiter: ;
encoding: utf-8
format: csv
hashing: md5
layout:
  headerRows:
    - 2
name: country-2
path: country-2.csv
profile: tabular-data-resource
schema:
  fields:
    - name: id
      title: Identifier
      type: integer
    - name: neighbor_id
      title: Identifier of the neighbor
      type: integer
    - name: name
      title: Name of the country
      type: string
    - constraints:
        minimum: 0
      description: According to the year 2020's data
      name: population
      title: Population
      type: integer
  foreignKeys:
    - fields:
        - neighbor_id
      reference:
        fields:
          - id
        resource: ''
scheme: file

---

Please preserve this line to notify @roll (lead of this repository)

[roll]

@aborruso
Regarding an API. Have I understood your idea correctly if I see it as something like a checks.table_dimension check:

table_dimension
    minimum_fields?
    maximum_fields?
    minimum_rows?
    maximum_rows?
    number_rows?

[aborruso]

The maximum_fields probably is not necessary, because in the schema you have exactly the required fields, you can't have more and you can't have less. The number of lines is variable and you should have some constraints.

Than

minimum_rows
maximum_rows

Thank you

[aborruso]

And probably also number_rows to set a fixed one

[roll]

Fields limit might be useful for cases when a schema is not provided so probably it will make sense to provide these options as well (while it's very easy)

[roll]

And probably also number_rows to set a fixed one

👍

[aborruso]

Wow, thank you very much @roll !!!

[roll]

@aborruso
Thanks to @aivuk 😃

[aborruso]

@roll Is there a new documentation section, on how to use it?

[roll]

@aborruso
Thanks, for the heads-up, we're on it 👍

[roll]

Hi @aborruso,

https://framework.frictionlessdata.io/docs/guides/validation-checks/#table-dimensions

[aborruso]

@roll as usual, you are very kind. Thank you

[aborruso]

https://framework.frictionlessdata.io/docs/guides/validation-checks/#table-dimensions

@roll how to run via cli this check? In example num_rows=5.

Thank you

[roll]

Hi @aborruso,

I've created a feature request for it - #1078 - we will be on it soon

[aborruso]

I've created a feature request for it - #1078 - we will be on it soon

WOW, really great