Get basis of record categories

[peterdesmet]

Description

For a given dataset, I want to know how many records have a certain basis of record. I also want to know how many of those are invalid. I envision this as a bar chart, where the records are grouped in categories based on basis of record.

Outcome

dataset_key
bor_preserved_specimen  // Preserved specimens
bor_fossil_specimen     // Fossil specimens
bor_living_specimen     // Living specimens
bor_material_sample     // Material samples
bor_observation         // Observations
bor_human_observation   // Human observations
bor_machine_observation // Machine observations
bor_literature          // Literature occurrences
bor_unknown             // Unknown

Terms we need

basisOfRecord

Ideally, use null if count is 0.

Questions

• BASIS_OF_RECORD_INVALID returns 0 results. Most likely covered by Unknown evidence, can thus be ignored.
• The basisOfRecord categories that GBIF provides are mutually exclusive.

Process

/* Map basisOfRecord to categories */

[peterdesmet]

We can easily use the count API for this, e.g. http://api.gbif.org/v1/occurrence/count?datasetKey=4ce8e3f9-2546-4af1-b28d-e2eadf05dfd4&basisOfRecord=PRESERVED_SPECIMEN

[peterdesmet]

The count API would require another method + 9 calls to the API. Decided to use metrics_store instead. All 9 fields are now available in CartoDB.

[bartaelterman]

@niconoe based on the architecture proposal, I'm expecting the following tags in the extraction module output:

PRESERVED_SPECIMEN
FOSSIL_SPECIMEN
LIVING_SPECIMEN
OBSERVATION
HUMAN_OBSERVATION
MACHINE_OBSERVATION
MATERIAL_SAMPLE
LITERATURE
UNKNOWN

All under the tag basisofRecords.

I'll aggregate them and create a table with the desired columns defined in this issues body.

[niconoe]

Very good ! I'll implement a first version of my module today and will let you know!