Features

Improvements

  1. make copyTo command compatible with both 3 and 5 level hash directory structure.

Bugs

Assets 4

@jhpoelen jhpoelen released this Jan 31, 2019

Features

  1. add copyTo command to export or copy the versioned graphs and associated datasets to another location.
  2. add test command to test the existence and integrity of the versioned graphs and associated datasets in the data directory.

Improvements

  1. use 3 level directory structure (e.g., data/ae/18/ae18bf...) instead of 5 (e.g., data/ae/18/bf/ae18bf.../data) (related to #9)
  2. remove version index for individual datasets to reduce number of files in data dir (related to #9)
  3. remove time stamp index for graph versions and datasets to reduce number of files in data dir (related to #9)

Bugs

  1. include most recent crawl log when running preston ls.
Assets 4

@jhpoelen jhpoelen released this Oct 29, 2018 · 68 commits to master since this release

Features

  1. add initial support for tracking GBIF IPT via RSS feeds

Improvements

  1. add use case for GBIF Norway
  2. add more examples for scheduling update using systemd service / timers

Bugs

  1. use xsd:dateTime types for all timestamps
Assets 5

@jhpoelen jhpoelen released this Oct 20, 2018 · 95 commits to master since this release

Features

  1. add initial support for producing docker image tars
  2. add initial support for producing deb package

Improvements

  1. various documentation additions

Bugs

n/a

Assets 5

@jhpoelen jhpoelen released this Oct 17, 2018 · 100 commits to master since this release

Features

  1. add initial support for DataONE emls (see #3)
  2. add support for listing supported seeds using preston seeds

Improvements

  1. various documentation additions
  2. update apache's httpclient

Bugs

n/a

Assets 3

@jhpoelen jhpoelen released this Sep 18, 2018 · 118 commits to master since this release

Features

n/a

Improvements

  1. various documentation additions
  2. apply jar magic to make preston easier to launch on linux/mac operating systems.

Bugs

n/a

Assets 3

@jhpoelen jhpoelen released this Sep 6, 2018 · 155 commits to master since this release

Features

n/a

Improvements

  • documentation update
  • publish to Zenodo

Bug fixes

n/a

Assets 3

@jhpoelen jhpoelen released this Sep 5, 2018 · 163 commits to master since this release

Features

n/a

Improvements

  • support for GBIF suggestion like preston update "http://api.gbif.org/v1/dataset/suggest?q=Amazon&type=OCCURRENCE"

Bug fixes

  • re-enable preston ls command
Assets 3

@jhpoelen jhpoelen released this Sep 5, 2018 · 178 commits to master since this release

Features

  • keep track of biodiversity archives in GBIF, iDigBio and BioCASe using preston update
  • access offline archives using preston get
  • list local graph of biodiversity datasets using preston ls
  • show history of the biodiversity dataset graph using preston history
  • clone, copy, distribute by copying the datasets directory to ensure continued data access

Improvements

n/a

Bug fixes

n/a

Assets 3