Persister

Kushal Kant Goyal edited this page Sep 21, 2015 · 5 revisions

Name: aidr-persister

Code: https://github.com/Qatar-Computing-Research-Institute/CrisisComputing/tree/master/aidr-persister

Overview

The aidr-persister module stores (persists) the items that have been collected and/or tagged into files. The items are persisted in JSON format in zip-compressed files.

The aidr-persister module also allow users to perform filtering and conversion operations on these files.

Filtering operations are the same ones as implemented in aidr-output.

Conversion operations are basically to allow three types of file format:

  • One JSON array containing all items.
  • One JSON object on a line per item.
  • One comma-separated-value (CSV) line per item.

The aidr-persister module has [no explicit per-collection start/stop](Per collection start or stop).

Technologies

  • Google GSON 2.2.4 (JSON processor)
  • JEDIS 2.4.2 (REDIS API library)
  • SuperCSV (CSV library)
  • Jersey 2+ (for JAX-RX 2.0)
  • FasterXML (JSON processor)

Module Dependencies

Clone this wiki locally
You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.
Press h to open a hovercard with more details.