Skip to content

Releases: metno/pyaro

v0.3.3

Choose a tag to compare

@heikoklein heikoklein released this 09 Oct 19:14

Full Changelog: v0.3.2...v0.3.3

v0.3.2

Choose a tag to compare

@heikoklein heikoklein released this 28 Sep 10:50

What's Changed

Full Changelog: v0.3.1...v0.3.2

v0.3.1

Choose a tag to compare

@heikoklein heikoklein released this 23 Sep 15:55

What's Changed

Full Changelog: v0.3.0...v0.3.1

v0.3.0: Memory efficiency and Metadata Convention

Choose a tag to compare

@heikoklein heikoklein released this 22 Sep 11:24

The 0.3.0 release enables a more memory efficient data-structure for the Data-section of pyaro, identifying stations by integer ids rather than full station -names. In addition, pyaro has now a Metadata Convention, to avoid metadata fragmentation.

For this the interface has been extended with:

  • add Data.station_ids
  • add Data.unique_by_keys()
  • removed requirement for Data.keys()
  • add new implementation of Data, called DataStationIdStructured separating stations and measurements in a memory efficient way
  • Metadata-Convention
  • bump minor version to 0.3 to indicate api-changes

The new DataStationIdStructured is a drop-in replacement for NpStructuredData. But rather than repeating all
columns like station, latitude, longitude, altitude for each data-point (hourly measurement), it uses internally two separate datatables, one for the station-information and one for the time-series data-point.

A single additional measurement for an existing station will be reduced from 310 bytes to 30 bytes. A new station will require 268 bytes + an dictionary entry (string(256bytes) to int(4 bytes)) mapping. Per one station (overhead estimated as 1kB):

NpStructuredData DataStationIdStructured
1 year of hourly data 2652 kB 257 kB
1 year of daily data 110 kB 11kB
1 year of monthly data 3.6 kB 1.4 kB

What's Changed

Full Changelog: v0.2.1...v0.3.0

v0.2.1

Choose a tag to compare

@heikoklein heikoklein released this 10 Jun 08:14
  • Fix of valley-floor filter for stations very close to the poles #91

Full Changelog: v0.2.0...v0.2.1

v0.2.0

Choose a tag to compare

@heikoklein heikoklein released this 13 May 14:37

What's Changed

Full Changelog: v0.1.3...v0.2.0

v0.1.3

Choose a tag to compare

@thorbjoernl thorbjoernl released this 06 May 11:53
99dc048

What's Changed

  • [fix] Set default variable_units to an empty dict by @thorbjoernl in #88
  • [performance] Improve performance of valley floor filter by ≃38x by @thorbjoernl in #87

Full Changelog: v0.1.2...v0.1.3

v0.1.2

Choose a tag to compare

@thorbjoernl thorbjoernl released this 03 Apr 11:03
707bcad

What's Changed

  • Support csv files with arbitrary length headers by @magnusuMET in #80
  • fix: Issue where multiple times use of valleyfloor_filter would raise an exception by @magnusuMET in #81

Full Changelog: v0.1.1...v0.1.2

v0.1.1

Choose a tag to compare

@thorbjoernl thorbjoernl released this 07 Jan 12:05
627c6e5

What's Changed

Full Changelog: v0.1.0...v0.1.1

v0.1.0

Choose a tag to compare

@thorbjoernl thorbjoernl released this 12 Nov 15:27
778e74e

What's Changed

New Contributors

Full Changelog: v0.0.14...v0.1.0