Repository navigation
Releases: metno/pyaro
Release list
v0.3.3
- memory reduction in DataStationIdStructured when accessing station data like latitude/longitude/altitude
Full Changelog: v0.3.2...v0.3.3
v0.3.2
v0.3.1
What's Changed
- Memory efficient datastructure for Data by @heikoklein in #93
- implement and document stations_by_id better by @heikoklein in #94
Full Changelog: v0.3.0...v0.3.1
v0.3.0: Memory efficiency and Metadata Convention
The 0.3.0 release enables a more memory efficient data-structure for the Data-section of pyaro, identifying stations by integer ids rather than full station -names. In addition, pyaro has now a Metadata Convention, to avoid metadata fragmentation.
For this the interface has been extended with:
- add
Data.station_ids - add
Data.unique_by_keys() - removed requirement for
Data.keys() - add new implementation of
Data, calledDataStationIdStructuredseparating stations and measurements in a memory efficient way - Metadata-Convention
- bump minor version to 0.3 to indicate api-changes
The new DataStationIdStructured is a drop-in replacement for NpStructuredData. But rather than repeating all
columns like station, latitude, longitude, altitude for each data-point (hourly measurement), it uses internally two separate datatables, one for the station-information and one for the time-series data-point.
A single additional measurement for an existing station will be reduced from 310 bytes to 30 bytes. A new station will require 268 bytes + an dictionary entry (string(256bytes) to int(4 bytes)) mapping. Per one station (overhead estimated as 1kB):
| NpStructuredData | DataStationIdStructured | |
|---|---|---|
| 1 year of hourly data | 2652 kB | 257 kB |
| 1 year of daily data | 110 kB | 11kB |
| 1 year of monthly data | 3.6 kB | 1.4 kB |
What's Changed
- Memory efficient data-structure by @heikoklein in #93
- Metadata conventions for pyaro by @heikoklein in #92
Full Changelog: v0.2.1...v0.3.0
v0.2.1
- Fix of valley-floor filter for stations very close to the poles #91
Full Changelog: v0.2.0...v0.2.1
v0.2.0
What's Changed
- 202505 release by @thorbjoernl in #89
- Remove friend method on Data by @magnusuMET in #85
Full Changelog: v0.1.3...v0.2.0
v0.1.3
What's Changed
- [fix] Set default
variable_unitsto an empty dict by @thorbjoernl in #88 - [performance] Improve performance of valley floor filter by ≃38x by @thorbjoernl in #87
Full Changelog: v0.1.2...v0.1.3
v0.1.2
What's Changed
- Support csv files with arbitrary length headers by @magnusuMET in #80
- fix: Issue where multiple times use of valleyfloor_filter would raise an exception by @magnusuMET in #81
Full Changelog: v0.1.1...v0.1.2
v0.1.1
What's Changed
- Minor version release by @thorbjoernl in #73
- Making Filter-docs nicer by @heikoklein in #70
- AutoFilterEngine implementing open by @magnusuMET in #74
- fix: Fix 0 elevation bug in valleyfloor filter by @thorbjoernl in #75
- Allow directory in valleyfloor filter by @thorbjoernl in #76
Full Changelog: v0.1.0...v0.1.1
v0.1.0
What's Changed
- Bump version by @thorbjoernl in #69
- add metadata to the VariableNameChangingReader by @jgriesfeller in #65
- Minimal deps test in CI by @magnusuMET in #72
New Contributors
- @jgriesfeller made their first contribution in #65
Full Changelog: v0.0.14...v0.1.0