All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
Changes are grouped as follows
Added
for new features.Changed
for changes in existing functionality.Deprecated
for soon-to-be removed features.Removed
for now removed features.Fixed
for any bug fixes.Security
in case of vulnerabilities.
- Command line arguments for limit historical files between timestamps
- Process historical files in ascending order by their timestamp postfix.
- Command line argument for specifying if we should move finished files to subfolder
- Upgraded dependencis of Cognite sdk and gcloud logger
- Check for new files every 8 seconds in live mode
- Removed timestamp command line argument
- Command line argument for setting log level
- Historical also works on newest files first
- Larger pool threads of requests to send to CDF
- Timestamps are in milliseconds again
- We sent empty list for all but the last request, fixed by copy
- Process files with csv library instead of pandas, and post data in parallel after file is processed
- Pandas dependency
- Metrics on number of files that we failed to process
- Moved live/historical distinction from Prometheus label to metric name
- New metrics for files
- Cognite Fusion project name to metrics labels
- Project name to Prometheus metrics
- Replaced metrics for datapoints per timeseries with count of timeseries
- LICENSE file
- CHANGELOG.md file
- CONTRIBUTING.md file
- Dockerfile for building a docker image
- Use py.test for unittesting
- Updated README to include versioning information
- Logging of missing files as debug log instead of errors
- Initial commit