Skip to content

Commit

Permalink
#123 InfluxDB Harvester from Data Collector 1 new env var, upgrade Stetl
Browse files Browse the repository at this point in the history
  • Loading branch information
justb4 committed Jun 11, 2018
1 parent f479406 commit d99b791
Show file tree
Hide file tree
Showing 3 changed files with 10 additions and 20 deletions.
1 change: 1 addition & 0 deletions etl/options/example.args
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,7 @@ stapublisher_max_input_records=5000
# InfluxDB: settings and Server credentials
#
influx_host=influxdb
influx_dc1_host=dc1.smartemission.nl
influx_port=8086
influx_admin_user=youruser
influx_admin_password=yourpw
Expand Down
2 changes: 1 addition & 1 deletion etl/run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ then
exit -1
fi

IMAGE=smartemission/se-stetl:1.0.5
IMAGE=smartemission/se-stetl:1.0.6
NAME="stetl_${ETL_PROCESS}"
NETWORK="--network=se_back"
ETL_DEFAULT_ARGS="/work/options/default.args"
Expand Down
27 changes: 8 additions & 19 deletions services/influxdb/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
# InfluxDB Server
# InfluxDB Server - Smart Emission Internal

This runs the InfluxDB service as a Docker container. See https://www.influxdata.com:
This runs the InfluxDB service as a Docker container for the SE internal Calibration (source data and results).
See https://www.influxdata.com:

> InfluxDB is an open source database written in Go specifically to handle time
> series data with high availability and high performance requirements.
Expand All @@ -11,26 +12,14 @@ The Docker image comes from https://hub.docker.com/_/influxdb/

## Use in SE

InfluxDB is used in the SE platform initially for storing time-series for kalibration ANN learning
and to test the EU JRC AirSensEUR AQ Sensor: http://www.airsenseur.org and possibly other attached sensors.
InfluxDB will in time become a central part of the SE platform.
InfluxDB was/is used in the SE platform for storing time-series for calibration ANN learning.

## Docker

Docker is used to deploy/run InfluxDB. See the [run.sh script](run.sh).

The Docker container will expose the InfluxDB ports (8086 and 8083). It makes the following
Docker-internal directories available to your local machine:

- config: `/etc/influxdb/influxdb.conf` to [./config/influxdb.conf](config/influxdb.conf)
- data: `/var/lib/influxdb` to `/var/smartem/data/influxdb`
- logs: `/var/log/influxdb` to `/var/smartem/log/influxdb`

You may edit the [./config/influxdb.conf](config/influxdb.conf) for your local machine.
Enable authentication by setting the auth-enabled option to true in the ``[http]``
section of the [configuration file](config/influxdb.conf).

Database initialization: tbs.
The Docker container will NOT expose the InfluxDB port (8086) externally.
Database initialization: via env settings.

Run `/usr/bin/influx` command as follows:

Expand All @@ -40,7 +29,7 @@ sudo docker run --rm --net=container:influxdb -it influxdb influx -host localhos

## Visualization

InfluxDB is closely integrated with Grafana (http://grafana.org). See the [Grafana Service](../grafana) in SE platform.
InfluxDB is closely integrated with Grafana (http://grafana.org). See the [Grafana Service](../grafana) in the SE platform.

## Authorization

Expand All @@ -51,7 +40,7 @@ We use two types of users: a global `admin` user and a per-DB user.
We need admin user. All below via `influx` CLI.

```
sudo docker exec -it influxdb bash
docker exec -it influxdb bash
influx -username <user> -password <pass>
```

Expand Down

0 comments on commit d99b791

Please sign in to comment.