Storage and data-processing companion for the poa-netstats-agent
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.circleci [#55] Receiver for storing ethereum statistics Aug 28, 2018
assets
config
doc [#64] generating documentation Sep 10, 2018
lib
pages [#24] improving Documentation Jul 6, 2018
priv [#57] Receiver for storing system stats Aug 28, 2018
rel [#26] building a release Jul 6, 2018
test
.gitignore [#37] adding endpoint for creating users Aug 7, 2018
LICENSE
README.md
coveralls.json [#64] fixing issues with mnesia and releases Sep 10, 2018
mix.exs
mix.lock

README.md

POABackend

Coverage Status codecov

Storage and data-processing companion for the poa-netstats-agent

Documentation

Or you can build the documenation locally running

mix deps.get
mix docs

That command will create a doc/ folder with the actual Documentation.

Setting up Cert SSL

POABackend uses https endpoints for Authorisation matters. In order to achieve that we have to set some configuration first. We would need a *.cert and a *.key files. We can generate them easily running:

openssl genrsa -out localhost.key 2048
openssl req -new -x509 -key localhost.key -out localhost.cert -days 3650 -subj /CN=localhost

Those command will create the needed files. Now we have to point them in the config file. Lets check the section :auth_rest

config :poa_backend,
       :auth_rest,
       [
          {:scheme, :https},
          {:port, 4003},
          {:keyfile, "priv/keys/localhost.key"},
          {:certfile, "priv/keys/localhost.cert"}
       ]

Here we can choose the port for the Auth endpoints and we must put the paths to the files we created previously (look :keyfile and :certfile fields)

Configuring Databases for first time

POABackend uses many Databases. For Authentication we use Mnesia as a local database and for some receivers which require storage we use Postgres. All databases are managed on top of Ecto a widly used database wrapper for Elixir projects.

For this reason we have to set the databases before running the POABackend for the first time.

  • Auth Database (Mnesia): Setting up Mnesia is easy since it is working localy and is built in the Erlang Virtual Machine. We only have to say "where" we are going to store the database's files. In order to do that we have to add the configuration to the config file (prod.exs or test.exs depending if you want to run tests or production)
config :mnesia,
  dir: 'your/local/path' # make sure this directory exists!
  • Receivers Database (Postgres): This is a little more complex than Mnesia. We need a Postgres instance running somewhere and we have to add the config to the config files
config :poa_backend, POABackend.Receivers.Repo,
  priv: "priv/receivers", # this value is not changed
  adapter: Ecto.Adapters.Postgres,
  database: "poabackend_stats",
  username: "postgres",
  password: "postgres",
  hostname: "localhost"

The important fields here are database, username, password and hostname. The rest of values must remain exactly as the example.

Once we have set the database configuration we have to create and migrate the databases, in order to do that we should be in the root of the project and run:

  • for production
MIX_ENV=prod mix ecto.create
MIX_ENV=prod mix ecto.migrate
  • for test
MIX_ENV=test mix ecto.create
MIX_ENV=test mix ecto.migrate

Now the environment is ready for running POABackend

Run Tests

The first time you run the tests you will need having the Database's environment set up. Check the previous section and set the configuration in the config/test.exs file.

Once the environment is set. We can run the tests with:

mix test

POABackend comes also with a code analysis tool Credo and a types checker tool Dialyxir. In order to run them we have to run

mix credo
mix dialyzer

Building & Deploying an Executable

To build an executable you'll need Elixir 1.6 (and Erlang/OTP 20).

  1. Start a clean Terminal
  2. Once you have a copy of this repository configure the backend for production in the file config/prod.exs.
  3. An example configuration can be found in the current config/prod.exs.
  4. Do a mix deps.get to fetch, among other dependencies, the tooling for building server executables.
  5. We have to export the MNESIA_HOST variable in order to tell in which node we are going to create the mnesia schema
export MNESIA_HOST=poa_backend@127.0.0.1
  1. A env MIX_ENV=prod mix release --name=poa_backend --env=prod will assemble an executable.

A resulting artifact resides at _build/prod/rel/poa_backend/releases/0.1.0/poa_backend.tar.gz which you can move to a remote host. Use tar xfz then bin/poa_backend start (bin/poa_backend stop will stop the server cleanly).

If you want to run it on the local host then the procedure is as simple as: _build/prod/rel/poa_backend/bin/poa_backend.

  1. Set up Mnesia. After start the POABackend we have to set up mnesia. First we have to check if the Mnesia directory exists (probably not). In our case we have set it to priv/data/mnesia
config :mnesia,
  dir: 'priv/data/mnesia' # make sure this directory exists!

so we have to create that folder inside the release folder.

After that we have to create and migrate the database. In order to do that we have make a RPC to the running node, this command is run only once (Note that the node must be running, that means we have executed bin/poa_backend start):

bin/poa_backend rpc Elixir.POABackend.Release.Tasks migrate

That will create the Mnesia Database. After those steps the app is ready to be used

Note: executables must be built on the platform (OS and architecture) they are destined for under the project's current configuration. Other options are possible (see https://hexdocs.pm/distillery/getting-started.html).