Skip to content

HULD-Lab/emits-datareader

Repository files navigation

EMITS data-reader for Outlook

by HULD

EMITS data-reader is a tool that supports data analysis on EMITS records. Currently, it processes only messages for newly issued tenders. The following fields are parsed:

  • Title
  • Description
  • Open date
  • Closing date
  • Min/ Max price
  • Tender Number
  • Tender Type
  • Products
  • Establishment

These data then can be imported as a datasource to PowerBI where various reports can be created.

Setting the environment

Requirements

  • Docker installed
  • Optionally PowerBI installed

Update Secret.json

  • See the examples in /secret_sample.json
  • Update this file with outlook credentials and other parameters you wish tune
  • Save it as a secret.json under /code/ directory (i.e /code/secret.json)

Run following commands:

docker-compose build
docker-compose up

Automation

Set cron for the following command.

docker start emits-datareader_app_1

This command updates the database.

Connection to PowerBI on windows

Pre-Condition: mongo db container up and running

  1. Install Mongo Connector for BI
  2. Run the following in windows command line
C:\Program Files\MongoDB\Connector for BI\2.13\bin>mongosqld.exe --mongo-uri <ip address on which a container has been exposed> -u <mongo user name from secret.json> -p <password from secret.json>
  1. Install and Mongo ODBC driver, under system DSN
  2. Test connection on localhost that has been created by Mongo Connector for BI that is connected to remote instance and translate the connection onto localhost.
  3. Open PowerBI and under Other select ODBC, from the list select Mongo

for detailed guide see Mongo help