No description or website provided.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
app
laradock @ 0c41fce
logs/crawler
.gitignore
.gitmodules
README.md
crawl.sh
sample-pages.csv
setup.sh
stop.sh
update.sh

README.md

About

This Symfony 4-app is a proof of concept for some tracking concepts. It will feature several social media plattforms as data provider and will use public data apis for accessing event data (page stats, post likes & comments etc.)

Prerequisite

You will need git, docker and docker-compose installed on your target machine.

Setup

Run git clon https://github.com/pascalheidmann/realtime-perf-analytics.git to checkout the project folder. Then cd into the project folder and run sh setup.sh

This will checkout Laradock and check for required .env configuration files. If all required .env files are available the setup script will continue setting up all required docker containers, then installing the project dependency within the container with the help of some composer magic.

Scripts

Crawler

To start a crawler run sh crawler.sh [SERVICE]. This will run the crawler on each docker workspace node, piping its output to app/logs/crawler/[SERVICE].log. You might have to chmod those log folders and files depending how strict your filesystem handles these writes.

Updating

For easy updates (via git) just run sh update.sh or sh update.sh all to include restarting crawlers.

Known issues

Docker for Windows

You might have to edit the laradock/docker-compose.yml files to change the volumes as Docker for Windows has some bugs that prevent mounting volumes for mariadb, mongodb, redis and maybe others.

MongoDB security

Laradock won't let you set a password for your MongoDB instance. As Docker exposes all ports to your network this allows anyone to access your docker instance!

The framework is already prepared for using authenticated access but you have to fill in your accessdata to the .env file.