Skip to content

Commit

Permalink
update documentation
Browse files Browse the repository at this point in the history
  • Loading branch information
liyakun committed Sep 28, 2017
1 parent f4d885e commit a04eeb3
Showing 1 changed file with 92 additions and 51 deletions.
143 changes: 92 additions & 51 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,31 +1,95 @@
#OBEU Platform

#Softwares Running on OBEU Platform

The software stack consists of several applications (OBEU-Components) provided by the partners in the OBEU-project as well as from other Open-Source-projects:

- LinkedPipes https://github.com/linkedpipes/etl with the FDP-to-RDF-pipeline https://github.com/openbudgets/pipeline-fragments/tree/master/FDPtoRDF
- Alignment https://github.com/okgreece/Alignment
- Rudolf https://github.com/openbudgets/rudolf
- RDFBrowser https://github.com/okgreece/RDFBrowser
- DAM https://github.com/openbudgets/DAM
- Indigo https://github.com/okgreece/indigo
- nginx as Reverse Proxy https://hub.docker.com/_/nginx/
- Microsite https://github.com/openbudgets/microsite
- OpenSpending-Admin https://github.com/openspending/os-admin
- OpenSpending-Viewer https://github.com/openspending/os-viewer
- OpenSpending-Explorer https://github.com/openspending/os-explorer
- Silk Linked Data Integration Framework https://github.com/silk-framework/silk
- Virtuoso https://hub.docker.com/r/tenforce/virtuoso/ https://github.com/openlink/virtuoso-opensource

Some of the publicly exposed endpoints/frontends:
- Aligment: http://alignment-obeu.iais.fraunhofer.de/
- Viewer: http://apps.openbudgets.eu/viewer/budget-athens-expenditure-2007__5d543?lang=en
- Explorer: http://apps.openbudgets.eu/explorer/
- Indigo: http://apps.openbudgets.eu/
- Rudolf: http://apps.openbudgets.eu/api/3/cubes/ analogue to OS API as documented here: http://openspending.readthedocs.io/en/master/developers/api/
- Dumps-folder for the FDP-to-RDF-pipeline-transformations and other datasets: http://apps.openbudgets.eu/dumps
# OBEU Platform

## Softwares Running on OBEU Platform

The software stack consists of several softwares (OBEU-Components) provided by the partners in the OBEU-project as well as from other Open-Source-projects:

- LinkedPipes
- https://github.com/linkedpipes/etl
- With FDP-to-RDF-pipeline
- https://github.com/openbudgets/pipeline-fragments/tree/master/FDPtoRDF
- Accessible through SSH
- http://localhost:8080
- Alignment
- https://github.com/okgreece/Alignment
- Running on: http://apps.openbudgets.eu/alignment
- Rudolf
- https://github.com/openbudgets/rudolf
- API running on: http://apps.openbudgets.eu/api/3/cubes/
- RDFBrowser
- https://github.com/okgreece/RDFBrowser
- DAM
- https://github.com/openbudgets/DAM
- Indigo
- https://github.com/okgreece/indigo
- Running on: http://apps.openbudgets.eu/
- Nginx as Reverse Proxy
- https://hub.docker.com/_/nginx/
- Microsite
- https://github.com/openbudgets/microsite
- OpenSpending-Admin
- https://github.com/openspending/os-admin
- OpenSpending-Viewer
- https://github.com/openspending/os-viewer
- Running on: http://apps.openbudgets.eu/viewer
- Example: http://apps.openbudgets.eu/viewer/budget-athens-expenditure-2007__5d543?lang=en
- Silk Linked Data Integration Framework
- https://github.com/silk-framework/silk
- Virtuoso
- https://github.com/openlink/virtuoso-opensource
- From docker hub https://hub.docker.com/r/tenforce/virtuoso/
- Accessible through SSH
- Virtuoso Staging: http://localhost:8890
- Virtuoso Production: http://localhost:8891

- Dumps-folder for the FDP-to-RDF-pipeline-transformations and other datasets:
- http://apps.openbudgets.eu/dumps

## Replica of OBEU Platform
It is possible to replicate the components running on OBEU platform to your own platform. The components are managed by using Docker and Docker-Compose, so you need have this two software installed on you server. For detail information about how to install docker and docker-compose, please check https://www.docker.com/.

The docker configuration files are included in the Integration repository, each component has its own folder, and every component is running within a separate docker container.

### Prepare The Integration
You need to make the integration folder prepared with all the shared volumes, static files placed in the correct path.

#### Clone the Integration Git Repository
You can git clone the repository by the following command:

`git clone https://github.com/openbudgets/integration`

#### Initialize Shared Volumes
You can use the provided bash shell script to initialize the share volumes in the integration folder.

`sh ./initVolumes.sh`

#### Environment Variables
You can specify the host-specific environment-variables in the `.env` file similar to `env.example` file.

Some components require credentials in order to use them such as Virtuoso. Credentials are stored in env.example. For example for a local installation the Virtuoso credentials are:

`Username: dba, Password: TEST`


#### Running Docker Containers

Update from Integration git repository and (re-)starting Docker containers by provided bash shell script with the following command:

`sh ./refresh_and_restart_prod.sh`

### Prepare Domain Name

This comment has been minimized.

Copy link
@skarampatakis

skarampatakis Sep 28, 2017

Contributor

Does this mean that we have to change the domain name on all nginx configuration files and .env on each respected application?

This comment has been minimized.

Copy link
@liyakun

liyakun Sep 29, 2017

Author Contributor

Normally, you only need to change the server name at the server_domain.conf file within Nginx, the rest will use $host variable. There are some files use the OBEU domain name directly, i will try to change those setttings. For each .env file in resprected application, you need to change setttings accordingly, i will try to find way to make this eaiser.

We use Nginx as a proxy server which runs in one docker container. You need to change the domain name and HTTPS credentials in order to use HTTPS.

#### Subdomains

#### HTTPS
There are some shell scripts provided to generate https credentials and ssl keys by using `letsencrypt` services running within docker container. You need to adapt the settings in `letsEncryptProductionCert` file with your own domain name, afterwards you can generate credentials by using the following command:

`sh letsEncryptProductionCert`

Then the credentials should already be generated to the shared volumes generated during initializing of the folders.

## Local Test
(1) Local Installation:

- Create & Initialize Volume Folders: sh ./initVolumes.sh
Expand Down Expand Up @@ -53,31 +117,8 @@ Some of the publicly exposed endpoints/frontends:

Remark: If you running Docker within a VirtualBox via docker-machine, use the IP-Adress of the docker-machine (mostly this is: 192.168.99.100 but you can find out via docker-machine ip) instead of localhost here.

(2) Server Installation:

- Clone the repo
- Create Volume Folders via executing: sh ./initVolumes.sh
- Specify host-specific environment-variables in .env-file (similar to env.example-file)
- Update from Git-repo & (re-)starting Docker containers via Shell-Script in Project folder:
sh ./refresh_and_restart_prod.sh
- Some apps requires credentials in order to use them such as Virtuoso. Credentials are stored in env.example.
For example for a local installation the Virtuoso credentials are:
Username: dba, Password: TEST

Exposed Components on the FhG server:

(a) Only accessible via SSH:
- LinkedPipes: http://localhost:8080
- Virtuoso Staging: http://localhost:8890
- Virtuoso Production: http://localhost:8891
- OS-Viewer: http://localhost/viewer

(b) Public accessible via http:
- Rudolf: http://apps.openbudgets.eu/api/3/cubes
- OS-Viewer: http://apps.openbudgets.eu/viewer
- Dump of the FDP-2-RDF-Pipeline: http://apps.openbudgets.eu/dumps

Appendix
## Appendix

How To import the FDP-2-RDF-Pipeline on LinkedPipes-Frontend (8080):
https://github.com/openbudgets/pipeline-fragments/tree/master/FDPtoRDF
Expand Down

0 comments on commit a04eeb3

Please sign in to comment.