CloudShare

share，edit your doc，pdf，md and so on...

Dependencies

Document conversion

See requirement.txt

pandoc==1.13.2.1 in webapp.

or

pandoc==1.19.2.1 in demoapp.

libreoffice and its uno

Search

Elasticsearch env

    jre-8u131
    elasticsearch-5.4.3

Elasticsearch plugins

    elasticsearch-analysis-ik-5.4.3

Draw && View router graph

anytree==2.4.3
pygraphviz==1.4.dev

Test

nose==1.3.7
Flask-Testing==0.4.2

You can do the automatic test by using Jenkins with karma, nose and so on. Here is a demo bash script to run Jenkins test:

    #!/bin/bash
    pkill java

    export JENKINS_ROOT=/home/followcat/Projects/jenkins
    export CLOUDSHARE_HOME=/home/followcat/Projects/cloudshare
    export CLOUDSHARE_CI_HOME=/home/followcat/Projects/cloudshare_ci

    export JENKINS_HOME=$CLOUDSHARE_CI_HOME/tools/jenkins-ci

    rm -rf $CLOUDSHARE_CI_HOME
    git clone $CLOUDSHARE_HOME $CLOUDSHARE_CI_HOME
    (cd $CLOUDSHARE_CI_HOME/webapp/static/js; npm install;)
    (cd $CLOUDSHARE_CI_HOME; git branch $CLOUDSHARE_CI_BRANCH);

    source ~/Virtualenv/charelation/bin/activate
    java -jar $JENKINS_ROOT/jenkins.war --httpPort=8001

Searchengine Datastructure Design

Search engine in cloudshare.

Use Elasticsearch as cloudshare default search engine. Run elasticsearch and config its address, port, user/password in es config file. The loader will init from baseapp/loader. And the default settings load from class Config in module loader.

Elasticsearch Indices and Doctype

• Index

  1. Different storage block will have different index.
  2. And different type of yaml info structure also in different index, such as Companys/Currivulumvitaes will use different Index. Defined from es config file in loader.
  3. The base storage index will defined from es config file in loader.

• Doctype

  1. Different projects have different doctype in its storage block index, the project id is doctype name.
  2. The base storage doctype will define from es config file in loader.

Front-end Building

Dependencies

node@6.1.0
npm@3.8.6
gulp@3.9.1

How to

0. Install libreoffice/Openoffice, add libreoffice uno env, and start service.

export PYTHONPATH=/usr/share/pyshared:$PYTHONPATH
export LD_LIBRARY_PATH=/usr/lib/libreoffice/program:$LD_LIBRARY_PATH
libreoffice --invisible "--accept=socket,host=localhost,port=8100;urp;"

1. Front-end building: enter /webapp root folder, and run

sh ./build.sh

there were generate two folders /static/dist/ and /templates_dist/

2. Run flask server and visit page http://localhost:4888/.

python run.py

Issues

In some BLAS versions, the numpy.dot will hangs in multithreading/processing. Upgrade your BLAS or use this before startup server. For ease of use the mining service in most environment.

export MKL_NUM_THREADS=1
export NUMEXPR_NUM_THREADS=1
export OMP_NUM_THREADS=1