Python computing node

Python computing node for otl_interpreter

Getting Started

Deploy on host machine

Prerequisites

You need:

• python 3.9.7

Deploy

1. Install virtual environment from requirements.txt:

   python3 -m venv ./venv
   source ./venv/bin/activate
   pip install -r ./requirements.txt

2. Configure computing_node.conf:

   cp ./python_computing_node/rest.conf.example ./python_computing_node/rest.conf

3. Deploy otl interpreter or just run kafka
4. Launch python computing node server:

   python ./python_computing_node/main.py

Deploy with conda

Prerequisites

1. Miniconda
2. Conda-Pack

Deploy

1. Create virtual environment for project:

   make dev

2. Configure computing_node.conf.

3. To activate virtual environment:

   conda activate ./venv

4. Deploy otl interpreter or just run kafka

5. Launch python computing node server:

python ./python_computing_node/main.py

Deployment

1. Unpack tar archive to destination directory
2. Create config

   cp ./python_computing_node/computing_node.conf.example ./python_computing_node/computing_node.conf

3. Unpack one or more execution environments in execution environment directory. For example see pp_exec_env
4. Run start.sh

Built With

• Conda
• python 3.9.7
  And python packages:
  • aiokafka==0.7.2
  • kafka-python==2.0.2
  • aiohttp==3.8.1
  • gunicorn==20.1.0
  • bottle==0.12.19

Versioning

We use SemVer for versioning. For the versions available, see the tags on this repository.

License

See the LICENSE.md file for details