Dalle Runtime 🤖

ML Server Runtime for "Industry Strength DALL-E Talk". Contains example loading gpt2 and Dalle models.

Example

Once you follow the setup below you can checkout the example showing the GPT2->DALL-E pipeline under /docs/examples/README.

Setup

You can get started by installing the environment with the following commands.

Make sure you have all dependencies set up as outlined in the Dependencies section.

# Recommended to create new environment
make conda-env-create
conda activate dalle_runtime

make install-dev # or make install for prod

Downloading models

You can download the models using the makefile command:

make local-download-resources

Running the server

You can then run the server locally for a test with the following command:

make local-start

And then you can send a test request to your deployed ML model runtime with the following command:

make local-test-request

Security

We can perform relevant security checks for the package by using the commands that we have available.

In order to run the python-specific commands we need to make sure to set up the environment accordingly.

# Recommended to create new environment
make conda-env-create
conda activate dalle_runtime_dev

make install-dev

Now we can run some of the base security checks:

# Check CVEs in any of the dependencies installed
make security-local-dependencies 

# Check for insecure code paths
make security-local-code

# Check for old dependencies
make security-local-dependencies-old 

In order to perform the container security scans, it is a pre-requisite to have built the image as below.

make docker-build

Now we can run the dependency scans on top of these.

make security-docker

If you want to just run all the security checks at once you can do so with the main command:

make security-all

Dependencies

We recommend using the version manager asdf-vm for simpler installation of all required command-line dependencies used in this project for development, testing, security, etc.

Once you have set up corretly asdf-vm, you can install all relevant dependencies by running the following:

make install-dev-deps

In order to install the package you will need to use the Poetry dependency manager.

Project Organization

├── Dockerfile
├── LICENSE
├── Makefile
├── README.md
├── docs
│   ├── Makefile
│   ├── commands.rst
│   ├── conf.py
│   ├── examples
│   │   └── model-settings.json
│   ├── getting-started.rst
│   ├── index.rst
│   └── make.bat
├── file
├── dalle_runtime
│   ├── __init__.py
│   ├── common.py
│   ├── runtime.py
│   └── version.py
├── pyproject.toml
├── requirements-dev.txt
├── setup.py
└── tests
    ├── conftest.py
    └── test_runtime.py

---

Project based on the Secure Production MLOps Cookiecutter. #cookiecuttermlops