Dataset Inference

This repository is developed for distributed inference.

Install

pip install dataset_inference

Python examples

Checkout these examples to call this as a lib:

• example.py

API

This module exposes a single function dataset_inference which takes the same arguments as the command line tool:

• dataset the dataset to run inference on. (required)
• models the models to run inference on. (required)
• output the output folder / cloud storage to save data. (required)

For development

Either locally, or in gitpod (do export PIP_USER=false there)

Setup a virtualenv:

python3 -m venv .env
source .env/bin/activate
pip install -e .

to run tests:

pip install -r requirements-test.txt

then

make lint
make test

You can use make black to reformat the code

python -m pytest -x -s -v tests -k "dummy" to run a specific test