Skip to content

pgimenes/adaserve

Repository files navigation

AdaServe

Getting Started

  1. Follow the instructions here to set up a Mase environment using Conda or Docker.

  2. Run the init.sh script to install the nightly versions of PyTorch and Transformers and initialize the mase submodule.

source scripts/init.sh
  1. Verify the setup by running the CLI.
ada -h
  1. Run one of the example scripts.
source examples/autosharding.sh

About

Adaptive Inference Serving Engine for Generative Language Models

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors