The toolkit has three major usages:
- Pretrain upstream models, including Mockingjay, Audio ALBERT and TERA.
- Document: pretrain/README.md
- Easily load most of the existing upstream models with pretrained weights in a unified I/O interface.
- Pretrained models are registered through torch.hub, which means you can use these models in your own project by one-line plug-and-play without depending on this toolkit's coding style.
- Document: upstream/README.md
- Utilize upstream models in lots of downstream tasks
- Benchmark upstream models with SUPERB Benchmark
- Document: downstream/README.md
- Python >= 3.6
- Install sox on your OS
- Install s3prl
pip install -e ./
- Some upstream models require special dependencies. If you encounter error with a specific upstream model, you can look into the
README.md
under eachupstream
folder. E.g.,upstream/pase/README.md