Skip to content

Latest commit

 

History

History
94 lines (92 loc) · 3.68 KB

changelog.md

File metadata and controls

94 lines (92 loc) · 3.68 KB

v0.3.0 (03/11/2024)

New Features:

  • Support mock transformers, see Mock transformers
  • Support lm-evaluation-harness for model evaluation
  • User Experience Optimization

New Supported Models:

  • These models are natively supported by libai
Models 2D(tp+pp) Inference 3D Parallel Training
BLOOM -
ChatGLM
Couplets
DALLE2 -
Llama2
MAE
Stable_Diffusion - -

New Mock Models:

  • These models are extended and implemented by libai through mocking transformers.
Models Tensor Parallel Pipeline Parallel
BLOOM -
GPT2 -
LLAMA -
LLAMA2 -
Baichuan -
OPT -