InfMoE is currently not stable and under active development. See Harry-Chen/InfMoE for source code & usage.
The code will be available here once officially released.
Inference framework for MoE layers based on TensorRT with Python binding
TsinghuaAI/InfMoE
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
About
Inference framework for MoE layers based on TensorRT with Python binding
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published