Skip to content
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
Python Other
  1. Python 99.2%
  2. Other 0.8%
Branch: master
Clone or download
Latest commit a91502e Dec 6, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
NEZHA update README Dec 2, 2019
TinyBERT update Dec 6, 2019
README.md update README Dec 2, 2019

README.md

Pretrained Language Model

This repository provides the latest pretrained language models and its related optimization techniques developed by Huawei Noah's Ark Lab.

Directory structure

  • NEZHA is a pretrained Chinese language model which achieves the state-of-the-art performances on several Chinese NLP tasks.
  • TinyBERT is a compressed BERT model which achieves 7.5x smaller and 9.4x faster on inference.
You can’t perform that action at this time.