Swiss AI

Popular repositories Loading

1. pretrain-data pretrain-data Public

   Pretraining data reconstruction scripts for Apertus

   Python 155 15

2. apertus-tech-report apertus-tech-report Public

   Tech Report of the Apertus LLM

   140 6

3. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python 49 34

4. ESFM ESFM Public

   Python 44 13

5. apertus-finetuning-recipes apertus-finetuning-recipes Public

   Python 40 17

6. MoE MoE Public

   some mixture of experts architecture implementations

   Python 28 3