Repository navigation
UltraEP v1.0.0 is the initial public release, which also ships Megatron-LM training reference and an 8-GPU demo for reproducing UltraEP load balancing. This release hosts the demo artifacts referenced by UltraEP/examples/README.md:
redpajama_1b_qwen3.tar.gz: a 1B-token preprocessed RedPajama sample, packed as Megatron-LMbin/idxfiles and tokenized for Qwen3.qwen3_tokenizer.tar.gz: the Qwen3 tokenizer files used by the demo.
These redistributed artifacts are provided solely for reproducing the UltraEP demo. Please refer to the upstream RedPajama-Data-1T and Qwen3 pages for their licenses and notices.