GitHub - Forks25/Megatron-DeepSpeed: Ongoing research training transformer language models at scale, including: BERT & GPT-2

Expected error msg:

/home/ubit/rpmbuild/BUILD/intel-compute-runtime-25.05.32567.18/shared/source/os_interface/linux/drm_neo.cpp
Segmentation fault from GPU at 0xff02fffffe150000, ctx_id: 5 (CCS) type: 0 (NotPresent), level: 1 (PDE), access: 0 (Read), banned: 1, aborting.
Segmentation fault from GPU at 0xff02fffffe150000, ctx_id: 5 (CCS) type: 0 (NotPresent), level: 1 (PDE), access: 0 (Read), banned: 1, aborting.

Name		Name	Last commit message	Last commit date
Latest commit History 2,866 Commits
.github/workflows		.github/workflows
ALCF		ALCF
dataset		dataset
docs		docs
examples		examples
examples_deepspeed		examples_deepspeed
images		images
megatron		megatron
tasks		tasks
tests		tests
tools		tools
.coveragerc		.coveragerc
.gitignore		.gitignore
.gitlab-ci.yml		.gitlab-ci.yml
CODEOWNERS		CODEOWNERS
LICENSE		LICENSE
MANIFEST.in		MANIFEST.in
README.md		README.md
SECURITY.md		SECURITY.md
finetune_llama.py		finetune_llama.py
mds_to_hf.py		mds_to_hf.py
pretrain_bert.py		pretrain_bert.py
pretrain_gpt.py		pretrain_gpt.py
pretrain_gpt_alcf.py		pretrain_gpt_alcf.py
pretrain_gpt_core.py		pretrain_gpt_core.py
pretrain_ict.py		pretrain_ict.py
pretrain_llama.py		pretrain_llama.py
pretrain_retro.py		pretrain_retro.py
pretrain_t5.py		pretrain_t5.py
pretrain_vision_classify.py		pretrain_vision_classify.py
pretrain_vision_dino.py		pretrain_vision_dino.py
pretrain_vision_inpaint.py		pretrain_vision_inpaint.py
repro.sh		repro.sh
run_repro.sh		run_repro.sh
setup.py		setup.py
test_agptllama.py		test_agptllama.py
train_aGPT_7B.sh		train_aGPT_7B.sh
train_agpt_polaris_7B_production.sh		train_agpt_polaris_7B_production.sh
train_alcf.sh		train_alcf.sh
train_llama_alcf.sh		train_llama_alcf.sh
train_llama_alcf_aurora_qsub.sh		train_llama_alcf_aurora_qsub.sh
train_llama_alcf_polaris_hzheng.sh		train_llama_alcf_polaris_hzheng.sh
train_llama_nersc_perlmutter.sh		train_llama_nersc_perlmutter.sh

Navigation Menu

Uh oh!

Repository files navigation

Expected error msg:

To reproduce, run `run_repro.sh` on 2 Aurora nodes

About

Releases

Packages

Contributors

Languages

Uh oh!

Folders and files

Latest commit

History

Repository files navigation

Expected error msg:

To reproduce, run run_repro.sh on 2 Aurora nodes

About

Resources

Security policy

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages

To reproduce, run `run_repro.sh` on 2 Aurora nodes