Skip to content

Enable MCore checkpointing optimizations #2543

Enable MCore checkpointing optimizations

Enable MCore checkpointing optimizations #2543

Triggered via pull request June 19, 2024 12:31
Status Cancelled
Total duration 6m 48s
Artifacts

cicd-main.yml

on: pull_request
cicd-cluster-clean
8s
cicd-cluster-clean
gpu-test
4s
gpu-test
cicd-test-container-setup
5m 2s
cicd-test-container-setup
L0_Unit_Tests_CPU  /  main
49s
L0_Unit_Tests_CPU / main
L2_Community_LLM_Checkpoints_tests_Llama  /  main
0s
L2_Community_LLM_Checkpoints_tests_Llama / main
L2_Community_LLM_Checkpoints_tests_StarCoder  /  main
0s
L2_Community_LLM_Checkpoints_tests_StarCoder / main
L2_Community_LLM_Checkpoints_tests_Falcon  /  main
0s
L2_Community_LLM_Checkpoints_tests_Falcon / main
ASR_dev_run_Speech_to_Text  /  main
49s
ASR_dev_run_Speech_to_Text / main
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet  /  main
0s
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet / main
ASR_dev_run_Speech_Pre-training_-_CitriNet  /  main
0s
ASR_dev_run_Speech_Pre-training_-_CitriNet / main
ASR_dev_run_Speech_To_Text_Finetuning  /  main
0s
ASR_dev_run_Speech_To_Text_Finetuning / main
ASR_dev_run_Speech_to_Text_WPE_-_Conformer  /  main
0s
ASR_dev_run_Speech_to_Text_WPE_-_Conformer / main
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer  /  main
0s
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer / main
L2_Speech_to_Text_EMA  /  main
0s
L2_Speech_to_Text_EMA / main
L2_Speaker_dev_run_Speaker_Recognition  /  main
0s
L2_Speaker_dev_run_Speaker_Recognition / main
L2_Speaker_dev_run_Speaker_Diarization  /  main
0s
L2_Speaker_dev_run_Speaker_Diarization / main
L2_Speaker_dev_run_Speech_to_Label  /  main
0s
L2_Speaker_dev_run_Speech_to_Label / main
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference  /  main
0s
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference / main
L2_Speaker_dev_run_Clustering_Diarizer_Inference  /  main
0s
L2_Speaker_dev_run_Clustering_Diarizer_Inference / main
L2_Speaker_dev_run_Neural_Diarizer_Inference  /  main
0s
L2_Speaker_dev_run_Neural_Diarizer_Inference / main
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation  /  main
0s
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation / main
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader  /  main
0s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader / main
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader  /  main
0s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader / main
L2_ASR_Adapters_Linear_Adapters  /  main
0s
L2_ASR_Adapters_Linear_Adapters / main
L2_ASR_Adapters_RelPos_MHA_Adapters  /  main
0s
L2_ASR_Adapters_RelPos_MHA_Adapters / main
L2_Speech_Transcription_Speech_to_Text_Transcribe  /  main
0s
L2_Speech_Transcription_Speech_to_Text_Transcribe / main
L2_Transducer_alignment_Running_pytest  /  main
0s
L2_Transducer_alignment_Running_pytest / main
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav  /  main
0s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav / main
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3  /  main
0s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3 / main
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference  /  main
0s
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference / main
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference  /  main
0s
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference / main
L2_Duplex_Text_Normalization_with_Tarred_dataset  /  main
0s
L2_Duplex_Text_Normalization_with_Tarred_dataset / main
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification  /  main
0s
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification / main
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification  /  main
0s
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification / main
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test  /  main
0s
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test / main
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test  /  main
0s
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test / main
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1  /  main
0s
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1 / main
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification  /  main
0s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification / main
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation  /  main
0s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation / main
L2_Pretraining_BERT_pretraining_from_Text  /  main
0s
L2_Pretraining_BERT_pretraining_from_Text / main
L2_Pretraining_BERT_from_Preprocessed  /  main
0s
L2_Pretraining_BERT_from_Preprocessed / main
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN  /  main
0s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN / main
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN  /  main
0s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN / main
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation  /  main
0s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation / main
L2_NMT_Attention_is_All_You_Need_Inference  /  main
0s
L2_NMT_Attention_is_All_You_Need_Inference / main
L2_NMT_Attention_is_All_You_Need_Finetuning  /  main
0s
L2_NMT_Attention_is_All_You_Need_Finetuning / main
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation  /  main
0s
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation / main
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation  /  main
0s
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation / main
L2_Megatron_NMT_Training_TP2  /  main
0s
L2_Megatron_NMT_Training_TP2 / main
L2_Megatron_BART_Perceiver_MIM_Training_TP2  /  main
0s
L2_Megatron_BART_Perceiver_MIM_Training_TP2 / main
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism
33s
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism
L2_Megatron_Bert_Pretraining_and_Resume_Training
55s
L2_Megatron_Bert_Pretraining_and_Resume_Training
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training
53s
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training
L2_Megatron_RETRO_Pretraining_and_Resume_Training  /  main
0s
L2_Megatron_RETRO_Pretraining_and_Resume_Training / main
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training  /  main
0s
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training / main
L2_RAG_Pipeline_Indexing
0s
L2_RAG_Pipeline_Indexing
L2_RAG_Pipeline_Generating
0s
L2_RAG_Pipeline_Generating
L2_BioMegatron_Bert_NER_Task  /  main
0s
L2_BioMegatron_Bert_NER_Task / main
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
0s
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
0s
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
14s
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
0s
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2  /  main
0s
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main
L2_Megatron_GPT_Finetuning_PP2  /  main
0s
L2_Megatron_GPT_Finetuning_PP2 / main
L2_Megatron_GPT_Finetuning_StarCoder_PP1
46s
L2_Megatron_GPT_Finetuning_StarCoder_PP1
L2_Megatron_GPT_Embedding  /  main
0s
L2_Megatron_GPT_Embedding / main
L2_Megatron_GPT_PEFT_Lora_PP2_O2  /  main
0s
L2_Megatron_GPT_PEFT_Lora_PP2_O2 / main
L2_Megatron_GPT_PEFT_Lora_TP2_O1  /  main
0s
L2_Megatron_GPT_PEFT_Lora_TP2_O1 / main
L2_Megatron_GPT_Eval  /  main
0s
L2_Megatron_GPT_Eval / main
L2_Megatron_GPT_Eval_PP2  /  main
0s
L2_Megatron_GPT_Eval_PP2 / main
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len  /  main
0s
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len / main
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2  /  main
0s
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2 / main
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2  /  main
0s
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2 / main
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2  /  main
0s
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2 / main
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2  /  main
0s
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2 / main
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2  /  main
0s
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2  /  main
0s
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2 / main
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining  /  main
0s
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining / main
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2  /  main
0s
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / main
L2_Megatron_T5_Eval  /  main
0s
L2_Megatron_T5_Eval / main
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2  /  main
0s
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2 / main
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2  /  main
0s
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2 / main
L2_Megatron_T5_PEFT_Lora_TP2  /  main
0s
L2_Megatron_T5_PEFT_Lora_TP2 / main
L2_Megatron_Mock_Data_Generation_MockGPTDataset  /  main
0s
L2_Megatron_Mock_Data_Generation_MockGPTDataset / main
L2_Megatron_Mock_Data_Generation_MockT5Dataset  /  main
0s
L2_Megatron_Mock_Data_Generation_MockT5Dataset / main
L2_TTS_Fast_dev_runs_1_Tacotron_2  /  main
0s
L2_TTS_Fast_dev_runs_1_Tacotron_2 / main
L2_TTS_Fast_dev_runs_1_WaveGlow  /  main
0s
L2_TTS_Fast_dev_runs_1_WaveGlow / main
L2_TTS_Fast_dev_runs_1_FastPitch  /  main
0s
L2_TTS_Fast_dev_runs_1_FastPitch / main
L2_TTS_Fast_dev_runs_1_Mixer-TTS  /  main
0s
L2_TTS_Fast_dev_runs_1_Mixer-TTS / main
L2_TTS_Fast_dev_runs_1_Hifigan  /  main
0s
L2_TTS_Fast_dev_runs_1_Hifigan / main
Speech_Checkpoints_tests  /  main
0s
Speech_Checkpoints_tests / main
OPTIONAL_L0_Unit_Tests_GPU  /  main
0s
OPTIONAL_L0_Unit_Tests_GPU / main
L0_Setup_Test_Data_And_Models  /  main
0s
L0_Setup_Test_Data_And_Models / main
L2_Community_LLM_Checkpoints_tests_Llama3  /  main
0s
L2_Community_LLM_Checkpoints_tests_Llama3 / main
L2_PTQ_Llama2_Export_Only  /  main
0s
L2_PTQ_Llama2_Export_Only / main
L2_PTQ_Llama2_FP8  /  main
0s
L2_PTQ_Llama2_FP8 / main
L2_PTQ_Llama2_INT8_SQ  /  main
0s
L2_PTQ_Llama2_INT8_SQ / main
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning  /  main
0s
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning / main
Nemo_CICD_Test
4s
Nemo_CICD_Test
Fit to window
Zoom out
Zoom in

Annotations

102 errors
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism
Process completed with exit code 1.
OPTIONAL_L0_Unit_Tests_GPU / main
The run was canceled by @github-actions[bot].
L0_Setup_Test_Data_And_Models / main
The run was canceled by @github-actions[bot].
L2_Community_LLM_Checkpoints_tests_Llama / main
The run was canceled by @github-actions[bot].
L2_Community_LLM_Checkpoints_tests_Llama3 / main
The run was canceled by @github-actions[bot].
L2_Community_LLM_Checkpoints_tests_StarCoder / main
The run was canceled by @github-actions[bot].
L2_Community_LLM_Checkpoints_tests_Falcon / main
The run was canceled by @github-actions[bot].
L2_PTQ_Llama2_Export_Only / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Finetuning_StarCoder_PP1
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Finetuning_StarCoder_PP1
Process completed with exit code 1.
L2_PTQ_Llama2_FP8 / main
The run was canceled by @github-actions[bot].
L2_PTQ_Llama2_INT8_SQ / main
The run was canceled by @github-actions[bot].
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet / main
The run was canceled by @github-actions[bot].
ASR_dev_run_Speech_Pre-training_-_CitriNet / main
The run was canceled by @github-actions[bot].
ASR_dev_run_Speech_To_Text_Finetuning / main
The run was canceled by @github-actions[bot].
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer / main
The run was canceled by @github-actions[bot].
ASR_dev_run_Speech_to_Text_WPE_-_Conformer / main
The run was canceled by @github-actions[bot].
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning / main
The run was canceled by @github-actions[bot].
L2_Speech_to_Text_EMA / main
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Speaker_Recognition / main
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Speaker_Diarization / main
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Speech_to_Label / main
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference / main
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Clustering_Diarizer_Inference / main
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation / main
The run was canceled by @github-actions[bot].
L2_RAG_Pipeline_Indexing
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
The run was canceled by @github-actions[bot].
L2_Speaker_dev_run_Neural_Diarizer_Inference / main
The run was canceled by @github-actions[bot].
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader / main
The run was canceled by @github-actions[bot].
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader / main
The run was canceled by @github-actions[bot].
L2_RAG_Pipeline_Generating
The run was canceled by @github-actions[bot].
L2_ASR_Adapters_Linear_Adapters / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
The run was canceled by @github-actions[bot].
L2_Speech_Transcription_Speech_to_Text_Transcribe / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
The run was canceled by @github-actions[bot].
L2_ASR_Adapters_RelPos_MHA_Adapters / main
The run was canceled by @github-actions[bot].
L2_Transducer_alignment_Running_pytest / main
The run was canceled by @github-actions[bot].
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference / main
The run was canceled by @github-actions[bot].
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference / main
The run was canceled by @github-actions[bot].
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav / main
The run was canceled by @github-actions[bot].
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3 / main
The run was canceled by @github-actions[bot].
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification / main
The run was canceled by @github-actions[bot].
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test / main
The run was canceled by @github-actions[bot].
L2_Duplex_Text_Normalization_with_Tarred_dataset / main
The run was canceled by @github-actions[bot].
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test / main
The run was canceled by @github-actions[bot].
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification / main
The run was canceled by @github-actions[bot].
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1 / main
The run was canceled by @github-actions[bot].
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification / main
The run was canceled by @github-actions[bot].
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation / main
The run was canceled by @github-actions[bot].
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN / main
The run was canceled by @github-actions[bot].
L2_Pretraining_BERT_pretraining_from_Text / main
The run was canceled by @github-actions[bot].
L2_NMT_Attention_is_All_You_Need_Inference / main
The run was canceled by @github-actions[bot].
L2_Pretraining_BERT_from_Preprocessed / main
The run was canceled by @github-actions[bot].
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation / main
The run was canceled by @github-actions[bot].
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN / main
The run was canceled by @github-actions[bot].
L0_Unit_Tests_CPU / main
The run was canceled by @github-actions[bot].
L0_Unit_Tests_CPU / main
The operation was canceled.
L2_Megatron_NMT_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_BART_Perceiver_MIM_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation / main
The run was canceled by @github-actions[bot].
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation / main
The run was canceled by @github-actions[bot].
L2_NMT_Attention_is_All_You_Need_Finetuning / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_RETRO_Pretraining_and_Resume_Training / main
The run was canceled by @github-actions[bot].
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training / main
The run was canceled by @github-actions[bot].
L2_BioMegatron_Bert_NER_Task / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Finetuning_PP2 / main
The run was canceled by @github-actions[bot].
ASR_dev_run_Speech_to_Text / main
The run was canceled by @github-actions[bot].
ASR_dev_run_Speech_to_Text / main
The operation was canceled.
L2_Megatron_GPT_Eval / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_PEFT_Lora_PP2_O2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Embedding / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_Eval_PP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_PEFT_Lora_TP2_O1 / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining / main
The run was canceled by @github-actions[bot].
L2_Megatron_Mock_Data_Generation_MockT5Dataset / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_Eval / main
The run was canceled by @github-actions[bot].
L2_Megatron_Mock_Data_Generation_MockGPTDataset / main
The run was canceled by @github-actions[bot].
L2_Megatron_T5_PEFT_Lora_TP2 / main
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
The run was canceled by @github-actions[bot].
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
The operation was canceled.
L2_TTS_Fast_dev_runs_1_Tacotron_2 / main
The run was canceled by @github-actions[bot].
L2_TTS_Fast_dev_runs_1_FastPitch / main
The run was canceled by @github-actions[bot].
L2_TTS_Fast_dev_runs_1_WaveGlow / main
The run was canceled by @github-actions[bot].
L2_TTS_Fast_dev_runs_1_Hifigan / main
The run was canceled by @github-actions[bot].
L2_TTS_Fast_dev_runs_1_Mixer-TTS / main
The run was canceled by @github-actions[bot].
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training
The run was canceled by @github-actions[bot].
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training
The operation was canceled.
Speech_Checkpoints_tests / main
The run was canceled by @github-actions[bot].
L2_Megatron_Bert_Pretraining_and_Resume_Training
The run was canceled by @github-actions[bot].
L2_Megatron_Bert_Pretraining_and_Resume_Training
The operation was canceled.
Nemo_CICD_Test
Process completed with exit code 1.