Draft: Add LoRA test with sequence parallelism #2645
Triggered via pull request
June 28, 2024 12:30
Status
Cancelled
Total duration
1h 19m 9s
Artifacts
–
cicd-main.yml
on: pull_request
cicd-cluster-clean
3s
gpu-test
17s
L0_Unit_Tests_GPU
/
main
29m 45s
L0_Unit_Tests_CPU
/
main
35m 38s
L2_Community_LLM_Checkpoints_tests_Llama
/
main
1m 11s
L2_Community_LLM_Checkpoints_tests_StarCoder
/
main
41s
L2_Community_LLM_Checkpoints_tests_Falcon
/
main
37s
ASR_dev_run_Speech_to_Text
/
main
47s
ASR_dev_run_Speech_to_Text_WPE_-_CitriNet
/
main
47s
ASR_dev_run_Speech_Pre-training_-_CitriNet
/
main
1m 37s
ASR_dev_run_Speech_To_Text_Finetuning
/
main
47s
ASR_dev_run_Speech_to_Text_WPE_-_Conformer
/
main
37s
ASR_dev_run-part_two_Speech_to_Text_WPE_-_Squeezeformer
/
main
39s
L2_Speech_to_Text_EMA
/
main
57s
L2_Speaker_dev_run_Speaker_Recognition
/
main
35s
L2_Speaker_dev_run_Speaker_Diarization
/
main
37s
L2_Speaker_dev_run_Speech_to_Label
/
main
38s
L2_Speaker_dev_run_Speaker_Diarization_with_ASR_Inference
/
main
1m 5s
L2_Speaker_dev_run_Clustering_Diarizer_Inference
/
main
37s
L2_Speaker_dev_run_Neural_Diarizer_Inference
/
main
41s
L2_Speaker_dev_run_Multispeaker_ASR_Data_Simulation
/
main
30s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Text_multi-dataloader
/
main
46s
L2_ASR_Multi-dataloader_dev_run_Speech_to_Label_multi-dataloader
/
main
37s
L2_ASR_Adapters_Linear_Adapters
/
main
38s
L2_ASR_Adapters_RelPos_MHA_Adapters
/
main
39s
L2_Speech_Transcription_Speech_to_Text_Transcribe
/
main
1m 3s
L2_Transducer_alignment_Running_pytest
/
main
52s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Eng_CitriNet_with_wav
/
main
3m 20s
L2_Segmentation_Tool_Parallel_ctc_segmentation_test_L2_Ru_QN_with_mp3
/
main
1m 38s
L2_G2P_Models_G2P_Conformer_training_evaluation_and_inference
/
main
55s
L2_G2P_Models_HeteronymClassificationModel_training_evaluation_and_inference
/
main
1m 14s
L2_Duplex_Text_Normalization_with_Tarred_dataset
/
main
1m 25s
L2_Intent_and_Slot_Classification_Tasks_Intent_and_Slot_Classification
/
main
38s
L2_Intent_and_Slot_Classification_Tasks_Multi-Label_Intent_and_Slot_Classification
/
main
42s
L2_Parallel_NLP_Examples2_NER_finetuning_from_pretrained_Test
/
main
42s
L2_Parallel_NLP_Examples2_Punctuation_and_capitalization_finetuning_from_pretrained_test
/
main
42s
L2_Parallel_NLP_Examples2_NER_with_TurkuNLP__bert-base-finnish-cased-v1
/
main
38s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Token_Classification
/
main
1m 16s
L2_Parallel_NLP_Examples2_Evaluation_script_for_Punctuation
/
main
37s
L2_Pretraining_BERT_pretraining_from_Text
/
main
38s
L2_Pretraining_BERT_from_Preprocessed
/
main
42s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Post-LN
/
main
1m 6s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Training_Pre-LN
/
main
52s
L2_NMT_Attention_is_All_You_Need_Training_NMT_Multi-Validation
/
main
1m 2s
L2_NMT_Attention_is_All_You_Need_Inference
/
main
50s
L2_NMT_Attention_is_All_You_Need_Finetuning
/
main
1m 47s
L2_NMT_Tarred_Dataset_Creation_Auto_Tarred_Dataset_Creation
/
main
51s
L2_NMT_Tarred_Dataset_Creation_Script_Tarred_Dataset_Creation
/
main
45s
L2_Megatron_NMT_Training_TP2
/
main
3m 34s
L2_Megatron_BART_Perceiver_MIM_Training_TP2
/
main
2m 39s
L2_Megatron_Bert_Pretraining_and_Resume_Training_with_Pipeline_Parallelism
3m 59s
L2_Megatron_Bert_Pretraining_and_Resume_Training
3m 59s
L2_Megatron_Core_Bert_Pretraining_and_Resume_Training
2m 9s
L2_Megatron_RETRO_Pretraining_and_Resume_Training
/
main
10m 4s
L2_Legacy_Megatron_RETRO_Pretraining_and_Resume_Training
/
main
1m 45s
L2_RAG_Pipeline_Indexing
1m 22s
L2_RAG_Pipeline_Generating
1m 54s
L2_BioMegatron_Bert_NER_Task
/
main
1m 45s
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
10m 4s
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
10m 6s
L2_Megatron_GPT_with_ResetLR_Pretraining_and_Resume_Training_TP2
10m 4s
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
10m 6s
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
10m 5s
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2
/
main
10m 7s
L2_Megatron_GPT_Finetuning_PP2
/
main
3m 7s
L2_Megatron_GPT_Finetuning_StarCoder_PP1
1m 59s
L2_Megatron_GPT_Embedding
/
main
2m 4s
L2_Megatron_GPT_PEFT_Lora_PP2_O2
/
main
1m 51s
L2_Megatron_GPT_PEFT_Lora_TP2_O1
/
main
1m 49s
L2_Megatron_GPT_PEFT_Lora_TP2SP1
/
main
1m 41s
L2_Megatron_GPT_Eval
/
main
51s
L2_Megatron_GPT_Eval_PP2
/
main
2m 8s
L2_Megatron_GPT_SFT_Eval_inference_seq_len_greaterThan_training_seq_len
/
main
1m 22s
L2_Megatron_Change_Partitions_Reduce_TP_Num_Partitions_-2_to_1-_and_PP_Num_Partitions_-1_to_2
/
main
51s
L2_Megatron_Change_Partitions_Increase_TP_Num_Partitions_-2_to_4-_and_PP_Num_Partitions_-1_to_2
/
main
46s
L2_Megatron_T5_Pretraining_and_Resume_Training_TP2
/
main
1m 48s
L2_Megatron_T5_with_ALiBi_Pretraining_and_Resume_Training_TP2
/
main
1m 48s
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2
/
main
1m 57s
L2_Megatron_T5_Pretraining_and_Resume_Training_PP2
/
main
2m 30s
L2_Megatron_T5_w_Mixture_of_Expert_Pretraining
/
main
1m 36s
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2
/
main
1m 56s
L2_Megatron_T5_Eval
/
main
33s
L2_Megatron_BART_Pretraining_and_Resume_Training_TP2
/
main
1m 47s
L2_Megatron_BART_Pretraining_and_Resume_Training_PP2
/
main
1m 50s
L2_Megatron_T5_PEFT_Lora_TP2
/
main
0s
L2_Megatron_Mock_Data_Generation_MockGPTDataset
/
main
31s
L2_Megatron_Mock_Data_Generation_MockT5Dataset
/
main
0s
L2_TTS_Fast_dev_runs_1_Tacotron_2
/
main
1m 2s
L2_TTS_Fast_dev_runs_1_WaveGlow
/
main
0s
L2_TTS_Fast_dev_runs_1_FastPitch
/
main
0s
L2_TTS_Fast_dev_runs_1_Mixer-TTS
/
main
0s
L2_TTS_Fast_dev_runs_1_Hifigan
/
main
0s
Speech_Checkpoints_tests
/
main
0s
L2_Stable_Diffusion_Training
/
main
3m 48s
L0_Setup_Test_Data_And_Models
/
main
29s
L2_Community_LLM_Checkpoints_tests_Llama3
/
main
39s
L2_PTQ_Llama2_Export_Only
/
main
1m 9s
L2_PTQ_Llama2_FP8
/
main
7m 11s
L2_PTQ_Llama2_INT8_SQ
/
main
7m 24s
OPTIONAL_ASR_dev_run_Speech_To_Text_HF_Finetuning
/
main
1m 34s
Nemo_CICD_Test
11s
Annotations
28 errors
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
The job running on runner azure-gpu-vm-runner3 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_GPT_Pretraining_and_Resume_Training_TP2
The operation was canceled.
|
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
The job running on runner azure-gpu-vm-runner2 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_GPT_with_ALiBi_Pretraining_and_Resume_Training_TP2
The operation was canceled.
|
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
The job running on runner azure-gpu-vm-runner5 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_GPT_with_KERPLE_Pretraining_and_Resume_Training_TP2
The operation was canceled.
|
L2_Megatron_GPT_with_ResetLR_Pretraining_and_Resume_Training_TP2
The job running on runner azure-gpu-vm-runner3 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_GPT_with_ResetLR_Pretraining_and_Resume_Training_TP2
The operation was canceled.
|
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
The job running on runner azure-gpu-vm-runner2 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_GPT_with_Rope_Pretraining_and_Resume_Training_TP2
The operation was canceled.
|
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main
The job running on runner azure-gpu-vm-runner2 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_GPT_Pretraining_and_Resume_Training_PP2 / main
The operation was canceled.
|
L2_Megatron_RETRO_Pretraining_and_Resume_Training / main
The job running on runner azure-gpu-vm-runner5 has exceeded the maximum execution time of 10 minutes.
|
L2_Megatron_RETRO_Pretraining_and_Resume_Training / main
The operation was canceled.
|
L2_TTS_Fast_dev_runs_1_WaveGlow / main
The run was canceled by @github-actions[bot].
|
L2_Megatron_T5_PEFT_Lora_TP2 / main
The run was canceled by @github-actions[bot].
|
L2_TTS_Fast_dev_runs_1_Hifigan / main
The run was canceled by @github-actions[bot].
|
L2_Megatron_Mock_Data_Generation_MockT5Dataset / main
The run was canceled by @github-actions[bot].
|
L2_TTS_Fast_dev_runs_1_FastPitch / main
The run was canceled by @github-actions[bot].
|
Speech_Checkpoints_tests / main
The run was canceled by @github-actions[bot].
|
L2_TTS_Fast_dev_runs_1_Mixer-TTS / main
The run was canceled by @github-actions[bot].
|
L2_Megatron_Mock_Data_Generation_MockGPTDataset / main
The run was canceled by @github-actions[bot].
|
L2_Megatron_Mock_Data_Generation_MockGPTDataset / main
Process completed with exit code 1.
|
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
|
L2_Megatron_T5_with_KERPLE_Pretraining_and_Resume_Training_TP2 / main
The operation was canceled.
|
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / main
The run was canceled by @github-actions[bot].
|
L2_Megatron_UL2_Pretraining_and_Resume_Training_TP2 / main
The operation was canceled.
|
Nemo_CICD_Test
Process completed with exit code 1.
|