You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is frequently seeing on few bamboo agents.
for example for this bamboo job: http://idm-bamboo:8085/browse/RIT-ID-207/log
it stuck on test:
test_analyzers_emod_comps.py: test_analyzer_preidmtools_exp case
this test is using experiment_id: 'f48e09d4-acd9-e911-a2be-f0921c167861' with 5 simulations.
from idmtools.log, I should see print this line 5 times: - Finalizing f58e09d4-acd9-e911-a2be-f0921c167861
instead I only see from 1 simulation out of 5 for above line
And I also expect these few lines in idmtools.log which I did not see.
Finished finalizing results
Destroying analyzers
Cleaning up the cache
last line was 2020-03-09 11:58:36,629.629 /home/idm_bamboo_user/bamboo-agent/xml-data/build-dir/RIT-ID-ITIP3C/idmtools_core/idmtools/analysis/analyze_manager.py:301 _run_and_wait_for_reducing [DEBUG] (24672,(140129637955392) - Finalizing f58e09d4-acd9-e911-a2be-f0921c167861
attached log I scp from bamboo agent: idmtools.log
Since job hung, I have to kill bamboo build. this test should finished in few seconds.
We seem more and more this behavior in bamboo.
I am not sure what cause this this hang. from log, it seems stuck on _run_and_wait_for_reducing method
The text was updated successfully, but these errors were encountered:
This is frequently seeing on few bamboo agents.
for example for this bamboo job:
http://idm-bamboo:8085/browse/RIT-ID-207/log
it stuck on test:
test_analyzers_emod_comps.py: test_analyzer_preidmtools_exp case
this test is using experiment_id: 'f48e09d4-acd9-e911-a2be-f0921c167861' with 5 simulations.
from idmtools.log, I should see print this line 5 times:
- Finalizing f58e09d4-acd9-e911-a2be-f0921c167861
instead I only see from 1 simulation out of 5 for above line
And I also expect these few lines in idmtools.log which I did not see.
last line was
2020-03-09 11:58:36,629.629 /home/idm_bamboo_user/bamboo-agent/xml-data/build-dir/RIT-ID-ITIP3C/idmtools_core/idmtools/analysis/analyze_manager.py:301 _run_and_wait_for_reducing [DEBUG] (24672,(140129637955392) - Finalizing f58e09d4-acd9-e911-a2be-f0921c167861
attached log I scp from bamboo agent:
idmtools.log
Since job hung, I have to kill bamboo build. this test should finished in few seconds.
We seem more and more this behavior in bamboo.
I am not sure what cause this this hang. from log, it seems stuck on _run_and_wait_for_reducing method
The text was updated successfully, but these errors were encountered: