Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[4.9] Smoketest Health #1837

Closed

Conversation

rohityadavcloud
Copy link
Member

@blueorangutan package

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-401

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-402

@rohityadavcloud
Copy link
Member Author

@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-690)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29592 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t690-kvm-centos7.zip
Test completed. 44 look ok, 4 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 325.87 test_privategw_acl.py
test_09_delete_detached_volume Error 10.20 test_volumes.py
test_08_resize_volume Error 5.09 test_volumes.py
test_07_resize_fail Error 10.26 test_volumes.py
test_06_download_detached_volume Error 5.10 test_volumes.py
test_05_detach_volume Error 5.09 test_volumes.py
test_04_delete_attached_volume Error 5.09 test_volumes.py
test_03_download_attached_volume Error 5.09 test_volumes.py
test_01_create_volume Error 247.67 test_volumes.py
ContextSuite context=TestTemplates>:setup Error 339.78 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 154.99 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.18 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 245.62 test_vpc_vpn.py
test_02_VPC_default_routes Success 465.72 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 792.08 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 510.98 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1397.37 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 535.73 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 734.25 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1291.70 test_vpc_redundant.py
test_02_attach_volume Success 48.69 test_volumes.py
test_deploy_vm_multiple Success 328.09 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.52 test_vm_life_cycle.py
test_09_expunge_vm Success 125.28 test_vm_life_cycle.py
test_08_migrate_vm Success 35.88 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 125.85 test_vm_life_cycle.py
test_03_reboot_vm Success 125.90 test_vm_life_cycle.py
test_02_start_vm Success 5.14 test_vm_life_cycle.py
test_01_stop_vm Success 125.86 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 65.63 test_templates.py
test_01_create_template Success 65.59 test_templates.py
test_10_destroy_cpvm Success 131.41 test_ssvm.py
test_09_destroy_ssvm Success 163.21 test_ssvm.py
test_08_reboot_cpvm Success 131.29 test_ssvm.py
test_07_reboot_ssvm Success 103.17 test_ssvm.py
test_06_stop_cpvm Success 106.42 test_ssvm.py
test_05_stop_ssvm Success 133.32 test_ssvm.py
test_04_cpvm_internals Success 1.03 test_ssvm.py
test_03_ssvm_internals Success 3.33 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 11.32 test_snapshots.py
test_04_change_offering_small Success 210.62 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.09 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.19 test_secondary_storage.py
test_09_reboot_router Success 35.32 test_routers.py
test_08_start_router Success 30.30 test_routers.py
test_07_stop_router Success 10.20 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.58 test_routers.py
test_03_restart_network_cleanup Success 50.46 test_routers.py
test_02_router_internal_adv Success 0.85 test_routers.py
test_01_router_internal_basic Success 0.49 test_routers.py
test_router_dns_guestipquery Success 75.04 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 362.88 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.57 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 171.17 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.22 test_pvlan.py
test_dedicatePublicIpRange Success 0.42 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 636.44 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 577.03 test_privategw_acl.py
test_01_vpc_privategw_acl Success 87.31 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.74 test_primary_storage.py
test_createPortablePublicIPRange Success 15.22 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.51 test_portable_publicip.py
test_isolate_network_password_server Success 61.39 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 30.68 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.33 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.27 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.33 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.50 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.32 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.80 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.44 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.30 test_non_contigiousvlan.py
test_01_nic Success 580.19 test_nic.py
test_releaseIP Success 278.05 test_network.py
test_reboot_router Success 509.20 test_network.py
test_public_ip_user_account Success 10.25 test_network.py
test_public_ip_admin_account Success 40.34 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.63 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.67 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 120.68 test_network.py
test_delete_account Success 298.08 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.87 test_network.py
test_01_port_fwd_on_src_nat Success 109.99 test_network.py
test_nic_secondaryip_add_remove Success 232.85 test_multipleips_per_nic.py
login_test_saml_user Success 19.39 test_login.py
test_assign_and_removal_lb Success 132.78 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 186.96 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.47 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.13 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.20 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 228.38 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 187.75 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 519.17 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 436.64 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.28 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.19 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.03 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.89 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.94 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.04 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.94 test_dynamicroles.py
test_role_lifecycle_update Success 11.00 test_dynamicroles.py
test_role_lifecycle_list Success 5.93 test_dynamicroles.py
test_role_lifecycle_delete Success 11.00 test_dynamicroles.py
test_role_lifecycle_create Success 5.93 test_dynamicroles.py
test_role_inuse_deletion Success 5.91 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.24 test_dynamicroles.py
test_role_account_acls Success 8.37 test_dynamicroles.py
test_default_role_deletion Success 6.01 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 20.60 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.67 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 86.00 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.39 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 90.95 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.03 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.04 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 222.57 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 207.55 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 116.32 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

I'll be fixing some env issues and possible regressions causing this today.

@blueorangutan
Copy link

Trillian test result (tid-692)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29989 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t692-kvm-centos7.zip
Test completed. 43 look ok, 6 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 862.70 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 354.24 test_privategw_acl.py
test_09_delete_detached_volume Error 10.15 test_volumes.py
test_08_resize_volume Error 5.07 test_volumes.py
test_07_resize_fail Error 10.19 test_volumes.py
test_06_download_detached_volume Error 5.07 test_volumes.py
test_05_detach_volume Error 5.07 test_volumes.py
test_04_delete_attached_volume Error 5.06 test_volumes.py
test_03_download_attached_volume Error 5.08 test_volumes.py
test_01_create_volume Error 279.45 test_volumes.py
ContextSuite context=TestTemplates>:setup Error 323.20 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 154.40 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 65.84 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 266.34 test_vpc_vpn.py
test_02_VPC_default_routes Success 461.74 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 873.96 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 505.35 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1442.99 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 552.30 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1277.80 test_vpc_redundant.py
test_02_attach_volume Success 50.95 test_volumes.py
test_deploy_vm_multiple Success 357.35 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.52 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 40.66 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 130.65 test_vm_life_cycle.py
test_03_reboot_vm Success 125.65 test_vm_life_cycle.py
test_02_start_vm Success 10.15 test_vm_life_cycle.py
test_01_stop_vm Success 125.63 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 70.48 test_templates.py
test_01_create_template Success 55.40 test_templates.py
test_10_destroy_cpvm Success 162.36 test_ssvm.py
test_09_destroy_ssvm Success 163.52 test_ssvm.py
test_08_reboot_cpvm Success 131.51 test_ssvm.py
test_07_reboot_ssvm Success 133.69 test_ssvm.py
test_06_stop_cpvm Success 131.50 test_ssvm.py
test_05_stop_ssvm Success 133.48 test_ssvm.py
test_04_cpvm_internals Success 1.19 test_ssvm.py
test_03_ssvm_internals Success 3.29 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 11.01 test_snapshots.py
test_04_change_offering_small Success 239.58 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.06 test_service_offerings.py
test_02_sys_template_ready Success 0.09 test_secondary_storage.py
test_01_sys_vm_start Success 0.12 test_secondary_storage.py
test_09_reboot_router Success 35.23 test_routers.py
test_08_start_router Success 30.20 test_routers.py
test_07_stop_router Success 10.12 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.64 test_routers.py
test_03_restart_network_cleanup Success 60.38 test_routers.py
test_02_router_internal_adv Success 1.03 test_routers.py
test_01_router_internal_basic Success 0.56 test_routers.py
test_router_dns_guestipquery Success 76.61 test_router_dns.py
test_router_dns_externalipquery Success 0.05 test_router_dns.py
test_router_dhcphosts Success 386.94 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.46 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.07 test_resource_detail.py
test_01_reset_vm_on_reboot Success 155.86 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.15 test_pvlan.py
test_dedicatePublicIpRange Success 0.30 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 661.68 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 570.10 test_privategw_acl.py
test_01_vpc_privategw_acl Success 81.58 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.68 test_primary_storage.py
test_createPortablePublicIPRange Success 15.14 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.31 test_portable_publicip.py
test_isolate_network_password_server Success 86.23 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.48 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.26 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.18 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.27 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.45 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.24 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.24 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.20 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.12 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.06 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.30 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.23 test_non_contigiousvlan.py
test_01_nic Success 588.99 test_nic.py
test_releaseIP Success 277.34 test_network.py
test_reboot_router Success 513.66 test_network.py
test_public_ip_user_account Success 10.19 test_network.py
test_public_ip_admin_account Success 40.21 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.58 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.55 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.92 test_network.py
test_delete_account Success 297.15 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.46 test_network.py
test_01_port_fwd_on_src_nat Success 111.60 test_network.py
test_nic_secondaryip_add_remove Success 232.11 test_multipleips_per_nic.py
login_test_saml_user Success 18.07 test_login.py
test_assign_and_removal_lb Success 133.36 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.07 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 219.01 test_loadbalance.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.13 test_iso.py
test_03_delete_iso Success 95.17 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.67 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 237.78 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 182.25 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 503.74 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 417.75 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.20 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.10 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.80 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.67 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.77 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.61 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.68 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.63 test_dynamicroles.py
test_role_lifecycle_update Success 10.66 test_dynamicroles.py
test_role_lifecycle_list Success 5.60 test_dynamicroles.py
test_role_lifecycle_delete Success 10.63 test_dynamicroles.py
test_role_lifecycle_create Success 5.59 test_dynamicroles.py
test_role_inuse_deletion Success 5.61 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.19 test_dynamicroles.py
test_role_account_acls Success 7.05 test_dynamicroles.py
test_default_role_deletion Success 5.66 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.07 test_disk_offerings.py
test_deployvm_userdispersing Success 20.54 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 45.52 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.47 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.26 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 75.61 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.09 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.66 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 231.95 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 206.77 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 65.66 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan test centos7 kvm-centos6

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos6) has been kicked to run smoke tests

@murali-reddy
Copy link
Contributor

@blueorangutan test centos7 vmware-55u3

@blueorangutan
Copy link

@murali-reddy a Trillian-Jenkins test job (centos7 mgmt + vmware-55u3) has been kicked to run smoke tests

@murali-reddy
Copy link
Contributor

@blueorangutan test centos7 xenserver-65sp1

@blueorangutan
Copy link

@murali-reddy a Trillian-Jenkins test job (centos7 mgmt + xenserver-65sp1) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-695)
Environment: kvm-centos6 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29131 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t695-kvm-centos6.zip
Test completed. 44 look ok, 4 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 340.84 test_privategw_acl.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 1870.65 test_vpc_vpn.py
ContextSuite context=TestTemplates>:setup Error 369.78 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 170.24 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 275.69 test_vpc_vpn.py
test_02_VPC_default_routes Success 337.58 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 703.11 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 547.84 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1341.46 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 575.95 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 760.11 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1302.32 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.42 test_volumes.py
test_08_resize_volume Success 15.36 test_volumes.py
test_07_resize_fail Success 20.53 test_volumes.py
test_06_download_detached_volume Success 15.37 test_volumes.py
test_05_detach_volume Success 100.30 test_volumes.py
test_04_delete_attached_volume Success 10.21 test_volumes.py
test_03_download_attached_volume Success 15.44 test_volumes.py
test_02_attach_volume Success 76.72 test_volumes.py
test_01_create_volume Success 861.49 test_volumes.py
test_deploy_vm_multiple Success 302.90 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.56 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 40.88 test_vm_life_cycle.py
test_07_restore_vm Success 0.12 test_vm_life_cycle.py
test_06_destroy_vm Success 130.80 test_vm_life_cycle.py
test_03_reboot_vm Success 125.80 test_vm_life_cycle.py
test_02_start_vm Success 10.23 test_vm_life_cycle.py
test_01_stop_vm Success 125.84 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 95.89 test_templates.py
test_01_create_template Success 55.57 test_templates.py
test_10_destroy_cpvm Success 161.92 test_ssvm.py
test_09_destroy_ssvm Success 225.09 test_ssvm.py
test_08_reboot_cpvm Success 131.87 test_ssvm.py
test_07_reboot_ssvm Success 133.85 test_ssvm.py
test_06_stop_cpvm Success 132.19 test_ssvm.py
test_05_stop_ssvm Success 164.25 test_ssvm.py
test_04_cpvm_internals Success 1.66 test_ssvm.py
test_03_ssvm_internals Success 3.94 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_04_change_offering_small Success 242.55 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.19 test_secondary_storage.py
test_09_reboot_router Success 45.36 test_routers.py
test_08_start_router Success 35.30 test_routers.py
test_07_stop_router Success 10.15 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.74 test_routers.py
test_03_restart_network_cleanup Success 60.51 test_routers.py
test_02_router_internal_adv Success 1.09 test_routers.py
test_01_router_internal_basic Success 0.66 test_routers.py
test_router_dns_guestipquery Success 106.80 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 328.33 test_router_dhcphosts.py
test_router_dhcp_opts Success 22.17 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.14 test_resource_detail.py
test_01_reset_vm_on_reboot Success 131.26 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.49 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 560.54 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 450.58 test_privategw_acl.py
test_01_vpc_privategw_acl Success 92.52 test_privategw_acl.py
test_01_primary_storage_nfs Success 36.05 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.56 test_portable_publicip.py
test_isolate_network_password_server Success 94.37 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 30.58 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.33 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.26 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.40 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.31 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.49 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.21 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.39 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.86 test_non_contigiousvlan.py
test_01_nic Success 519.48 test_nic.py
test_releaseIP Success 252.71 test_network.py
test_reboot_router Success 458.78 test_network.py
test_public_ip_user_account Success 10.31 test_network.py
test_public_ip_admin_account Success 40.26 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.86 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.75 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 154.55 test_network.py
test_delete_account Success 302.76 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.60 test_network.py
test_01_port_fwd_on_src_nat Success 141.74 test_network.py
test_nic_secondaryip_add_remove Success 207.51 test_multipleips_per_nic.py
login_test_saml_user Success 19.16 test_login.py
test_assign_and_removal_lb Success 133.49 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.24 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 248.50 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.24 test_iso.py
test_03_delete_iso Success 95.12 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 20.97 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 268.77 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 198.35 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 557.55 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 442.51 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.25 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.10 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.96 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.83 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.87 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.96 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.88 test_dynamicroles.py
test_role_lifecycle_update Success 10.94 test_dynamicroles.py
test_role_lifecycle_list Success 5.86 test_dynamicroles.py
test_role_lifecycle_delete Success 10.90 test_dynamicroles.py
test_role_lifecycle_create Success 5.86 test_dynamicroles.py
test_role_inuse_deletion Success 5.84 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.12 test_dynamicroles.py
test_role_account_acls Success 8.17 test_dynamicroles.py
test_default_role_deletion Success 5.94 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 20.56 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 25.59 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 96.03 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.56 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 70.82 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.94 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 232.35 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 217.36 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 116.15 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_01_snapshot_root_disk Skipped 0.00 test_snapshots.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✖debian. JID-409

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-697)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35551 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t697-xenserver-65sp1.zip
Test completed. 43 look ok, 5 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 567.60 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1355.15 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 534.36 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 760.96 test_privategw_acl.py
ContextSuite context=TestVpcSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVPCRedundancy>:teardown Error 889.94 test_vpc_redundant.py
ContextSuite context=TestTemplates>:setup Error 393.38 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_02_VPC_default_routes Success 333.45 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 646.94 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 917.09 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1054.16 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.53 test_volumes.py
test_08_resize_volume Success 85.56 test_volumes.py
test_07_resize_fail Success 100.64 test_volumes.py
test_06_download_detached_volume Success 25.26 test_volumes.py
test_05_detach_volume Success 100.23 test_volumes.py
test_04_delete_attached_volume Success 10.13 test_volumes.py
test_03_download_attached_volume Success 15.19 test_volumes.py
test_02_attach_volume Success 10.63 test_volumes.py
test_01_create_volume Success 393.09 test_volumes.py
test_03_delete_vm_snapshots Success 280.17 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 191.08 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.74 test_vm_snapshots.py
test_deploy_vm_multiple Success 236.75 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.55 test_vm_life_cycle.py
test_09_expunge_vm Success 125.18 test_vm_life_cycle.py
test_08_migrate_vm Success 65.73 test_vm_life_cycle.py
test_07_restore_vm Success 0.06 test_vm_life_cycle.py
test_06_destroy_vm Success 10.12 test_vm_life_cycle.py
test_03_reboot_vm Success 10.11 test_vm_life_cycle.py
test_02_start_vm Success 20.16 test_vm_life_cycle.py
test_01_stop_vm Success 25.15 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 120.68 test_templates.py
test_01_create_template Success 61.06 test_templates.py
test_10_destroy_cpvm Success 196.50 test_ssvm.py
test_09_destroy_ssvm Success 228.58 test_ssvm.py
test_08_reboot_cpvm Success 141.39 test_ssvm.py
test_07_reboot_ssvm Success 153.76 test_ssvm.py
test_06_stop_cpvm Success 161.35 test_ssvm.py
test_05_stop_ssvm Success 168.75 test_ssvm.py
test_04_cpvm_internals Success 0.96 test_ssvm.py
test_03_ssvm_internals Success 3.31 test_ssvm.py
test_02_list_cpvm_vm Success 0.08 test_ssvm.py
test_01_list_sec_storage_vm Success 0.08 test_ssvm.py
test_01_snapshot_root_disk Success 21.05 test_snapshots.py
test_04_change_offering_small Success 95.87 test_service_offerings.py
test_03_delete_service_offering Success 0.02 test_service_offerings.py
test_02_edit_service_offering Success 0.04 test_service_offerings.py
test_01_create_service_offering Success 0.06 test_service_offerings.py
test_02_sys_template_ready Success 0.08 test_secondary_storage.py
test_01_sys_vm_start Success 0.11 test_secondary_storage.py
test_01_scale_vm Success 5.12 test_scale_vm.py
test_09_reboot_router Success 65.35 test_routers.py
test_08_start_router Success 50.28 test_routers.py
test_07_stop_router Success 15.12 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.46 test_routers.py
test_03_restart_network_cleanup Success 120.61 test_routers.py
test_02_router_internal_adv Success 0.76 test_routers.py
test_01_router_internal_basic Success 0.48 test_routers.py
test_router_dns_guestipquery Success 48.66 test_router_dns.py
test_router_dns_externalipquery Success 0.04 test_router_dns.py
test_router_dhcphosts Success 122.21 test_router_dhcphosts.py
test_router_dhcp_opts Success 30.97 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.06 test_resource_detail.py
test_01_reset_vm_on_reboot Success 115.75 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.17 test_pvlan.py
test_dedicatePublicIpRange Success 0.27 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 820.04 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 645.22 test_privategw_acl.py
test_01_vpc_privategw_acl Success 161.84 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.79 test_primary_storage.py
test_01_primary_storage_iscsi Success 77.61 test_primary_storage.py
test_createPortablePublicIPRange Success 15.13 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.32 test_portable_publicip.py
test_isolate_network_password_server Success 35.78 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.49 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.24 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.16 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.23 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.24 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.22 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.22 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.16 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.11 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.06 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.12 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.06 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.27 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.21 test_non_contigiousvlan.py
test_01_nic Success 730.23 test_nic.py
test_releaseIP Success 317.30 test_network.py
test_reboot_router Success 574.71 test_network.py
test_public_ip_user_account Success 10.19 test_network.py
test_public_ip_admin_account Success 40.20 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.37 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.48 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 102.68 test_network.py
test_delete_account Success 327.55 test_network.py
test_02_port_fwd_on_non_src_nat Success 70.49 test_network.py
test_01_port_fwd_on_src_nat Success 83.97 test_network.py
test_nic_secondaryip_add_remove Success 226.81 test_multipleips_per_nic.py
login_test_saml_user Success 17.70 test_login.py
test_assign_and_removal_lb Success 148.31 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.08 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.48 test_loadbalance.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.08 test_iso.py
test_03_delete_iso Success 95.09 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.67 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 483.85 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 377.97 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1021.30 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 625.37 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.21 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.10 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.76 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.65 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.56 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.79 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.68 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.58 test_dynamicroles.py
test_role_lifecycle_update Success 10.66 test_dynamicroles.py
test_role_lifecycle_list Success 5.58 test_dynamicroles.py
test_role_lifecycle_delete Success 10.70 test_dynamicroles.py
test_role_lifecycle_create Success 5.58 test_dynamicroles.py
test_role_inuse_deletion Success 5.57 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 6.89 test_dynamicroles.py
test_role_account_acls Success 7.04 test_dynamicroles.py
test_default_role_deletion Success 5.64 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.04 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.04 test_disk_offerings.py
test_01_create_disk_offering Success 0.05 test_disk_offerings.py
test_deployvm_userdispersing Success 40.54 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 130.88 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 196.04 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 25.31 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 110.75 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.56 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.57 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.73 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 261.93 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 236.48 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.01 test_staticroles.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-696)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 40114 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t696-vmware-55u3.zip
Test completed. 44 look ok, 4 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 957.80 test_privategw_acl.py
ContextSuite context=TestVpcSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestVPCRedundancy>:teardown Error 705.54 test_vpc_redundant.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_02_VPC_default_routes Success 339.10 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 775.00 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 700.45 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1607.67 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 708.09 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 697.93 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1392.10 test_vpc_redundant.py
test_09_delete_detached_volume Success 31.10 test_volumes.py
test_06_download_detached_volume Success 75.50 test_volumes.py
test_05_detach_volume Success 110.29 test_volumes.py
test_04_delete_attached_volume Success 20.23 test_volumes.py
test_03_download_attached_volume Success 20.25 test_volumes.py
test_02_attach_volume Success 69.90 test_volumes.py
test_01_create_volume Success 555.35 test_volumes.py
test_03_delete_vm_snapshots Success 275.12 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 237.06 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 186.15 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.57 test_vm_snapshots.py
test_deploy_vm_multiple Success 307.15 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.70 test_vm_life_cycle.py
test_09_expunge_vm Success 185.26 test_vm_life_cycle.py
test_08_migrate_vm Success 105.99 test_vm_life_cycle.py
test_07_restore_vm Success 0.07 test_vm_life_cycle.py
test_06_destroy_vm Success 10.11 test_vm_life_cycle.py
test_03_reboot_vm Success 5.10 test_vm_life_cycle.py
test_02_start_vm Success 20.17 test_vm_life_cycle.py
test_01_stop_vm Success 10.12 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 291.51 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 15.18 test_templates.py
test_03_delete_template Success 5.08 test_templates.py
test_02_edit_template Success 90.07 test_templates.py
test_01_create_template Success 130.74 test_templates.py
test_10_destroy_cpvm Success 236.59 test_ssvm.py
test_09_destroy_ssvm Success 268.48 test_ssvm.py
test_08_reboot_cpvm Success 156.66 test_ssvm.py
test_07_reboot_ssvm Success 158.44 test_ssvm.py
test_06_stop_cpvm Success 176.77 test_ssvm.py
test_05_stop_ssvm Success 208.86 test_ssvm.py
test_04_cpvm_internals Success 1.03 test_ssvm.py
test_03_ssvm_internals Success 3.17 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 71.32 test_snapshots.py
test_04_change_offering_small Success 96.79 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.08 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.12 test_secondary_storage.py
test_09_reboot_router Success 136.05 test_routers.py
test_08_start_router Success 120.86 test_routers.py
test_07_stop_router Success 20.16 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.53 test_routers.py
test_03_restart_network_cleanup Success 196.06 test_routers.py
test_02_router_internal_adv Success 0.89 test_routers.py
test_01_router_internal_basic Success 0.48 test_routers.py
test_router_dns_guestipquery Success 106.71 test_router_dns.py
test_router_dns_externalipquery Success 0.04 test_router_dns.py
test_router_dhcphosts Success 157.63 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.28 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.06 test_resource_detail.py
test_01_reset_vm_on_reboot Success 80.50 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.16 test_pvlan.py
test_dedicatePublicIpRange Success 0.30 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1071.09 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 705.21 test_privategw_acl.py
test_01_vpc_privategw_acl Success 202.24 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.34 test_primary_storage.py
test_createPortablePublicIPRange Success 15.14 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.36 test_portable_publicip.py
test_isolate_network_password_server Success 96.89 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.11 test_over_provisioning.py
test_oobm_zchange_password Success 30.58 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.30 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.19 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.28 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.27 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.23 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.25 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.32 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.12 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.08 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.32 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.26 test_non_contigiousvlan.py
test_01_nic Success 590.47 test_nic.py
test_releaseIP Success 327.49 test_network.py
test_reboot_router Success 719.74 test_network.py
test_public_ip_user_account Success 10.23 test_network.py
test_public_ip_admin_account Success 40.24 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.47 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.47 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.08 test_network.py
test_delete_account Success 322.23 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.53 test_network.py
test_01_port_fwd_on_src_nat Success 111.99 test_network.py
test_nic_secondaryip_add_remove Success 252.20 test_multipleips_per_nic.py
login_test_saml_user Success 17.77 test_login.py
test_assign_and_removal_lb Success 149.55 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.23 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.62 test_loadbalance.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.13 test_iso.py
test_03_delete_iso Success 95.18 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.73 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 579.69 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 504.23 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1113.44 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 881.78 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.20 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.10 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.79 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.67 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.59 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.61 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.69 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.61 test_dynamicroles.py
test_role_lifecycle_update Success 5.78 test_dynamicroles.py
test_role_lifecycle_list Success 5.63 test_dynamicroles.py
test_role_lifecycle_delete Success 10.63 test_dynamicroles.py
test_role_lifecycle_create Success 5.59 test_dynamicroles.py
test_role_inuse_deletion Success 5.59 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.07 test_dynamicroles.py
test_role_account_acls Success 7.07 test_dynamicroles.py
test_default_role_deletion Success 5.66 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 75.78 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 55.58 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 201.47 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 80.59 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 231.36 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.56 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.57 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.70 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 392.68 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 211.42 test_affinity_groups.py
test_08_resize_volume Skipped 5.08 test_volumes.py
test_07_resize_fail Skipped 10.21 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 66.31 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-705)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30368 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t705-kvm-centos7.zip
Test completed. 45 look ok, 3 have error(s)

Test Result Time (s) Test File
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 358.38 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 396.40 test_privategw_acl.py
test_09_delete_detached_volume Error 10.20 test_volumes.py
test_08_resize_volume Error 5.08 test_volumes.py
test_07_resize_fail Error 10.28 test_volumes.py
test_06_download_detached_volume Error 5.09 test_volumes.py
test_05_detach_volume Error 5.08 test_volumes.py
test_04_delete_attached_volume Error 5.09 test_volumes.py
test_03_download_attached_volume Error 5.09 test_volumes.py
test_01_create_volume Error 247.73 test_volumes.py
test_01_vpc_site2site_vpn Success 164.85 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 66.43 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 251.24 test_vpc_vpn.py
test_02_VPC_default_routes Success 470.10 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 776.60 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 500.31 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1392.38 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 549.37 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 764.70 test_vpc_redundant.py
test_02_attach_volume Success 49.32 test_volumes.py
test_deploy_vm_multiple Success 373.47 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.53 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 35.92 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 125.83 test_vm_life_cycle.py
test_03_reboot_vm Success 125.89 test_vm_life_cycle.py
test_02_start_vm Success 5.15 test_vm_life_cycle.py
test_01_stop_vm Success 125.94 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 95.92 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.09 test_templates.py
test_04_extract_template Success 5.40 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.11 test_templates.py
test_01_create_template Success 35.41 test_templates.py
test_10_destroy_cpvm Success 161.68 test_ssvm.py
test_09_destroy_ssvm Success 163.67 test_ssvm.py
test_08_reboot_cpvm Success 131.40 test_ssvm.py
test_07_reboot_ssvm Success 133.29 test_ssvm.py
test_06_stop_cpvm Success 131.54 test_ssvm.py
test_05_stop_ssvm Success 163.34 test_ssvm.py
test_04_cpvm_internals Success 0.96 test_ssvm.py
test_03_ssvm_internals Success 2.88 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 16.25 test_snapshots.py
test_04_change_offering_small Success 240.64 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.12 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_09_reboot_router Success 40.34 test_routers.py
test_08_start_router Success 30.29 test_routers.py
test_07_stop_router Success 10.16 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.70 test_routers.py
test_03_restart_network_cleanup Success 75.64 test_routers.py
test_02_router_internal_adv Success 0.91 test_routers.py
test_01_router_internal_basic Success 0.46 test_routers.py
test_router_dns_guestipquery Success 74.76 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 361.94 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.70 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 191.29 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.49 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 691.81 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 582.25 test_privategw_acl.py
test_01_vpc_privategw_acl Success 97.43 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.74 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.53 test_portable_publicip.py
test_isolate_network_password_server Success 89.44 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 25.75 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.32 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.25 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.39 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.38 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.33 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.60 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.43 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.32 test_non_contigiousvlan.py
test_01_nic Success 590.29 test_nic.py
test_releaseIP Success 283.25 test_network.py
test_reboot_router Success 473.81 test_network.py
test_public_ip_user_account Success 10.24 test_network.py
test_public_ip_admin_account Success 40.29 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.93 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.53 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.92 test_network.py
test_delete_account Success 277.73 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.72 test_network.py
test_01_port_fwd_on_src_nat Success 112.28 test_network.py
test_nic_secondaryip_add_remove Success 232.69 test_multipleips_per_nic.py
login_test_saml_user Success 19.14 test_login.py
test_assign_and_removal_lb Success 133.36 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.37 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 219.37 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.23 test_iso.py
test_02_edit_iso Success 0.08 test_iso.py
test_01_create_iso Success 21.04 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 223.96 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 183.47 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 511.08 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 434.68 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.29 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.15 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.14 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.98 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.85 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.88 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.01 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.90 test_dynamicroles.py
test_role_lifecycle_update Success 10.98 test_dynamicroles.py
test_role_lifecycle_list Success 5.90 test_dynamicroles.py
test_role_lifecycle_delete Success 10.94 test_dynamicroles.py
test_role_lifecycle_create Success 5.91 test_dynamicroles.py
test_role_inuse_deletion Success 5.87 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.13 test_dynamicroles.py
test_role_account_acls Success 8.19 test_dynamicroles.py
test_default_role_deletion Success 6.03 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 55.81 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.75 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 80.80 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 40.64 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 55.79 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.99 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 222.48 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 207.56 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 86.08 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-704)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 33589 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t704-xenserver-65sp1.zip
Test completed. 43 look ok, 5 have error(s)

Test Result Time (s) Test File
test_01_redundant_vpc_site2site_vpn Failure 378.58 test_vpc_vpn.py
test_05_rvpc_multi_tiers Failure 546.35 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1387.11 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 539.13 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 744.64 test_privategw_acl.py
test_04_extract_template Error 5.14 test_templates.py
test_03_delete_template Error 5.11 test_templates.py
test_01_create_template Error 70.72 test_templates.py
ContextSuite context=TestSnapshotRootDisk>:teardown Error 67.16 test_snapshots.py
test_01_vpc_site2site_vpn Success 317.31 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 142.04 test_vpc_vpn.py
test_02_VPC_default_routes Success 305.23 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 704.52 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 891.14 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1074.02 test_vpc_redundant.py
test_09_delete_detached_volume Success 20.80 test_volumes.py
test_08_resize_volume Success 111.12 test_volumes.py
test_07_resize_fail Success 116.22 test_volumes.py
test_06_download_detached_volume Success 20.41 test_volumes.py
test_05_detach_volume Success 100.30 test_volumes.py
test_04_delete_attached_volume Success 15.26 test_volumes.py
test_03_download_attached_volume Success 15.40 test_volumes.py
test_02_attach_volume Success 15.81 test_volumes.py
test_01_create_volume Success 397.69 test_volumes.py
test_03_delete_vm_snapshots Success 280.34 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 224.73 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.73 test_vm_snapshots.py
test_deploy_vm_multiple Success 172.56 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 192.76 test_vm_life_cycle.py
test_09_expunge_vm Success 125.48 test_vm_life_cycle.py
test_08_migrate_vm Success 66.28 test_vm_life_cycle.py
test_07_restore_vm Success 0.15 test_vm_life_cycle.py
test_06_destroy_vm Success 10.18 test_vm_life_cycle.py
test_03_reboot_vm Success 20.48 test_vm_life_cycle.py
test_02_start_vm Success 25.30 test_vm_life_cycle.py
test_01_stop_vm Success 30.30 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 146.28 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_02_edit_template Success 90.19 test_templates.py
test_10_destroy_cpvm Success 231.95 test_ssvm.py
test_09_destroy_ssvm Success 230.10 test_ssvm.py
test_08_reboot_cpvm Success 146.70 test_ssvm.py
test_07_reboot_ssvm Success 149.25 test_ssvm.py
test_06_stop_cpvm Success 166.77 test_ssvm.py
test_05_stop_ssvm Success 138.93 test_ssvm.py
test_04_cpvm_internals Success 1.14 test_ssvm.py
test_03_ssvm_internals Success 3.43 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.15 test_ssvm.py
test_01_snapshot_root_disk Success 26.62 test_snapshots.py
test_04_change_offering_small Success 126.18 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.11 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.22 test_secondary_storage.py
test_01_scale_vm Success 5.27 test_scale_vm.py
test_09_reboot_router Success 55.53 test_routers.py
test_08_start_router Success 45.48 test_routers.py
test_07_stop_router Success 15.23 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.55 test_routers.py
test_03_restart_network_cleanup Success 100.88 test_routers.py
test_02_router_internal_adv Success 0.79 test_routers.py
test_01_router_internal_basic Success 0.43 test_routers.py
test_router_dns_guestipquery Success 48.84 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 153.52 test_router_dhcphosts.py
test_router_dhcp_opts Success 31.77 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.12 test_resource_detail.py
test_01_reset_vm_on_reboot Success 111.02 test_reset_vm_on_reboot.py
test_createRegion Success 0.06 test_regions.py
test_create_pvlan_network Success 5.27 test_pvlan.py
test_dedicatePublicIpRange Success 0.61 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 945.54 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 593.93 test_privategw_acl.py
test_01_vpc_privategw_acl Success 148.11 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.74 test_primary_storage.py
test_01_primary_storage_iscsi Success 77.46 test_primary_storage.py
test_createPortablePublicIPRange Success 15.28 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.54 test_portable_publicip.py
test_isolate_network_password_server Success 36.17 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.17 test_over_provisioning.py
test_oobm_zchange_password Success 30.85 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.41 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.36 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.45 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.46 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.46 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.43 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 83.63 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.19 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.21 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.47 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.39 test_non_contigiousvlan.py
test_01_nic Success 596.19 test_nic.py
test_releaseIP Success 283.82 test_network.py
test_reboot_router Success 580.46 test_network.py
test_public_ip_user_account Success 10.35 test_network.py
test_public_ip_admin_account Success 40.38 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.85 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 77.50 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 103.51 test_network.py
test_delete_account Success 283.38 test_network.py
test_02_port_fwd_on_non_src_nat Success 70.98 test_network.py
test_01_port_fwd_on_src_nat Success 84.02 test_network.py
test_nic_secondaryip_add_remove Success 213.60 test_multipleips_per_nic.py
login_test_saml_user Success 19.45 test_login.py
test_assign_and_removal_lb Success 148.97 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.66 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 210.94 test_loadbalance.py
test_03_list_snapshots Success 0.10 test_list_ids_parameter.py
test_02_list_templates Success 0.06 test_list_ids_parameter.py
test_01_list_volumes Success 0.04 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.14 test_iso.py
test_03_delete_iso Success 95.21 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 21.09 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 491.34 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 354.81 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1040.64 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 685.80 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.32 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.36 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.17 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.94 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.01 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.20 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.24 test_dynamicroles.py
test_role_lifecycle_update Success 11.12 test_dynamicroles.py
test_role_lifecycle_list Success 5.98 test_dynamicroles.py
test_role_lifecycle_delete Success 11.06 test_dynamicroles.py
test_role_lifecycle_create Success 6.00 test_dynamicroles.py
test_role_inuse_deletion Success 5.94 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.80 test_dynamicroles.py
test_role_account_acls Success 9.02 test_dynamicroles.py
test_default_role_deletion Success 6.14 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.10 test_disk_offerings.py
test_01_create_disk_offering Success 0.14 test_disk_offerings.py
test_deployvm_userdispersing Success 50.98 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 101.39 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 176.74 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 20.54 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 111.28 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.12 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 177.77 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 152.14 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-708)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36003 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t708-vmware-55u3.zip
Test completed. 45 look ok, 3 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 944.85 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Failure 182.10 test_privategw_acl.py
test_01_vpc_site2site_vpn Error 506.71 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 824.09 test_vpc_vpn.py
test_CreateTemplateWithDuplicateName Error 5.14 test_templates.py
test_01_create_template Error 5.13 test_templates.py
ContextSuite context=TestTemplates>:setup Error 243.78 test_templates.py
test_01_vpc_remote_access_vpn Success 201.87 test_vpc_vpn.py
test_02_VPC_default_routes Success 379.57 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 786.41 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 734.09 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1604.97 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 864.93 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 730.71 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1405.13 test_vpc_redundant.py
test_09_delete_detached_volume Success 30.85 test_volumes.py
test_06_download_detached_volume Success 65.69 test_volumes.py
test_05_detach_volume Success 110.29 test_volumes.py
test_04_delete_attached_volume Success 15.62 test_volumes.py
test_03_download_attached_volume Success 20.31 test_volumes.py
test_02_attach_volume Success 58.83 test_volumes.py
test_01_create_volume Success 526.23 test_volumes.py
test_03_delete_vm_snapshots Success 295.27 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 230.05 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 176.42 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.73 test_vm_snapshots.py
test_deploy_vm_multiple Success 307.91 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 107.81 test_vm_life_cycle.py
test_09_expunge_vm Success 125.22 test_vm_life_cycle.py
test_08_migrate_vm Success 86.19 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 10.14 test_vm_life_cycle.py
test_03_reboot_vm Success 5.13 test_vm_life_cycle.py
test_02_start_vm Success 20.22 test_vm_life_cycle.py
test_01_stop_vm Success 10.14 test_vm_life_cycle.py
test_10_destroy_cpvm Success 237.00 test_ssvm.py
test_09_destroy_ssvm Success 233.76 test_ssvm.py
test_08_reboot_cpvm Success 246.62 test_ssvm.py
test_07_reboot_ssvm Success 158.67 test_ssvm.py
test_06_stop_cpvm Success 212.01 test_ssvm.py
test_05_stop_ssvm Success 203.67 test_ssvm.py
test_04_cpvm_internals Success 1.17 test_ssvm.py
test_03_ssvm_internals Success 3.37 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 71.56 test_snapshots.py
test_04_change_offering_small Success 97.51 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.15 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_09_reboot_router Success 186.12 test_routers.py
test_08_start_router Success 156.00 test_routers.py
test_07_stop_router Success 25.23 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.62 test_routers.py
test_03_restart_network_cleanup Success 191.33 test_routers.py
test_02_router_internal_adv Success 0.99 test_routers.py
test_01_router_internal_basic Success 0.56 test_routers.py
test_router_dns_guestipquery Success 76.89 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 155.91 test_router_dhcphosts.py
test_router_dhcp_opts Success 26.59 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.38 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.21 test_pvlan.py
test_dedicatePublicIpRange Success 0.41 test_public_ip_range.py
test_02_vpc_privategw_static_routes Success 668.83 test_privategw_acl.py
test_01_vpc_privategw_acl Success 218.10 test_privategw_acl.py
test_01_primary_storage_nfs Success 37.82 test_primary_storage.py
test_createPortablePublicIPRange Success 15.17 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.44 test_portable_publicip.py
test_isolate_network_password_server Success 94.38 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 30.77 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.32 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.22 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 10.29 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.46 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.31 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.67 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.14 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.13 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.57 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.30 test_non_contigiousvlan.py
test_01_nic Success 756.66 test_nic.py
test_releaseIP Success 267.95 test_network.py
test_reboot_router Success 675.13 test_network.py
test_public_ip_user_account Success 10.39 test_network.py
test_public_ip_admin_account Success 40.30 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.93 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.69 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.15 test_network.py
test_delete_account Success 483.93 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.65 test_network.py
test_01_port_fwd_on_src_nat Success 111.92 test_network.py
test_nic_secondaryip_add_remove Success 262.80 test_multipleips_per_nic.py
login_test_saml_user Success 19.09 test_login.py
test_assign_and_removal_lb Success 148.25 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.20 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.30 test_loadbalance.py
test_03_list_snapshots Success 0.08 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.12 test_iso.py
test_03_delete_iso Success 95.16 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 20.99 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 630.86 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 394.29 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1053.36 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 787.13 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.27 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.13 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.95 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.84 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.93 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.97 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.87 test_dynamicroles.py
test_role_lifecycle_update Success 10.95 test_dynamicroles.py
test_role_lifecycle_list Success 5.86 test_dynamicroles.py
test_role_lifecycle_delete Success 10.94 test_dynamicroles.py
test_role_lifecycle_create Success 5.88 test_dynamicroles.py
test_role_inuse_deletion Success 5.85 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.23 test_dynamicroles.py
test_role_account_acls Success 8.19 test_dynamicroles.py
test_default_role_deletion Success 5.96 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 60.83 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.08 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 186.87 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 25.63 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 156.29 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.84 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.83 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.98 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 217.41 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 181.67 test_affinity_groups.py
test_08_resize_volume Skipped 10.13 test_volumes.py
test_07_resize_fail Skipped 15.28 test_volumes.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 66.32 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Trillian test result (tid-996)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36731 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t996-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 877.26 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 334.68 test_privategw_acl.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
test_02_redundant_VPC_default_routes Error 963.13 test_vpc_redundant.py
test_02_list_snapshots_with_removed_data_store Error 0.03 test_snapshots.py
test_01_vpc_site2site_vpn Success 144.53 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.25 test_vpc_vpn.py
test_02_VPC_default_routes Success 301.42 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 533.63 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 521.16 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1335.72 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 667.36 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1303.54 test_vpc_redundant.py
test_09_delete_detached_volume Success 151.11 test_volumes.py
test_08_resize_volume Success 156.08 test_volumes.py
test_07_resize_fail Success 161.08 test_volumes.py
test_06_download_detached_volume Success 155.99 test_volumes.py
test_05_detach_volume Success 155.60 test_volumes.py
test_04_delete_attached_volume Success 146.10 test_volumes.py
test_03_download_attached_volume Success 156.11 test_volumes.py
test_02_attach_volume Success 89.79 test_volumes.py
test_01_create_volume Success 711.06 test_volumes.py
test_deploy_vm_multiple Success 261.94 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.53 test_vm_life_cycle.py
test_09_expunge_vm Success 125.14 test_vm_life_cycle.py
test_08_migrate_vm Success 40.67 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 125.65 test_vm_life_cycle.py
test_03_reboot_vm Success 125.66 test_vm_life_cycle.py
test_02_start_vm Success 10.12 test_vm_life_cycle.py
test_01_stop_vm Success 40.24 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 55.41 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.02 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 5.13 test_templates.py
test_03_delete_template Success 5.08 test_templates.py
test_02_edit_template Success 90.15 test_templates.py
test_01_create_template Success 45.34 test_templates.py
test_10_destroy_cpvm Success 161.62 test_ssvm.py
test_09_destroy_ssvm Success 163.69 test_ssvm.py
test_08_reboot_cpvm Success 101.44 test_ssvm.py
test_07_reboot_ssvm Success 133.56 test_ssvm.py
test_06_stop_cpvm Success 131.57 test_ssvm.py
test_05_stop_ssvm Success 163.64 test_ssvm.py
test_04_cpvm_internals Success 1.22 test_ssvm.py
test_03_ssvm_internals Success 3.40 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_01_snapshot_root_disk Success 10.93 test_snapshots.py
test_04_change_offering_small Success 210.82 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.04 test_service_offerings.py
test_01_create_service_offering Success 0.09 test_service_offerings.py
test_02_sys_template_ready Success 0.08 test_secondary_storage.py
test_01_sys_vm_start Success 0.12 test_secondary_storage.py
test_09_reboot_router Success 40.25 test_routers.py
test_08_start_router Success 30.22 test_routers.py
test_07_stop_router Success 10.12 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.65 test_routers.py
test_03_restart_network_cleanup Success 60.39 test_routers.py
test_02_router_internal_adv Success 1.11 test_routers.py
test_01_router_internal_basic Success 0.61 test_routers.py
test_router_dns_guestipquery Success 76.66 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 276.49 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.54 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.71 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.16 test_pvlan.py
test_dedicatePublicIpRange Success 0.29 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 498.90 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 358.52 test_privategw_acl.py
test_01_vpc_privategw_acl Success 81.66 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.72 test_primary_storage.py
test_createPortablePublicIPRange Success 15.14 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.31 test_portable_publicip.py
test_isolate_network_password_server Success 90.95 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.09 test_over_provisioning.py
test_oobm_zchange_password Success 30.48 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 11.25 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.18 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.28 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.24 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 97.31 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.11 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.14 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.08 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.06 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.30 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.24 test_non_contigiousvlan.py
test_01_nic Success 417.98 test_nic.py
test_releaseIP Success 267.14 test_network.py
test_reboot_router Success 407.74 test_network.py
test_public_ip_user_account Success 10.44 test_network.py
test_public_ip_admin_account Success 40.27 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.71 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.55 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.13 test_network.py
test_delete_account Success 292.06 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.61 test_network.py
test_01_port_fwd_on_src_nat Success 111.65 test_network.py
test_nic_secondaryip_add_remove Success 206.92 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.24 test_metrics_api.py
test_list_volumes_metrics Success 0.39 test_metrics_api.py
test_list_vms_metrics Success 206.31 test_metrics_api.py
test_list_pstorage_metrics Success 0.19 test_metrics_api.py
test_list_infrastructure_metrics Success 0.26 test_metrics_api.py
test_list_hosts_metrics Success 0.20 test_metrics_api.py
test_list_clusters_metrics Success 0.22 test_metrics_api.py
login_test_saml_user Success 17.75 test_login.py
test_assign_and_removal_lb Success 133.48 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.25 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 227.76 test_loadbalance.py
test_03_list_snapshots Success 0.03 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.14 test_iso.py
test_03_delete_iso Success 95.16 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 20.76 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 202.27 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 136.87 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 523.93 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 438.64 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.19 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.09 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.77 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.65 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.57 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.71 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.65 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.61 test_dynamicroles.py
test_role_lifecycle_update Success 10.67 test_dynamicroles.py
test_role_lifecycle_list Success 5.60 test_dynamicroles.py
test_role_lifecycle_delete Success 10.62 test_dynamicroles.py
test_role_lifecycle_create Success 5.61 test_dynamicroles.py
test_role_inuse_deletion Success 5.58 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.13 test_dynamicroles.py
test_role_account_acls Success 7.15 test_dynamicroles.py
test_default_role_deletion Success 5.66 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 20.38 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 30.42 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.44 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.36 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 65.64 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.64 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.65 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 206.75 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 206.72 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 70.67 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.01 test_staticroles.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-997)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36449 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t997-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vm_snapshots.py
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_01_test_vm_volume_snapshot Failure 403.75 test_vm_snapshots.py
test_04_rvpc_privategw_static_routes Failure 873.63 test_privategw_acl.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Failure 106.24 test_internal_lb.py
test_03_delete_vm_snapshots Error 127.20 test_vm_snapshots.py
ContextSuite context=TestVmSnapshot>:teardown Error 254.43 test_vm_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 126.45 test_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 131.54 test_snapshots.py
test_02_vpc_privategw_static_routes Error 591.55 test_privategw_acl.py
test_02_revert_vm_snapshots Success 232.41 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.70 test_vm_snapshots.py
test_deploy_vm_multiple Success 288.21 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.22 test_vm_life_cycle.py
test_09_expunge_vm Success 125.24 test_vm_life_cycle.py
test_08_migrate_vm Success 81.42 test_vm_life_cycle.py
test_07_restore_vm Success 0.11 test_vm_life_cycle.py
test_06_destroy_vm Success 10.25 test_vm_life_cycle.py
test_03_reboot_vm Success 5.15 test_vm_life_cycle.py
test_02_start_vm Success 20.32 test_vm_life_cycle.py
test_01_stop_vm Success 10.24 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 252.89 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.10 test_templates.py
test_04_extract_template Success 10.39 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.10 test_templates.py
test_01_create_template Success 126.41 test_templates.py
test_10_destroy_cpvm Success 236.91 test_ssvm.py
test_09_destroy_ssvm Success 239.12 test_ssvm.py
test_08_reboot_cpvm Success 186.73 test_ssvm.py
test_07_reboot_ssvm Success 158.52 test_ssvm.py
test_06_stop_cpvm Success 206.92 test_ssvm.py
test_05_stop_ssvm Success 213.92 test_ssvm.py
test_04_cpvm_internals Success 1.24 test_ssvm.py
test_03_ssvm_internals Success 3.56 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 26.25 test_snapshots.py
test_04_change_offering_small Success 92.49 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.20 test_service_offerings.py
test_02_sys_template_ready Success 0.13 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_09_reboot_router Success 161.39 test_routers.py
test_08_start_router Success 156.46 test_routers.py
test_07_stop_router Success 25.23 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.67 test_routers.py
test_03_restart_network_cleanup Success 196.37 test_routers.py
test_02_router_internal_adv Success 1.06 test_routers.py
test_01_router_internal_basic Success 0.57 test_routers.py
test_router_dns_guestipquery Success 76.77 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 155.82 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.69 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.33 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.42 test_pvlan.py
test_dedicatePublicIpRange Success 0.49 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1033.82 test_privategw_acl.py
test_01_vpc_privategw_acl Success 198.02 test_privategw_acl.py
test_01_primary_storage_nfs Success 37.13 test_primary_storage.py
test_createPortablePublicIPRange Success 15.20 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.50 test_portable_publicip.py
test_isolate_network_password_server Success 94.22 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.22 test_over_provisioning.py
test_oobm_zchange_password Success 30.81 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.39 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.22 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.37 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.38 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.37 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.42 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.77 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.39 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.31 test_non_contigiousvlan.py
test_01_nic Success 525.43 test_nic.py
test_releaseIP Success 288.20 test_network.py
test_reboot_router Success 640.16 test_network.py
test_public_ip_user_account Success 10.24 test_network.py
test_public_ip_admin_account Success 40.29 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.81 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.68 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.33 test_network.py
test_delete_account Success 343.32 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.93 test_network.py
test_01_port_fwd_on_src_nat Success 111.79 test_network.py
test_nic_secondaryip_add_remove Success 212.64 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.23 test_metrics_api.py
test_list_volumes_metrics Success 5.51 test_metrics_api.py
test_list_vms_metrics Success 186.82 test_metrics_api.py
test_list_pstorage_metrics Success 0.28 test_metrics_api.py
test_list_infrastructure_metrics Success 0.40 test_metrics_api.py
test_list_hosts_metrics Success 0.38 test_metrics_api.py
test_list_clusters_metrics Success 0.36 test_metrics_api.py
login_test_saml_user Success 19.28 test_login.py
test_assign_and_removal_lb Success 148.51 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.26 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.91 test_loadbalance.py
test_03_list_snapshots Success 0.08 test_list_ids_parameter.py
test_02_list_templates Success 0.08 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.14 test_iso.py
test_03_delete_iso Success 95.17 test_iso.py
test_02_edit_iso Success 0.08 test_iso.py
test_01_create_iso Success 21.00 test_iso.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 394.50 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1128.97 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 822.95 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.38 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.16 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.96 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.88 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.88 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.02 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.91 test_dynamicroles.py
test_role_lifecycle_update Success 10.97 test_dynamicroles.py
test_role_lifecycle_list Success 5.89 test_dynamicroles.py
test_role_lifecycle_delete Success 10.95 test_dynamicroles.py
test_role_lifecycle_create Success 5.90 test_dynamicroles.py
test_role_inuse_deletion Success 5.87 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.54 test_dynamicroles.py
test_role_account_acls Success 8.43 test_dynamicroles.py
test_default_role_deletion Success 6.00 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 60.84 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 91.11 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 181.51 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.54 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 196.60 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.86 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.91 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.08 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 217.62 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 197.15 test_affinity_groups.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 66.30 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-643

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-645

@rohityadavcloud
Copy link
Member Author

rohityadavcloud commented Apr 18, 2017 via email

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-1004)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30606 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t1004-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 192.52 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 334.31 test_privategw_acl.py
test_02_list_snapshots_with_removed_data_store Error 0.04 test_snapshots.py
test_01_vpc_site2site_vpn Success 149.70 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 65.84 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 229.83 test_vpc_vpn.py
test_02_VPC_default_routes Success 255.62 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 501.18 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 501.97 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1396.60 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 581.51 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1281.32 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.15 test_volumes.py
test_08_resize_volume Success 156.09 test_volumes.py
test_07_resize_fail Success 156.02 test_volumes.py
test_06_download_detached_volume Success 155.99 test_volumes.py
test_05_detach_volume Success 145.57 test_volumes.py
test_04_delete_attached_volume Success 145.84 test_volumes.py
test_03_download_attached_volume Success 155.99 test_volumes.py
test_02_attach_volume Success 89.03 test_volumes.py
test_01_create_volume Success 622.03 test_volumes.py
test_deploy_vm_multiple Success 246.91 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.45 test_vm_life_cycle.py
test_09_expunge_vm Success 125.21 test_vm_life_cycle.py
test_08_migrate_vm Success 40.68 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 130.66 test_vm_life_cycle.py
test_03_reboot_vm Success 125.67 test_vm_life_cycle.py
test_02_start_vm Success 10.12 test_vm_life_cycle.py
test_01_stop_vm Success 30.21 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 60.51 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 5.16 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.13 test_templates.py
test_01_create_template Success 30.27 test_templates.py
test_10_destroy_cpvm Success 131.27 test_ssvm.py
test_09_destroy_ssvm Success 138.43 test_ssvm.py
test_08_reboot_cpvm Success 101.19 test_ssvm.py
test_07_reboot_ssvm Success 102.98 test_ssvm.py
test_06_stop_cpvm Success 161.38 test_ssvm.py
test_05_stop_ssvm Success 133.09 test_ssvm.py
test_04_cpvm_internals Success 0.94 test_ssvm.py
test_03_ssvm_internals Success 2.83 test_ssvm.py
test_02_list_cpvm_vm Success 0.10 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 16.02 test_snapshots.py
test_04_change_offering_small Success 204.31 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.08 test_service_offerings.py
test_02_sys_template_ready Success 0.09 test_secondary_storage.py
test_01_sys_vm_start Success 0.13 test_secondary_storage.py
test_09_reboot_router Success 35.23 test_routers.py
test_08_start_router Success 25.19 test_routers.py
test_07_stop_router Success 10.12 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.57 test_routers.py
test_03_restart_network_cleanup Success 55.48 test_routers.py
test_02_router_internal_adv Success 0.98 test_routers.py
test_01_router_internal_basic Success 0.57 test_routers.py
test_router_dns_guestipquery Success 76.71 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 235.70 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.26 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.69 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.16 test_pvlan.py
test_dedicatePublicIpRange Success 0.28 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 463.64 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 338.42 test_privategw_acl.py
test_01_vpc_privategw_acl Success 81.59 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.66 test_primary_storage.py
test_createPortablePublicIPRange Success 15.13 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.35 test_portable_publicip.py
test_isolate_network_password_server Success 58.77 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.12 test_over_provisioning.py
test_oobm_zchange_password Success 30.45 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.26 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.17 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.27 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.27 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.25 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.24 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.24 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.11 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.08 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.05 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.31 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.31 test_non_contigiousvlan.py
test_01_nic Success 413.05 test_nic.py
test_releaseIP Success 131.70 test_network.py
test_reboot_router Success 402.62 test_network.py
test_public_ip_user_account Success 10.18 test_network.py
test_public_ip_admin_account Success 40.21 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.60 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.34 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.83 test_network.py
test_delete_account Success 256.92 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.55 test_network.py
test_01_port_fwd_on_src_nat Success 108.58 test_network.py
test_nic_secondaryip_add_remove Success 221.93 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.17 test_metrics_api.py
test_list_volumes_metrics Success 5.40 test_metrics_api.py
test_list_vms_metrics Success 181.46 test_metrics_api.py
test_list_pstorage_metrics Success 0.36 test_metrics_api.py
test_list_infrastructure_metrics Success 0.31 test_metrics_api.py
test_list_hosts_metrics Success 0.27 test_metrics_api.py
test_list_clusters_metrics Success 0.23 test_metrics_api.py
login_test_saml_user Success 17.78 test_login.py
test_assign_and_removal_lb Success 133.19 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.30 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 217.67 test_loadbalance.py
test_03_list_snapshots Success 0.04 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.13 test_iso.py
test_03_delete_iso Success 95.18 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.68 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 167.45 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 142.69 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 482.52 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 413.03 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.22 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.09 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.77 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.70 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.69 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.68 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.70 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.63 test_dynamicroles.py
test_role_lifecycle_update Success 10.68 test_dynamicroles.py
test_role_lifecycle_list Success 5.60 test_dynamicroles.py
test_role_lifecycle_delete Success 5.62 test_dynamicroles.py
test_role_lifecycle_create Success 5.60 test_dynamicroles.py
test_role_inuse_deletion Success 5.73 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 6.90 test_dynamicroles.py
test_role_account_acls Success 7.28 test_dynamicroles.py
test_default_role_deletion Success 5.68 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.05 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 20.39 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.44 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 80.60 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.30 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 85.65 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.64 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.64 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 196.68 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 201.65 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 50.66 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-1003)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 51655 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t1003-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_internal_lb.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_templates.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 46 look ok, 4 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 540.91 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1320.11 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 512.24 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 882.99 test_privategw_acl.py
test_02_list_snapshots_with_removed_data_store Error 104.27 test_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 109.35 test_snapshots.py
ContextSuite context=TestSnapshotRootDisk>:teardown Error 134.67 test_snapshots.py
test_01_vpc_site2site_vpn Success 320.69 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 186.70 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 532.26 test_vpc_vpn.py
test_02_VPC_default_routes Success 315.67 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 791.18 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 899.00 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1060.40 test_vpc_redundant.py
test_09_delete_detached_volume Success 25.73 test_volumes.py
test_08_resize_volume Success 121.09 test_volumes.py
test_07_resize_fail Success 126.10 test_volumes.py
test_06_download_detached_volume Success 40.48 test_volumes.py
test_05_detach_volume Success 105.52 test_volumes.py
test_04_delete_attached_volume Success 15.51 test_volumes.py
test_03_download_attached_volume Success 20.35 test_volumes.py
test_02_attach_volume Success 16.03 test_volumes.py
test_01_create_volume Success 438.78 test_volumes.py
test_03_delete_vm_snapshots Success 280.27 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 221.81 test_vm_snapshots.py
test_01_create_vm_snapshots Success 101.18 test_vm_snapshots.py
test_deploy_vm_multiple Success 151.76 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.79 test_vm_life_cycle.py
test_09_expunge_vm Success 125.23 test_vm_life_cycle.py
test_08_migrate_vm Success 116.22 test_vm_life_cycle.py
test_07_restore_vm Success 0.11 test_vm_life_cycle.py
test_06_destroy_vm Success 20.21 test_vm_life_cycle.py
test_03_reboot_vm Success 25.23 test_vm_life_cycle.py
test_02_start_vm Success 35.28 test_vm_life_cycle.py
test_01_stop_vm Success 30.25 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 216.45 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.12 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.13 test_templates.py
test_01_create_template Success 201.69 test_templates.py
test_10_destroy_cpvm Success 191.41 test_ssvm.py
test_09_destroy_ssvm Success 173.32 test_ssvm.py
test_08_reboot_cpvm Success 106.40 test_ssvm.py
test_07_reboot_ssvm Success 159.54 test_ssvm.py
test_06_stop_cpvm Success 131.34 test_ssvm.py
test_05_stop_ssvm Success 209.66 test_ssvm.py
test_04_cpvm_internals Success 0.99 test_ssvm.py
test_03_ssvm_internals Success 4.79 test_ssvm.py
test_02_list_cpvm_vm Success 0.10 test_ssvm.py
test_01_list_sec_storage_vm Success 0.11 test_ssvm.py
test_01_snapshot_root_disk Success 16.17 test_snapshots.py
test_04_change_offering_small Success 113.90 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.09 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_01_scale_vm Success 5.21 test_scale_vm.py
test_09_reboot_router Success 85.55 test_routers.py
test_08_start_router Success 65.50 test_routers.py
test_07_stop_router Success 20.21 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.61 test_routers.py
test_03_restart_network_cleanup Success 145.91 test_routers.py
test_02_router_internal_adv Success 1.00 test_routers.py
test_01_router_internal_basic Success 0.51 test_routers.py
test_router_dns_guestipquery Success 48.69 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 98.10 test_router_dhcphosts.py
test_router_dhcp_opts Success 26.41 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.11 test_resource_detail.py
test_01_reset_vm_on_reboot Success 85.72 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.27 test_pvlan.py
test_dedicatePublicIpRange Success 0.43 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1113.50 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 540.67 test_privategw_acl.py
test_01_vpc_privategw_acl Success 112.17 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.34 test_primary_storage.py
test_01_primary_storage_iscsi Success 76.55 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.45 test_portable_publicip.py
test_isolate_network_password_server Success 61.24 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.12 test_over_provisioning.py
test_oobm_zchange_password Success 30.71 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.35 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.24 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.39 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 72.45 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.15 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.08 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 18.43 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.43 test_non_contigiousvlan.py
test_01_nic Success 710.63 test_nic.py
test_releaseIP Success 217.38 test_network.py
test_reboot_router Success 493.76 test_network.py
test_public_ip_user_account Success 10.25 test_network.py
test_public_ip_admin_account Success 40.26 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.56 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.44 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 101.22 test_network.py
test_delete_account Success 423.38 test_network.py
test_02_port_fwd_on_non_src_nat Success 60.63 test_network.py
test_01_port_fwd_on_src_nat Success 78.64 test_network.py
test_nic_secondaryip_add_remove Success 162.22 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.25 test_metrics_api.py
test_list_volumes_metrics Success 5.44 test_metrics_api.py
test_list_vms_metrics Success 156.47 test_metrics_api.py
test_list_pstorage_metrics Success 0.28 test_metrics_api.py
test_list_infrastructure_metrics Success 0.34 test_metrics_api.py
test_list_hosts_metrics Success 0.26 test_metrics_api.py
test_list_clusters_metrics Success 0.31 test_metrics_api.py
login_test_saml_user Success 18.05 test_login.py
test_assign_and_removal_lb Success 149.60 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.45 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.43 test_loadbalance.py
test_03_list_snapshots Success 0.07 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.05 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.15 test_iso.py
test_03_delete_iso Success 95.17 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 20.81 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 414.32 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 213.12 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 982.34 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 746.95 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.30 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.16 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.94 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.83 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.68 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.70 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.83 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.72 test_dynamicroles.py
test_role_lifecycle_update Success 10.82 test_dynamicroles.py
test_role_lifecycle_list Success 5.69 test_dynamicroles.py
test_role_lifecycle_delete Success 5.71 test_dynamicroles.py
test_role_lifecycle_create Success 5.73 test_dynamicroles.py
test_role_inuse_deletion Success 5.70 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.51 test_dynamicroles.py
test_role_account_acls Success 7.69 test_dynamicroles.py
test_default_role_deletion Success 5.85 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.10 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 50.70 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 101.01 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 256.94 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 15.35 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 106.06 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.70 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.67 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 5.90 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 257.50 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 287.21 test_affinity_groups.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-1005)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 56080 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t1005-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_network.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 47 look ok, 2 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 394.02 test_privategw_acl.py
test_02_list_snapshots_with_removed_data_store Error 86.53 test_snapshots.py
test_02_list_snapshots_with_removed_data_store Error 91.65 test_snapshots.py
test_01_vpc_site2site_vpn Success 525.31 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 242.58 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 618.60 test_vpc_vpn.py
test_02_VPC_default_routes Success 465.60 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 757.62 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 834.27 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1640.13 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 741.56 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 728.14 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1476.61 test_vpc_redundant.py
test_09_delete_detached_volume Success 36.53 test_volumes.py
test_06_download_detached_volume Success 116.00 test_volumes.py
test_05_detach_volume Success 110.46 test_volumes.py
test_04_delete_attached_volume Success 30.42 test_volumes.py
test_03_download_attached_volume Success 30.61 test_volumes.py
test_02_attach_volume Success 86.73 test_volumes.py
test_01_create_volume Success 534.85 test_volumes.py
test_03_delete_vm_snapshots Success 275.21 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 232.31 test_vm_snapshots.py
test_01_create_vm_snapshots Success 158.78 test_vm_snapshots.py
test_deploy_vm_multiple Success 278.52 test_vm_life_cycle.py
test_deploy_vm Success 0.04 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.00 test_vm_life_cycle.py
test_09_expunge_vm Success 185.28 test_vm_life_cycle.py
test_08_migrate_vm Success 96.82 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 10.19 test_vm_life_cycle.py
test_03_reboot_vm Success 10.21 test_vm_life_cycle.py
test_02_start_vm Success 30.36 test_vm_life_cycle.py
test_01_stop_vm Success 10.22 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 624.96 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.05 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 10.24 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.19 test_templates.py
test_01_create_template Success 373.02 test_templates.py
test_10_destroy_cpvm Success 242.01 test_ssvm.py
test_09_destroy_ssvm Success 264.53 test_ssvm.py
test_08_reboot_cpvm Success 156.82 test_ssvm.py
test_07_reboot_ssvm Success 158.81 test_ssvm.py
test_06_stop_cpvm Success 202.26 test_ssvm.py
test_05_stop_ssvm Success 209.29 test_ssvm.py
test_04_cpvm_internals Success 1.95 test_ssvm.py
test_03_ssvm_internals Success 3.96 test_ssvm.py
test_02_list_cpvm_vm Success 0.20 test_ssvm.py
test_01_list_sec_storage_vm Success 0.23 test_ssvm.py
test_01_snapshot_root_disk Success 87.06 test_snapshots.py
test_04_change_offering_small Success 137.72 test_service_offerings.py
test_03_delete_service_offering Success 0.06 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.17 test_service_offerings.py
test_02_sys_template_ready Success 0.20 test_secondary_storage.py
test_01_sys_vm_start Success 0.28 test_secondary_storage.py
test_09_reboot_router Success 141.14 test_routers.py
test_08_start_router Success 116.05 test_routers.py
test_07_stop_router Success 25.31 test_routers.py
test_06_router_advanced Success 0.08 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.77 test_routers.py
test_03_restart_network_cleanup Success 186.46 test_routers.py
test_02_router_internal_adv Success 1.15 test_routers.py
test_01_router_internal_basic Success 0.65 test_routers.py
test_router_dns_guestipquery Success 82.16 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 195.63 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.95 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.15 test_resource_detail.py
test_01_reset_vm_on_reboot Success 55.68 test_reset_vm_on_reboot.py
test_createRegion Success 0.07 test_regions.py
test_create_pvlan_network Success 5.34 test_pvlan.py
test_dedicatePublicIpRange Success 0.60 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1267.89 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 780.83 test_privategw_acl.py
test_01_vpc_privategw_acl Success 199.16 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.51 test_primary_storage.py
test_createPortablePublicIPRange Success 15.24 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.65 test_portable_publicip.py
test_isolate_network_password_server Success 94.62 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.21 test_over_provisioning.py
test_oobm_zchange_password Success 26.03 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.60 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.30 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.53 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.55 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.47 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.46 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 88.12 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.29 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.15 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.24 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.24 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.14 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.14 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 18.69 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.44 test_non_contigiousvlan.py
test_01_nic Success 587.27 test_nic.py
test_releaseIP Success 288.69 test_network.py
test_reboot_router Success 716.80 test_network.py
test_public_ip_user_account Success 10.32 test_network.py
test_public_ip_admin_account Success 40.36 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 77.18 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.17 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 127.56 test_network.py
test_delete_account Success 319.12 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.82 test_network.py
test_01_port_fwd_on_src_nat Success 111.82 test_network.py
test_nic_secondaryip_add_remove Success 223.41 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.38 test_metrics_api.py
test_list_volumes_metrics Success 5.62 test_metrics_api.py
test_list_vms_metrics Success 212.37 test_metrics_api.py
test_list_pstorage_metrics Success 0.45 test_metrics_api.py
test_list_infrastructure_metrics Success 0.67 test_metrics_api.py
test_list_hosts_metrics Success 0.51 test_metrics_api.py
test_list_clusters_metrics Success 0.50 test_metrics_api.py
login_test_saml_user Success 19.60 test_login.py
test_assign_and_removal_lb Success 148.86 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.96 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.74 test_loadbalance.py
test_03_list_snapshots Success 0.10 test_list_ids_parameter.py
test_02_list_templates Success 0.06 test_list_ids_parameter.py
test_01_list_volumes Success 0.04 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.09 test_iso.py
test_04_extract_Iso Success 5.23 test_iso.py
test_03_delete_iso Success 95.23 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 21.09 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 687.83 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 471.33 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1214.17 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 871.56 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.48 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.16 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.38 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.16 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.93 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.03 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.30 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.96 test_dynamicroles.py
test_role_lifecycle_update Success 6.15 test_dynamicroles.py
test_role_lifecycle_list Success 6.04 test_dynamicroles.py
test_role_lifecycle_delete Success 11.24 test_dynamicroles.py
test_role_lifecycle_create Success 6.26 test_dynamicroles.py
test_role_inuse_deletion Success 6.04 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.38 test_dynamicroles.py
test_role_account_acls Success 9.59 test_dynamicroles.py
test_default_role_deletion Success 6.11 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.15 test_disk_offerings.py
test_03_delete_disk_offering Success 0.07 test_disk_offerings.py
test_02_edit_disk_offering Success 0.08 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.12 test_disk_offerings.py
test_01_create_disk_offering Success 0.14 test_disk_offerings.py
test_deployvm_userdispersing Success 96.68 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.75 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 222.32 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.65 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 207.09 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.02 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.95 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.03 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 339.92 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 197.73 test_affinity_groups.py
test_08_resize_volume Skipped 10.23 test_volumes.py
test_07_resize_fail Skipped 15.37 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_01_scale_vm Skipped 66.59 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.01 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-670

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-671

@rohityadavcloud
Copy link
Member Author

/cc @karuturi running a test on 4.9 as well, given several failures in recent/last set of tests
@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-1028)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 33857 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1837-t1028-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_snapshots.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 47 look ok, 2 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 401.09 test_privategw_acl.py
test_02_list_snapshots_with_removed_data_store Error 0.03 test_snapshots.py
test_01_vpc_site2site_vpn Success 160.01 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.01 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 281.17 test_vpc_vpn.py
test_02_VPC_default_routes Success 257.17 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 623.17 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 494.77 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1330.07 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 578.61 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 774.73 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1274.12 test_vpc_redundant.py
test_09_delete_detached_volume Success 156.39 test_volumes.py
test_08_resize_volume Success 156.35 test_volumes.py
test_07_resize_fail Success 161.40 test_volumes.py
test_06_download_detached_volume Success 156.20 test_volumes.py
test_05_detach_volume Success 150.72 test_volumes.py
test_04_delete_attached_volume Success 151.16 test_volumes.py
test_03_download_attached_volume Success 156.22 test_volumes.py
test_02_attach_volume Success 90.52 test_volumes.py
test_01_create_volume Success 711.97 test_volumes.py
test_deploy_vm_multiple Success 398.39 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.57 test_vm_life_cycle.py
test_09_expunge_vm Success 125.22 test_vm_life_cycle.py
test_08_migrate_vm Success 40.92 test_vm_life_cycle.py
test_07_restore_vm Success 0.12 test_vm_life_cycle.py
test_06_destroy_vm Success 125.79 test_vm_life_cycle.py
test_03_reboot_vm Success 125.81 test_vm_life_cycle.py
test_02_start_vm Success 10.16 test_vm_life_cycle.py
test_01_stop_vm Success 30.26 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 125.95 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.16 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.18 test_templates.py
test_01_create_template Success 70.54 test_templates.py
test_10_destroy_cpvm Success 161.57 test_ssvm.py
test_09_destroy_ssvm Success 133.15 test_ssvm.py
test_08_reboot_cpvm Success 101.24 test_ssvm.py
test_07_reboot_ssvm Success 103.07 test_ssvm.py
test_06_stop_cpvm Success 131.48 test_ssvm.py
test_05_stop_ssvm Success 133.28 test_ssvm.py
test_04_cpvm_internals Success 1.14 test_ssvm.py
test_03_ssvm_internals Success 3.62 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_01_snapshot_root_disk Success 11.06 test_snapshots.py
test_04_change_offering_small Success 239.67 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.11 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_09_reboot_router Success 40.31 test_routers.py
test_08_start_router Success 35.30 test_routers.py
test_07_stop_router Success 10.16 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.68 test_routers.py
test_03_restart_network_cleanup Success 70.58 test_routers.py
test_02_router_internal_adv Success 1.05 test_routers.py
test_01_router_internal_basic Success 0.62 test_routers.py
test_router_dns_guestipquery Success 73.74 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 266.31 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.85 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.15 test_resource_detail.py
test_01_reset_vm_on_reboot Success 166.11 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.23 test_pvlan.py
test_dedicatePublicIpRange Success 0.40 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 530.06 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 400.10 test_privategw_acl.py
test_01_vpc_privategw_acl Success 87.16 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.78 test_primary_storage.py
test_createPortablePublicIPRange Success 15.24 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.54 test_portable_publicip.py
test_isolate_network_password_server Success 59.82 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.11 test_over_provisioning.py
test_oobm_zchange_password Success 30.68 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.31 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.23 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_on Success 10.28 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.39 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.29 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.48 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.17 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.43 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.34 test_non_contigiousvlan.py
test_01_nic Success 454.29 test_nic.py
test_releaseIP Success 162.42 test_network.py
test_reboot_router Success 373.06 test_network.py
test_public_ip_user_account Success 10.27 test_network.py
test_public_ip_admin_account Success 40.26 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.87 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.76 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 121.38 test_network.py
test_delete_account Success 312.81 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.59 test_network.py
test_01_port_fwd_on_src_nat Success 111.79 test_network.py
test_nic_secondaryip_add_remove Success 217.49 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.22 test_metrics_api.py
test_list_volumes_metrics Success 5.50 test_metrics_api.py
test_list_vms_metrics Success 176.49 test_metrics_api.py
test_list_pstorage_metrics Success 0.25 test_metrics_api.py
test_list_infrastructure_metrics Success 0.36 test_metrics_api.py
test_list_hosts_metrics Success 0.35 test_metrics_api.py
test_list_clusters_metrics Success 0.30 test_metrics_api.py
login_test_saml_user Success 19.12 test_login.py
test_assign_and_removal_lb Success 133.41 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.29 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 219.40 test_loadbalance.py
test_03_list_snapshots Success 0.08 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.13 test_iso.py
test_03_delete_iso Success 95.20 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 20.96 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 239.35 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 153.07 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 528.20 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 419.93 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.29 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.18 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.28 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.99 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.83 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.87 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.96 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.87 test_dynamicroles.py
test_role_lifecycle_update Success 10.95 test_dynamicroles.py
test_role_lifecycle_list Success 5.86 test_dynamicroles.py
test_role_lifecycle_delete Success 10.90 test_dynamicroles.py
test_role_lifecycle_create Success 5.86 test_dynamicroles.py
test_role_inuse_deletion Success 5.98 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.03 test_dynamicroles.py
test_role_account_acls Success 8.36 test_dynamicroles.py
test_default_role_deletion Success 5.94 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.09 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 20.58 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.55 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 90.83 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.38 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 45.64 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.93 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.95 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 247.63 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 202.44 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 192.02 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.00 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

(tests did not run :( )
@blueorangutan package

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-723

@rohityadavcloud
Copy link
Member Author

Will create a new PR, this has too many comments now.

@rohityadavcloud
Copy link
Member Author

New: #2115

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants