Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[4.10] Latest health test run #1754

Closed

Conversation

rohityadavcloud
Copy link
Member

Dummy PR to run trillian tests on latest master (4.10-snapshot).

@blueorangutan package

Signed-off-by: Rohit Yadav <rohit.yadav@shapeblue.com>
@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@rohityadavcloud
Copy link
Member Author

@blueorangutan test

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-179

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-388)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28142 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t388-kvm-centos7.zip
Test completed. 43 look ok, 5 have error(s)

Test Result Time (s) Test File
test_01_VPC_nics_after_destroy Failure 797.96 test_vpc_router_nics.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 364.60 test_vpc_redundant.py
test_04_change_offering_small Failure 799.72 test_service_offerings.py
test_03_vpc_privategw_restart_vpc_cleanup Failure 235.98 test_privategw_acl.py
test_02_vpc_privategw_static_routes Failure 889.57 test_privategw_acl.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
test_01_vpc_site2site_vpn Success 145.09 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 56.17 test_vpc_vpn.py
test_02_VPC_default_routes Success 278.08 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 501.93 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1409.36 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 564.05 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 838.04 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.58 test_volumes.py
test_08_resize_volume Success 15.40 test_volumes.py
test_07_resize_fail Success 20.48 test_volumes.py
test_06_download_detached_volume Success 15.29 test_volumes.py
test_05_detach_volume Success 100.32 test_volumes.py
test_04_delete_attached_volume Success 10.20 test_volumes.py
test_03_download_attached_volume Success 15.28 test_volumes.py
test_02_attach_volume Success 43.70 test_volumes.py
test_01_create_volume Success 621.03 test_volumes.py
test_deploy_vm_multiple Success 253.90 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.66 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 35.93 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 125.83 test_vm_life_cycle.py
test_03_reboot_vm Success 125.89 test_vm_life_cycle.py
test_02_start_vm Success 10.20 test_vm_life_cycle.py
test_01_stop_vm Success 40.33 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 60.59 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.15 test_templates.py
test_03_delete_template Success 5.13 test_templates.py
test_02_edit_template Success 90.12 test_templates.py
test_01_create_template Success 60.55 test_templates.py
test_10_destroy_cpvm Success 161.47 test_ssvm.py
test_09_destroy_ssvm Success 163.64 test_ssvm.py
test_08_reboot_cpvm Success 101.33 test_ssvm.py
test_07_reboot_ssvm Success 103.41 test_ssvm.py
test_06_stop_cpvm Success 131.48 test_ssvm.py
test_05_stop_ssvm Success 133.70 test_ssvm.py
test_04_cpvm_internals Success 0.97 test_ssvm.py
test_03_ssvm_internals Success 2.94 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.16 test_ssvm.py
test_01_snapshot_root_disk Success 11.25 test_snapshots.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.09 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.21 test_secondary_storage.py
test_09_reboot_router Success 50.43 test_routers.py
test_08_start_router Success 30.28 test_routers.py
test_07_stop_router Success 10.16 test_routers.py
test_06_router_advanced Success 0.08 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.70 test_routers.py
test_03_restart_network_cleanup Success 60.55 test_routers.py
test_02_router_internal_adv Success 0.86 test_routers.py
test_01_router_internal_basic Success 0.47 test_routers.py
test_router_dns_guestipquery Success 73.69 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 271.92 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.98 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.26 test_pvlan.py
test_dedicatePublicIpRange Success 0.43 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 477.31 test_privategw_acl.py
test_01_vpc_privategw_acl Success 88.16 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.83 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.44 test_portable_publicip.py
test_isolate_network_password_server Success 86.76 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.14 test_over_provisioning.py
test_oobm_zchange_password Success 21.02 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.49 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.54 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.52 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 62.20 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.20 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.10 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.10 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.84 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.35 test_non_contigiousvlan.py
test_01_nic Success 646.56 test_nic.py
test_releaseIP Success 248.79 test_network.py
test_reboot_router Success 404.84 test_network.py
test_public_ip_user_account Success 10.26 test_network.py
test_public_ip_admin_account Success 40.27 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.94 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.70 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.28 test_network.py
test_delete_account Success 273.85 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.71 test_network.py
test_01_port_fwd_on_src_nat Success 111.74 test_network.py
test_nic_secondaryip_add_remove Success 269.05 test_multipleips_per_nic.py
login_test_saml_user Success 24.78 test_login.py
test_assign_and_removal_lb Success 134.12 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.44 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 219.23 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.04 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.17 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.94 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 233.14 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 178.36 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 511.15 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 425.22 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.30 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.16 test_global_settings.py
test_rolepermission_lifecycle_update Success 7.23 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.95 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.78 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.83 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.93 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.88 test_dynamicroles.py
test_role_lifecycle_update Success 12.06 test_dynamicroles.py
test_role_lifecycle_list Success 6.92 test_dynamicroles.py
test_role_lifecycle_delete Success 11.93 test_dynamicroles.py
test_role_lifecycle_create Success 7.35 test_dynamicroles.py
test_role_inuse_deletion Success 7.02 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 9.23 test_dynamicroles.py
test_role_account_acls Success 9.46 test_dynamicroles.py
test_default_role_deletion Success 7.11 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 20.65 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.69 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 60.72 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.46 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 75.99 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.05 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 7.12 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 218.58 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 203.65 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 101.22 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-387)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 33323 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t387-xenserver-65sp1.zip
Test completed. 46 look ok, 2 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 648.44 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1352.26 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 535.32 test_vpc_redundant.py
test_01_snapshot_root_disk Failure 16.48 test_snapshots.py
test_05_rvpc_multi_tiers Error 845.93 test_vpc_redundant.py
test_01_vpc_site2site_vpn Success 327.20 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 162.00 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 525.30 test_vpc_vpn.py
test_02_VPC_default_routes Success 331.63 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 711.72 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 897.56 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1038.99 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.88 test_volumes.py
test_08_resize_volume Success 116.26 test_volumes.py
test_07_resize_fail Success 121.32 test_volumes.py
test_06_download_detached_volume Success 25.45 test_volumes.py
test_05_detach_volume Success 100.36 test_volumes.py
test_04_delete_attached_volume Success 10.25 test_volumes.py
test_03_download_attached_volume Success 20.45 test_volumes.py
test_02_attach_volume Success 10.74 test_volumes.py
test_01_create_volume Success 392.74 test_volumes.py
test_03_delete_vm_snapshots Success 280.29 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 181.39 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.91 test_vm_snapshots.py
test_deploy_vm_multiple Success 284.16 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.86 test_vm_life_cycle.py
test_09_expunge_vm Success 125.27 test_vm_life_cycle.py
test_08_migrate_vm Success 66.28 test_vm_life_cycle.py
test_07_restore_vm Success 0.16 test_vm_life_cycle.py
test_06_destroy_vm Success 10.20 test_vm_life_cycle.py
test_03_reboot_vm Success 10.21 test_vm_life_cycle.py
test_02_start_vm Success 20.29 test_vm_life_cycle.py
test_01_stop_vm Success 25.28 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 111.69 test_templates.py
test_08_list_system_templates Success 0.06 test_templates.py
test_07_list_public_templates Success 0.07 test_templates.py
test_05_template_permissions Success 0.07 test_templates.py
test_04_extract_template Success 5.21 test_templates.py
test_03_delete_template Success 5.13 test_templates.py
test_02_edit_template Success 90.20 test_templates.py
test_01_create_template Success 71.55 test_templates.py
test_10_destroy_cpvm Success 196.75 test_ssvm.py
test_09_destroy_ssvm Success 264.55 test_ssvm.py
test_08_reboot_cpvm Success 141.61 test_ssvm.py
test_07_reboot_ssvm Success 244.01 test_ssvm.py
test_06_stop_cpvm Success 136.74 test_ssvm.py
test_05_stop_ssvm Success 144.29 test_ssvm.py
test_04_cpvm_internals Success 1.10 test_ssvm.py
test_03_ssvm_internals Success 3.46 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_04_change_offering_small Success 129.30 test_service_offerings.py
test_03_delete_service_offering Success 0.06 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.18 test_secondary_storage.py
test_01_sys_vm_start Success 0.19 test_secondary_storage.py
test_01_scale_vm Success 5.26 test_scale_vm.py
test_09_reboot_router Success 65.59 test_routers.py
test_08_start_router Success 50.52 test_routers.py
test_07_stop_router Success 20.28 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.59 test_routers.py
test_03_restart_network_cleanup Success 116.01 test_routers.py
test_02_router_internal_adv Success 0.83 test_routers.py
test_01_router_internal_basic Success 0.53 test_routers.py
test_router_dns_guestipquery Success 48.83 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 168.42 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 116.04 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.26 test_pvlan.py
test_dedicatePublicIpRange Success 0.56 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 947.17 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 895.79 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 549.19 test_privategw_acl.py
test_01_vpc_privategw_acl Success 159.34 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.87 test_primary_storage.py
test_01_primary_storage_iscsi Success 77.99 test_primary_storage.py
test_createPortablePublicIPRange Success 10.24 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.71 test_portable_publicip.py
test_isolate_network_password_server Success 36.29 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_oobm_zchange_password Success 21.05 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.52 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.52 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.54 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_off Success 16.02 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 16.02 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 57.99 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.21 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.13 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.25 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.15 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.12 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.12 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 24.06 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.40 test_non_contigiousvlan.py
test_01_nic Success 758.91 test_nic.py
test_releaseIP Success 259.47 test_network.py
test_reboot_router Success 571.36 test_network.py
test_public_ip_user_account Success 10.38 test_network.py
test_public_ip_admin_account Success 40.35 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.92 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.71 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 103.08 test_network.py
test_delete_account Success 324.68 test_network.py
test_02_port_fwd_on_non_src_nat Success 70.91 test_network.py
test_01_port_fwd_on_src_nat Success 83.92 test_network.py
test_nic_secondaryip_add_remove Success 214.16 test_multipleips_per_nic.py
login_test_saml_user Success 25.07 test_login.py
test_assign_and_removal_lb Success 148.89 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.60 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.24 test_loadbalance.py
test_03_list_snapshots Success 0.10 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.22 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 21.97 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 567.44 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 320.54 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1002.68 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 700.35 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.37 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.18 test_global_settings.py
test_rolepermission_lifecycle_update Success 7.52 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 7.09 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.88 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.99 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 7.16 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.98 test_dynamicroles.py
test_role_lifecycle_update Success 12.11 test_dynamicroles.py
test_role_lifecycle_list Success 7.19 test_dynamicroles.py
test_role_lifecycle_delete Success 12.05 test_dynamicroles.py
test_role_lifecycle_create Success 7.03 test_dynamicroles.py
test_role_inuse_deletion Success 6.92 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 10.04 test_dynamicroles.py
test_role_account_acls Success 10.27 test_dynamicroles.py
test_default_role_deletion Success 7.19 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.06 test_disk_offerings.py
test_02_edit_disk_offering Success 0.09 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.11 test_disk_offerings.py
test_01_create_disk_offering Success 0.17 test_disk_offerings.py
test_deployvm_userdispersing Success 101.56 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 50.99 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 191.99 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.67 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 111.50 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.83 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.87 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 7.04 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 163.91 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 167.73 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-386)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35704 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t386-vmware-55u3.zip
Test completed. 43 look ok, 5 have error(s)

Test Result Time (s) Test File
test_02_vpc_privategw_static_routes Failure 365.52 test_privategw_acl.py
test_04_extract_Iso Failure 5.11 test_iso.py
test_01_redundant_vpc_site2site_vpn Error 693.18 test_vpc_vpn.py
ContextSuite context=TestVpcSite2SiteVpn>:setup Error 3910.30 test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 2394.73 test_vpc_vpn.py
test_CreateTemplateWithDuplicateName Error 5.14 test_templates.py
test_01_create_template Error 30.30 test_templates.py
ContextSuite context=TestTemplates>:setup Error 361.32 test_templates.py
ContextSuite context=TestInternalLb>:setup Error 0.00 test_internal_lb.py
test_02_VPC_default_routes Success 360.45 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 737.99 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 637.94 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1524.95 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 710.64 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 674.82 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1356.23 test_vpc_redundant.py
test_09_delete_detached_volume Success 30.92 test_volumes.py
test_06_download_detached_volume Success 60.56 test_volumes.py
test_05_detach_volume Success 100.29 test_volumes.py
test_04_delete_attached_volume Success 10.20 test_volumes.py
test_03_download_attached_volume Success 20.33 test_volumes.py
test_02_attach_volume Success 58.78 test_volumes.py
test_01_create_volume Success 457.36 test_volumes.py
test_03_delete_vm_snapshots Success 275.19 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 199.10 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 141.23 test_vm_snapshots.py
test_01_create_vm_snapshots Success 158.62 test_vm_snapshots.py
test_deploy_vm_multiple Success 193.57 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.77 test_vm_life_cycle.py
test_09_expunge_vm Success 125.18 test_vm_life_cycle.py
test_08_migrate_vm Success 71.16 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 10.15 test_vm_life_cycle.py
test_03_reboot_vm Success 5.14 test_vm_life_cycle.py
test_02_start_vm Success 20.24 test_vm_life_cycle.py
test_01_stop_vm Success 5.12 test_vm_life_cycle.py
test_10_destroy_cpvm Success 237.07 test_ssvm.py
test_09_destroy_ssvm Success 208.69 test_ssvm.py
test_08_reboot_cpvm Success 156.56 test_ssvm.py
test_07_reboot_ssvm Success 158.54 test_ssvm.py
test_06_stop_cpvm Success 181.89 test_ssvm.py
test_05_stop_ssvm Success 208.78 test_ssvm.py
test_04_cpvm_internals Success 1.18 test_ssvm.py
test_03_ssvm_internals Success 3.39 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 26.33 test_snapshots.py
test_04_change_offering_small Success 91.85 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.18 test_secondary_storage.py
test_09_reboot_router Success 176.14 test_routers.py
test_08_start_router Success 120.87 test_routers.py
test_07_stop_router Success 20.22 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.67 test_routers.py
test_03_restart_network_cleanup Success 135.95 test_routers.py
test_02_router_internal_adv Success 1.00 test_routers.py
test_01_router_internal_basic Success 0.53 test_routers.py
test_router_dns_guestipquery Success 77.06 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 117.18 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.12 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.34 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.22 test_pvlan.py
test_dedicatePublicIpRange Success 0.48 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 1157.03 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1024.96 test_privategw_acl.py
test_01_vpc_privategw_acl Success 209.23 test_privategw_acl.py
test_01_primary_storage_nfs Success 37.75 test_primary_storage.py
test_createPortablePublicIPRange Success 15.24 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.58 test_portable_publicip.py
test_isolate_network_password_server Success 64.70 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.17 test_over_provisioning.py
test_oobm_zchange_password Success 20.52 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.52 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.51 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_off Success 16.01 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.52 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 57.66 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.20 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.20 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.10 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.49 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.32 test_non_contigiousvlan.py
test_01_nic Success 657.22 test_nic.py
test_releaseIP Success 284.06 test_network.py
test_reboot_router Success 586.69 test_network.py
test_public_ip_user_account Success 10.29 test_network.py
test_public_ip_admin_account Success 40.29 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.86 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.64 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.39 test_network.py
test_delete_account Success 298.94 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.69 test_network.py
test_01_port_fwd_on_src_nat Success 111.78 test_network.py
test_nic_secondaryip_add_remove Success 183.59 test_multipleips_per_nic.py
login_test_saml_user Success 24.64 test_login.py
test_assign_and_removal_lb Success 148.54 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.27 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.81 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_03_delete_iso Success 95.21 test_iso.py
test_02_edit_iso Success 0.08 test_iso.py
test_01_create_iso Success 21.89 test_iso.py
test_dedicateGuestVlanRange Success 10.28 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 7.05 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.89 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.87 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.78 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.92 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.78 test_dynamicroles.py
test_role_lifecycle_update Success 11.96 test_dynamicroles.py
test_role_lifecycle_list Success 6.92 test_dynamicroles.py
test_role_lifecycle_delete Success 6.79 test_dynamicroles.py
test_role_lifecycle_create Success 6.78 test_dynamicroles.py
test_role_inuse_deletion Success 6.78 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 9.14 test_dynamicroles.py
test_role_account_acls Success 9.21 test_dynamicroles.py
test_default_role_deletion Success 6.86 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 50.77 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.14 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 201.53 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 75.81 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 176.49 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.89 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.82 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.90 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 213.41 test_deploy_vm_iso.py
test_3d_gpu_support Success 486.52 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 272.29 test_affinity_groups.py
test_08_resize_volume Skipped 5.11 test_volumes.py
test_07_resize_fail Skipped 10.26 test_volumes.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 66.32 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.06 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 2.01 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-236

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-405)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28600 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t405-kvm-centos7.zip
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 427.76 test_vpc_redundant.py
test_03_vpc_privategw_restart_vpc_cleanup Failure 247.07 test_privategw_acl.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Failure 251.05 test_internal_lb.py
test_01_vpc_site2site_vpn Success 176.75 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 66.46 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 276.63 test_vpc_vpn.py
test_02_VPC_default_routes Success 279.73 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 598.57 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 549.99 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1454.06 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 623.86 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 853.25 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.62 test_volumes.py
test_08_resize_volume Success 15.50 test_volumes.py
test_07_resize_fail Success 20.54 test_volumes.py
test_06_download_detached_volume Success 15.37 test_volumes.py
test_05_detach_volume Success 100.28 test_volumes.py
test_04_delete_attached_volume Success 10.22 test_volumes.py
test_03_download_attached_volume Success 15.35 test_volumes.py
test_02_attach_volume Success 74.33 test_volumes.py
test_01_create_volume Success 732.01 test_volumes.py
test_deploy_vm_multiple Success 319.47 test_vm_life_cycle.py
test_deploy_vm Success 0.04 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.98 test_vm_life_cycle.py
test_09_expunge_vm Success 125.22 test_vm_life_cycle.py
test_08_migrate_vm Success 41.15 test_vm_life_cycle.py
test_07_restore_vm Success 0.17 test_vm_life_cycle.py
test_06_destroy_vm Success 125.99 test_vm_life_cycle.py
test_03_reboot_vm Success 126.03 test_vm_life_cycle.py
test_02_start_vm Success 10.23 test_vm_life_cycle.py
test_01_stop_vm Success 40.43 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 90.85 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.09 test_templates.py
test_04_extract_template Success 5.19 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.15 test_templates.py
test_01_create_template Success 65.96 test_templates.py
test_10_destroy_cpvm Success 191.97 test_ssvm.py
test_09_destroy_ssvm Success 198.91 test_ssvm.py
test_08_reboot_cpvm Success 131.76 test_ssvm.py
test_07_reboot_ssvm Success 133.70 test_ssvm.py
test_06_stop_cpvm Success 167.16 test_ssvm.py
test_05_stop_ssvm Success 134.12 test_ssvm.py
test_04_cpvm_internals Success 1.42 test_ssvm.py
test_03_ssvm_internals Success 3.56 test_ssvm.py
test_02_list_cpvm_vm Success 0.15 test_ssvm.py
test_01_list_sec_storage_vm Success 0.17 test_ssvm.py
test_01_snapshot_root_disk Success 16.41 test_snapshots.py
test_04_change_offering_small Success 243.81 test_service_offerings.py
test_03_delete_service_offering Success 0.08 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.16 test_service_offerings.py
test_02_sys_template_ready Success 0.21 test_secondary_storage.py
test_01_sys_vm_start Success 0.27 test_secondary_storage.py
test_09_reboot_router Success 55.53 test_routers.py
test_08_start_router Success 60.59 test_routers.py
test_07_stop_router Success 10.20 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.83 test_routers.py
test_03_restart_network_cleanup Success 75.77 test_routers.py
test_02_router_internal_adv Success 1.21 test_routers.py
test_01_router_internal_basic Success 0.67 test_routers.py
test_router_dns_guestipquery Success 77.08 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 280.84 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.11 test_resource_detail.py
test_01_reset_vm_on_reboot Success 131.07 test_reset_vm_on_reboot.py
test_createRegion Success 0.07 test_regions.py
test_create_pvlan_network Success 5.27 test_pvlan.py
test_dedicatePublicIpRange Success 0.53 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 578.99 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 509.01 test_privategw_acl.py
test_01_vpc_privategw_acl Success 93.64 test_privategw_acl.py
test_01_primary_storage_nfs Success 36.00 test_primary_storage.py
test_createPortablePublicIPRange Success 15.27 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.54 test_portable_publicip.py
test_isolate_network_password_server Success 95.04 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.21 test_over_provisioning.py
test_oobm_zchange_password Success 21.02 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.52 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.51 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 16.03 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 57.40 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.25 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.19 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.29 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.15 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.11 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.10 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.96 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.39 test_non_contigiousvlan.py
test_01_nic Success 562.29 test_nic.py
test_releaseIP Success 284.90 test_network.py
test_reboot_router Success 521.51 test_network.py
test_public_ip_user_account Success 10.31 test_network.py
test_public_ip_admin_account Success 40.30 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.29 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.05 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.71 test_network.py
test_delete_account Success 319.65 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.89 test_network.py
test_01_port_fwd_on_src_nat Success 111.98 test_network.py
test_nic_secondaryip_add_remove Success 279.30 test_multipleips_per_nic.py
login_test_saml_user Success 24.99 test_login.py
test_assign_and_removal_lb Success 136.87 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.88 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 259.05 test_loadbalance.py
test_03_list_snapshots Success 0.11 test_list_ids_parameter.py
test_02_list_templates Success 0.05 test_list_ids_parameter.py
test_01_list_volumes Success 0.06 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.08 test_iso.py
test_04_extract_Iso Success 5.27 test_iso.py
test_03_delete_iso Success 95.26 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 22.06 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 309.54 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 209.58 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 639.49 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.33 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.15 test_global_settings.py
test_rolepermission_lifecycle_update Success 7.37 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 7.02 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.79 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.95 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 7.14 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.94 test_dynamicroles.py
test_role_lifecycle_update Success 12.11 test_dynamicroles.py
test_role_lifecycle_list Success 6.94 test_dynamicroles.py
test_role_lifecycle_delete Success 12.19 test_dynamicroles.py
test_role_lifecycle_create Success 6.90 test_dynamicroles.py
test_role_inuse_deletion Success 7.05 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 9.35 test_dynamicroles.py
test_role_account_acls Success 10.15 test_dynamicroles.py
test_default_role_deletion Success 7.08 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.06 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.23 test_disk_offerings.py
test_01_create_disk_offering Success 0.16 test_disk_offerings.py
test_deployvm_userdispersing Success 20.69 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.68 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 106.17 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 50.83 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 157.05 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 7.33 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 7.33 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 228.63 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 234.28 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 81.34 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-404)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 35986 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t404-xenserver-65sp1.zip
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 504.74 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1380.67 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 609.39 test_vpc_redundant.py
test_01_snapshot_root_disk Failure 16.19 test_snapshots.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Failure 251.80 test_internal_lb.py
test_06_download_detached_volume Error 20.27 test_volumes.py
test_01_vpc_site2site_vpn Success 326.01 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 161.86 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 567.49 test_vpc_vpn.py
test_02_VPC_default_routes Success 385.45 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 708.25 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 913.65 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1096.90 test_vpc_redundant.py
test_09_delete_detached_volume Success 10.68 test_volumes.py
test_08_resize_volume Success 86.19 test_volumes.py
test_07_resize_fail Success 100.85 test_volumes.py
test_05_detach_volume Success 100.24 test_volumes.py
test_04_delete_attached_volume Success 10.19 test_volumes.py
test_03_download_attached_volume Success 15.28 test_volumes.py
test_02_attach_volume Success 10.99 test_volumes.py
test_01_create_volume Success 432.82 test_volumes.py
test_03_delete_vm_snapshots Success 280.20 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 191.42 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.77 test_vm_snapshots.py
test_deploy_vm_multiple Success 293.36 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 37.02 test_vm_life_cycle.py
test_09_expunge_vm Success 125.13 test_vm_life_cycle.py
test_08_migrate_vm Success 65.90 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 15.17 test_vm_life_cycle.py
test_03_reboot_vm Success 20.20 test_vm_life_cycle.py
test_02_start_vm Success 25.23 test_vm_life_cycle.py
test_01_stop_vm Success 30.23 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 161.79 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 5.23 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.08 test_templates.py
test_01_create_template Success 65.53 test_templates.py
test_10_destroy_cpvm Success 226.79 test_ssvm.py
test_09_destroy_ssvm Success 228.86 test_ssvm.py
test_08_reboot_cpvm Success 141.58 test_ssvm.py
test_07_reboot_ssvm Success 143.93 test_ssvm.py
test_06_stop_cpvm Success 131.61 test_ssvm.py
test_05_stop_ssvm Success 169.05 test_ssvm.py
test_04_cpvm_internals Success 1.06 test_ssvm.py
test_03_ssvm_internals Success 3.48 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.10 test_ssvm.py
test_04_change_offering_small Success 122.09 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.07 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.09 test_secondary_storage.py
test_01_sys_vm_start Success 0.16 test_secondary_storage.py
test_01_scale_vm Success 5.57 test_scale_vm.py
test_09_reboot_router Success 65.46 test_routers.py
test_08_start_router Success 55.48 test_routers.py
test_07_stop_router Success 10.14 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.49 test_routers.py
test_03_restart_network_cleanup Success 120.76 test_routers.py
test_02_router_internal_adv Success 0.83 test_routers.py
test_01_router_internal_basic Success 0.46 test_routers.py
test_router_dns_guestipquery Success 48.74 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 102.30 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 45.59 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.20 test_pvlan.py
test_dedicatePublicIpRange Success 0.78 test_public_ip_range.py
test_04_rvpc_privategw_static_routes Success 1119.91 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1100.22 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 722.47 test_privategw_acl.py
test_01_vpc_privategw_acl Success 193.10 test_privategw_acl.py
test_01_primary_storage_nfs Success 39.49 test_primary_storage.py
test_01_primary_storage_iscsi Success 79.20 test_primary_storage.py
test_createPortablePublicIPRange Success 10.17 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.42 test_portable_publicip.py
test_isolate_network_password_server Success 36.25 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.11 test_over_provisioning.py
test_oobm_zchange_password Success 20.50 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.53 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.51 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 16.01 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.52 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.51 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.51 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.51 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 62.30 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 0.14 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.18 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.83 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.43 test_non_contigiousvlan.py
test_01_nic Success 822.33 test_nic.py
test_releaseIP Success 253.44 test_network.py
test_reboot_router Success 595.37 test_network.py
test_public_ip_user_account Success 10.26 test_network.py
test_public_ip_admin_account Success 40.42 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.55 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.57 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 100.09 test_network.py
test_delete_account Success 379.41 test_network.py
test_02_port_fwd_on_non_src_nat Success 70.89 test_network.py
test_01_port_fwd_on_src_nat Success 84.07 test_network.py
test_nic_secondaryip_add_remove Success 284.37 test_multipleips_per_nic.py
login_test_saml_user Success 21.60 test_login.py
test_assign_and_removal_lb Success 149.01 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.42 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.31 test_loadbalance.py
test_03_list_snapshots Success 0.07 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.05 test_iso.py
test_04_extract_Iso Success 5.20 test_iso.py
test_03_delete_iso Success 95.13 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 21.33 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 677.97 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 410.99 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 899.68 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.50 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.48 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.56 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 7.20 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.24 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.38 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.27 test_dynamicroles.py
test_role_lifecycle_update Success 6.32 test_dynamicroles.py
test_role_lifecycle_list Success 6.25 test_dynamicroles.py
test_role_lifecycle_delete Success 11.32 test_dynamicroles.py
test_role_lifecycle_create Success 6.32 test_dynamicroles.py
test_role_inuse_deletion Success 6.24 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.90 test_dynamicroles.py
test_role_account_acls Success 8.17 test_dynamicroles.py
test_default_role_deletion Success 6.31 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 40.59 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 116.12 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 247.06 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 131.01 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 141.44 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.20 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.21 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.33 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 217.71 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 322.64 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.02 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-406)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 42870 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t406-vmware-55u3.zip
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 604.84 test_privategw_acl.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Failure 468.39 test_internal_lb.py
test_01_vpc_site2site_vpn Error 501.05 test_vpc_vpn.py
ContextSuite context=TestVpcRemoteAccessVpn>:setup Error 0.00 test_vpc_vpn.py
ContextSuite context=TestRVPCSite2SiteVpn>:setup Error 0.00 test_vpc_vpn.py
test_02_VPC_default_routes Success 369.39 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 825.58 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 682.81 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1698.62 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 755.82 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 735.21 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1432.98 test_vpc_redundant.py
test_09_delete_detached_volume Success 35.76 test_volumes.py
test_06_download_detached_volume Success 70.50 test_volumes.py
test_05_detach_volume Success 105.23 test_volumes.py
test_04_delete_attached_volume Success 20.37 test_volumes.py
test_03_download_attached_volume Success 25.30 test_volumes.py
test_02_attach_volume Success 53.87 test_volumes.py
test_01_create_volume Success 519.60 test_volumes.py
test_03_delete_vm_snapshots Success 285.27 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 231.38 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 166.31 test_vm_snapshots.py
test_01_create_vm_snapshots Success 161.92 test_vm_snapshots.py
test_deploy_vm_multiple Success 358.39 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.80 test_vm_life_cycle.py
test_09_expunge_vm Success 125.11 test_vm_life_cycle.py
test_08_migrate_vm Success 75.86 test_vm_life_cycle.py
test_07_restore_vm Success 0.07 test_vm_life_cycle.py
test_06_destroy_vm Success 10.12 test_vm_life_cycle.py
test_03_reboot_vm Success 5.11 test_vm_life_cycle.py
test_02_start_vm Success 25.20 test_vm_life_cycle.py
test_01_stop_vm Success 10.12 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 341.87 test_templates.py
test_08_list_system_templates Success 0.02 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.04 test_templates.py
test_04_extract_template Success 20.35 test_templates.py
test_03_delete_template Success 5.08 test_templates.py
test_02_edit_template Success 90.11 test_templates.py
test_01_create_template Success 211.58 test_templates.py
test_10_destroy_cpvm Success 261.70 test_ssvm.py
test_09_destroy_ssvm Success 273.52 test_ssvm.py
test_08_reboot_cpvm Success 156.69 test_ssvm.py
test_07_reboot_ssvm Success 158.79 test_ssvm.py
test_06_stop_cpvm Success 236.68 test_ssvm.py
test_05_stop_ssvm Success 234.29 test_ssvm.py
test_04_cpvm_internals Success 1.08 test_ssvm.py
test_03_ssvm_internals Success 3.50 test_ssvm.py
test_02_list_cpvm_vm Success 0.09 test_ssvm.py
test_01_list_sec_storage_vm Success 0.10 test_ssvm.py
test_01_snapshot_root_disk Success 71.28 test_snapshots.py
test_04_change_offering_small Success 97.42 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.08 test_service_offerings.py
test_02_sys_template_ready Success 0.10 test_secondary_storage.py
test_01_sys_vm_start Success 0.13 test_secondary_storage.py
test_09_reboot_router Success 181.00 test_routers.py
test_08_start_router Success 140.82 test_routers.py
test_07_stop_router Success 30.24 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.68 test_routers.py
test_03_restart_network_cleanup Success 201.13 test_routers.py
test_02_router_internal_adv Success 0.89 test_routers.py
test_01_router_internal_basic Success 0.50 test_routers.py
test_router_dns_guestipquery Success 106.89 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 153.98 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.07 test_resource_detail.py
test_01_reset_vm_on_reboot Success 90.58 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.16 test_pvlan.py
test_dedicatePublicIpRange Success 0.29 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1425.19 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 807.76 test_privategw_acl.py
test_01_vpc_privategw_acl Success 213.00 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.58 test_primary_storage.py
test_createPortablePublicIPRange Success 15.15 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.38 test_portable_publicip.py
test_isolate_network_password_server Success 97.87 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.19 test_over_provisioning.py
test_oobm_zchange_password Success 21.01 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 11.48 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.53 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.51 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.51 test_outofbandmanagement.py
test_oobm_issue_power_on Success 10.53 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.51 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 10.51 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 52.25 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 0.12 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.14 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.13 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.11 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.88 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.25 test_non_contigiousvlan.py
test_01_nic Success 676.48 test_nic.py
test_releaseIP Success 303.17 test_network.py
test_reboot_router Success 776.08 test_network.py
test_public_ip_user_account Success 10.19 test_network.py
test_public_ip_admin_account Success 40.23 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.51 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.36 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.06 test_network.py
test_delete_account Success 383.42 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.51 test_network.py
test_01_port_fwd_on_src_nat Success 111.69 test_network.py
test_nested_virtualization_vmware Success 425.28 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 237.68 test_multipleips_per_nic.py
login_test_saml_user Success 21.63 test_login.py
test_assign_and_removal_lb Success 149.06 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.49 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.54 test_loadbalance.py
test_03_list_snapshots Success 0.05 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.20 test_iso.py
test_03_delete_iso Success 95.13 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.32 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 947.11 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1143.05 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 905.41 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.20 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.13 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.38 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.37 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.22 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.30 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.30 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.25 test_dynamicroles.py
test_role_lifecycle_update Success 6.23 test_dynamicroles.py
test_role_lifecycle_list Success 6.21 test_dynamicroles.py
test_role_lifecycle_delete Success 6.29 test_dynamicroles.py
test_role_lifecycle_create Success 6.21 test_dynamicroles.py
test_role_inuse_deletion Success 6.18 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.52 test_dynamicroles.py
test_role_account_acls Success 7.80 test_dynamicroles.py
test_default_role_deletion Success 6.27 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.04 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.05 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 75.69 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 156.24 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 251.50 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 55.48 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 191.19 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.16 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.23 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.27 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 267.64 test_deploy_vm_iso.py
test_3d_gpu_support Success 564.91 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 327.00 test_affinity_groups.py
test_08_resize_volume Skipped 5.08 test_volumes.py
test_07_resize_fail Skipped 15.28 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.03 test_ssvm.py
test_01_scale_vm Skipped 66.74 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 1.33 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

Some new errors have popped up related to snapshots/volumes which were previously passing on xenserver:

test_01_snapshot_root_disk Failure 16.19 test_snapshots.py
test_06_download_detached_volume Error 20.27 test_volumes.py

Guys can you help review the new errors - @nvazquez @syed @mike-tutkowski @abhinandanprateek and others who have worked in the volumes, snapshot, xenserver related subsystems

@serg38
Copy link

serg38 commented Nov 24, 2016

@rhtyd I quickly checked. test_06_download_detached_volume failed only on last run due to
errorcode : 530, errortext : u'Unable to create a link for entity at volumes/76/141/e19cdd3c-201b-442a-9563-020f35d9e6c3.vhd on ssvm,No remote endpoint to send command, check if host or ssvm is down?'
It is either environmental or introduced in the every recent merges. We need to confimr if it shows up in the next test run
test_01_snapshot_root_disk consistently fails on 'is_snapshot_on_nfs' method on test for existence of snapshot. It seems a bug was introduced that adds second suffix vhd to the snapshot entry in DB that wouldnt match the file name

aramiko.transport: DEBUG: [chan 2] EOF received (2)
paramiko.transport: DEBUG: [chan 2] EOF sent (2)
sshClient: DEBUG: {Cmd: test -f /mnt/tmp/snapshots/66/120/db18ffda-1ab1-4843-95fe-cb134d1ae4b5.vhd.vhd && echo 'snapshot exists' via Host: 10.2.2.27} {returns: []}
paramiko.transport: DEBUG: [chan 3] Max packet in: 32768 bytes
paramiko.transport: DEBUG: [chan 3] Max packet out: 32768 bytes
paramiko.transport: DEBUG: Secsh channel 3 opened.

@nvazquez
Copy link
Contributor

@rhtyd adding to @serg38's comment, in test_06_download_detached_volume extractVolumeCmd fails with this error:
Invalid state of the volume with specified ID. It should be either detached or the VM should be in stopped state.

2016-11-23 19:27:57,454 - DEBUG - ========Sending GET Cmd : extractVolume=======
2016-11-23 19:27:57,522 - DEBUG - === Jobid: 7579b5d3-c855-4ccd-9830-d4129c363016 Started ===
2016-11-23 19:27:57,522 - DEBUG - Payload: {'signature': 'nEFfv6toUVO3tVUul9Kuud0aF0Q=', 'apiKey': u'LIN6rqXuaJwMPfGYFh13qDwYz5VNNz1J2J6qIOWcd3oLQOq0WtD4CwRundBL6rzXToa3lQOC_vKjI3nkHtiD8Q', 'command': 'queryAsyncJobResult', 'response': 'json', 'jobid': u'7579b5d3-c855-4ccd-9830-d4129c363016'}
2016-11-23 19:27:57,522 - DEBUG - ========Sending GET Cmd : queryAsyncJobResult=======
2016-11-23 19:27:57,543 - DEBUG - Response : {jobprocstatus : 0, created : u'2016-11-23T19:27:55+0000', cmd : u'org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd', userid : u'7ad6e032-b175-11e6-a92a-060292010740', jobstatus : 0, jobid : u'7579b5d3-c855-4ccd-9830-d4129c363016', jobresultcode : 0, jobinstanceid : u'868de86b-cabc-4426-ad1f-d475c0ed23f4', jobinstancetype : u'Volume', accountid : u'7ad6d754-b175-11e6-a92a-060292010740'}
2016-11-23 19:28:02,549 - DEBUG - === JobId:7579b5d3-c855-4ccd-9830-d4129c363016 is Still Processing, Will TimeOut in:3595 ====
2016-11-23 19:28:02,549 - DEBUG - Payload: {'signature': 'nEFfv6toUVO3tVUul9Kuud0aF0Q=', 'apiKey': u'LIN6rqXuaJwMPfGYFh13qDwYz5VNNz1J2J6qIOWcd3oLQOq0WtD4CwRundBL6rzXToa3lQOC_vKjI3nkHtiD8Q', 'command': 'queryAsyncJobResult', 'response': 'json', 'jobid': u'7579b5d3-c855-4ccd-9830-d4129c363016'}
2016-11-23 19:28:02,549 - DEBUG - ========Sending GET Cmd : queryAsyncJobResult=======
2016-11-23 19:28:02,571 - DEBUG - Response : {jobprocstatus : 0, created : u'2016-11-23T19:27:55+0000', jobresult : {errorcode : 530, errortext : u'Invalid state of the volume with specified ID. It should be either detached or the VM should be in stopped state.'}, cmd : u'org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd', userid : u'7ad6e032-b175-11e6-a92a-060292010740', jobstatus : 2, jobid : u'7579b5d3-c855-4ccd-9830-d4129c363016', jobresultcode : 530, jobinstanceid : u'868de86b-cabc-4426-ad1f-d475c0ed23f4', jobresulttype : u'object', jobinstancetype : u'Volume', accountid : u'7ad6d754-b175-11e6-a92a-060292010740'}
2016-11-23 19:28:02,571 - ERROR - ==== __poll: Exception Occurred :Job failed: {jobprocstatus : 0, created : u'2016-11-23T19:27:55+0000', jobresult : {errorcode : 530, errortext : u'Invalid state of the volume with specified ID. It should be either detached or the VM should be in stopped state.'}, cmd : u'org.apache.cloudstack.api.command.user.volume.ExtractVolumeCmd', userid : u'7ad6e032-b175-11e6-a92a-060292010740', jobstatus : 2, jobid : u'7579b5d3-c855-4ccd-9830-d4129c363016', jobresultcode : 530, jobinstanceid : u'868de86b-cabc-4426-ad1f-d475c0ed23f4', jobresulttype : u'object', jobinstancetype : u'Volume', accountid : u'7ad6d754-b175-11e6-a92a-060292010740'} ====

@mike-tutkowski
Copy link
Member

mike-tutkowski commented Nov 24, 2016 via email

@rohityadavcloud
Copy link
Member Author

Thanks @nvazquez @serg38 -- they could be env related. I'll check again tomorrow, kick some tests now.
Thanks @mike-tutkowski - happy thanksgiving to you and everyone in the community celebrating it. No problem, please have a look Monday/next week.

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-251

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@rohityadavcloud
Copy link
Member Author

@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-640)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 28281 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t640-kvm-centos7.zip
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 863.95 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 366.10 test_privategw_acl.py
test_CreateTemplateWithDuplicateName Error 0.04 test_templates.py
test_01_create_template Error 0.05 test_templates.py
ContextSuite context=TestTemplates>:setup Error 238.68 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 200.41 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 81.24 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 265.46 test_vpc_vpn.py
test_02_VPC_default_routes Success 269.83 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 583.50 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 594.18 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1350.83 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 625.94 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1362.72 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.46 test_volumes.py
test_08_resize_volume Success 15.36 test_volumes.py
test_07_resize_fail Success 20.44 test_volumes.py
test_06_download_detached_volume Success 15.33 test_volumes.py
test_05_detach_volume Success 100.30 test_volumes.py
test_04_delete_attached_volume Success 10.21 test_volumes.py
test_03_download_attached_volume Success 15.29 test_volumes.py
test_02_attach_volume Success 73.79 test_volumes.py
test_01_create_volume Success 721.05 test_volumes.py
test_deploy_vm_multiple Success 318.38 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 51.71 test_vm_life_cycle.py
test_09_expunge_vm Success 125.24 test_vm_life_cycle.py
test_08_migrate_vm Success 40.90 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 130.87 test_vm_life_cycle.py
test_03_reboot_vm Success 130.82 test_vm_life_cycle.py
test_02_start_vm Success 10.17 test_vm_life_cycle.py
test_01_stop_vm Success 45.36 test_vm_life_cycle.py
test_10_destroy_cpvm Success 196.66 test_ssvm.py
test_09_destroy_ssvm Success 169.40 test_ssvm.py
test_08_reboot_cpvm Success 136.73 test_ssvm.py
test_07_reboot_ssvm Success 138.76 test_ssvm.py
test_06_stop_cpvm Success 141.96 test_ssvm.py
test_05_stop_ssvm Success 168.79 test_ssvm.py
test_04_cpvm_internals Success 1.15 test_ssvm.py
test_03_ssvm_internals Success 3.28 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.12 test_ssvm.py
test_01_snapshot_root_disk Success 16.32 test_snapshots.py
test_04_change_offering_small Success 215.53 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.06 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_09_reboot_router Success 50.37 test_routers.py
test_08_start_router Success 30.29 test_routers.py
test_07_stop_router Success 15.19 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.57 test_routers.py
test_03_restart_network_cleanup Success 60.70 test_routers.py
test_02_router_internal_adv Success 0.86 test_routers.py
test_01_router_internal_basic Success 0.49 test_routers.py
test_router_dns_guestipquery Success 106.75 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 287.06 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.54 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 136.07 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.20 test_pvlan.py
test_dedicatePublicIpRange Success 0.45 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 499.89 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 455.79 test_privategw_acl.py
test_01_vpc_privategw_acl Success 102.21 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.79 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.52 test_portable_publicip.py
test_isolate_network_password_server Success 86.05 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 30.61 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.34 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.25 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 10.31 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.33 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.43 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.49 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.80 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.43 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.28 test_non_contigiousvlan.py
test_01_nic Success 529.67 test_nic.py
test_releaseIP Success 202.51 test_network.py
test_reboot_router Success 404.24 test_network.py
test_public_ip_user_account Success 10.27 test_network.py
test_public_ip_admin_account Success 40.26 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.65 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.52 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.92 test_network.py
test_delete_account Success 318.01 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.74 test_network.py
test_01_port_fwd_on_src_nat Success 111.72 test_network.py
test_nic_secondaryip_add_remove Success 207.51 test_multipleips_per_nic.py
login_test_saml_user Success 19.27 test_login.py
test_assign_and_removal_lb Success 133.17 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.27 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 218.27 test_loadbalance.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.06 test_iso.py
test_04_extract_Iso Success 5.25 test_iso.py
test_03_delete_iso Success 95.22 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 21.11 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 258.31 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 192.97 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 544.26 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 481.08 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.34 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.18 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.95 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.83 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.90 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.99 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.89 test_dynamicroles.py
test_role_lifecycle_update Success 11.59 test_dynamicroles.py
test_role_lifecycle_list Success 5.91 test_dynamicroles.py
test_role_lifecycle_delete Success 11.26 test_dynamicroles.py
test_role_lifecycle_create Success 5.87 test_dynamicroles.py
test_role_inuse_deletion Success 5.88 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.00 test_dynamicroles.py
test_role_account_acls Success 8.30 test_dynamicroles.py
test_default_role_deletion Success 5.97 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.07 test_disk_offerings.py
test_01_create_disk_offering Success 0.11 test_disk_offerings.py
test_deployvm_userdispersing Success 21.07 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 20.63 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 126.36 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.38 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 80.82 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.08 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.05 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 233.08 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 269.70 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 147.62 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.04 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.05 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✖debian. JID-379

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-648)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 29481 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t648-kvm-centos7.zip
Test completed. 46 look ok, 3 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 894.71 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 416.86 test_privategw_acl.py
ContextSuite context=TestTemplates>:setup Error 299.76 test_templates.py
test_01_vpc_site2site_vpn Success 171.19 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 71.47 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 271.08 test_vpc_vpn.py
test_02_VPC_default_routes Success 293.03 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 591.52 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 541.42 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1493.13 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 648.83 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1348.14 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.51 test_volumes.py
test_08_resize_volume Success 15.43 test_volumes.py
test_07_resize_fail Success 20.54 test_volumes.py
test_06_download_detached_volume Success 15.30 test_volumes.py
test_05_detach_volume Success 100.24 test_volumes.py
test_04_delete_attached_volume Success 10.21 test_volumes.py
test_03_download_attached_volume Success 15.33 test_volumes.py
test_02_attach_volume Success 73.86 test_volumes.py
test_01_create_volume Success 723.22 test_volumes.py
test_deploy_vm_multiple Success 318.49 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.70 test_vm_life_cycle.py
test_09_expunge_vm Success 125.27 test_vm_life_cycle.py
test_08_migrate_vm Success 41.01 test_vm_life_cycle.py
test_07_restore_vm Success 0.15 test_vm_life_cycle.py
test_06_destroy_vm Success 130.90 test_vm_life_cycle.py
test_03_reboot_vm Success 130.90 test_vm_life_cycle.py
test_02_start_vm Success 10.17 test_vm_life_cycle.py
test_01_stop_vm Success 45.45 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 70.75 test_templates.py
test_01_create_template Success 70.68 test_templates.py
test_10_destroy_cpvm Success 171.95 test_ssvm.py
test_09_destroy_ssvm Success 174.08 test_ssvm.py
test_08_reboot_cpvm Success 137.26 test_ssvm.py
test_07_reboot_ssvm Success 140.40 test_ssvm.py
test_06_stop_cpvm Success 137.08 test_ssvm.py
test_05_stop_ssvm Success 138.95 test_ssvm.py
test_04_cpvm_internals Success 1.34 test_ssvm.py
test_03_ssvm_internals Success 3.49 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.17 test_ssvm.py
test_01_snapshot_root_disk Success 11.30 test_snapshots.py
test_04_change_offering_small Success 210.04 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.13 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.20 test_secondary_storage.py
test_09_reboot_router Success 45.50 test_routers.py
test_08_start_router Success 50.67 test_routers.py
test_07_stop_router Success 20.25 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.77 test_routers.py
test_03_restart_network_cleanup Success 80.76 test_routers.py
test_02_router_internal_adv Success 1.20 test_routers.py
test_01_router_internal_basic Success 0.64 test_routers.py
test_router_dns_guestipquery Success 76.85 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 288.36 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.89 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 176.74 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.24 test_pvlan.py
test_dedicatePublicIpRange Success 0.49 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 622.14 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 401.82 test_privategw_acl.py
test_01_vpc_privategw_acl Success 92.50 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.89 test_primary_storage.py
test_createPortablePublicIPRange Success 15.20 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.56 test_portable_publicip.py
test_isolate_network_password_server Success 90.40 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.14 test_over_provisioning.py
test_oobm_zchange_password Success 31.14 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.36 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.26 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.36 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.37 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.33 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.44 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 77.86 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.17 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.20 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.08 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.56 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.33 test_non_contigiousvlan.py
test_01_nic Success 531.22 test_nic.py
test_releaseIP Success 263.12 test_network.py
test_reboot_router Success 469.55 test_network.py
test_public_ip_user_account Success 10.28 test_network.py
test_public_ip_admin_account Success 40.32 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.01 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.20 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.38 test_network.py
test_delete_account Success 282.91 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.68 test_network.py
test_01_port_fwd_on_src_nat Success 113.43 test_network.py
test_nic_secondaryip_add_remove Success 213.00 test_multipleips_per_nic.py
login_test_saml_user Success 19.38 test_login.py
test_assign_and_removal_lb Success 134.03 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.26 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 188.59 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.05 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.19 test_iso.py
test_03_delete_iso Success 95.21 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.09 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 283.65 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 233.90 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 592.61 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 543.67 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.32 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.15 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.26 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.02 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.89 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.95 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.07 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.96 test_dynamicroles.py
test_role_lifecycle_update Success 11.06 test_dynamicroles.py
test_role_lifecycle_list Success 6.00 test_dynamicroles.py
test_role_lifecycle_delete Success 11.01 test_dynamicroles.py
test_role_lifecycle_create Success 5.97 test_dynamicroles.py
test_role_inuse_deletion Success 5.99 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.72 test_dynamicroles.py
test_role_account_acls Success 8.79 test_dynamicroles.py
test_default_role_deletion Success 6.06 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.06 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 20.74 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 50.83 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.73 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.51 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 91.04 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.05 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.05 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 233.27 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 237.91 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 66.04 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.04 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-647)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 34915 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t647-xenserver-65sp1.zip
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 640.99 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1371.10 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 578.80 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 870.92 test_privategw_acl.py
test_05_rvpc_multi_tiers Error 843.19 test_vpc_redundant.py
ContextSuite context=TestTemplates>:setup Error 416.63 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 326.74 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 167.04 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 570.43 test_vpc_vpn.py
test_02_VPC_default_routes Success 340.54 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 664.37 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 855.89 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1096.32 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.75 test_volumes.py
test_08_resize_volume Success 101.03 test_volumes.py
test_07_resize_fail Success 116.27 test_volumes.py
test_06_download_detached_volume Success 25.43 test_volumes.py
test_05_detach_volume Success 100.32 test_volumes.py
test_04_delete_attached_volume Success 10.23 test_volumes.py
test_03_download_attached_volume Success 20.41 test_volumes.py
test_02_attach_volume Success 10.69 test_volumes.py
test_01_create_volume Success 394.21 test_volumes.py
test_03_delete_vm_snapshots Success 280.31 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 187.44 test_vm_snapshots.py
test_01_create_vm_snapshots Success 100.79 test_vm_snapshots.py
test_deploy_vm_multiple Success 227.98 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.85 test_vm_life_cycle.py
test_09_expunge_vm Success 125.27 test_vm_life_cycle.py
test_08_migrate_vm Success 76.42 test_vm_life_cycle.py
test_07_restore_vm Success 0.15 test_vm_life_cycle.py
test_06_destroy_vm Success 10.25 test_vm_life_cycle.py
test_03_reboot_vm Success 20.27 test_vm_life_cycle.py
test_02_start_vm Success 25.30 test_vm_life_cycle.py
test_01_stop_vm Success 30.32 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 126.87 test_templates.py
test_01_create_template Success 76.20 test_templates.py
test_10_destroy_cpvm Success 196.79 test_ssvm.py
test_09_destroy_ssvm Success 224.11 test_ssvm.py
test_08_reboot_cpvm Success 141.53 test_ssvm.py
test_07_reboot_ssvm Success 204.03 test_ssvm.py
test_06_stop_cpvm Success 166.74 test_ssvm.py
test_05_stop_ssvm Success 169.67 test_ssvm.py
test_04_cpvm_internals Success 1.19 test_ssvm.py
test_03_ssvm_internals Success 3.93 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 31.74 test_snapshots.py
test_04_change_offering_small Success 122.24 test_service_offerings.py
test_03_delete_service_offering Success 0.06 test_service_offerings.py
test_02_edit_service_offering Success 0.11 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.20 test_secondary_storage.py
test_01_scale_vm Success 5.28 test_scale_vm.py
test_09_reboot_router Success 70.64 test_routers.py
test_08_start_router Success 65.70 test_routers.py
test_07_stop_router Success 20.27 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.91 test_routers.py
test_03_restart_network_cleanup Success 141.87 test_routers.py
test_02_router_internal_adv Success 0.78 test_routers.py
test_01_router_internal_basic Success 0.47 test_routers.py
test_router_dns_guestipquery Success 48.98 test_router_dns.py
test_router_dns_externalipquery Success 0.07 test_router_dns.py
test_router_dhcphosts Success 103.13 test_router_dhcphosts.py
test_router_dhcp_opts Success 31.48 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 146.32 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.33 test_pvlan.py
test_dedicatePublicIpRange Success 0.60 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 930.00 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 629.33 test_privategw_acl.py
test_01_vpc_privategw_acl Success 168.37 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.92 test_primary_storage.py
test_01_primary_storage_iscsi Success 78.76 test_primary_storage.py
test_createPortablePublicIPRange Success 15.22 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.53 test_portable_publicip.py
test_isolate_network_password_server Success 36.21 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_oobm_zchange_password Success 30.97 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.38 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.72 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.41 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.49 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.41 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.38 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 93.14 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.21 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.20 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.15 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.51 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.41 test_non_contigiousvlan.py
test_01_nic Success 747.78 test_nic.py
test_releaseIP Success 324.73 test_network.py
test_reboot_router Success 636.66 test_network.py
test_public_ip_user_account Success 10.48 test_network.py
test_public_ip_admin_account Success 40.37 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.88 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 76.51 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 100.12 test_network.py
test_delete_account Success 298.98 test_network.py
test_02_port_fwd_on_non_src_nat Success 71.04 test_network.py
test_01_port_fwd_on_src_nat Success 84.04 test_network.py
test_nic_secondaryip_add_remove Success 243.23 test_multipleips_per_nic.py
login_test_saml_user Success 19.65 test_login.py
test_assign_and_removal_lb Success 148.43 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.41 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 209.51 test_loadbalance.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.20 test_iso.py
test_03_delete_iso Success 95.14 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.06 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 481.17 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 384.96 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1031.75 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 726.46 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.38 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.35 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.43 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.11 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.07 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.82 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.24 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.01 test_dynamicroles.py
test_role_lifecycle_update Success 11.20 test_dynamicroles.py
test_role_lifecycle_list Success 6.12 test_dynamicroles.py
test_role_lifecycle_delete Success 11.06 test_dynamicroles.py
test_role_lifecycle_create Success 6.08 test_dynamicroles.py
test_role_inuse_deletion Success 6.03 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 9.15 test_dynamicroles.py
test_role_account_acls Success 9.19 test_dynamicroles.py
test_default_role_deletion Success 6.26 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.11 test_disk_offerings.py
test_03_delete_disk_offering Success 0.06 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.10 test_disk_offerings.py
test_01_create_disk_offering Success 0.17 test_disk_offerings.py
test_deployvm_userdispersing Success 47.16 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 106.42 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 181.82 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 25.60 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 121.50 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 6.00 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.10 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 167.76 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 177.67 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.04 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-649)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36867 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t649-vmware-55u3.zip
Test completed. 44 look ok, 5 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 1070.94 test_privategw_acl.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Failure 136.95 test_internal_lb.py
test_01_vpc_site2site_vpn Error 517.07 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 748.89 test_vpc_vpn.py
test_09_reboot_router Error 125.87 test_routers.py
test_03_vpc_privategw_restart_vpc_cleanup Error 738.03 test_privategw_acl.py
test_03_vpc_privategw_restart_vpc_cleanup Error 793.86 test_privategw_acl.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_remote_access_vpn Success 171.95 test_vpc_vpn.py
test_02_VPC_default_routes Success 395.27 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 740.38 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 688.54 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1559.53 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 720.53 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 653.67 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1372.72 test_vpc_redundant.py
test_09_delete_detached_volume Success 25.89 test_volumes.py
test_06_download_detached_volume Success 55.55 test_volumes.py
test_05_detach_volume Success 100.45 test_volumes.py
test_04_delete_attached_volume Success 10.21 test_volumes.py
test_03_download_attached_volume Success 15.35 test_volumes.py
test_02_attach_volume Success 48.73 test_volumes.py
test_01_create_volume Success 460.32 test_volumes.py
test_03_delete_vm_snapshots Success 275.23 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 204.26 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 186.63 test_vm_snapshots.py
test_01_create_vm_snapshots Success 129.43 test_vm_snapshots.py
test_deploy_vm_multiple Success 212.52 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.68 test_vm_life_cycle.py
test_09_expunge_vm Success 125.19 test_vm_life_cycle.py
test_08_migrate_vm Success 81.41 test_vm_life_cycle.py
test_07_restore_vm Success 0.11 test_vm_life_cycle.py
test_06_destroy_vm Success 10.15 test_vm_life_cycle.py
test_03_reboot_vm Success 5.16 test_vm_life_cycle.py
test_02_start_vm Success 20.25 test_vm_life_cycle.py
test_01_stop_vm Success 10.16 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 221.54 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 20.58 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.12 test_templates.py
test_01_create_template Success 146.50 test_templates.py
test_10_destroy_cpvm Success 272.94 test_ssvm.py
test_09_destroy_ssvm Success 274.82 test_ssvm.py
test_08_reboot_cpvm Success 156.72 test_ssvm.py
test_07_reboot_ssvm Success 188.63 test_ssvm.py
test_06_stop_cpvm Success 207.05 test_ssvm.py
test_05_stop_ssvm Success 208.82 test_ssvm.py
test_04_cpvm_internals Success 1.30 test_ssvm.py
test_03_ssvm_internals Success 3.42 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.16 test_ssvm.py
test_01_snapshot_root_disk Success 66.76 test_snapshots.py
test_04_change_offering_small Success 121.91 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.20 test_secondary_storage.py
test_08_start_router Success 115.89 test_routers.py
test_07_stop_router Success 25.29 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.68 test_routers.py
test_03_restart_network_cleanup Success 186.39 test_routers.py
test_02_router_internal_adv Success 1.15 test_routers.py
test_01_router_internal_basic Success 0.61 test_routers.py
test_router_dns_guestipquery Success 76.78 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 154.59 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.82 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.10 test_resource_detail.py
test_01_reset_vm_on_reboot Success 25.41 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.32 test_pvlan.py
test_dedicatePublicIpRange Success 0.47 test_public_ip_range.py
test_02_vpc_privategw_static_routes Success 744.11 test_privategw_acl.py
test_01_vpc_privategw_acl Success 223.51 test_privategw_acl.py
test_01_primary_storage_nfs Success 37.34 test_primary_storage.py
test_createPortablePublicIPRange Success 15.20 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.49 test_portable_publicip.py
test_isolate_network_password_server Success 62.16 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.15 test_over_provisioning.py
test_oobm_zchange_password Success 30.94 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.35 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.29 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.40 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.42 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.34 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.41 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.35 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 93.28 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 0.14 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.19 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.12 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.65 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.36 test_non_contigiousvlan.py
test_01_nic Success 651.42 test_nic.py
test_releaseIP Success 338.74 test_network.py
test_reboot_router Success 615.64 test_network.py
test_public_ip_user_account Success 10.35 test_network.py
test_public_ip_admin_account Success 40.34 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 76.97 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.83 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.61 test_network.py
test_delete_account Success 353.55 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.73 test_network.py
test_01_port_fwd_on_src_nat Success 111.86 test_network.py
test_nested_virtualization_vmware Success 439.24 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 258.90 test_multipleips_per_nic.py
login_test_saml_user Success 19.31 test_login.py
test_assign_and_removal_lb Success 149.26 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.56 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.17 test_loadbalance.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.17 test_iso.py
test_03_delete_iso Success 95.15 test_iso.py
test_02_edit_iso Success 0.10 test_iso.py
test_01_create_iso Success 21.03 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 575.84 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 445.77 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 825.06 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.36 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.29 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.07 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.12 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.33 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.22 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.07 test_dynamicroles.py
test_role_lifecycle_update Success 11.26 test_dynamicroles.py
test_role_lifecycle_list Success 6.02 test_dynamicroles.py
test_role_lifecycle_delete Success 11.10 test_dynamicroles.py
test_role_lifecycle_create Success 6.04 test_dynamicroles.py
test_role_inuse_deletion Success 5.99 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.74 test_dynamicroles.py
test_role_account_acls Success 9.00 test_dynamicroles.py
test_default_role_deletion Success 6.44 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.10 test_disk_offerings.py
test_03_delete_disk_offering Success 0.07 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.12 test_disk_offerings.py
test_01_create_disk_offering Success 0.18 test_disk_offerings.py
test_deployvm_userdispersing Success 60.91 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 86.06 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 216.76 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.55 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 176.62 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.88 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.91 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.05 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 263.11 test_deploy_vm_iso.py
test_3d_gpu_support Success 475.31 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 327.83 test_affinity_groups.py
test_08_resize_volume Skipped 5.12 test_volumes.py
test_07_resize_fail Skipped 10.29 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 66.29 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 1.17 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✖centos6 ✔centos7 ✔debian. JID-385

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✖debian. JID-389

@borisstoyanov
Copy link
Contributor

@blueorangutan test matrix

@blueorangutan
Copy link

@borisstoyanov a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-665)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 27751 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t665-kvm-centos7.zip
Test completed. 47 look ok, 2 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 370.62 test_privategw_acl.py
ContextSuite context=TestTemplates>:setup Error 369.99 test_templates.py
test_01_vpc_site2site_vpn Success 161.65 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 71.16 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 255.96 test_vpc_vpn.py
test_02_VPC_default_routes Success 292.15 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 566.73 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 540.75 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1456.28 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 686.33 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 904.49 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1346.32 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.40 test_volumes.py
test_08_resize_volume Success 15.39 test_volumes.py
test_07_resize_fail Success 20.51 test_volumes.py
test_06_download_detached_volume Success 15.27 test_volumes.py
test_05_detach_volume Success 100.29 test_volumes.py
test_04_delete_attached_volume Success 10.18 test_volumes.py
test_03_download_attached_volume Success 15.28 test_volumes.py
test_02_attach_volume Success 73.72 test_volumes.py
test_01_create_volume Success 716.41 test_volumes.py
test_deploy_vm_multiple Success 267.64 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.71 test_vm_life_cycle.py
test_09_expunge_vm Success 125.14 test_vm_life_cycle.py
test_08_migrate_vm Success 40.87 test_vm_life_cycle.py
test_07_restore_vm Success 0.15 test_vm_life_cycle.py
test_06_destroy_vm Success 130.81 test_vm_life_cycle.py
test_03_reboot_vm Success 130.81 test_vm_life_cycle.py
test_02_start_vm Success 10.16 test_vm_life_cycle.py
test_01_stop_vm Success 45.34 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 101.04 test_templates.py
test_01_create_template Success 75.60 test_templates.py
test_10_destroy_cpvm Success 136.55 test_ssvm.py
test_09_destroy_ssvm Success 173.75 test_ssvm.py
test_08_reboot_cpvm Success 137.34 test_ssvm.py
test_07_reboot_ssvm Success 138.78 test_ssvm.py
test_06_stop_cpvm Success 141.94 test_ssvm.py
test_05_stop_ssvm Success 138.80 test_ssvm.py
test_04_cpvm_internals Success 1.22 test_ssvm.py
test_03_ssvm_internals Success 3.37 test_ssvm.py
test_02_list_cpvm_vm Success 0.13 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 11.20 test_snapshots.py
test_04_change_offering_small Success 247.77 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.12 test_secondary_storage.py
test_01_sys_vm_start Success 0.17 test_secondary_storage.py
test_09_reboot_router Success 40.31 test_routers.py
test_08_start_router Success 30.28 test_routers.py
test_07_stop_router Success 15.18 test_routers.py
test_06_router_advanced Success 0.05 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.71 test_routers.py
test_03_restart_network_cleanup Success 65.56 test_routers.py
test_02_router_internal_adv Success 1.03 test_routers.py
test_01_router_internal_basic Success 0.56 test_routers.py
test_router_dns_guestipquery Success 76.72 test_router_dns.py
test_router_dns_externalipquery Success 0.05 test_router_dns.py
test_router_dhcphosts Success 287.02 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.73 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.16 test_resource_detail.py
test_01_reset_vm_on_reboot Success 135.97 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.20 test_pvlan.py
test_dedicatePublicIpRange Success 0.77 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 550.29 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 481.48 test_privategw_acl.py
test_01_vpc_privategw_acl Success 97.20 test_privategw_acl.py
test_01_primary_storage_nfs Success 35.71 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.42 test_portable_publicip.py
test_isolate_network_password_server Success 89.26 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.12 test_over_provisioning.py
test_oobm_zchange_password Success 30.68 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.31 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.24 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.51 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.31 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.30 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.29 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.56 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.23 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.42 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.30 test_non_contigiousvlan.py
test_01_nic Success 529.60 test_nic.py
test_releaseIP Success 257.83 test_network.py
test_reboot_router Success 444.22 test_network.py
test_public_ip_user_account Success 10.26 test_network.py
test_public_ip_admin_account Success 40.28 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.84 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.76 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.11 test_network.py
test_delete_account Success 348.58 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.57 test_network.py
test_01_port_fwd_on_src_nat Success 111.72 test_network.py
test_nic_secondaryip_add_remove Success 212.46 test_multipleips_per_nic.py
login_test_saml_user Success 19.18 test_login.py
test_assign_and_removal_lb Success 133.23 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.32 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 217.63 test_loadbalance.py
test_03_list_snapshots Success 0.08 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.14 test_iso.py
test_03_delete_iso Success 95.30 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 21.00 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 248.52 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 198.50 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 556.21 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 460.17 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.28 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.12 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.25 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.97 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.86 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.88 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.00 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.89 test_dynamicroles.py
test_role_lifecycle_update Success 10.98 test_dynamicroles.py
test_role_lifecycle_list Success 5.88 test_dynamicroles.py
test_role_lifecycle_delete Success 11.08 test_dynamicroles.py
test_role_lifecycle_create Success 5.90 test_dynamicroles.py
test_role_inuse_deletion Success 5.85 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.02 test_dynamicroles.py
test_role_account_acls Success 8.29 test_dynamicroles.py
test_default_role_deletion Success 6.00 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.06 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.06 test_disk_offerings.py
test_01_create_disk_offering Success 0.10 test_disk_offerings.py
test_deployvm_userdispersing Success 20.54 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 45.69 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 60.68 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.38 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 50.67 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.95 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 6.12 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 283.23 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 217.47 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 60.88 test_affinity_groups.py
test_03_delete_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_02_revert_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_01_create_vm_snapshots Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.03 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-664)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 34373 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t664-xenserver-65sp1.zip
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 560.81 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1377.12 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 604.67 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 725.63 test_privategw_acl.py
test_05_rvpc_multi_tiers Error 747.87 test_vpc_redundant.py
ContextSuite context=TestTemplates>:setup Error 390.92 test_templates.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_site2site_vpn Success 332.11 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 141.93 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 626.36 test_vpc_vpn.py
test_02_VPC_default_routes Success 376.83 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 710.21 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 910.76 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 1080.64 test_vpc_redundant.py
test_09_delete_detached_volume Success 20.80 test_volumes.py
test_08_resize_volume Success 106.22 test_volumes.py
test_07_resize_fail Success 111.21 test_volumes.py
test_06_download_detached_volume Success 25.60 test_volumes.py
test_05_detach_volume Success 100.32 test_volumes.py
test_04_delete_attached_volume Success 15.30 test_volumes.py
test_03_download_attached_volume Success 15.54 test_volumes.py
test_02_attach_volume Success 15.78 test_volumes.py
test_01_create_volume Success 392.81 test_volumes.py
test_03_delete_vm_snapshots Success 280.30 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 186.44 test_vm_snapshots.py
test_01_create_vm_snapshots Success 130.97 test_vm_snapshots.py
test_deploy_vm_multiple Success 344.12 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 31.92 test_vm_life_cycle.py
test_09_expunge_vm Success 125.24 test_vm_life_cycle.py
test_08_migrate_vm Success 66.29 test_vm_life_cycle.py
test_07_restore_vm Success 0.16 test_vm_life_cycle.py
test_06_destroy_vm Success 15.24 test_vm_life_cycle.py
test_03_reboot_vm Success 10.23 test_vm_life_cycle.py
test_02_start_vm Success 20.66 test_vm_life_cycle.py
test_01_stop_vm Success 30.32 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 156.46 test_templates.py
test_01_create_template Success 85.83 test_templates.py
test_10_destroy_cpvm Success 231.84 test_ssvm.py
test_09_destroy_ssvm Success 229.28 test_ssvm.py
test_08_reboot_cpvm Success 176.57 test_ssvm.py
test_07_reboot_ssvm Success 149.08 test_ssvm.py
test_06_stop_cpvm Success 166.86 test_ssvm.py
test_05_stop_ssvm Success 139.03 test_ssvm.py
test_04_cpvm_internals Success 1.12 test_ssvm.py
test_03_ssvm_internals Success 4.18 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_01_snapshot_root_disk Success 21.66 test_snapshots.py
test_04_change_offering_small Success 91.17 test_service_offerings.py
test_03_delete_service_offering Success 0.05 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.22 test_secondary_storage.py
test_01_scale_vm Success 5.26 test_scale_vm.py
test_09_reboot_router Success 65.59 test_routers.py
test_08_start_router Success 60.60 test_routers.py
test_07_stop_router Success 15.24 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.59 test_routers.py
test_03_restart_network_cleanup Success 131.49 test_routers.py
test_02_router_internal_adv Success 0.80 test_routers.py
test_01_router_internal_basic Success 0.42 test_routers.py
test_router_dns_guestipquery Success 48.99 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 173.85 test_router_dhcphosts.py
test_router_dhcp_opts Success 31.59 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.12 test_resource_detail.py
test_01_reset_vm_on_reboot Success 40.49 test_reset_vm_on_reboot.py
test_createRegion Success 0.06 test_regions.py
test_create_pvlan_network Success 5.31 test_pvlan.py
test_dedicatePublicIpRange Success 0.67 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 859.56 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 613.62 test_privategw_acl.py
test_01_vpc_privategw_acl Success 173.46 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.94 test_primary_storage.py
test_01_primary_storage_iscsi Success 77.82 test_primary_storage.py
test_createPortablePublicIPRange Success 15.27 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.60 test_portable_publicip.py
test_isolate_network_password_server Success 36.23 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.19 test_over_provisioning.py
test_oobm_zchange_password Success 30.87 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.53 test_outofbandmanagement.py
test_oobm_issue_power_status Success 5.30 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 10.42 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.61 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.67 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.41 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.40 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 93.54 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.19 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.28 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.22 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.50 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.35 test_non_contigiousvlan.py
test_01_nic Success 732.65 test_nic.py
test_releaseIP Success 303.91 test_network.py
test_reboot_router Success 580.53 test_network.py
test_public_ip_user_account Success 10.33 test_network.py
test_public_ip_admin_account Success 40.37 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 86.94 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 77.01 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 103.43 test_network.py
test_delete_account Success 313.49 test_network.py
test_02_port_fwd_on_non_src_nat Success 71.35 test_network.py
test_01_port_fwd_on_src_nat Success 84.26 test_network.py
test_nic_secondaryip_add_remove Success 228.28 test_multipleips_per_nic.py
login_test_saml_user Success 19.54 test_login.py
test_assign_and_removal_lb Success 149.19 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.66 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 208.31 test_loadbalance.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.12 test_iso.py
test_04_extract_Iso Success 5.16 test_iso.py
test_03_delete_iso Success 95.16 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 21.18 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 642.51 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 304.71 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1027.08 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 688.86 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.51 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.20 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.31 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.12 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.90 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.97 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.19 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.07 test_dynamicroles.py
test_role_lifecycle_update Success 11.16 test_dynamicroles.py
test_role_lifecycle_list Success 6.05 test_dynamicroles.py
test_role_lifecycle_delete Success 11.19 test_dynamicroles.py
test_role_lifecycle_create Success 6.17 test_dynamicroles.py
test_role_inuse_deletion Success 5.99 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.80 test_dynamicroles.py
test_role_account_acls Success 8.94 test_dynamicroles.py
test_default_role_deletion Success 6.80 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.09 test_disk_offerings.py
test_01_create_disk_offering Success 0.13 test_disk_offerings.py
test_deployvm_userdispersing Success 141.82 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 55.97 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 166.58 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 20.54 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 121.36 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.97 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.12 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 152.85 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 161.93 test_affinity_groups.py
test_01_test_vm_volume_snapshot Skipped 0.00 test_vm_snapshots.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-666)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 39654 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1754-t666-vmware-55u3.zip
Test completed. 45 look ok, 4 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 959.57 test_privategw_acl.py
test_01_vpc_site2site_vpn Error 527.03 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Error 738.56 test_vpc_vpn.py
test_01_nic Error 510.03 test_nic.py
ContextSuite context=TestListIdsParams>:setup Error 0.00 test_list_ids_parameter.py
test_01_vpc_remote_access_vpn Success 202.00 test_vpc_vpn.py
test_02_VPC_default_routes Success 475.13 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 879.88 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 769.80 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1604.97 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 787.01 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 709.96 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1431.96 test_vpc_redundant.py
test_09_delete_detached_volume Success 25.83 test_volumes.py
test_06_download_detached_volume Success 65.58 test_volumes.py
test_05_detach_volume Success 105.26 test_volumes.py
test_04_delete_attached_volume Success 20.26 test_volumes.py
test_03_download_attached_volume Success 20.32 test_volumes.py
test_02_attach_volume Success 58.83 test_volumes.py
test_01_create_volume Success 521.44 test_volumes.py
test_03_delete_vm_snapshots Success 275.21 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 230.38 test_vm_snapshots.py
test_01_test_vm_volume_snapshot Success 196.57 test_vm_snapshots.py
test_01_create_vm_snapshots Success 166.67 test_vm_snapshots.py
test_deploy_vm_multiple Success 307.99 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.86 test_vm_life_cycle.py
test_09_expunge_vm Success 125.25 test_vm_life_cycle.py
test_08_migrate_vm Success 81.19 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 10.14 test_vm_life_cycle.py
test_03_reboot_vm Success 5.15 test_vm_life_cycle.py
test_02_start_vm Success 20.28 test_vm_life_cycle.py
test_01_stop_vm Success 5.12 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 272.00 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 15.23 test_templates.py
test_03_delete_template Success 5.10 test_templates.py
test_02_edit_template Success 90.18 test_templates.py
test_01_create_template Success 161.12 test_templates.py
test_10_destroy_cpvm Success 241.98 test_ssvm.py
test_09_destroy_ssvm Success 233.87 test_ssvm.py
test_08_reboot_cpvm Success 186.61 test_ssvm.py
test_07_reboot_ssvm Success 189.01 test_ssvm.py
test_06_stop_cpvm Success 387.25 test_ssvm.py
test_05_stop_ssvm Success 204.92 test_ssvm.py
test_04_cpvm_internals Success 1.22 test_ssvm.py
test_03_ssvm_internals Success 3.63 test_ssvm.py
test_02_list_cpvm_vm Success 0.12 test_ssvm.py
test_01_list_sec_storage_vm Success 0.13 test_ssvm.py
test_01_snapshot_root_disk Success 26.27 test_snapshots.py
test_04_change_offering_small Success 130.41 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.11 test_service_offerings.py
test_02_sys_template_ready Success 0.15 test_secondary_storage.py
test_01_sys_vm_start Success 0.19 test_secondary_storage.py
test_09_reboot_router Success 156.09 test_routers.py
test_08_start_router Success 161.10 test_routers.py
test_07_stop_router Success 20.34 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.72 test_routers.py
test_03_restart_network_cleanup Success 186.32 test_routers.py
test_02_router_internal_adv Success 1.07 test_routers.py
test_01_router_internal_basic Success 0.58 test_routers.py
test_router_dns_guestipquery Success 106.78 test_router_dns.py
test_router_dns_externalipquery Success 0.08 test_router_dns.py
test_router_dhcphosts Success 146.74 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.69 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 30.36 test_reset_vm_on_reboot.py
test_createRegion Success 0.04 test_regions.py
test_create_pvlan_network Success 5.22 test_pvlan.py
test_dedicatePublicIpRange Success 0.45 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1164.74 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 673.36 test_privategw_acl.py
test_01_vpc_privategw_acl Success 258.58 test_privategw_acl.py
test_01_primary_storage_nfs Success 38.17 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.56 test_portable_publicip.py
test_isolate_network_password_server Success 94.17 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_oobm_zchange_password Success 30.77 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.48 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.52 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.43 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.38 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.35 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.47 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.31 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.66 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.16 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.09 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.19 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.13 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.10 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.48 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.35 test_non_contigiousvlan.py
test_releaseIP Success 319.40 test_network.py
test_reboot_router Success 697.24 test_network.py
test_public_ip_user_account Success 10.39 test_network.py
test_public_ip_admin_account Success 40.30 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 77.29 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 62.49 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 125.39 test_network.py
test_delete_account Success 298.09 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.76 test_network.py
test_01_port_fwd_on_src_nat Success 111.93 test_network.py
test_nested_virtualization_vmware Success 424.08 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 257.93 test_multipleips_per_nic.py
login_test_saml_user Success 19.23 test_login.py
test_assign_and_removal_lb Success 148.74 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 207.56 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 207.98 test_loadbalance.py
test_07_list_default_iso Success 0.07 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.72 test_iso.py
test_03_delete_iso Success 95.21 test_iso.py
test_02_edit_iso Success 0.06 test_iso.py
test_01_create_iso Success 21.22 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 660.97 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 430.15 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1108.46 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 892.75 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.49 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.38 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.99 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.89 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.91 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.01 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.11 test_dynamicroles.py
test_role_lifecycle_update Success 5.96 test_dynamicroles.py
test_role_lifecycle_list Success 5.89 test_dynamicroles.py
test_role_lifecycle_delete Success 5.92 test_dynamicroles.py
test_role_lifecycle_create Success 5.90 test_dynamicroles.py
test_role_inuse_deletion Success 5.88 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.21 test_dynamicroles.py
test_role_account_acls Success 8.29 test_dynamicroles.py
test_default_role_deletion Success 6.00 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.07 test_disk_offerings.py
test_03_delete_disk_offering Success 0.04 test_disk_offerings.py
test_02_edit_disk_offering Success 0.05 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 60.82 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 96.05 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 226.81 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 70.94 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 156.36 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 5.85 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 5.88 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 6.01 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 232.63 test_deploy_vm_iso.py
test_3d_gpu_support Success 485.11 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 211.85 test_affinity_groups.py
test_08_resize_volume Skipped 10.14 test_volumes.py
test_07_resize_fail Skipped 10.29 test_volumes.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 66.34 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 1.17 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member Author

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-394

@rohityadavcloud
Copy link
Member Author

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-399

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants