Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CLOUDSTACK-9977: Enhance SSL protocol used by Console Proxy #2177

Merged
merged 1 commit into from Jul 27, 2017

Conversation

GabrielBrascher
Copy link
Member

@GabrielBrascher GabrielBrascher commented Jul 12, 2017

Current SSL protocol and ciphers used in SystemVMs are not the recommended. One can verify this with tests such as the one from SSL Labs (https://www.ssllabs.com/ssltest/). The grade was capped to C because of SSL ciphers and protocol. The grade was capped to B because it was allowed to use Diffie-Hellman keys with size lesser than 2048 bits. This commit changes the grade from C to A-.

The following image shows the test result before any changes.
sslreportc

After including the changes from this commit the test result was A-.
sslreporta

@rohityadavcloud
Copy link
Member

rohityadavcloud commented Jul 13, 2017

LGTM :)
@GabrielBrascher can we get a JIRA id for this, and can you use that ID in the git commit message.

@@ -38,6 +38,11 @@
private static final Logger s_logger = Logger.getLogger(ConsoleProxySecureServerFactoryImpl.class);

private SSLContext sslContext = null;
private static String[] SSL_PROTOCOLS = { "TLSv1", "TLSv1.1", "TLSv1.2" };
private static String[] SSL_CIPHERS = { "TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA", "TLS_DHE_RSA_WITH_AES_128_GCM_SHA256", "TLS_DHE_RSA_WITH_AES_128_CBC_SHA256",
"TLS_RSA_WITH_AES_128_GCM_SHA256", "TLS_RSA_WITH_AES_128_CBC_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256", "TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@GabrielBrascher do you think we can get the list of ciphers moved/refactored to SSLUtils and other parts of the system may use it (now or in future?)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will check this approach and provide a feedback soon. Thanks for the hint @rhtyd !

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I transfered those SSL protocols and ciphers to methos getRecommendedProtocols and getRecommendedCiphers in SSLUtils.

@rohityadavcloud
Copy link
Member

Re-kicked travis.
@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✖centos6 ✖centos7 ✖debian. JID-799

@rohityadavcloud
Copy link
Member

@GabrielBrascher check and fix build/packaging/Travis failures

@GabrielBrascher GabrielBrascher changed the title Enhance SSL protocol used by Console Proxy CLOUDSTACK-9977: Enhance SSL protocol used by Console Proxy Jul 13, 2017
@GabrielBrascher
Copy link
Member Author

Thanks for the feedback @rhtyd !
Updated PR with a JIRA id. I will check the jenkins and travis failures.

/**
* It returns recommended protocols that are considered secure.
*/
public static String[] getRecommendedProtocols() {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @GabrielBrascher much better!

Copy link
Member

@rafaelweingartner rafaelweingartner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have to very small comments here @GabrielBrascher

* It returns recommended protocols that are considered secure.
*/
public static String[] getRecommendedProtocols() {
String[] supportedProtocols = { "TLSv1", "TLSv1.1", "TLSv1.2" };
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a little cosmetic, but, how about returning directly the array? Instead of assigning it to a variable first?
Also, what about test cases? I mean, if someone starts using this method because it expected the behavior of returning { "TLSv1", "TLSv1.1", "TLSv1.2" }, but later some other person changes it to return only { "TLSv1.1", "TLSv1.2" }, this might affect people using this method

@GabrielBrascher
Copy link
Member Author

Thanks for the comments @rafaelweingartner. Hope I have addressed them all.


@Test
public void getSupportedProtocolsTest() {
ArrayList<String> protocolsList = new ArrayList<>(Arrays.asList(spySSLUtils.getSupportedProtocols(new String[] { "TLSv1", "TLSv1.1", "TLSv1.2", "SSLv3", "SSLv2Hello" })));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did not understand this test. You are not using the return of the method, but configuring a return.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately, if I did something like the test getRecommendedCiphersTest (with a simple Assert.assertArrayEquals) it would always fail. This method returns an array where the protocols are in a different position of the expected [TLSv1, TLSv1.1, TLSv1.2]. The input is [TLSv1, TLSv1.1, TLSv1.2, SSLv3, SSLv2Hello] but the output is [TLSv1, TLSv1.2, TLSv1.1].

In order to ensure that it will return the expected protocols without caring with their position in the array, I pick the returned array and set as an ArrayList to use the contains method.

Additionally, if someone in the future changes the method getSupportedProtocols and/or getRecommendedProtocols to return a sorted array according to the most recommended protocols (starting from TLSv1.2 then) this test would not fail because it still returning secure protocols.

I can use the returned array and verify all positions without changing the output to an ArrayList.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Aha, my bad. I confused the method "getSupportedProtocols" with "getRecommendedProtocols".
Now I understand what you are doing here.
Everything is just fine +1

Copy link
Member

@rafaelweingartner rafaelweingartner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM


@Test
public void getSupportedProtocolsTest() {
ArrayList<String> protocolsList = new ArrayList<>(Arrays.asList(spySSLUtils.getSupportedProtocols(new String[] { "TLSv1", "TLSv1.1", "TLSv1.2", "SSLv3", "SSLv2Hello" })));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Aha, my bad. I confused the method "getSupportedProtocols" with "getRecommendedProtocols".
Now I understand what you are doing here.
Everything is just fine +1

Copy link
Member

@sateesh-chodapuneedi sateesh-chodapuneedi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, @GabrielBrascher.
Code LGTM

@rohityadavcloud
Copy link
Member

LGTM.

@rohityadavcloud
Copy link
Member

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-819

@rohityadavcloud
Copy link
Member

@blueorangutan test

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-1217)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 30376 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2177-t1217-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Test completed. 50 look ok, 1 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 310.98 test_privategw_acl.py
test_01_vpc_site2site_vpn Success 160.23 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 61.39 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 246.22 test_vpc_vpn.py
test_02_VPC_default_routes Success 298.35 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 451.83 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 524.04 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1399.05 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 550.22 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 744.98 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1285.53 test_vpc_redundant.py
test_09_delete_detached_volume Success 157.01 test_volumes.py
test_08_resize_volume Success 156.79 test_volumes.py
test_07_resize_fail Success 157.04 test_volumes.py
test_06_download_detached_volume Success 156.65 test_volumes.py
test_05_detach_volume Success 140.74 test_volumes.py
test_04_delete_attached_volume Success 151.37 test_volumes.py
test_03_download_attached_volume Success 151.63 test_volumes.py
test_02_attach_volume Success 84.53 test_volumes.py
test_01_create_volume Success 617.34 test_volumes.py
test_03_delete_vm_snapshots Success 275.20 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 100.88 test_vm_snapshots.py
test_01_create_vm_snapshots Success 133.89 test_vm_snapshots.py
test_deploy_vm_multiple Success 297.99 test_vm_life_cycle.py
test_deploy_vm Success 0.04 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.75 test_vm_life_cycle.py
test_09_expunge_vm Success 125.27 test_vm_life_cycle.py
test_08_migrate_vm Success 30.91 test_vm_life_cycle.py
test_07_restore_vm Success 0.13 test_vm_life_cycle.py
test_06_destroy_vm Success 125.84 test_vm_life_cycle.py
test_03_reboot_vm Success 125.91 test_vm_life_cycle.py
test_02_start_vm Success 5.16 test_vm_life_cycle.py
test_01_stop_vm_forced Success 5.15 test_vm_life_cycle.py
test_01_stop_vm Success 30.28 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 115.96 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 5.27 test_templates.py
test_03_delete_template Success 5.14 test_templates.py
test_02_edit_template Success 90.13 test_templates.py
test_01_create_template Success 45.44 test_templates.py
test_10_destroy_cpvm Success 161.72 test_ssvm.py
test_09_destroy_ssvm Success 168.33 test_ssvm.py
test_08_reboot_cpvm Success 101.42 test_ssvm.py
test_07_reboot_ssvm Success 103.10 test_ssvm.py
test_06_stop_cpvm Success 131.46 test_ssvm.py
test_05_stop_ssvm Success 133.24 test_ssvm.py
test_04_cpvm_internals Success 1.01 test_ssvm.py
test_03_ssvm_internals Success 2.91 test_ssvm.py
test_02_list_cpvm_vm Success 0.15 test_ssvm.py
test_01_list_sec_storage_vm Success 0.16 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 86.99 test_snapshots.py
test_01_snapshot_root_disk Success 11.24 test_snapshots.py
test_04_change_offering_small Success 239.77 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.08 test_service_offerings.py
test_01_create_service_offering Success 0.12 test_service_offerings.py
test_02_sys_template_ready Success 0.14 test_secondary_storage.py
test_01_sys_vm_start Success 0.23 test_secondary_storage.py
test_09_reboot_router Success 35.31 test_routers.py
test_08_start_router Success 30.30 test_routers.py
test_07_stop_router Success 10.17 test_routers.py
test_06_router_advanced Success 0.06 test_routers.py
test_05_router_basic Success 0.04 test_routers.py
test_04_restart_network_wo_cleanup Success 5.72 test_routers.py
test_03_restart_network_cleanup Success 65.57 test_routers.py
test_02_router_internal_adv Success 1.09 test_routers.py
test_01_router_internal_basic Success 0.58 test_routers.py
test_router_dns_guestipquery Success 76.90 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 236.75 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.60 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.11 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.97 test_reset_vm_on_reboot.py
test_createRegion Success 0.07 test_regions.py
test_create_pvlan_network Success 5.24 test_pvlan.py
test_dedicatePublicIpRange Success 0.43 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 515.58 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 320.31 test_privategw_acl.py
test_01_vpc_privategw_acl Success 82.39 test_privategw_acl.py
test_03_migration_options_storage_tags Success 161.77 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.11 test_primary_storage.py
test_01_primary_storage_nfs Success 35.87 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 31.27 test_primary_storage.py
test_createPortablePublicIPRange Success 15.21 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 10.48 test_portable_publicip.py
test_isolate_network_password_server Success 89.69 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_oobm_zchange_password Success 30.74 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.37 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.28 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.41 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_on Success 10.32 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.38 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.38 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 77.76 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.24 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.12 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.25 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.17 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.10 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.10 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 29.50 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.57 test_non_contigiousvlan.py
test_01_nic Success 450.36 test_nic.py
test_releaseIP Success 273.50 test_network.py
test_reboot_router Success 399.03 test_network.py
test_public_ip_user_account Success 10.30 test_network.py
test_public_ip_admin_account Success 40.38 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.81 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.72 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 120.79 test_network.py
test_delete_account Success 273.29 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.87 test_network.py
test_01_port_fwd_on_src_nat Success 109.27 test_network.py
test_nic_secondaryip_add_remove Success 208.00 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.28 test_metrics_api.py
test_list_volumes_metrics Success 5.50 test_metrics_api.py
test_list_vms_metrics Success 232.68 test_metrics_api.py
test_list_pstorage_metrics Success 0.59 test_metrics_api.py
test_list_infrastructure_metrics Success 0.85 test_metrics_api.py
test_list_hosts_metrics Success 0.60 test_metrics_api.py
test_list_clusters_metrics Success 0.46 test_metrics_api.py
login_test_saml_user Success 19.53 test_login.py
test_assign_and_removal_lb Success 135.96 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.58 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 219.19 test_loadbalance.py
test_03_list_snapshots Success 0.09 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.04 test_list_ids_parameter.py
test_07_list_default_iso Success 0.12 test_iso.py
test_05_iso_permissions Success 0.10 test_iso.py
test_04_extract_Iso Success 5.33 test_iso.py
test_03_delete_iso Success 95.22 test_iso.py
test_02_edit_iso Success 0.08 test_iso.py
test_01_create_iso Success 21.19 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 223.54 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 147.82 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 504.98 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 414.57 test_internal_lb.py
test_dedicateGuestVlanRange Success 5.43 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.16 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.38 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.16 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.94 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.99 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.14 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.07 test_dynamicroles.py
test_role_lifecycle_update Success 11.11 test_dynamicroles.py
test_role_lifecycle_list Success 5.99 test_dynamicroles.py
test_role_lifecycle_delete Success 10.99 test_dynamicroles.py
test_role_lifecycle_create Success 5.94 test_dynamicroles.py
test_role_inuse_deletion Success 6.10 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.39 test_dynamicroles.py
test_role_account_acls Success 9.04 test_dynamicroles.py
test_default_role_deletion Success 6.27 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.07 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.12 test_disk_offerings.py
test_01_create_disk_offering Success 0.13 test_disk_offerings.py
test_deployvm_userdispersing Success 20.62 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 50.90 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 55.81 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.43 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 86.19 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 0.07 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 0.07 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 206.89 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 202.71 test_deploy_vm_iso.py
test_06_verify_guest_lspci_again Success 40.53 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Success 11.14 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Success 40.53 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Success 10.71 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Success 136.74 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Success 0.60 test_deploy_virtio_scsi_vm.py
test_DeployVmAntiAffinityGroup Success 61.08 test_affinity_groups.py
test_change_service_offering_for_vm_with_snapshots Skipped 0.00 test_vm_snapshots.py
test_09_copy_delete_template Skipped 0.02 test_templates.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.05 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.04 test_deploy_vgpu_enabled_vm.py

@@ -49,10 +66,10 @@
}

public static SSLContext getSSLContext() throws NoSuchAlgorithmException {
return SSLContext.getInstance("TLSv1");
return SSLContext.getInstance("TLSv1.2");
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might break clients (non-browser) for some cases where TLSv1.2 is not supported.

}

public static SSLContext getSSLContext(String provider) throws NoSuchAlgorithmException, NoSuchProviderException {
return SSLContext.getInstance("TLSv1", provider);
return SSLContext.getInstance("TLSv1.2", provider);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might break clients (non-browser) for some cases where TLSv1.2 is not supported.

@rohityadavcloud
Copy link
Member

@blueorangutan test centos7 vmware55u3

@blueorangutan
Copy link

@rhtyd unsupported parameters provided. Supported mgmt server os are: centos6, centos7, ubuntu. Supported hypervisors are: kvm-centos6, kvm-centos7, kvm-ubuntu, xenserver-65sp1, xenserver-62sp1, vmware-60u2, vmware-55u3, vmware-51u1, vmware-50u1

@rohityadavcloud
Copy link
Member

@blueorangutan test centos7 vmware-55u3

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins test job (centos7 mgmt + vmware-55u3) has been kicked to run smoke tests

@wido
Copy link
Contributor

wido commented Jul 24, 2017

LGTM!

I think that any client that doesn't support TLSv1.2 shouldn't be out there anyway.

@rohityadavcloud
Copy link
Member

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-857

@blueorangutan
Copy link

Trillian test result (tid-1242)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 54791 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2177-t1242-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_vm_root_resize.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Test completed. 48 look ok, 4 have error(s)

Test Result Time (s) Test File
test_01_create_volume Failure 212.70 test_volumes.py
test_04_rvpc_privategw_static_routes Failure 1072.23 test_privategw_acl.py
ContextSuite context=TestDeployVmRootSize>:setup Error 0.00 test_deploy_vm_root_resize.py
test_01_vpc_site2site_vpn Success 498.81 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 257.89 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 897.81 test_vpc_vpn.py
test_02_VPC_default_routes Success 546.66 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 1084.88 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 811.76 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1627.48 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 914.59 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 801.53 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1552.65 test_vpc_redundant.py
test_09_delete_detached_volume Success 42.74 test_volumes.py
test_06_download_detached_volume Success 136.36 test_volumes.py
test_05_detach_volume Success 110.50 test_volumes.py
test_04_delete_attached_volume Success 20.31 test_volumes.py
test_03_download_attached_volume Success 25.39 test_volumes.py
test_02_attach_volume Success 77.89 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 779.76 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 285.35 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 232.68 test_vm_snapshots.py
test_01_create_vm_snapshots Success 166.83 test_vm_snapshots.py
test_deploy_vm_multiple Success 404.46 test_vm_life_cycle.py
test_deploy_vm Success 0.03 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.15 test_vm_life_cycle.py
test_09_expunge_vm Success 125.29 test_vm_life_cycle.py
test_08_migrate_vm Success 96.72 test_vm_life_cycle.py
test_07_restore_vm Success 0.14 test_vm_life_cycle.py
test_06_destroy_vm Success 10.28 test_vm_life_cycle.py
test_03_reboot_vm Success 10.26 test_vm_life_cycle.py
test_02_start_vm Success 30.50 test_vm_life_cycle.py
test_01_stop_vm_forced Success 5.27 test_vm_life_cycle.py
test_01_stop_vm Success 10.23 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 659.86 test_templates.py
test_08_list_system_templates Success 0.04 test_templates.py
test_07_list_public_templates Success 0.06 test_templates.py
test_05_template_permissions Success 0.10 test_templates.py
test_04_extract_template Success 50.74 test_templates.py
test_03_delete_template Success 5.15 test_templates.py
test_02_edit_template Success 90.17 test_templates.py
test_01_create_template Success 574.76 test_templates.py
test_10_destroy_cpvm Success 292.31 test_ssvm.py
test_09_destroy_ssvm Success 359.61 test_ssvm.py
test_08_reboot_cpvm Success 187.07 test_ssvm.py
test_07_reboot_ssvm Success 189.44 test_ssvm.py
test_06_stop_cpvm Success 237.26 test_ssvm.py
test_05_stop_ssvm Success 239.75 test_ssvm.py
test_04_cpvm_internals Success 1.53 test_ssvm.py
test_03_ssvm_internals Success 5.40 test_ssvm.py
test_02_list_cpvm_vm Success 0.17 test_ssvm.py
test_01_list_sec_storage_vm Success 0.21 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 352.31 test_snapshots.py
test_01_snapshot_root_disk Success 41.98 test_snapshots.py
test_04_change_offering_small Success 127.51 test_service_offerings.py
test_03_delete_service_offering Success 0.09 test_service_offerings.py
test_02_edit_service_offering Success 0.16 test_service_offerings.py
test_01_create_service_offering Success 0.12 test_service_offerings.py
test_02_sys_template_ready Success 0.16 test_secondary_storage.py
test_01_sys_vm_start Success 0.21 test_secondary_storage.py
test_09_reboot_router Success 236.94 test_routers.py
test_08_start_router Success 216.69 test_routers.py
test_07_stop_router Success 25.29 test_routers.py
test_06_router_advanced Success 0.08 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.75 test_routers.py
test_03_restart_network_cleanup Success 292.68 test_routers.py
test_02_router_internal_adv Success 2.21 test_routers.py
test_01_router_internal_basic Success 0.66 test_routers.py
test_router_dns_guestipquery Success 77.45 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 149.79 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.76 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.12 test_resource_detail.py
test_01_reset_vm_on_reboot Success 40.61 test_reset_vm_on_reboot.py
test_createRegion Success 0.10 test_regions.py
test_create_pvlan_network Success 5.30 test_pvlan.py
test_dedicatePublicIpRange Success 0.72 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1160.25 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 703.45 test_privategw_acl.py
test_01_vpc_privategw_acl Success 202.95 test_privategw_acl.py
test_03_migration_options_storage_tags Success 38.64 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.13 test_primary_storage.py
test_01_primary_storage_nfs Success 37.54 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 51.75 test_primary_storage.py
test_createPortablePublicIPRange Success 15.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 20.60 test_portable_publicip.py
test_isolate_network_password_server Success 92.88 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.13 test_over_provisioning.py
test_oobm_zchange_password Success 25.69 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.59 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.26 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.58 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.39 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.36 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.36 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.37 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 82.61 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.15 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.21 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.08 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 18.39 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.29 test_non_contigiousvlan.py
test_01_nic Success 570.53 test_nic.py
test_releaseIP Success 338.85 test_network.py
test_reboot_router Success 680.61 test_network.py
test_public_ip_user_account Success 10.30 test_network.py
test_public_ip_admin_account Success 40.35 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.73 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.62 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.06 test_network.py
test_delete_account Success 429.01 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.91 test_network.py
test_01_port_fwd_on_src_nat Success 111.90 test_network.py
test_nested_virtualization_vmware Success 449.32 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 293.31 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.36 test_metrics_api.py
test_list_volumes_metrics Success 5.51 test_metrics_api.py
test_list_vms_metrics Success 262.16 test_metrics_api.py
test_list_pstorage_metrics Success 0.30 test_metrics_api.py
test_list_infrastructure_metrics Success 0.38 test_metrics_api.py
test_list_hosts_metrics Success 0.36 test_metrics_api.py
test_list_clusters_metrics Success 0.34 test_metrics_api.py
login_test_saml_user Success 19.31 test_login.py
test_assign_and_removal_lb Success 134.74 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.47 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 188.86 test_loadbalance.py
test_03_list_snapshots Success 0.08 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.09 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.39 test_iso.py
test_03_delete_iso Success 95.19 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 20.96 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 650.59 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 474.46 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1148.46 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 876.83 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.30 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.19 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.97 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.95 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.90 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.07 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.95 test_dynamicroles.py
test_role_lifecycle_update Success 11.13 test_dynamicroles.py
test_role_lifecycle_list Success 5.92 test_dynamicroles.py
test_role_lifecycle_delete Success 10.96 test_dynamicroles.py
test_role_lifecycle_create Success 5.93 test_dynamicroles.py
test_role_inuse_deletion Success 5.86 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 8.43 test_dynamicroles.py
test_role_account_acls Success 8.49 test_dynamicroles.py
test_default_role_deletion Success 6.35 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.08 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.08 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.12 test_disk_offerings.py
test_deployvm_userdispersing Success 81.10 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 116.51 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 201.62 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 35.57 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 171.47 test_deploy_vm_with_userdata.py
test_deploy_vm_from_iso Success 252.93 test_deploy_vm_iso.py
test_3d_gpu_support Success 586.06 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 398.56 test_affinity_groups.py
test_08_resize_volume Skipped 10.17 test_volumes.py
test_07_resize_fail Skipped 10.26 test_volumes.py
test_09_copy_delete_template Skipped 0.02 test_templates.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.03 test_ssvm.py
test_01_scale_vm Skipped 66.53 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_06_verify_guest_lspci_again Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm Skipped 1.32 test_deploy_vgpu_enabled_vm.py

Current SSL protocol and ciphers used in SystemVMs are not the
recommended. To analyze it is possible to use tests such as from SSL
Labs (https://www.ssllabs.com/ssltest/). This commit changes the grade
from C to -A
@cloudmonger
Copy link

ACS CI BVT Run

Sumarry:
Build Number 1010
Hypervisor xenserver
NetworkType Advanced
Passed=106
Failed=7
Skipped=12

Link to logs Folder (search by build_no): https://www.dropbox.com/sh/r2si930m8xxzavs/AAAzNrnoF1fC3auFrvsKo_8-a?dl=0

Failed tests:

  • test_deploy_vm_iso.py

  • test_deploy_vm_from_iso Failing since 66 runs

  • test_volumes.py

  • test_06_download_detached_volume Failed

  • test_vm_life_cycle.py

  • test_10_attachAndDetach_iso Failing since 66 runs

  • test_routers_network_ops.py

  • test_01_isolate_network_FW_PF_default_routes_egress_true Failing since 99 runs

  • test_02_isolate_network_FW_PF_default_routes_egress_false Failing since 99 runs

  • test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true Failing since 97 runs

  • test_02_RVR_Network_FW_PF_SSH_default_routes_egress_false Failing since 97 runs

Skipped tests:
test_vm_nic_adapter_vmxnet3
test_01_verify_libvirt
test_02_verify_libvirt_after_restart
test_03_verify_libvirt_attach_disk
test_04_verify_guest_lspci
test_05_change_vm_ostype_restart
test_06_verify_guest_lspci_again
test_static_role_account_acls
test_11_ss_nfs_version_on_ssvm
test_nested_virtualization_vmware
test_3d_gpu_support
test_deploy_vgpu_enabled_vm

Passed test suits:
test_deploy_vm_with_userdata.py
test_affinity_groups_projects.py
test_portable_publicip.py
test_vm_snapshots.py
test_over_provisioning.py
test_global_settings.py
test_scale_vm.py
test_service_offerings.py
test_routers_iptables_default_policy.py
test_loadbalance.py
test_routers.py
test_reset_vm_on_reboot.py
test_deploy_vms_with_varied_deploymentplanners.py
test_network.py
test_router_dns.py
test_non_contigiousvlan.py
test_login.py
test_list_ids_parameter.py
test_public_ip_range.py
test_multipleips_per_nic.py
test_metrics_api.py
test_regions.py
test_affinity_groups.py
test_network_acl.py
test_pvlan.py
test_nic.py
test_deploy_vm_root_resize.py
test_resource_detail.py
test_secondary_storage.py
test_disk_offerings.py

@rohityadavcloud
Copy link
Member

@blueorangutan package

@blueorangutan
Copy link

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Copy link
Member

@rohityadavcloud rohityadavcloud left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, I see some failures -- will kick a test matrix on xen+kvm+vmware to rule our regressions.

@blueorangutan
Copy link

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-860

@rohityadavcloud
Copy link
Member

@blueorangutan test matrix

@blueorangutan
Copy link

@rhtyd a Trillian-Jenkins matrix job (centos6 mgmt + xs65sp1, centos7 mgmt + vmware55u3, centos7 mgmt + kvmcentos7) has been kicked to run smoke tests

@blueorangutan
Copy link

Trillian test result (tid-1251)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 6
Total time taken: 36981 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2177-t1251-xenserver-65sp1.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 49 look ok, 2 have error(s)

Test Result Time (s) Test File
test_05_rvpc_multi_tiers Failure 361.71 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Failure 1274.56 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Failure 368.72 test_vpc_redundant.py
test_04_rvpc_privategw_static_routes Failure 546.07 test_privategw_acl.py
test_01_vpc_site2site_vpn Success 244.93 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 121.19 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 405.77 test_vpc_vpn.py
test_02_VPC_default_routes Success 248.42 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 555.20 test_vpc_router_nics.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 691.83 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 907.29 test_vpc_redundant.py
test_09_delete_detached_volume Success 15.53 test_volumes.py
test_08_resize_volume Success 75.69 test_volumes.py
test_07_resize_fail Success 90.76 test_volumes.py
test_06_download_detached_volume Success 20.32 test_volumes.py
test_05_detach_volume Success 100.27 test_volumes.py
test_04_delete_attached_volume Success 10.20 test_volumes.py
test_03_download_attached_volume Success 10.24 test_volumes.py
test_02_attach_volume Success 43.77 test_volumes.py
test_01_create_volume Success 392.27 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 356.73 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 280.24 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 209.16 test_vm_snapshots.py
test_01_create_vm_snapshots Success 133.75 test_vm_snapshots.py
test_deploy_vm_multiple Success 176.83 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.02 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.83 test_vm_life_cycle.py
test_09_expunge_vm Success 125.29 test_vm_life_cycle.py
test_08_migrate_vm Success 80.98 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 15.19 test_vm_life_cycle.py
test_03_reboot_vm Success 15.18 test_vm_life_cycle.py
test_02_start_vm Success 15.20 test_vm_life_cycle.py
test_01_stop_vm_forced Success 5.13 test_vm_life_cycle.py
test_01_stop_vm Success 30.28 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 80.67 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.13 test_templates.py
test_03_delete_template Success 5.08 test_templates.py
test_02_edit_template Success 90.06 test_templates.py
test_01_create_template Success 40.39 test_templates.py
test_10_destroy_cpvm Success 191.60 test_ssvm.py
test_09_destroy_ssvm Success 168.75 test_ssvm.py
test_08_reboot_cpvm Success 136.59 test_ssvm.py
test_07_reboot_ssvm Success 138.59 test_ssvm.py
test_06_stop_cpvm Success 161.63 test_ssvm.py
test_05_stop_ssvm Success 133.57 test_ssvm.py
test_04_cpvm_internals Success 1.15 test_ssvm.py
test_03_ssvm_internals Success 3.51 test_ssvm.py
test_02_list_cpvm_vm Success 0.10 test_ssvm.py
test_01_list_sec_storage_vm Success 0.11 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 109.18 test_snapshots.py
test_01_snapshot_root_disk Success 21.27 test_snapshots.py
test_04_change_offering_small Success 58.91 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.04 test_service_offerings.py
test_01_create_service_offering Success 0.07 test_service_offerings.py
test_02_sys_template_ready Success 0.11 test_secondary_storage.py
test_01_sys_vm_start Success 0.16 test_secondary_storage.py
test_01_scale_vm Success 5.14 test_scale_vm.py
test_09_reboot_router Success 45.31 test_routers.py
test_08_start_router Success 35.27 test_routers.py
test_07_stop_router Success 10.14 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.58 test_routers.py
test_03_restart_network_cleanup Success 95.66 test_routers.py
test_02_router_internal_adv Success 0.94 test_routers.py
test_01_router_internal_basic Success 0.54 test_routers.py
test_router_dns_guestipquery Success 43.74 test_router_dns.py
test_router_dns_externalipquery Success 0.04 test_router_dns.py
test_router_dhcphosts Success 135.73 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.42 test_router_dhcphosts.py
test_01_updatevolumedetail Success 0.08 test_resource_detail.py
test_01_reset_vm_on_reboot Success 55.41 test_reset_vm_on_reboot.py
test_createRegion Success 0.06 test_regions.py
test_create_pvlan_network Success 5.27 test_pvlan.py
test_dedicatePublicIpRange Success 0.43 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 745.50 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 465.11 test_privategw_acl.py
test_01_vpc_privategw_acl Success 112.06 test_privategw_acl.py
test_03_migration_options_storage_tags Success 37.56 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.10 test_primary_storage.py
test_01_primary_storage_nfs Success 37.69 test_primary_storage.py
test_01_primary_storage_iscsi Success 73.75 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 25.99 test_primary_storage.py
test_createPortablePublicIPRange Success 15.18 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.38 test_portable_publicip.py
test_isolate_network_password_server Success 27.24 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.11 test_over_provisioning.py
test_oobm_zchange_password Success 30.65 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.42 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.31 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 10.32 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.33 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.39 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.32 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.34 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 87.52 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 0.13 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 0.15 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.10 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.07 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.07 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 18.41 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.36 test_non_contigiousvlan.py
test_01_nic Success 509.22 test_nic.py
test_releaseIP Success 242.61 test_network.py
test_reboot_router Success 448.56 test_network.py
test_public_ip_user_account Success 10.23 test_network.py
test_public_ip_admin_account Success 40.29 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 71.61 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.76 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 91.40 test_network.py
test_delete_account Success 207.08 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.60 test_network.py
test_01_port_fwd_on_src_nat Success 78.74 test_network.py
test_nic_secondaryip_add_remove Success 172.09 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.24 test_metrics_api.py
test_list_volumes_metrics Success 5.46 test_metrics_api.py
test_list_vms_metrics Success 96.01 test_metrics_api.py
test_list_pstorage_metrics Success 0.26 test_metrics_api.py
test_list_infrastructure_metrics Success 0.38 test_metrics_api.py
test_list_hosts_metrics Success 0.27 test_metrics_api.py
test_list_clusters_metrics Success 0.36 test_metrics_api.py
login_test_saml_user Success 18.04 test_login.py
test_assign_and_removal_lb Success 134.55 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.63 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 194.13 test_loadbalance.py
test_03_list_snapshots Success 0.05 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.03 test_list_ids_parameter.py
test_07_list_default_iso Success 0.05 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.12 test_iso.py
test_03_delete_iso Success 95.18 test_iso.py
test_02_edit_iso Success 0.04 test_iso.py
test_01_create_iso Success 20.78 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 348.48 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 217.56 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 754.93 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 563.80 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.30 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.14 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.86 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.73 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.64 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.84 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.92 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.80 test_dynamicroles.py
test_role_lifecycle_update Success 5.85 test_dynamicroles.py
test_role_lifecycle_list Success 5.81 test_dynamicroles.py
test_role_lifecycle_delete Success 10.75 test_dynamicroles.py
test_role_lifecycle_create Success 5.72 test_dynamicroles.py
test_role_inuse_deletion Success 5.65 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 7.29 test_dynamicroles.py
test_role_account_acls Success 7.41 test_dynamicroles.py
test_default_role_deletion Success 5.83 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.10 test_disk_offerings.py
test_03_delete_disk_offering Success 0.08 test_disk_offerings.py
test_02_edit_disk_offering Success 0.07 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.12 test_disk_offerings.py
test_01_create_disk_offering Success 0.09 test_disk_offerings.py
test_deployvm_userdispersing Success 85.92 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 30.56 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 146.22 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 15.36 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 90.88 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 0.04 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 0.05 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 181.81 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 126.71 test_deploy_vm_iso.py
test_DeployVmAntiAffinityGroup Success 111.16 test_affinity_groups.py
test_09_copy_delete_template Skipped 0.05 test_templates.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.02 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.02 test_ssvm.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_06_verify_guest_lspci_again Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm Skipped 0.03 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.03 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-1252)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36665 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2177-t1252-kvm-centos7.zip
Intermitten failure detected: /marvin/tests/smoke/test_deploy_virtio_scsi_vm.py
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 50 look ok, 1 have error(s)

Test Result Time (s) Test File
test_04_rvpc_privategw_static_routes Failure 349.06 test_privategw_acl.py
test_01_vpc_site2site_vpn Success 163.97 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 65.75 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 234.25 test_vpc_vpn.py
test_02_VPC_default_routes Success 257.63 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 503.17 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 497.26 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1396.08 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 540.25 test_vpc_redundant.py
test_02_redundant_VPC_default_routes Success 740.29 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1309.39 test_vpc_redundant.py
test_09_delete_detached_volume Success 151.03 test_volumes.py
test_08_resize_volume Success 155.98 test_volumes.py
test_07_resize_fail Success 160.97 test_volumes.py
test_06_download_detached_volume Success 155.89 test_volumes.py
test_05_detach_volume Success 155.59 test_volumes.py
test_04_delete_attached_volume Success 150.80 test_volumes.py
test_03_download_attached_volume Success 155.92 test_volumes.py
test_02_attach_volume Success 90.90 test_volumes.py
test_01_create_volume Success 711.61 test_volumes.py
test_03_delete_vm_snapshots Success 275.13 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 100.70 test_vm_snapshots.py
test_01_create_vm_snapshots Success 163.91 test_vm_snapshots.py
test_deploy_vm_multiple Success 271.98 test_vm_life_cycle.py
test_deploy_vm Success 0.02 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.01 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 26.74 test_vm_life_cycle.py
test_09_expunge_vm Success 125.14 test_vm_life_cycle.py
test_08_migrate_vm Success 30.54 test_vm_life_cycle.py
test_07_restore_vm Success 0.08 test_vm_life_cycle.py
test_06_destroy_vm Success 125.62 test_vm_life_cycle.py
test_03_reboot_vm Success 130.62 test_vm_life_cycle.py
test_02_start_vm Success 10.11 test_vm_life_cycle.py
test_01_stop_vm_forced Success 5.09 test_vm_life_cycle.py
test_01_stop_vm Success 35.22 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 100.59 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.03 test_templates.py
test_05_template_permissions Success 0.05 test_templates.py
test_04_extract_template Success 5.15 test_templates.py
test_03_delete_template Success 5.11 test_templates.py
test_02_edit_template Success 90.15 test_templates.py
test_01_create_template Success 130.69 test_templates.py
test_10_destroy_cpvm Success 191.38 test_ssvm.py
test_09_destroy_ssvm Success 163.14 test_ssvm.py
test_08_reboot_cpvm Success 131.62 test_ssvm.py
test_07_reboot_ssvm Success 138.53 test_ssvm.py
test_06_stop_cpvm Success 161.93 test_ssvm.py
test_05_stop_ssvm Success 164.71 test_ssvm.py
test_04_cpvm_internals Success 1.26 test_ssvm.py
test_03_ssvm_internals Success 3.79 test_ssvm.py
test_02_list_cpvm_vm Success 0.08 test_ssvm.py
test_01_list_sec_storage_vm Success 0.09 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 81.51 test_snapshots.py
test_01_snapshot_root_disk Success 16.00 test_snapshots.py
test_04_change_offering_small Success 204.25 test_service_offerings.py
test_03_delete_service_offering Success 0.03 test_service_offerings.py
test_02_edit_service_offering Success 0.05 test_service_offerings.py
test_01_create_service_offering Success 0.08 test_service_offerings.py
test_02_sys_template_ready Success 0.07 test_secondary_storage.py
test_01_sys_vm_start Success 0.11 test_secondary_storage.py
test_09_reboot_router Success 35.23 test_routers.py
test_08_start_router Success 25.19 test_routers.py
test_07_stop_router Success 10.13 test_routers.py
test_06_router_advanced Success 0.04 test_routers.py
test_05_router_basic Success 0.03 test_routers.py
test_04_restart_network_wo_cleanup Success 5.59 test_routers.py
test_03_restart_network_cleanup Success 55.34 test_routers.py
test_02_router_internal_adv Success 1.05 test_routers.py
test_01_router_internal_basic Success 0.67 test_routers.py
test_router_dns_guestipquery Success 73.68 test_router_dns.py
test_router_dns_externalipquery Success 0.06 test_router_dns.py
test_router_dhcphosts Success 271.12 test_router_dhcphosts.py
test_router_dhcp_opts Success 21.64 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.09 test_resource_detail.py
test_01_reset_vm_on_reboot Success 130.66 test_reset_vm_on_reboot.py
test_createRegion Success 0.03 test_regions.py
test_create_pvlan_network Success 5.16 test_pvlan.py
test_dedicatePublicIpRange Success 0.29 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 503.28 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 363.34 test_privategw_acl.py
test_01_vpc_privategw_acl Success 91.48 test_privategw_acl.py
test_03_migration_options_storage_tags Success 161.26 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.06 test_primary_storage.py
test_01_primary_storage_nfs Success 35.66 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 30.69 test_primary_storage.py
test_createPortablePublicIPRange Success 15.13 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.29 test_portable_publicip.py
test_isolate_network_password_server Success 90.47 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.08 test_over_provisioning.py
test_oobm_zchange_password Success 30.51 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.24 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.16 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.26 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.22 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.23 test_outofbandmanagement.py
test_oobm_issue_power_off Success 15.22 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 10.24 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 92.07 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.11 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 5.08 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.13 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.07 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.06 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.05 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.27 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.25 test_non_contigiousvlan.py
test_01_nic Success 412.90 test_nic.py
test_releaseIP Success 236.94 test_network.py
test_reboot_router Success 382.64 test_network.py
test_public_ip_user_account Success 10.20 test_network.py
test_public_ip_admin_account Success 40.20 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 66.36 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.38 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 123.24 test_network.py
test_delete_account Success 261.89 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.47 test_network.py
test_01_port_fwd_on_src_nat Success 109.66 test_network.py
test_nic_secondaryip_add_remove Success 232.01 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.17 test_metrics_api.py
test_list_volumes_metrics Success 5.30 test_metrics_api.py
test_list_vms_metrics Success 176.16 test_metrics_api.py
test_list_pstorage_metrics Success 0.21 test_metrics_api.py
test_list_infrastructure_metrics Success 0.27 test_metrics_api.py
test_list_hosts_metrics Success 0.23 test_metrics_api.py
test_list_clusters_metrics Success 0.21 test_metrics_api.py
login_test_saml_user Success 17.75 test_login.py
test_assign_and_removal_lb Success 134.00 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 187.36 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 198.45 test_loadbalance.py
test_03_list_snapshots Success 0.05 test_list_ids_parameter.py
test_02_list_templates Success 0.03 test_list_ids_parameter.py
test_01_list_volumes Success 0.02 test_list_ids_parameter.py
test_07_list_default_iso Success 0.04 test_iso.py
test_05_iso_permissions Success 0.04 test_iso.py
test_04_extract_Iso Success 5.13 test_iso.py
test_03_delete_iso Success 95.17 test_iso.py
test_02_edit_iso Success 0.05 test_iso.py
test_01_create_iso Success 20.65 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 202.03 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 141.79 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 471.90 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 434.68 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.18 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.09 test_global_settings.py
test_rolepermission_lifecycle_update Success 5.89 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 5.64 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 5.56 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 5.58 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 5.70 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 5.59 test_dynamicroles.py
test_role_lifecycle_update Success 10.64 test_dynamicroles.py
test_role_lifecycle_list Success 5.58 test_dynamicroles.py
test_role_lifecycle_delete Success 10.60 test_dynamicroles.py
test_role_lifecycle_create Success 5.59 test_dynamicroles.py
test_role_inuse_deletion Success 5.57 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 6.98 test_dynamicroles.py
test_role_account_acls Success 7.42 test_dynamicroles.py
test_default_role_deletion Success 5.65 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.04 test_disk_offerings.py
test_03_delete_disk_offering Success 0.03 test_disk_offerings.py
test_02_edit_disk_offering Success 0.03 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.04 test_disk_offerings.py
test_01_create_disk_offering Success 0.08 test_disk_offerings.py
test_deployvm_userdispersing Success 20.38 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 55.56 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 80.61 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 10.33 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 150.94 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 0.04 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 0.04 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 226.23 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 216.72 test_deploy_vm_iso.py
test_06_verify_guest_lspci_again Success 34.17 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Success 16.08 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Success 40.47 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Success 10.63 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Success 136.16 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Success 0.56 test_deploy_virtio_scsi_vm.py
test_DeployVmAntiAffinityGroup Success 70.70 test_affinity_groups.py
test_change_service_offering_for_vm_with_snapshots Skipped 0.00 test_vm_snapshots.py
test_09_copy_delete_template Skipped 0.01 test_templates.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.01 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.01 test_ssvm.py
test_01_scale_vm Skipped 0.00 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.02 test_primary_storage.py
test_nested_virtualization_vmware Skipped 0.00 test_nested_virtualization.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_deploy_vgpu_enabled_vm Skipped 0.02 test_deploy_vgpu_enabled_vm.py
test_3d_gpu_support Skipped 0.02 test_deploy_vgpu_enabled_vm.py

@blueorangutan
Copy link

Trillian test result (tid-1253)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 50326 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr2177-t1253-vmware-55u3.zip
Intermitten failure detected: /marvin/tests/smoke/test_privategw_acl.py
Intermitten failure detected: /marvin/tests/smoke/test_routers_network_ops.py
Intermitten failure detected: /marvin/tests/smoke/test_vm_life_cycle.py
Intermitten failure detected: /marvin/tests/smoke/test_volumes.py
Intermitten failure detected: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 48 look ok, 4 have error(s)

Test Result Time (s) Test File
test_02_redundant_VPC_default_routes Failure 616.16 test_vpc_redundant.py
test_01_create_volume Failure 193.76 test_volumes.py
test_04_rvpc_privategw_static_routes Failure 1012.18 test_privategw_acl.py
test_06_download_detached_volume Error 100.91 test_volumes.py
test_01_vpc_site2site_vpn Success 387.00 test_vpc_vpn.py
test_01_vpc_remote_access_vpn Success 268.11 test_vpc_vpn.py
test_01_redundant_vpc_site2site_vpn Success 790.00 test_vpc_vpn.py
test_02_VPC_default_routes Success 381.16 test_vpc_router_nics.py
test_01_VPC_nics_after_destroy Success 749.61 test_vpc_router_nics.py
test_05_rvpc_multi_tiers Success 542.75 test_vpc_redundant.py
test_04_rvpc_network_garbage_collector_nics Success 1588.62 test_vpc_redundant.py
test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers Success 831.19 test_vpc_redundant.py
test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL Success 1204.55 test_vpc_redundant.py
test_09_delete_detached_volume Success 26.04 test_volumes.py
test_05_detach_volume Success 110.36 test_volumes.py
test_04_delete_attached_volume Success 20.27 test_volumes.py
test_03_download_attached_volume Success 25.35 test_volumes.py
test_02_attach_volume Success 58.86 test_volumes.py
test_change_service_offering_for_vm_with_snapshots Success 483.15 test_vm_snapshots.py
test_03_delete_vm_snapshots Success 280.26 test_vm_snapshots.py
test_02_revert_vm_snapshots Success 234.51 test_vm_snapshots.py
test_01_create_vm_snapshots Success 162.06 test_vm_snapshots.py
test_deploy_vm_multiple Success 232.84 test_vm_life_cycle.py
test_deploy_vm Success 0.04 test_vm_life_cycle.py
test_advZoneVirtualRouter Success 0.03 test_vm_life_cycle.py
test_10_attachAndDetach_iso Success 27.00 test_vm_life_cycle.py
test_09_expunge_vm Success 125.28 test_vm_life_cycle.py
test_08_migrate_vm Success 66.27 test_vm_life_cycle.py
test_07_restore_vm Success 0.10 test_vm_life_cycle.py
test_06_destroy_vm Success 10.16 test_vm_life_cycle.py
test_03_reboot_vm Success 5.16 test_vm_life_cycle.py
test_02_start_vm Success 20.26 test_vm_life_cycle.py
test_01_stop_vm_forced Success 5.18 test_vm_life_cycle.py
test_01_stop_vm Success 10.17 test_vm_life_cycle.py
test_CreateTemplateWithDuplicateName Success 398.24 test_templates.py
test_08_list_system_templates Success 0.03 test_templates.py
test_07_list_public_templates Success 0.04 test_templates.py
test_05_template_permissions Success 0.06 test_templates.py
test_04_extract_template Success 15.29 test_templates.py
test_03_delete_template Success 5.12 test_templates.py
test_02_edit_template Success 90.18 test_templates.py
test_01_create_template Success 271.93 test_templates.py
test_10_destroy_cpvm Success 292.14 test_ssvm.py
test_09_destroy_ssvm Success 274.15 test_ssvm.py
test_08_reboot_cpvm Success 156.64 test_ssvm.py
test_07_reboot_ssvm Success 218.87 test_ssvm.py
test_06_stop_cpvm Success 202.14 test_ssvm.py
test_05_stop_ssvm Success 234.34 test_ssvm.py
test_04_cpvm_internals Success 1.33 test_ssvm.py
test_03_ssvm_internals Success 4.24 test_ssvm.py
test_02_list_cpvm_vm Success 0.14 test_ssvm.py
test_01_list_sec_storage_vm Success 0.14 test_ssvm.py
test_02_list_snapshots_with_removed_data_store Success 233.36 test_snapshots.py
test_01_snapshot_root_disk Success 71.62 test_snapshots.py
test_04_change_offering_small Success 98.09 test_service_offerings.py
test_03_delete_service_offering Success 0.04 test_service_offerings.py
test_02_edit_service_offering Success 0.10 test_service_offerings.py
test_01_create_service_offering Success 0.10 test_service_offerings.py
test_02_sys_template_ready Success 0.15 test_secondary_storage.py
test_01_sys_vm_start Success 0.25 test_secondary_storage.py
test_09_reboot_router Success 171.28 test_routers.py
test_08_start_router Success 156.11 test_routers.py
test_07_stop_router Success 25.30 test_routers.py
test_06_router_advanced Success 0.07 test_routers.py
test_05_router_basic Success 0.05 test_routers.py
test_04_restart_network_wo_cleanup Success 5.71 test_routers.py
test_03_restart_network_cleanup Success 161.34 test_routers.py
test_02_router_internal_adv Success 1.31 test_routers.py
test_01_router_internal_basic Success 0.69 test_routers.py
test_router_dns_guestipquery Success 77.33 test_router_dns.py
test_router_dns_externalipquery Success 0.09 test_router_dns.py
test_router_dhcphosts Success 144.91 test_router_dhcphosts.py
test_router_dhcp_opts Success 22.00 test_router_dhcphosts.py
test_01_updatevolumedetail Success 5.12 test_resource_detail.py
test_01_reset_vm_on_reboot Success 35.44 test_reset_vm_on_reboot.py
test_createRegion Success 0.05 test_regions.py
test_create_pvlan_network Success 5.44 test_pvlan.py
test_dedicatePublicIpRange Success 0.79 test_public_ip_range.py
test_03_vpc_privategw_restart_vpc_cleanup Success 1152.19 test_privategw_acl.py
test_02_vpc_privategw_static_routes Success 794.77 test_privategw_acl.py
test_01_vpc_privategw_acl Success 279.12 test_privategw_acl.py
test_03_migration_options_storage_tags Success 39.05 test_primary_storage.py
test_02_edit_primary_storage_tags Success 0.14 test_primary_storage.py
test_01_primary_storage_nfs Success 37.96 test_primary_storage.py
test_01_deploy_vms_storage_tags Success 52.05 test_primary_storage.py
test_createPortablePublicIPRange Success 10.19 test_portable_publicip.py
test_createPortablePublicIPAcquire Success 15.67 test_portable_publicip.py
test_isolate_network_password_server Success 92.74 test_password_server.py
test_UpdateStorageOverProvisioningFactor Success 0.16 test_over_provisioning.py
test_oobm_zchange_password Success 30.86 test_outofbandmanagement.py
test_oobm_multiple_mgmt_server_ownership Success 16.52 test_outofbandmanagement.py
test_oobm_issue_power_status Success 10.39 test_outofbandmanagement.py
test_oobm_issue_power_soft Success 15.44 test_outofbandmanagement.py
test_oobm_issue_power_reset Success 15.47 test_outofbandmanagement.py
test_oobm_issue_power_on Success 15.63 test_outofbandmanagement.py
test_oobm_issue_power_off Success 10.52 test_outofbandmanagement.py
test_oobm_issue_power_cycle Success 15.55 test_outofbandmanagement.py
test_oobm_enabledisable_across_clusterzones Success 93.10 test_outofbandmanagement.py
test_oobm_enable_feature_valid Success 5.19 test_outofbandmanagement.py
test_oobm_enable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_disable_feature_valid Success 5.20 test_outofbandmanagement.py
test_oobm_disable_feature_invalid Success 0.11 test_outofbandmanagement.py
test_oobm_configure_invalid_driver Success 0.09 test_outofbandmanagement.py
test_oobm_configure_default_driver Success 0.09 test_outofbandmanagement.py
test_oobm_background_powerstate_sync Success 23.49 test_outofbandmanagement.py
test_extendPhysicalNetworkVlan Success 15.35 test_non_contigiousvlan.py
test_01_nic Success 578.10 test_nic.py
test_releaseIP Success 299.38 test_network.py
test_reboot_router Success 606.03 test_network.py
test_public_ip_user_account Success 10.34 test_network.py
test_public_ip_admin_account Success 40.36 test_network.py
test_network_rules_acquired_public_ip_3_Load_Balancer_Rule Success 67.20 test_network.py
test_network_rules_acquired_public_ip_2_nat_rule Success 61.92 test_network.py
test_network_rules_acquired_public_ip_1_static_nat_rule Success 124.25 test_network.py
test_delete_account Success 273.12 test_network.py
test_02_port_fwd_on_non_src_nat Success 55.84 test_network.py
test_01_port_fwd_on_src_nat Success 142.05 test_network.py
test_nested_virtualization_vmware Success 394.83 test_nested_virtualization.py
test_nic_secondaryip_add_remove Success 334.18 test_multipleips_per_nic.py
test_list_zones_metrics Success 0.36 test_metrics_api.py
test_list_volumes_metrics Success 5.69 test_metrics_api.py
test_list_vms_metrics Success 237.52 test_metrics_api.py
test_list_pstorage_metrics Success 0.47 test_metrics_api.py
test_list_infrastructure_metrics Success 0.47 test_metrics_api.py
test_list_hosts_metrics Success 0.42 test_metrics_api.py
test_list_clusters_metrics Success 0.44 test_metrics_api.py
login_test_saml_user Success 19.70 test_login.py
test_assign_and_removal_lb Success 136.16 test_loadbalance.py
test_02_create_lb_rule_non_nat Success 188.43 test_loadbalance.py
test_01_create_lb_rule_src_nat Success 204.44 test_loadbalance.py
test_03_list_snapshots Success 0.10 test_list_ids_parameter.py
test_02_list_templates Success 0.04 test_list_ids_parameter.py
test_01_list_volumes Success 0.04 test_list_ids_parameter.py
test_07_list_default_iso Success 0.06 test_iso.py
test_05_iso_permissions Success 0.07 test_iso.py
test_04_extract_Iso Success 5.20 test_iso.py
test_03_delete_iso Success 95.24 test_iso.py
test_02_edit_iso Success 0.07 test_iso.py
test_01_create_iso Success 21.28 test_iso.py
test_04_rvpc_internallb_haproxy_stats_on_all_interfaces Success 622.29 test_internal_lb.py
test_03_vpc_internallb_haproxy_stats_on_all_interfaces Success 374.70 test_internal_lb.py
test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 Success 1014.94 test_internal_lb.py
test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 Success 803.64 test_internal_lb.py
test_dedicateGuestVlanRange Success 10.49 test_guest_vlan_range.py
test_UpdateConfigParamWithScope Success 0.17 test_global_settings.py
test_rolepermission_lifecycle_update Success 6.33 test_dynamicroles.py
test_rolepermission_lifecycle_list Success 6.15 test_dynamicroles.py
test_rolepermission_lifecycle_delete Success 6.16 test_dynamicroles.py
test_rolepermission_lifecycle_create Success 6.65 test_dynamicroles.py
test_rolepermission_lifecycle_concurrent_updates Success 6.25 test_dynamicroles.py
test_role_lifecycle_update_role_inuse Success 6.06 test_dynamicroles.py
test_role_lifecycle_update Success 6.07 test_dynamicroles.py
test_role_lifecycle_list Success 6.04 test_dynamicroles.py
test_role_lifecycle_delete Success 11.15 test_dynamicroles.py
test_role_lifecycle_create Success 6.09 test_dynamicroles.py
test_role_inuse_deletion Success 6.16 test_dynamicroles.py
test_role_account_acls_multiple_mgmt_servers Success 9.04 test_dynamicroles.py
test_role_account_acls Success 9.62 test_dynamicroles.py
test_default_role_deletion Success 6.29 test_dynamicroles.py
test_04_create_fat_type_disk_offering Success 0.09 test_disk_offerings.py
test_03_delete_disk_offering Success 0.05 test_disk_offerings.py
test_02_edit_disk_offering Success 0.09 test_disk_offerings.py
test_02_create_sparse_type_disk_offering Success 0.08 test_disk_offerings.py
test_01_create_disk_offering Success 0.14 test_disk_offerings.py
test_deployvm_userdispersing Success 76.25 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userconcentrated Success 121.49 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_firstfit Success 181.98 test_deploy_vms_with_varied_deploymentplanners.py
test_deployvm_userdata_post Success 30.67 test_deploy_vm_with_userdata.py
test_deployvm_userdata Success 181.92 test_deploy_vm_with_userdata.py
test_02_deploy_vm_root_resize Success 0.10 test_deploy_vm_root_resize.py
test_01_deploy_vm_root_resize Success 0.10 test_deploy_vm_root_resize.py
test_00_deploy_vm_root_resize Success 405.95 test_deploy_vm_root_resize.py
test_deploy_vm_from_iso Success 268.51 test_deploy_vm_iso.py
test_3d_gpu_support Success 602.61 test_deploy_vgpu_enabled_vm.py
test_DeployVmAntiAffinityGroup Success 237.70 test_affinity_groups.py
test_08_resize_volume Skipped 10.15 test_volumes.py
test_07_resize_fail Skipped 20.34 test_volumes.py
test_09_copy_delete_template Skipped 0.03 test_templates.py
test_06_copy_template Skipped 0.00 test_templates.py
test_static_role_account_acls Skipped 0.03 test_staticroles.py
test_11_ss_nfs_version_on_ssvm Skipped 0.03 test_ssvm.py
test_01_scale_vm Skipped 67.41 test_scale_vm.py
test_01_primary_storage_iscsi Skipped 0.04 test_primary_storage.py
test_06_copy_iso Skipped 0.00 test_iso.py
test_06_verify_guest_lspci_again Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_05_change_vm_ostype_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_04_verify_guest_lspci Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_03_verify_libvirt_attach_disk Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_02_verify_libvirt_after_restart Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_01_verify_libvirt Skipped 0.00 test_deploy_virtio_scsi_vm.py
test_deploy_vgpu_enabled_vm Skipped 1.43 test_deploy_vgpu_enabled_vm.py

@rohityadavcloud
Copy link
Member

Test LGTM, the failed tests are intermittent (for r/vpc) and some env induced errors for vmware/xenserver.

@rohityadavcloud rohityadavcloud merged commit e1c4b1b into apache:master Jul 27, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants