Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Details: Request Failed: internal server error while processing your request. #592

Closed
zancas opened this issue Jun 2, 2017 · 2 comments
Closed

Details: Request Failed: internal server error while processing your request. #592

zancas opened this issue Jun 2, 2017 · 2 comments
Assignees
@zancas
Labels
P3 S3 test-bug

Comments

@zancas
Copy link
Contributor

zancas commented Jun 2, 2017 •
edited

liberty_12.1.1_undercloud_vxlan

The three associated tests failed in nightly 2017-06-02, but not in a manual run.

All three reference an internal error, associated with a "delete loadbalancer" operation.

name:	test_update_health_monitor_missing_url_path
description:	Test update health monitor with missing url_path field
result:	fail
failure msg:	../../../../../.tox/apiv2/local/lib/python2.7/site-packages/tempest/test.py:318: in tearDownClass
    six.reraise(etype, value, trace)
../../../../../.tox/apiv2/local/lib/python2.7/site-packages/tempest/test.py:301: in tearDownClass
    teardown()
base.py:109: in resource_cleanup
    cls._try_delete_resource(cls._delete_load_balancer, lb_id)
../../../../../.tox/apiv2/local/lib/python2.7/site-packages/tempest/api/network/base.py:150: in _try_delete_resource
    delete_callable(*args, **kwargs)
base.py:147: in _delete_load_balancer
    load_balancer_id, delete=True)
base.py:170: in _wait_for_load_balancer_status
    load_balancer_id)
../clients/load_balancers_client.py:40: in get_load_balancer
    resp, body = self.get(url)
../../../../../.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py:274: in get
    return self.request('GET', url, extra_headers, headers)
../../../../../.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py:641: in request
    resp, resp_body)
../../../../../.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py:760: in _error_checker
    message=message)
E ServerFault: Got server fault
E Details: Request Failed: internal server error while processing your request.

name:	test_create_load_balancer
description:	Test create load balancer
result:	fail
failure msg:	NOTE: Incompatible Exception Representation, displaying natively:

_StringException: pythonlogging:'': {{{
2017-06-02 01:15:01,108 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_create_load_balancer): 201 POST http://10.190.4.156:9696/v2.0/lbaas/loadbalancers 0.652s
2017-06-02 01:15:01,239 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_create_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.131s
2017-06-02 01:15:02,426 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_create_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.185s
2017-06-02 01:15:02,518 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_create_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/ports/285f3a9f-6102-41bc-8409-3a54134a96ef 0.091s
2017-06-02 01:15:02,646 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_create_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.128s
2017-06-02 01:15:02,705 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_create_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.058s
2017-06-02 01:15:02,706 18034 INFO     [neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin:LoadBalancersTestJSON] Finished: test_create_load_balancer

2017-06-02 01:15:02,975 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:_run_cleanups): 204 DELETE http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.269s
2017-06-02 01:15:03,025 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:_run_cleanups): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.050s
2017-06-02 01:15:04,066 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:_run_cleanups): 500 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/1f4f2c2a-fb74-474f-b051-e6ca3ee2d8a8 0.039s
}}}

Traceback (most recent call last):
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 147, in _delete_load_balancer
    load_balancer_id, delete=True)
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 170, in _wait_for_load_balancer_status
    load_balancer_id)
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/clients/load_balancers_client.py", line 40, in get_load_balancer
    resp, body = self.get(url)
File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 274, in get
    return self.request('GET', url, extra_headers, headers)
File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 641, in request
    resp, resp_body)
File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 760, in _error_checker
    message=message)
tempest.lib.exceptions.ServerFault: Got server fault
Details: Request Failed: internal server error while processing your request.

name:	test_delete_load_balancer
description:	Test delete load balancer
result:	fail
failure msg:	NOTE: Incompatible Exception Representation, displaying natively:

_StringException: pythonlogging:'': {{{
2017-06-02 01:15:45,936 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 201 POST http://10.190.4.156:9696/v2.0/lbaas/loadbalancers 0.683s
2017-06-02 01:15:46,004 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.056s
2017-06-02 01:15:47,084 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.077s
2017-06-02 01:15:48,152 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.066s
2017-06-02 01:15:48,262 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/ports/80e1bb31-4114-4091-bb2a-14e746e7b685 0.110s
2017-06-02 01:15:48,320 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.057s
2017-06-02 01:15:48,368 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.047s
2017-06-02 01:15:48,626 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 204 DELETE http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.257s
2017-06-02 01:15:48,674 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 200 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.047s
2017-06-02 01:15:49,697 18034 INFO     [tempest.lib.common.rest_client] Request (LoadBalancersTestJSON:test_delete_load_balancer): 500 GET http://10.190.4.156:9696/v2.0/lbaas/loadbalancers/92cd39f4-bb06-4a65-bfc4-10d0f18e55ba 0.021s
2017-06-02 01:15:49,698 18034 INFO     [neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin:LoadBalancersTestJSON] Finished: test_delete_load_balancer
}}}

Traceback (most recent call last):
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/test_load_balancers_non_admin.py", line 441, in test_delete_load_balancer
    self._delete_load_balancer(new_load_balancer_id)
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 147, in _delete_load_balancer
    load_balancer_id, delete=True)
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 170, in _wait_for_load_balancer_status
    load_balancer_id)
File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/clients/load_balancers_client.py", line 40, in get_load_balancer
    resp, body = self.get(url)
File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 274, in get
    return self.request('GET', url, extra_headers, headers)
File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 641, in request
    resp, resp_body)
File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 760, in _error_checker
    message=message)
tempest.lib.exceptions.ServerFault: Got server fault
Details: Request Failed: internal server error while processing your request.

Associated Tests:
["neutron_lbaas.tests.tempest.v2.api.test_health_monitors_non_admin.testhealthmonitors:: test_update_health_monitor_missing_url_path",
"neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.loadbalancerstestjson:: test_create_load_balancer",
"neutron_lbaas.tests.tempest.v2.api.test_load_balancers_non_admin.loadbalancerstestjson:: test_delete_load_balancer"]
@zancas zancas self-assigned this Jun 2, 2017
@zancas zancas mentioned this issue Jun 2, 2017
Closed
@mattgreene mattgreene added P3 and removed P2 labels Aug 11, 2017
@ssorenso
Copy link

ssorenso commented Aug 15, 2017 •
edited

md5sum: 0ec5276a7d13c6e7098289e912654d60

Other sums:
md5sum:0d2d2af7eb462870ac6992640fce980e
md5sum:38cac2b466c4b2d61f4a8225ec9c81d5

@ssorenso
Copy link

ssorenso commented Aug 15, 2017 •
edited

Additional test instances impacted:

  • openstack_driver_liberty_11.5.4-undercloud-vxlan.79.consoleText.LoadBalancersTestJSON.test_update_load_balancer_invalid_name
  • openstack_driver_liberty_12.1.1-undercloud-vxlan.99.consoleText.LoadBalancersTestJSON.test_update_load_balancer_invalid_name
  • openstack_driver_liberty_11.6.1-undercloud-vxlan.82.consoleText.LoadBalancersTestJSON.test_update_load_balancer_invalid_name
    sum: 4c4b8528079374ffbe97851b71a5a821

And another:

Traceback (most recent call last):
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/test_load_balancers_non_admin.py", line 349, in test_update_load_balancer_invalid_description
    description='a' * 256)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 434, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 445, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 495, in _matchHelper
    mismatch = matcher.match(matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_exception.py", line 108, in match
    mismatch = self.exception_matcher.match(exc_info)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_higherorder.py", line 62, in match
    mismatch = matcher.match(matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 426, in match
    reraise(*matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_exception.py", line 101, in match
    result = matchee()
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 982, in __call__
    return self._callable_object(*self._args, **self._kwargs)
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 234, in _update_load_balancer
    load_balancer_id, **lb_kwargs)
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/clients/load_balancers_client.py", line 57, in update_load_balancer
    .format(load_balancer_id), put_body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 322, in put
    return self.request('PUT', url, extra_headers, headers, body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 641, in request
    resp, resp_body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 760, in _error_checker
    message=message)
tempest.lib.exceptions.ServerFault: Got server fault
Details: Request Failed: internal server error while processing your request.
  • openstack_driver_liberty_11.5.4-undercloud-vxlan.79.consoleText.LoadBalancersTestJSON.test_update_load_balancer_invalid_description
  • openstack_driver_liberty_12.1.1-undercloud-vxlan.99.consoleText.LoadBalancersTestJSON.test_update_load_balancer_invalid_description
  • openstack_driver_liberty_11.6.1-undercloud-vxlan.82.consoleText.LoadBalancersTestJSON.test_update_load_balancer_invalid_description
    sum:511ba6c167bb9a84bd91e3546ff2c110
Traceback (most recent call last):
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/test_listeners_non_admin.py", line 225, in test_create_listener_invalid_name
    name='a' * 256)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 434, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 445, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 495, in _matchHelper
    mismatch = matcher.match(matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_exception.py", line 108, in match
    mismatch = self.exception_matcher.match(exc_info)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_higherorder.py", line 62, in match
    mismatch = matcher.match(matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 426, in match
    reraise(*matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_exception.py", line 101, in match
    result = matchee()
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 982, in __call__
    return self._callable_object(*self._args, **self._kwargs)
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 312, in _create_listener
    listener = cls.listeners_client.create_listener(**listener_kwargs)
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/clients/listeners_client.py", line 48, in create_listener
    resp, body = self.post('v2.0/lbaas/listeners', post_body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 259, in post
    return self.request('POST', url, extra_headers, headers, body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 641, in request
    resp, resp_body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 760, in _error_checker
    message=message)
tempest.lib.exceptions.ServerFault: Got server fault
Details: Request Failed: internal server error while processing your request.

Impacted tests:

  • openstack_driver_liberty_11.5.4-undercloud-vxlan.79.consoleText.ListenersTestJSON.test_create_listener_invalid_name
  • openstack_driver_liberty_12.1.1-undercloud-vxlan.99.consoleText.ListenersTestJSON.test_create_listener_invalid_name
  • openstack_driver_liberty_11.6.1-undercloud-vxlan.82.consoleText.ListenersTestJSON.test_create_listener_invalid_name
    sums:
    64d6fc7621a21ef1813aea4baec8d6ec
Traceback (most recent call last):
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/test_listeners_non_admin.py", line 237, in test_create_listener_invalid_description
    description='a' * 256)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 434, in assertRaises
    self.assertThat(our_callable, matcher)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 445, in assertThat
    mismatch_error = self._matchHelper(matchee, matcher, message, verbose)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 495, in _matchHelper
    mismatch = matcher.match(matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_exception.py", line 108, in match
    mismatch = self.exception_matcher.match(exc_info)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_higherorder.py", line 62, in match
    mismatch = matcher.match(matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 426, in match
    reraise(*matchee)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/matchers/_exception.py", line 101, in match
    result = matchee()
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/testtools/testcase.py", line 982, in __call__
    return self._callable_object(*self._args, **self._kwargs)
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/api/base.py", line 312, in _create_listener
    listener = cls.listeners_client.create_listener(**listener_kwargs)
  File "/home/jenkins/neutron-lbaas/neutron_lbaas/tests/tempest/v2/clients/listeners_client.py", line 48, in create_listener
    resp, body = self.post('v2.0/lbaas/listeners', post_body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 259, in post
    return self.request('POST', url, extra_headers, headers, body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 641, in request
    resp, resp_body)
  File "/home/jenkins/neutron-lbaas/.tox/apiv2/local/lib/python2.7/site-packages/tempest/lib/common/rest_client.py", line 760, in _error_checker
    message=message)
tempest.lib.exceptions.ServerFault: Got server fault

Tests:

  • openstack_driver_liberty_11.5.4-undercloud-vxlan.79.consoleText.ListenersTestJSON.test_create_listener_invalid_description
  • openstack_driver_liberty_12.1.1-undercloud-vxlan.99.consoleText.ListenersTestJSON.test_create_listener_invalid_description
  • openstack_driver_liberty_11.6.1-undercloud-vxlan.82.consoleText.ListenersTestJSON.test_create_listener_invalid_description
    sums:
  • md5sum:8e5fa2b361e5c6395991c525d871821c
  • reduced(md5sum):6cadb8b3a87ac2501ba79d78e2de4a47

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zancas zancas

Labels
P3 S3 test-bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@zancas @amudukutore @ssorenso @dflanigan @mattgreene