test failures; 3.0.15, funtests; errors=10

[idella]

while the funtests all pass fine in 3.0.14, the release 3.0.15 fails with 10 errors.

test_basic_get (funtests.tests.test_redis.test_redis) ... ERROR
test_cant_connect_raises_connection_error (funtests.tests.test_redis.test_redis) ... ERROR
test_cyclic_reference_channel (funtests.tests.test_redis.test_redis) ... ERROR
test_cyclic_reference_connection (funtests.tests.test_redis.test_redis) ... ERROR
test_cyclic_reference_transport (funtests.tests.test_redis.test_redis) ... ERROR
test_produce__consume (funtests.tests.test_redis.test_redis) ... ERROR
test_produce__consume_large_messages (funtests.tests.test_redis.test_redis) ... ERROR
test_produce__consume_multiple (funtests.tests.test_redis.test_redis) ... ERROR
test_purge (funtests.tests.test_redis.test_redis) ... ERROR
test_timeout (funtests.tests.test_redis.test_redis) ... ERROR
``

without exception the yield

```python
Traceback (most recent call last):
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/transport.py", line 92, in setUp
    self.do_connect()
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/transport.py", line 119, in do_connect
    self.connection.connect()
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/connection.py", line 241, in connect
    return self.connection
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/connection.py", line 758, in connection
    self._connection = self._establish_connection()
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/connection.py", line 713, in _establish_connection
    conn = self.transport.establish_connection()
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/transport/virtual/__init__.py", line 809, in establish_connection
    self._avail_channels.append(self.create_channel(self))
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/transport/virtual/__init__.py", line 791, in create_channel
    channel = self.Channel(connection)
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/transport/redis.py", line 445, in __init__
    self._pool.disconnect()
  File "/usr/lib64/python2.7/site-packages/redis/connection.py", line 478, in disconnect
    connection.disconnect()
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/transport/redis.py", line 800, in disconnect
    channel._on_connection_disconnect(self)
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/transport/redis.py", line 461, in _on_connection_disconnect
    self.connection.cycle._on_connection_disconnect(connection)
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/transport/redis.py", line 259, in _on_connection_disconnect
    self.poller.unregister(connection._sock)
  File "/mnt/gen2/TmpDir/portage/dev-python/kombu-3.0.15/work/kombu-3.0.15-python2_7/funtests/../kombu/utils/eventio.py", line 85, in unregister
    self._epoll.unregister(fd)
TypeError: argument must be an int, or have a fileno() method.
111

Do you require anything further?

[nimrodm]

I have the same issue.

[gidantribal]

Same here, big issue with Django + Celery (3.1.11) + Redis.
I had to downgrade celery and kombu to get rid of the blocking error :/

[ckaalund]

Running into the same problem

[thegreenfield]

I have the same issue.

Traceback (most recent call last):

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/celery/app/task.py", line 453, in delay
    return self.apply_async(args, kwargs)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/celery/app/task.py", line 555, in apply_async
    **dict(self._get_exec_options(), **options)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/celery/app/base.py", line 323, in send_task
    reply_to=reply_to or self.oid, **options

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/celery/app/amqp.py", line 302, in publish_task
    **kwargs

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/messaging.py", line 168, in publish
    routing_key, mandatory, immediate, exchange, declare)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/connection.py", line 440, in _ensured
    return fun(*args, **kwargs)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/messaging.py", line 184, in _publish
    mandatory=mandatory, immediate=immediate,

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/virtual/__init__.py", line 521, in basic_publish
    message, exchange, routing_key, **kwargs

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/virtual/exchange.py", line 60, in deliver
    for queue in _lookup(exchange, routing_key):

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/virtual/__init__.py", line 612, in _lookup
    self.get_table(exchange),

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/redis.py", line 719, in get_table
    values = client.smembers(key)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/redis/client.py", line 1286, in smembers
    return self.execute_command('SMEMBERS', name)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/redis/client.py", line 463, in execute_command
    connection.disconnect()

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/redis.py", line 800, in disconnect
    channel._on_connection_disconnect(self)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/redis.py", line 461, in _on_connection_disconnect
    self.connection.cycle._on_connection_disconnect(connection)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/transport/redis.py", line 259, in _on_connection_disconnect
    self.poller.unregister(connection._sock)

  File "/home/nhk/virtualenvs/r1/local/lib/python2.7/site-packages/kombu/utils/eventio.py", line 85, in unregister
    self._epoll.unregister(fd)

TypeError: argument must be an int, or have a fileno() method.

[nimrodm]

#342

[neara]

i'm having same issue. Appeared lately, i guess after i updated celery and kombu. Running on Heroku, celery + redis.

`
Stacktrace (most recent call last):

File "django/core/handlers/base.py", line 112, in get_response
response = wrapped_callback(request, _callback_args, *_callback_kwargs)
File "newrelic/hooks/framework_django.py", line 492, in wrapper
return wrapped(_args, *_kwargs)
File "django/views/generic/base.py", line 69, in view
return self.dispatch(request, _args, *_kwargs)
File "django/views/decorators/csrf.py", line 57, in wrapped_view
return view_func(_args, *_kwargs)
File "rest_framework/views.py", line 400, in dispatch
response = self.handle_exception(exc)
File "rest_framework/views.py", line 397, in dispatch
response = handler(request, _args, *_kwargs)
File "arena/api/arenawaze_views.py", line 77, in post
.id, user=self.request.user.id)
File "celery/app/task.py", line 453, in delay
return self.apply_async(args, kwargs)
File "celery/app/task.py", line 555, in apply_async
*_dict(self._get_exec_options(), *_options)
File "celery/app/base.py", line 351, in send_task
reply_to=reply_to or self.oid, *_options
File "celery/app/amqp.py", line 305, in publish_task
*_kwargs
File "kombu/messaging.py", line 168, in publish
routing_key, mandatory, immediate, exchange, declare)
File "kombu/connection.py", line 440, in _ensured
return fun(_args, *_kwargs)
File "kombu/messaging.py", line 184, in _publish
mandatory=mandatory, immediate=immediate,
File "kombu/transport/virtual/init.py", line 521, in basic_publish
message, exchange, routing_key, *_kwargs
File "kombu/transport/virtual/exchange.py", line 60, in deliver
for queue in _lookup(exchange, routing_key):
File "kombu/transport/virtual/init.py", line 612, in _lookup
self.get_table(exchange),
File "kombu/transport/redis.py", line 719, in get_table
values = client.smembers(key)
File "newrelic/api/function_trace.py", line 100, in literal_wrapper
return wrapped(_args, **kwargs)
File "redis/client.py", line 1286, in smembers
return self.execute_command('SMEMBERS', name)
File "redis/client.py", line 463, in execute_command
connection.disconnect()
File "kombu/transport/redis.py", line 800, in disconnect
channel._on_connection_disconnect(self)
File "kombu/transport/redis.py", line 461, in _on_connection_disconnect
self.connection.cycle._on_connection_disconnect(connection)
File "kombu/transport/redis.py", line 259, in _on_connection_disconnect
self.poller.unregister(connection._sock)
File "kombu/utils/eventio.py", line 85, in unregister
self._epoll.unregister(fd)
`

[ask]

Did you upgrade kombu to > 3.0.16?

[neara]

Updated celery to 3.1.12 and kombu to 3.0.19 and indeed it solved the issue.

[ask]

Thanks! Closing then