Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

UnicodeDecodeError when starting up Flower #212

Closed
jarandaf opened this issue Apr 17, 2014 · 4 comments
Closed

UnicodeDecodeError when starting up Flower #212

jarandaf opened this issue Apr 17, 2014 · 4 comments

Comments

@jarandaf
Copy link

I get the following errors when starting up flower:

celery flower --port=5555 --debug

[E 140417 09:35:35 events:103] Failed to capture events: ''utf8' codec can't decode byte 0xf5 in position 0: invalid start byte', trying again in 2 seconds.
[D 140417 09:35:35 events:104] 'utf8' codec can't decode byte 0xf5 in position 0: invalid start byte
    Traceback (most recent call last):
      File "/home/pista/x/env/lib/python2.7/site-packages/flower/events.py", line 91, in run
        recv.capture(limit=None, timeout=None)
      File "/home/pista/x/env/lib/python2.7/site-packages/kombu/connection.py", line 732, in __exit__
        self.release()
      File "/home/pista/x/env/lib/python2.7/site-packages/kombu/connection.py", line 334, in release
        self._close()
      File "/home/pista/x/env/lib/python2.7/site-packages/kombu/connection.py", line 302, in _close
        self._do_close_self()
      File "/home/pista/x/env/lib/python2.7/site-packages/kombu/connection.py", line 295, in _do_close_self
        self.transport.close_connection(self._connection)
      File "/home/pista/x/env/lib/python2.7/site-packages/kombu/transport/pyamqp.py", line 122, in close_connection
        connection.close()
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/connection.py", line 461, in close
        (10, 51),  # Connection.close_ok
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/abstract_channel.py", line 67, in wait
        self.channel_id, allowed_methods)
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/connection.py", line 270, in _wait_method
        self.wait()
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/abstract_channel.py", line 69, in wait
        return self.dispatch_method(method_sig, args, content)
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/abstract_channel.py", line 87, in dispatch_method
        return amqp_method(self, args)
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/connection.py", line 530, in _blocked
        reason = args.read_shortstr()
      File "/home/pista/x/env/lib/python2.7/site-packages/amqp/serialization.py", line 120, in read_shortstr
        return self.input.read(slen).decode('utf-8')
      File "/home/pista/x/env/lib/python2.7/encodings/utf_8.py", line 16, in decode
        return codecs.utf_8_decode(input, errors, True)
    UnicodeDecodeError: 'utf8' codec can't decode byte 0xf5 in position 0: invalid start byte

I don't really know what it is going on here. I'm pretty new to both Celery and Flower. The system locale is actually set to en_US.UTF-8. Flower version is:

0.6.0
3.1.10 (Cipater)
flower   -> 0.6.0
software -> celery:3.1.10 (Cipater) kombu:3.0.15 py:2.7.3
            billiard:3.3.0.17 py-amqp:1.4.5
platform -> system:Linux arch:64bit, ELF imp:CPython
loader   -> celery.loaders.default.Loader
settings -> transport:amqp results:disabled

Any hint would be much appreciated, thanks!
@mher
Copy link
Owner

mher commented Apr 22, 2014

@JordiAranda have you checked the RabbitMQ logs? This can be a low memory/disk alerts issue.

@jarandaf
Copy link
Author

Hi @mher, thanks for your reply. The memory/disk usage shouldn't be a problem, I'm working with a "fresh" box. The RabbitMQ logs doesn't say too much (at least to me):

** Reason for termination == 
** {amqp_error,frame_error,
               "cannot decode <<0,0,45,99,101,108,101,114,121,101,118,46,100,97,100,102,49,99,99,102,45,57,97,51,56,45,52,97,50,49,45,98,54,97,98,45,101,53,1
01,97,52,54,55,97,57,101,51,56,1,53,2,0,0,0,0>>",
               'basic.consume'}

@meako689
Copy link

just run into the same issue, but when trying to start celeryd after updating to 3.1.10 and installing flower

-------------- celery@**** v3.1.10 (Cipater)
---- **** ----- 
--- * ***  * -- Linux-2.6.18-ovz-smp-alt26.M40.2-i686-with-debian-6.0.9
-- * - **** --- 
- ** ---------- [config]
- ** ---------- .> app:         default:0x893ad2c (djcelery.loaders.DjangoLoader)
- ** ---------- .> transport:   amqp://celery@localhost:5672/localhost
- ** ---------- .> results:     database
- *** --- * --- .> concurrency: 4 (prefork)
-- ******* ---- 
--- ***** ----- [queues]
 -------------- .> celery           exchange=celery(direct) key=celery

[2014-04-29 23:04:06,751: WARNING/MainProcess] Traceback (most recent call last):
[2014-04-29 23:04:06,751: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/bin/django-admin.py", line 6, in <module>
[2014-04-29 23:04:06,751: WARNING/MainProcess] management.execute_from_command_line()
[2014-04-29 23:04:06,751: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/django/core/management/__init__.py", line 429, in execute_from_command_line
[2014-04-29 23:04:06,751: WARNING/MainProcess] utility.execute()
[2014-04-29 23:04:06,752: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/django/core/management/__init__.py", line 379, in execute
[2014-04-29 23:04:06,752: WARNING/MainProcess] self.fetch_command(subcommand).run_from_argv(self.argv)
[2014-04-29 23:04:06,752: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/djcelery/management/base.py", line 77, in run_from_argv
[2014-04-29 23:04:06,752: WARNING/MainProcess] return super(CeleryCommand, self).run_from_argv(argv)
[2014-04-29 23:04:06,752: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/django/core/management/base.py", line 191, in run_from_argv
[2014-04-29 23:04:06,753: WARNING/MainProcess] self.execute(*args, **options.__dict__)
[2014-04-29 23:04:06,753: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/djcelery/management/base.py", line 70, in execute
[2014-04-29 23:04:06,753: WARNING/MainProcess] super(CeleryCommand, self).execute(*args, **options)
[2014-04-29 23:04:06,753: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/django/core/management/base.py", line 220, in execute
[2014-04-29 23:04:06,753: WARNING/MainProcess] output = self.handle(*args, **options)
[2014-04-29 23:04:06,754: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/djcelery/management/commands/celeryd.py", line 26, in handle
[2014-04-29 23:04:06,754: WARNING/MainProcess] worker.run(**options)
[2014-04-29 23:04:06,754: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/bin/worker.py", line 208, in run
[2014-04-29 23:04:06,754: WARNING/MainProcess] state_db=self.node_format(state_db, hostname), **kwargs
[2014-04-29 23:04:06,754: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/__init__.py", line 211, in start
[2014-04-29 23:04:06,755: WARNING/MainProcess] self.stop()
[2014-04-29 23:04:06,755: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/__init__.py", line 252, in stop
[2014-04-29 23:04:06,755: WARNING/MainProcess] self._shutdown(warm=True)
[2014-04-29 23:04:06,755: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/__init__.py", line 266, in _shutdown
[2014-04-29 23:04:06,755: WARNING/MainProcess] self.blueprint.stop(self, terminate=not warm)
[2014-04-29 23:04:06,755: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/bootsteps.py", line 183, in stop
[2014-04-29 23:04:06,756: WARNING/MainProcess] self.on_stopped()
[2014-04-29 23:04:06,756: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/__init__.py", line 164, in on_stopped
[2014-04-29 23:04:06,756: WARNING/MainProcess] self.consumer.shutdown()
[2014-04-29 23:04:06,756: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/consumer.py", line 305, in shutdown
[2014-04-29 23:04:06,756: WARNING/MainProcess] self.blueprint.shutdown(self)
[2014-04-29 23:04:06,757: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/consumer.py", line 170, in shutdown
[2014-04-29 23:04:06,757: WARNING/MainProcess] self.send_all(parent, 'shutdown')
[2014-04-29 23:04:06,757: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/bootsteps.py", line 155, in send_all
[2014-04-29 23:04:06,757: WARNING/MainProcess] fun(parent, *args)
[2014-04-29 23:04:06,757: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/consumer.py", line 531, in shutdown
[2014-04-29 23:04:06,758: WARNING/MainProcess] self._close(c)
[2014-04-29 23:04:06,758: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/celery/worker/consumer.py", line 525, in _close
[2014-04-29 23:04:06,758: WARNING/MainProcess] ignore_errors(c, dispatcher.connection.close)
[2014-04-29 23:04:06,758: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/kombu/common.py", line 273, in ignore_errors
[2014-04-29 23:04:06,758: WARNING/MainProcess] return fun(*args, **kwargs)
[2014-04-29 23:04:06,759: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/kombu/connection.py", line 334, in release
[2014-04-29 23:04:06,759: WARNING/MainProcess] self._close()
[2014-04-29 23:04:06,759: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/kombu/connection.py", line 302, in _close
[2014-04-29 23:04:06,759: WARNING/MainProcess] self._do_close_self()
[2014-04-29 23:04:06,759: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/kombu/connection.py", line 295, in _do_close_self
[2014-04-29 23:04:06,760: WARNING/MainProcess] self.transport.close_connection(self._connection)
[2014-04-29 23:04:06,760: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/kombu/transport/pyamqp.py", line 122, in close_connection
[2014-04-29 23:04:06,760: WARNING/MainProcess] connection.close()
[2014-04-29 23:04:06,760: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/connection.py", line 461, in close
[2014-04-29 23:04:06,760: WARNING/MainProcess] (10, 51),  # Connection.close_ok
[2014-04-29 23:04:06,761: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/abstract_channel.py", line 67, in wait
[2014-04-29 23:04:06,761: WARNING/MainProcess] self.channel_id, allowed_methods)
[2014-04-29 23:04:06,761: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/connection.py", line 270, in _wait_method
[2014-04-29 23:04:06,761: WARNING/MainProcess] self.wait()
[2014-04-29 23:04:06,761: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/abstract_channel.py", line 69, in wait
[2014-04-29 23:04:06,761: WARNING/MainProcess] return self.dispatch_method(method_sig, args, content)
[2014-04-29 23:04:06,762: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/abstract_channel.py", line 87, in dispatch_method
[2014-04-29 23:04:06,762: WARNING/MainProcess] return amqp_method(self, args)
[2014-04-29 23:04:06,762: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/connection.py", line 530, in _blocked
[2014-04-29 23:04:06,762: WARNING/MainProcess] reason = args.read_shortstr()
[2014-04-29 23:04:06,762: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/site-packages/amqp/serialization.py", line 120, in read_shortstr
[2014-04-29 23:04:06,763: WARNING/MainProcess] return self.input.read(slen).decode('utf-8')
[2014-04-29 23:04:06,763: WARNING/MainProcess] File "/usr/local/lib/staging/42-deploy/env/d9f9e9ce1d3a73ccd521f175c68e543bd2335a6e.140429.220719/lib/python2.6/encodings/utf_8.py", line 16, in decode
[2014-04-29 23:04:06,763: WARNING/MainProcess] return codecs.utf_8_decode(input, errors, True)
[2014-04-29 23:04:06,763: WARNING/MainProcess] UnicodeDecodeError
[2014-04-29 23:04:06,763: WARNING/MainProcess] :
[2014-04-29 23:04:06,763: WARNING/MainProcess] 'utf8' codec can't decode byte 0xf5 in position 0: invalid start byte
[2014-04-29 23:04:06,764: DEBUG/MainProcess] removing tasks from inqueue until task handler finished

@meako689
Copy link

seems to be rabbitmq-server issue. Updating from 1.something to 3.3.1 solved it.

@mher mher closed this as completed Mar 5, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@meako689 @mher @jarandaf