Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mail worker broken #424

Closed
duker33 opened this issue Jul 16, 2018 · 4 comments
Closed

Mail worker broken #424

duker33 opened this issue Jul 16, 2018 · 4 comments
Assignees
Labels
1 burning issue 2 hours some big and monolith issue with hard decisions, discussions or bug with strong research bug from business from PO from product owner. It's hellxi report Put it to completed tasks temporary list for business

Comments

@duker33
Copy link
Contributor

duker33 commented Jul 16, 2018

PO says that mail doesn't work on prod.

dcp logs celery-mail-worker run on prod returns traceback:

...
se-celery-mail-worker    | Traceback (most recent call last):
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/kombu/transport/base.py", line 123, in __getattr__
se-celery-mail-worker    |     return self[key]
se-celery-mail-worker    | KeyError: 'async'
se-celery-mail-worker    |
se-celery-mail-worker    | During handling of the above exception, another exception occurred:
se-celery-mail-worker    |
se-celery-mail-worker    | Traceback (most recent call last):
se-celery-mail-worker    |   File "/usr/local/bin/celery", line 11, in <module>
se-celery-mail-worker    |     sys.exit(main())
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/__main__.py", line 14, in main
se-celery-mail-worker    |     _main()
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 326, in main
se-celery-mail-worker    |     cmd.execute_from_commandline(argv)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 488, in execute_from_commandline
se-celery-mail-worker    |     super(CeleryCommand, self).execute_from_commandline(argv)))
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/base.py", line 281, in execute_from_commandline
se-celery-mail-worker    |     return self.handle_argv(self.prog_name, argv[1:])
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 480, in handle_argv
se-celery-mail-worker    |     return self.execute(command, argv)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 412, in execute
se-celery-mail-worker    |     ).run_from_argv(self.prog_name, argv[1:], command=argv[0])
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/worker.py", line 221, in run_from_argv
se-celery-mail-worker    |     return self(*args, **options)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/base.py", line 244, in __call__
se-celery-mail-worker    |     ret = self.run(*args, **kwargs)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/worker.py", line 255, in run
se-celery-mail-worker    |     **kwargs)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/worker/worker.py", line 99, in __init__
se-celery-mail-worker    |     self.setup_instance(**self.prepare_args(**kwargs))
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/worker/worker.py", line 122, in setup_instance
se-celery-mail-worker    |     self.should_use_eventloop() if use_eventloop is None
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/worker/worker.py", line 241, in should_use_eventloop
se-celery-mail-worker    |     self._conninfo.transport.implements.async and
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/kombu/transport/base.py", line 125, in __getattr__
se-celery-mail-worker    |     raise AttributeError(key)
se-celery-mail-worker    | AttributeError: async
root@web:~/prog/shopelectro/docker# dcp logs celery-mail-worker | tail -n 70
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 488, in execute_from_commandline
se-celery-mail-worker    |     super(CeleryCommand, self).execute_from_commandline(argv)))
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/base.py", line 281, in execute_from_commandline
se-celery-mail-worker    |     return self.handle_argv(self.prog_name, argv[1:])
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 480, in handle_argv
se-celery-mail-worker    |     return self.execute(command, argv)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/celery.py", line 412, in execute
se-celery-mail-worker    |     ).run_from_argv(self.prog_name, argv[1:], command=argv[0])
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/worker.py", line 221, in run_from_argv
se-celery-mail-worker    |     return self(*args, **options)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/base.py", line 244, in __call__
se-celery-mail-worker    |     ret = self.run(*args, **kwargs)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/bin/worker.py", line 255, in run
se-celery-mail-worker    |     **kwargs)
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/worker/worker.py", line 99, in __init__
se-celery-mail-worker    |     self.setup_instance(**self.prepare_args(**kwargs))
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/worker/worker.py", line 122, in setup_instance
se-celery-mail-worker    |     self.should_use_eventloop() if use_eventloop is None
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/celery/worker/worker.py", line 241, in should_use_eventloop
se-celery-mail-worker    |     self._conninfo.transport.implements.async and
se-celery-mail-worker    |   File "/usr/local/lib/python3.6/site-packages/kombu/transport/base.py", line 125, in __getattr__
se-celery-mail-worker    |     raise AttributeError(key)
se-celery-mail-worker    | AttributeError: async
@duker33 duker33 added bug from business 2 hours some big and monolith issue with hard decisions, discussions or bug with strong research 1 burning issue from PO from product owner. It's hellxi labels Jul 16, 2018
@duker33 duker33 self-assigned this Jul 16, 2018
@duker33
Copy link
Contributor Author

duker33 commented Jul 16, 2018

seems it's version conflict: our celery uses too new version of kombu.

4.2.1 kombu's version uses new Transport class's field names
https://github.com/celery/kombu/blob/master/kombu/transport/base.py#L135

@duker33
Copy link
Contributor Author

duker33 commented Jul 16, 2018

... and celery don't control versions during build
https://github.com/celery/celery/blob/master/setup.cfg#L21

@duker33
Copy link
Contributor Author

duker33 commented Jul 16, 2018

celery released hotfix according to this issue.
http://www.celeryproject.org/news/celery-411-hot-fix-releaesd/

I'll try to reniew it for 4.2.0 version

duker33 added a commit that referenced this issue Jul 16, 2018
@duker33
Copy link
Contributor Author

duker33 commented Jul 16, 2018

fixed on prod

2h includes chat with PO, working with prod

@duker33 duker33 added the review waits for review label Jul 16, 2018
duker33 added a commit that referenced this issue Jul 17, 2018
@duker33 duker33 added report Put it to completed tasks temporary list for business and removed review waits for review labels Jul 17, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
1 burning issue 2 hours some big and monolith issue with hard decisions, discussions or bug with strong research bug from business from PO from product owner. It's hellxi report Put it to completed tasks temporary list for business
Projects
None yet
Development

No branches or pull requests

1 participant