Exception daemonic processes are not allowed to have children

[guohaolee]

Hi, I got this issue when deploying the timeout_decorator in celery tasks.

I have set use_signals = False.

The timeout works but will throw this error message. Checked around the internet and its probably due to the multiprocessing library and can be solved using billard.

Do you think you can implement billard library to replace multiprocessing?

[bitranox]

You might look here :

https://stackoverflow.com/questions/6974695/python-process-pool-non-daemonic

and You might give it a try, just by:

import billard as multiprocessing

[guohaolee]

Hi, do you mean on my celery change to use billiard? Or inside the timeout decorator change to use billiard?

[bitranox]

As far as I know celery uses billard already.
Just inside the timeout decorator, replace the multiprocessing module with billard.
You might also try my decorator - https://github.com/bitranox/wrapt-timeout-decorator
it is using
"dill" instead of pickle (can pickle more datatypes)
and "multiprocess" instead of "multiprocessing"

[guohaolee]

Alright, thanks for the information. Will try it out