Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Interest in a PostgreSQL result backend #172

Open
jtcho opened this issue Sep 8, 2021 · 3 comments
Open

Interest in a PostgreSQL result backend #172

jtcho opened this issue Sep 8, 2021 · 3 comments

Comments

@jtcho
Copy link

jtcho commented Sep 8, 2021

Hi,

I see that there is Celery/Redis backend support out of the box – but unfortunately I've been using PostgreSQL as a result backend for my own project until I can migrate to Redis.

I plan to write a lightweight Postgres backend wrapper based off of the Celery one – https://github.com/celery/celery/blob/master/celery/backends/database/models.py . Since the interface provided by gocelery is simple (GetResult/SetResult), I imagine it would be pretty straightforward.

Do you / folks think there would be interest if I were to open a PR with it here, even as a proof of concept?

@ftntming
Copy link

That would be awesome!

@jtcho
Copy link
Author

jtcho commented Oct 16, 2021

@ftntming This ended up being more tricky than I anticipated, because Celery pickles all task results in the DB backend. I tried using a couple golang pickle deserializers with minimal success. Instead, I ended up just writing a thin wrapper around the python celery that shells out and reads stderr/stdout.

@ftntming
Copy link

@ftntming This ended up being more tricky than I anticipated, because Celery pickles all task results in the DB backend. I tried using a couple golang pickle deserializers with minimal success. Instead, I ended up just writing a thin wrapper around the python celery that shells out and reads stderr/stdout.

No worries man. I found that too. I realized that, implementations of Celery clients in golang/nodejs all lack the enhanced features of Celery task features, e.g. Chained, so I'm now more inclined to stick with Python Celery

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants