Adding job from another language (php,perl,Ruby etc)

[amit777]

We rolled our own simple queue system with Redis and have components in different languages that can push jobs into the queue. Is there a documented or recommended way to do this with bull?

[manast]

The easiest way right now is to pick the "addJob" lua script and try to use it from the other languages...

[suchakraborty]

I was using express and bull-master - so my solution was to expose an API by adding an endpoint in each queue /<queue>/add that takes the JSON from POST body as job data to that queue. So as long as I can form a JSON and send an HTTP POST - I can add a job.

[gabegorelick]

This comes up a lot:
#323
#573
#918
#1040
#1261
#1373

[manast]

I have almost completed a redis module that implements Bull/BullMQ which besides being much better it will of course work from any languange that has a redis client available. Stay tuned!

[dphaener]

Anyone here still needing to push jobs to Bull from another language, check this out: https://github.com/bitfinexcom/caron. I have this running next to my Node service and am easily able to push items onto a Redis list, which is then popped from Redis by caron and then enqueued for the Bull workers.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[gabegorelick]

I have almost completed a redis module that implements Bull/BullMQ which besides being much better it will of course work from any languange that has a redis client available. Stay tuned!

Any update on this @manast?

[manast]

@gabegorelick not yet. What is your specific use case where you would need this?

[gabegorelick]

What is your specific use case where you would need this?

A few things:

• Ability to do more things atomically. E.g. if you wanted to atomically peek and modify jobs in the queue, today your best bet is often to figure out Bull's data structures (since they're not officially documented) and write a Lua script that interacts with them. A native Redis-side API would make such problems much easier to solve.

• Interacting with Bull directly from redis-cli. This would make management easier. Right now to investigate issues, you often need to write custom code to query Bull, and then maybe more code to fix up issues with jobs in the queue. A lot of that work would be easier if it could be done directly from redis-cli.

• Connecting from other languages, as a bunch of commenters have stated.

[manast]

@gabegorelick
I am not sure you have seen the POC version of the module: https://github.com/taskforcesh/bullmq-redis
It should be backwards compatible with BullMQ at least.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[hellojukay]

Any news on this?

[manast]

@hellojukay from which language would you like to interoperate with Bull?

[hellojukay]

@manast I want to consume job from golang.

[manast]

We are planning something for early next year, but short-term consuming jobs from a different language is quite hard. You would need to port some of the code in Bull that handles jobs consumptions, easiest pattern would be consuming manually like this: https://docs.bullmq.io/patterns/manually-fetching-jobs

[manast]

Btw, development for this feature will happen here: https://github.com/taskforcesh/bullmq-redis