Symfony Messenger Component: Some of the Async are working, some are stuck on the Queue on Production

[deanilvincent]

Hi,

We are using Symfony Messenger on our application. We have a long running process that involves generating of thousands of records using doctrinne (around 5000 to 10000). We currently deployed it on Digital Ocean App Platform where they offer a background component called worker.

But the problem is, there are times they are working where we can generate like 5000 records and sometimes is not. (During my testing for the past days, I was able to generate 95000+ records on different transactions using the messenger). We already increased the memory and CPU while monitoring the logs and the analytics but there's no significant usage spikes nor error on the query nor failed message on the messenger component. After checking the stats, we have this:

Here's the build and run command of the worker: (I also tried removing the limit just to test before, but still, there are messenges that stays on the queue)

Any thoughts on this? Thank you!