You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I try to use bull within massive batch process in cron to make small pieces of batch.
There are so many db columns per batch (1M+) so I need to devide small pieces of batch.
(Definitely without deviding small pieces of batch, out of memory will come out.)
My concern is, garbage collector can be garbaged in process callback function?
If not, still there will be same memory issue on my problem.
FYI)
I plan to build batch process like java's spring batch process using bull.
DB Counting -> Devide small pieces of batch (simply 100 db columns per job) -> DB Inserting What Job is -> Queueing pass through job db id -> process callback
The text was updated successfully, but these errors were encountered:
First of all, sorry for bad English.
I try to use bull within massive batch process in cron to make small pieces of batch.
There are so many db columns per batch (1M+) so I need to devide small pieces of batch.
(Definitely without deviding small pieces of batch, out of memory will come out.)
My concern is, garbage collector can be garbaged in process callback function?
If not, still there will be same memory issue on my problem.
FYI)
I plan to build batch process like java's spring batch process using bull.
DB Counting -> Devide small pieces of batch (simply 100 db columns per job) -> DB Inserting What Job is -> Queueing pass through job db id -> process callback
The text was updated successfully, but these errors were encountered: