Skip to content

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] Is nodeJS's memory garbage collector can be garbaged per process callback function? #2246

Closed
xkguq007 opened this issue Jan 4, 2022 · 0 comments

Comments

@xkguq007
Copy link

xkguq007 commented Jan 4, 2022

First of all, sorry for bad English.

I try to use bull within massive batch process in cron to make small pieces of batch.
There are so many db columns per batch (1M+) so I need to devide small pieces of batch.
(Definitely without deviding small pieces of batch, out of memory will come out.)

My concern is, garbage collector can be garbaged in process callback function?
If not, still there will be same memory issue on my problem.

FYI)
I plan to build batch process like java's spring batch process using bull.
DB Counting -> Devide small pieces of batch (simply 100 db columns per job) -> DB Inserting What Job is -> Queueing pass through job db id -> process callback

@OptimalBits OptimalBits locked and limited conversation to collaborators Jan 10, 2022
@manast manast converted this issue into discussion #2251 Jan 10, 2022

This issue was moved to a discussion.

You can continue the conversation there. Go to discussion →

Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant