Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
String value of datasource name with blocking queue reader #193
First of all, thanks for this project. I like it a lot.
Following principles of tutorial "3. Dispatching records", I found out that the data source name in the job parameter is set as a String when job launches.
In my case I have a master job and 2 sub jobs reading a blokingQueue. If I launch the 3 jobs with a thread pool size of 2 then, the 3rd job (subjob 2) launches with thousands of elements in the queue.
Unfortunately, the data source name is set there with the current content of the blocking queue. This lists all the elements contained in that queue (thousands). This is a big string to store, and printing it out in the reports is very hard (that's not a readable report anymore ;-) )
Hi @Kmouille Thank you, I'm glad you like Easy Batch
Thank you for pointing out this issue! Indeed, not very convenient to dump the queue content in the job report.. The
The size of the queue would be redundant with the total records count in the job report. I suggest to simply put "In-Memory Queue" just like (and to be consistent with) the
added a commit
Jun 15, 2016
I've updated the
With this fix, elements in the queue will not be dumped in the job report.