Skip to content

String value of datasource name with blocking queue reader #193

Closed
@Kmouille

Description

@Kmouille

Hi Mahmoud,

First of all, thanks for this project. I like it a lot.

Following principles of tutorial "3. Dispatching records", I found out that the data source name in the job parameter is set as a String when job launches.

In my case I have a master job and 2 sub jobs reading a blokingQueue. If I launch the 3 jobs with a thread pool size of 2 then, the 3rd job (subjob 2) launches with thousands of elements in the queue.

Unfortunately, the data source name is set there with the current content of the blocking queue. This lists all the elements contained in that queue (thousands). This is a big string to store, and printing it out in the reports is very hard (that's not a readable report anymore ;-) )
Maybe the size of the queue at the beginning of the job could be enough ? or the size and the first n elements...

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions