Implement InputParser and ParseBuffer lock-free

[vigsterkr]

currently for synchronisation mutex and conditional vars are being used, which is a waste of resources. use atomic types to implement a lock-free InputParser and ParseBuffer

[tdjogi010]

Hi @vigsterkr, I would like to work on this.

[vigsterkr]

@tdjogi010 sure thing, just send a PR when you have something

[tdjogi010]

Even though I am working on it, if anyone wishes to take this one up, please do so. Not sure if I can implement it correctly.

[hangg7]

@vigsterkr @tdjogi010 Interesting. Thanks being so generous about the task, would have a stub on it.

[tdjogi010]

Hi @vigsterkr , as far as I have understood, InputParser uses the ParseBuffer(which is a ring buffer) to hold the data and does the parsing(with the help of StreamingFile classes) in a separate thread when started. Now the StreamingFeatures fetches example objects one by one through a InputParser object. So there is only one parsing thread(producer) and only one streaming*feature thread(consumer) at all times? Not multiple producer/multiple consumer?

[vigsterkr]

yeah pretty much that's the story there.

[tdjogi010]

Thanks!