You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
A Data Prepper pipeline with a File Source cannot handle a file which is has more lines than the buffer capacity. The file source does not manage the Buffer Timeouts effectively. The File Source will throw an exception once the buffer is full.
To Reproduce
Steps to reproduce the behavior:
Create a file that has a couple thousand lines of data
Build and run a simple pipeline with a file source and stdout sink.
See Error: "Error processing the input file path ..."
Expected behavior
The File source can handle timeouts from a full buffer and wait until there is room to add more lines to the buffer.
The text was updated successfully, but these errors were encountered:
Describe the bug
A Data Prepper pipeline with a File Source cannot handle a file which is has more lines than the buffer capacity. The file source does not manage the Buffer Timeouts effectively. The File Source will throw an exception once the buffer is full.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
The File source can handle timeouts from a full buffer and wait until there is room to add more lines to the buffer.
The text was updated successfully, but these errors were encountered: