Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Create an ItemReader that reads from an InputStream [BATCH-2695] #912
A regular request is to be able to read S3 files without downloading them first. In order to do this a reader would need to be created to read from an
Backported to: 4.1.0.M3
Mahmoud Ben Hassine commented
Michael Minella As discussed, I first tried to see if It's possible to read data from a URL without downloading it using a
which is passing. The file is not downloaded locally and is streamed directly from S3.
The good news is that all file readers in Spring Batch (
One important part of this user story is we need to make sure that Spring Batch mechanics (skip, restart, etc) are still valid when streaming data from a URL. I wrote a test suite for these features here and it is passing too.