Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
DataVec: Avoid sampling bias in RandomPathFilter.filter() #7769
@AlexDBlack Is there already a set of images somewhere in the test resources that we could use to create a test for this?
What changes were proposed in this pull request?
Shuffles the input array before filtering to avoid sampling bias.
How was this patch tested?
Existing unit tests pass
@saudet We have a few (very) small sets of images here: https://github.com/deeplearning4j/dl4j-test-resources/tree/master/src/main/resources/datavec-data-image
But we could duplicate the files a few times in the tests themselves...
Anyway, changes LGTM...