-
Notifications
You must be signed in to change notification settings - Fork 609
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add opt-in support for case insensitive webdataset #5016
Conversation
- the current implementation of webdataset is case-sensitive when it comes to file extensions. This PR adds an option to make it case insensitive when it comes to provided by the user extensions as well as the file extensions in the container Signed-off-by: Janusz Lisiecki <jlisiecki@nvidia.com>
56c4359
to
dadef03
Compare
CI MESSAGE: [9482491]: BUILD STARTED |
CI MESSAGE: [9482491]: BUILD PASSED |
6f8678a
to
db6c45d
Compare
Signed-off-by: Janusz Lisiecki <jlisiecki@nvidia.com>
db6c45d
to
5416660
Compare
CI MESSAGE: [9497185]: BUILD STARTED |
908291b
to
ced1dc2
Compare
CI MESSAGE: [9497235]: BUILD STARTED |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please remeber to adjust the warning in the docs as well, apart from that LGTM.
Signed-off-by: Janusz Lisiecki <jlisiecki@nvidia.com>
ced1dc2
to
aad8cc0
Compare
CI MESSAGE: [9497235]: BUILD PASSED |
CI MESSAGE: [9511524]: BUILD STARTED |
CI MESSAGE: [9511524]: BUILD PASSED |
- the current implementation of webdataset is case-sensitive when it comes to file extensions. This PR adds an option to make it case insensitive when it comes to provided by the user extensions as well as the file extensions in the container Signed-off-by: Janusz Lisiecki <jlisiecki@nvidia.com>
it comes to file extensions. This PR adds an option to make
it case insensitive when it comes to provided by the user extensions
as well as the file extensions in the container
Category:
New feature (non-breaking change which adds functionality)
Description:
it comes to file extensions. This PR adds an option to make
it case insensitive when it comes to provided by the user extensions
as well as the file extensions in the container
Additional information:
Affected modules and functionalities:
Key points relevant for the review:
Tests:
Checklist
Documentation
DALI team only
Requirements
REQ IDs: RDWDS.26
JIRA TASK: N/A