This repository has been archived by the owner. It is now read-only.

Parent directories containing periods are erroneously filtered #273

Closed
crockpotveggies opened this Issue May 17, 2017 · 2 comments

Comments

Projects
None yet
3 participants
@crockpotveggies
Copy link
Collaborator

crockpotveggies commented May 17, 2017

Issue Description

When using a dataset where data files are organized into labelled directories, if the label (parent) directory of the record contains a . then ParentPathLabelGenerator will mistakenly use the parent directory as the label.

For example, if a dataset is structured as:

/msceleb
  - m.1298
    -- 1.jpg
    -- 2.jpg
  - m.088d832
    -- 1.jpg
    -- 2.jpg

When ParentPathLabelGenerator is used by a RecordReader such as ImageRecordReader, the label selected is ultimately msceleb and not the child directories. This will cause total labels to equal 1. If no label generator is provided, then total labels will be 0.

Version Information

Current master

Contributing

Investigating possible fixes currently.

@crockpotveggies crockpotveggies added the bug label May 17, 2017

@crockpotveggies crockpotveggies self-assigned this May 17, 2017

@raver119 raver119 added the ETL label Apr 29, 2018

@raver119

This comment has been minimized.

Copy link
Contributor

raver119 commented Apr 29, 2018

Is this issue still viable?

@crockpotveggies

This comment has been minimized.

Copy link
Collaborator

crockpotveggies commented Apr 30, 2018

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.