Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add exact pattern matching to list_files #333

Merged
merged 8 commits into from
Nov 13, 2020
Merged

Add exact pattern matching to list_files #333

merged 8 commits into from
Nov 13, 2020

Conversation

alex-l-kong
Copy link
Contributor

@alex-l-kong alex-l-kong commented Nov 12, 2020

What is the purpose of this PR?

Addresses and closes #332. Our current substr matching scheme doesn't work if we pass in file names for exact matching (as opposed to file extensions, which we do most but not all of the time). This has caused problems when implementing FlowSOM preprocessing, so we patch this up.

How did you implement your changes

We add a control flag extensions in list_files which will handle both file extension generic matching and file name exact matching.

We also patch up bugs in load_imgs_from_tree when the user passes in some channel names without file extensions and make the variable names more distinguished from each other.

@alex-l-kong alex-l-kong self-assigned this Nov 12, 2020
ark/utils/io_utils.py Outdated Show resolved Hide resolved
ark/utils/load_utils.py Show resolved Hide resolved
@ngreenwald ngreenwald merged commit 54386b7 into master Nov 13, 2020
@ngreenwald ngreenwald deleted the substr_fix branch November 13, 2020 00:31
alex-l-kong added a commit that referenced this pull request Jan 14, 2021
* Add exact pattern matching to list_files and patch up load_imgs_from_tree bug

* Change extensions to is_extensions to make argument clearer

* Change extensions to is_extensions in io_utils_test

* Change from is_extensions to exact_match

* Documentation fix
y2kbugger pushed a commit that referenced this pull request Jul 29, 2021
* Add exact pattern matching to list_files and patch up load_imgs_from_tree bug

* Change extensions to is_extensions to make argument clearer

* Change extensions to is_extensions in io_utils_test

* Change from is_extensions to exact_match

* Documentation fix
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

list_files in io_utils needs better substr matching
2 participants