Adds prefix filtering for table URLs #18780
Merged
+83
−14
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Adds the ability to list files backing a table URL optionally filtered by a path prefix - Reintroduces the ability for partitioned listing tables to only list prefixes that match an input filter - Adds tests for new functionality
github-actions
bot
added
core
35 tasks
alamb
approved these changes
Nov 17, 2025
Contributor
alamb
left a comment
alamb
left a comment
There was a problem hiding this comment.
Thank you @BlakeOrth -- this looks great to me
| RequestCountingObjectStore() | ||
| Total Requests: 2 | ||
| - LIST prefix=data | ||
| - LIST prefix=data/a=2 |
Contributor
|
Thanks again @BlakeOrth |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Which issue does this PR close?
This is a follow-on PR spurred by this comment chain:
This work is associated with:
ListFilesCacheto be available for partitioned tables #17211Rationale for this change
The implementation prior to merging #18146 was capable of only listing files under a specific prefix when the known prefixes could be matched to filters. This PR re-introduces that capability, alleviating the need to list and filter every file for a table when the filters match.
What changes are included in this PR?
Are these changes tested?
Yes. There is existing coverage on many of the changes, new tests have been added, and existing integration tests have been updated to show the change in behavior.
Are there any user-facing changes?
no
cc @alamb