-
Notifications
You must be signed in to change notification settings - Fork 297
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove upper version bound from fsspec #2143
Conversation
Signed-off-by: Kevin Su <pingsutw@gmail.com>
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #2143 +/- ##
==========================================
- Coverage 85.57% 85.53% -0.05%
==========================================
Files 308 308
Lines 23113 23116 +3
Branches 3540 3541 +1
==========================================
- Hits 19779 19772 -7
- Misses 2722 2729 +7
- Partials 612 615 +3 ☔ View full report in Codecov by Sentry. |
Hey @pingsutw I could really use this as the current upper bound limits botocore to pre-aws bedrock releases (llms in flyte are awesome!). I see some of the windows CICD is failing -- are they false positives? Can this be merged? Appreciate any attention you can give this. |
Signed-off-by: Kevin Su <pingsutw@gmail.com>
flytekit/types/directory/types.py
Outdated
@@ -431,6 +428,8 @@ def to_literal( | |||
if should_upload: | |||
if remote_directory is None: | |||
remote_directory = ctx.file_access.get_random_remote_directory() | |||
if not os.path.isdir(source_path): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we use pathlib.Path().is_dir?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated it
Signed-off-by: Kevin Su <pingsutw@gmail.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
@pingsutw Thank you so very much! You're a rock star! |
Why are the changes needed?
Allow users to use the latest
fsspec
by removing the upper-bound.What changes were proposed in this pull request?
remove the upper-bound
How was this patch tested?
Setup process
Screenshots
Check all the applicable boxes