You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Description of expected behavior and the observed behavior
pack_partitions_to_parquet does not work, error is encountered consistently in current build. Error does not occur in previous build.
ERROR:root:Filesystem not yet consistent
Expected len: 2
Found len: 2
Missing: ['s3://spatial-temp/acabf4b3-c12a-4293-8bab-65ece4502d94-0001.parquet/part.0.parquet', 's3://spatial-temp/acabf4b3-c12a-4293-8bab-65ece4502d94-0001.parquet/part.1.parquet']
Extras: ["['s3', 's3a']://spatial-temp/acabf4b3-c12a-4293-8bab-65ece4502d94-0001.parquet/part.0.parquet", "['s3', 's3a']://spatial-temp/acabf4b3-c12a-4293-8bab-65ece4502d94-0001.parquet/part.1.parquet"]
Based on the error, it appears the s3 protocol is now reported as a list ['s3', 's3a'] rather than a str 's3', and when it is prepended to the paths for comparison causes the comparison to fail.
Complete, minimal, self-contained example code that reproduces the issue
ddf.pack_partitions_to_parquet("s3://path")
The text was updated successfully, but these errors were encountered:
ALL software version info
Current build
Previous build
Description of expected behavior and the observed behavior
pack_partitions_to_parquet
does not work, error is encountered consistently in current build. Error does not occur in previous build.Based on the error, it appears the s3 protocol is now reported as a list
['s3', 's3a']
rather than a str's3'
, and when it is prepended to the paths for comparison causes the comparison to fail.Complete, minimal, self-contained example code that reproduces the issue
The text was updated successfully, but these errors were encountered: