You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fsspec, which we use via UPath, looks suboptimal for most of our users, see astronomy-commons/lsdb#936pandas doesn't really use fsspec if given URI string is natively supported by pyarrow, which makes pandas HTTP and S3 reads much faster than ours (especially in the case of column selection).
I propose to:
Change to pyarrow filesystems for supported URI strings