Skip to content

module 'pyarrow.fs' has no attribute 'S3FileSystem' #7443

@szdrasiak-apptension

Description

@szdrasiak-apptension

pyarrow version = 0.17.1

I have latest version installed but I cant import S3FileSystem from pyarrow.fs module.

I'm trying read parquet file from S3 using read_table with argument use_legacy_dataset=False to filter data without partitions, I tried to use file system from s3fs package but I'm getting filesystem` argument must be a FileSystem instance or a valid file system URI. I tried pass full s3 url as source without filesystem parameter but I'm getting Got S3 URI but Arrow compiled without S3 support

Why I'm missing S3FileSystem and is my approach to filter data on reading good?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions