Skip to content

[Bug] OBS FileSystem is not cached by authority #8588

Description

@thswlsqls

Search before asking

  • I searched in the issues and found nothing similar.

Paimon version
master @ fb3484d

Compute Engine
Engine-agnostic (core)

Minimal reproduce step
HadoopCompliantFileIO.getFileSystem() (paimon-filesystems/paimon-obs-impl/src/main/java/org/apache/paimon/obs/HadoopCompliantFileIO.java line 109) caches a single FileSystem fs for the first authority (bucket) it sees and returns it for every subsequent path. When one OBSFileIO instance serves paths across multiple OBS buckets on the default (non-resolving) FileIO path, all requests are routed to the first bucket's FileSystem.

What doesn't meet your expectations?
Expected: each authority (bucket) gets its own cached FileSystem. Actual: the first bucket's FileSystem is reused for all authorities.

Anything else?
The sibling implementations already cache per authority in a Map<String, FileSystem> keyed by path.toUri().getAuthority() (null → "DEFAULT"): see paimon-oss-impl (#2417), paimon-s3-impl (#2504), and paimon-gs-impl. OBS was never updated to match.

Are you willing to submit a PR?

  • I'm willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions