Skip to content

GEOMESA-3565 FSDS - Improve metadata query performance#3524

Merged
elahrvivaz merged 40 commits intolocationtech:mainfrom
elahrvivaz:emilio/fsds_refactor
Apr 10, 2026
Merged

GEOMESA-3565 FSDS - Improve metadata query performance#3524
elahrvivaz merged 40 commits intolocationtech:mainfrom
elahrvivaz:emilio/fsds_refactor

Conversation

@elahrvivaz
Copy link
Copy Markdown
Contributor

  • Track metadata per file instead of per partition
  • Filter out files based on file-level bounds
  • Drop support for the Orc format

Note: does not support backward compatibility with previous FSDS installs, but does support a migration path if using Parquet.

…e refresh for file metadata, make file locking retries configurable, update jdbc metadata scaladocs
@elahrvivaz elahrvivaz added this to the 6.0.0 milestone Apr 10, 2026
@elahrvivaz elahrvivaz merged commit 9ac21ac into locationtech:main Apr 10, 2026
67 of 68 checks passed
@elahrvivaz elahrvivaz deleted the emilio/fsds_refactor branch April 10, 2026 19:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant